DEVSTORY #1 : Ingest Nymex settles using open source tools
A startup natural gas trading desk within a large midstream energy company, needed a simple repository to warehouse Nymex settlement prices among other data sets for a large number of traded products.
Being an upstart trading desk they did not have a budget to procure information from data vendors. The traders, analysts, quants, risk managers, and mid-office personnel required a data warehouse to capture these daily settlement prices published by the Nymex. A simple greenfield solution built on open source technology was called for to meet the sophisticated needs of the trading desk that rivaled capabilities of the investment bank that the principals were accustomed to.
Dev Story #1 : Cron based Nymex commodity price ingest into energy data warehouse provides a quick 2 minute read on how this problem was solved using open source software.