Quandl (www.quandl.com) - futures io
futures io futures trading



Quandl (www.quandl.com)


Discussion in Trading Reviews and Vendors

Updated
      Top Posters
    1. looks_one Nicolas11 with 12 posts (11 thanks)
    2. looks_two Big Mike with 2 posts (11 thanks)
    3. looks_3 aventeren with 2 posts (0 thanks)
    4. looks_4 csayantan with 1 posts (0 thanks)
    1. trending_up 9,560 views
    2. thumb_up 23 thanks given
    3. group 8 followers
    1. forum 18 posts
    2. attach_file 4 attachments




Welcome to futures io: the largest futures trading community on the planet, with well over 125,000 members
  • Genuine reviews from real traders, not fake reviews from stealth vendors
  • Quality education from leading professional traders
  • We are a friendly, helpful, and positive community
  • We do not tolerate rude behavior, trolling, or vendors advertising in posts
  • We are here to help, just let us know what you need
You'll need to register in order to view the content of the threads and start contributing to our community.  It's free and simple.

-- Big Mike, Site Administrator

(If you already have an account, login at the top of the page)

 
Search this Thread
 

Quandl (www.quandl.com)

(login for full post details)
  #1 (permalink)
Site Administrator
Swing Trader
Data Scientist & DevOps
Manta, Ecuador
 
Experience: Advanced
Platform: My own custom solution
Trading: Emini Futures
 
Big Mike's Avatar
 
Posts: 49,785 since Jun 2009
Thanks: 32,314 given, 97,575 received

A nice free resource:

Quandl for Investors - Quandl

They also have an R package.

What is Quandl?

Quandl is a repository of time-series data on the internet, tailored for active investors and finance professionals.


Why should I use Quandl?

Quandl allows you to:

Quickly find the financial and economic data you need
Get that data in any format you want
For free

What kind of data does Quandl have?

Quandl currently has over millions of time-series datasets. Most of the data is in the domains of markets, finance, economics, demography, sociology, energy and the environment. 1000s of new datasets are added to Quandl daily.

Here are some of the datasets available on Quandl:

Price data for futures, stocks, interest rates, currencies, commodities and more.
Macroeconomic data, banking and monetary data, and national statistics.
Data on real estate, energy, health, education, economics, demography and society.
Country-specific data for 200 countries including global stock markets.
Corporate data and financial ratios going back up to 10 years.
All data on Quandl is available in a single unified interface, and is downloadable in the format of your choice. All data on Quandl is free.


Where does the data come from?

Data on Quandl comes from a variety of credible sources:

Multinational organizations like the UN, World Bank, ILO, OECD, BIS, Eurostat and WHO.
Central banks like the Federal Reserve, Bundesbank, BOJ, ECB, SNB, BCB and BOC.
Government statistical agencies like the BLS, BEA, DOE, Census, USDA, StatCan, IBGE, ABS and ONS.
Exchanges like the CME, ICE, CBOE, NYSE, NSE and Nasdaq.
Secondary data aggregators like FRED, OFDP, Google and Yahoo.
Think-tanks, industry research groups, and academia.
Every single dataset on Quandl comes with a link back to its original source, so you can always validate and attribute the data correctly.

Here is a list of major data sources on Quandl. If there's any particular source that you'd like to see added to Quandl, please let us know.


How can I use the data on Quandl?

You can access Quandl data in a number of ways:

View raw data and graphs on the Quandl website.
Download data in any format you want: XLS, CSV, XML, JSON.
Use our API to download large numbers of datasets programmatically.
Import data directly into your preferred tool: R, Python, Matlab, Excel, Stata, Maple and more.
Quandl does all the work in acquiring, harmonizing, updating and delivering data for you; you don't have to spend any time importing, cleaning or re-formatting the data you need.

If there's another file format that you would like Quandl to deliver data in, or another data workflow tool that you would like to integrate Quandl with, please let us know.

Mike

We're here to help -- just ask

For the best trading education, watch our webinars
Searching for trading reviews? Review this list

Follow us on Twitter, YouTube, and Facebook

Support our community as an Elite Member:
https://futures.io/elite/
Follow me on Twitter Visit my futures io Trade Journal Started this thread Reply With Quote
The following 11 users say Thank You to Big Mike for this post:

Can you help answer these questions
from other members on futures io?
SimplerOptions
Trading Reviews and Vendors
ZigZag with Depth and Backstep
EasyLanguage Programming
Second Entry Indicator (Looking for testers/feedback)
NinjaTrader
MACD line not plotting after change of plot order
NinjaTrader
Automatic pattern research with NT
Elite Algorithmic NinjaTrader Trading
 
 
(login for full post details)
  #3 (permalink)
near Paris, France
 
Experience: Beginner
Platform: -
Trading: -
 
Nicolas11's Avatar
 
Posts: 1,071 since Aug 2011
Thanks: 2,232 given, 1,751 received


Hi,

As any one understood what their business model is?
It is surprising to see so many data made available for free.
I was once said that "if you do not understand what the product sold is, it means that you are the product." ^_^
But does not seem to be the case here...

Nicolas

Visit my futures io Trade Journal Reply With Quote
 
(login for full post details)
  #4 (permalink)
near Paris, France
 
Experience: Beginner
Platform: -
Trading: -
 
Nicolas11's Avatar
 
Posts: 1,071 since Aug 2011
Thanks: 2,232 given, 1,751 received

Two articles on the quality of Quandl data compared to Bloomberg:
Evaluating Quandl Data Quality « The R Trader
Evaluating Quandl Data Quality ? part II « The R Trader

(I have not read them.)

Nicolas

Visit my futures io Trade Journal Reply With Quote
The following user says Thank You to Nicolas11 for this post:
 
(login for full post details)
  #5 (permalink)
near Paris, France
 
Experience: Beginner
Platform: -
Trading: -
 
Nicolas11's Avatar
 
Posts: 1,071 since Aug 2011
Thanks: 2,232 given, 1,751 received

Exemple of R code to retrieve quotes for ES ( CME E-mini S&P 500 Futures, Continuous Contract #1 (ES1) (Front Month) (OFDP) - Data and Charts from Quandl):

 
Code
library(Quandl)

Quandl.auth("xxx") # here, your authentification token

es.quandl <- Quandl("OFDP/FUTURE_ES1")

print(head(es.quandl))
It returns:
 
Code
        Date    Open   High     Low  Settle  Volume Open Interest
1 2014-04-15 1825.00 1844.0 1809.25 1839.50 2608555       2792211
2 2014-04-14 1806.00 1828.0 1803.25 1824.50 1878366       2789974
3 2014-04-11 1829.50 1832.0 1807.25 1811.75 2525778       2782527
4 2014-04-10 1865.75 1867.5 1823.75 1827.00 2377896       2740044
5 2014-04-09 1845.00 1866.5 1843.75 1864.75 1410063       2752796
6 2014-04-08 1840.00 1849.0 1830.75 1845.00 1852618       2772342
Nicolas

Visit my futures io Trade Journal Reply With Quote
The following 4 users say Thank You to Nicolas11 for this post:
 
(login for full post details)
  #6 (permalink)
near Paris, France
 
Experience: Beginner
Platform: -
Trading: -
 
Nicolas11's Avatar
 
Posts: 1,071 since Aug 2011
Thanks: 2,232 given, 1,751 received

Quandl data can also be directly obtained through an URL.

For instance:
https://www.quandl.com/api/v1/datasets/OFDP/FUTURE_ES1.csv
generates a CSV file with daily quotes of ES.

Same with authentication token:
https://www.quandl.com/api/v1/datasets/OFDP/FUTURE_ES1.csv?auth_token=xxx

Documentation and specification for URL format: Quandl - Find, Use and Share Numerical Data

Visit my futures io Trade Journal Reply With Quote
 
(login for full post details)
  #7 (permalink)
near Paris, France
 
Experience: Beginner
Platform: -
Trading: -
 
Nicolas11's Avatar
 
Posts: 1,071 since Aug 2011
Thanks: 2,232 given, 1,751 received

A simple Java code to send a query to Quandl and retrieve the information:

 
Code
import java.io.BufferedReader;
import java.io.InputStreamReader;
import java.net.URL;
import java.net.URLConnection;

// inspired by http://stackoverflow.com/questions/9093000/read-csv-file-from-internet
public class Quandl_ReadCSVFromWebQuery {

    public static void main(String[] args) {
        try {
            String AUTH_TOKEN = "xxx";
            URL url = new URL("http://www.quandl.com/api/v1/datasets/OFDP/FUTURE_ES1.csv?auth_token="+AUTH_TOKEN);
            URLConnection urlConn = url.openConnection();
            InputStreamReader inputStreamReader = new InputStreamReader(urlConn.getInputStream());
            BufferedReader bufferedReader = new BufferedReader(inputStreamReader);
            String line;
            while ((line = bufferedReader.readLine()) != null) {
                System.out.println(line);
            }
            bufferedReader.close();
            inputStreamReader.close();
        } catch (Exception e) {
            e.printStackTrace();
        }
    }
}
Output:

Quoting 
Date,Open,High,Low,Settle,Volume,Open Interest
2014-04-15,1825.0,1844.0,1809.25,1839.5,2608555.0,2792211.0
2014-04-14,1806.0,1828.0,1803.25,1824.5,1878366.0,2789974.0
2014-04-11,1829.5,1832.0,1807.25,1811.75,2525778.0,2782527.0
2014-04-10,1865.75,1867.5,1823.75,1827.0,2377896.0,2740044.0
2014-04-09,1845.0,1866.5,1843.75,1864.75,1410063.0,2752796.0
2014-04-08,1840.0,1849.0,1830.75,1845.0,1852618.0,2772342.0
2014-04-07,1861.0,1861.75,1834.5,1838.0,2177594.0,2782262.0
2014-04-04,1884.25,1892.5,1855.75,1860.0,2496787.0,2798619.0
[...]

It seems that a dedicated API exists: https://github.com/iamtrask/quandl-java

List of API for all languages: Quandl - Find, Use and Share Numerical Data

Nicolas

Visit my futures io Trade Journal Reply With Quote
The following user says Thank You to Nicolas11 for this post:
 
(login for full post details)
  #8 (permalink)
near Paris, France
 
Experience: Beginner
Platform: -
Trading: -
 
Nicolas11's Avatar
 
Posts: 1,071 since Aug 2011
Thanks: 2,232 given, 1,751 received

This article evoked Quandl future possible business model.


Quoting 
Interested VCs may already be thinking something like, “But how does Quandl plan to monetize all this data and interoperability thereof?” While that profit goal remains something of a work-in-progress, one idea is to offer a premium service, perhaps with analytics tools, or to become a private data reseller using the Quandl data-as-a-service platform. I found it heartening that Quandl’s knee jerk response to the monetization question was not “sell ads.”

Nicolas

Visit my futures io Trade Journal Reply With Quote
 
(login for full post details)
  #9 (permalink)
near Paris, France
 
Experience: Beginner
Platform: -
Trading: -
 
Nicolas11's Avatar
 
Posts: 1,071 since Aug 2011
Thanks: 2,232 given, 1,751 received

Extract of a (generic) e-mail received from Quandl on May 2nd, 2014:



Nicolas

Visit my futures io Trade Journal Reply With Quote
The following user says Thank You to Nicolas11 for this post:
 
(login for full post details)
  #10 (permalink)
near Paris, France
 
Experience: Beginner
Platform: -
Trading: -
 
Nicolas11's Avatar
 
Posts: 1,071 since Aug 2011
Thanks: 2,232 given, 1,751 received


Quandl is easily available from Excel.

Instructions:
Quandl - Find, Use and Share Numerical Data

Demonstration:


Nicolas

Visit my futures io Trade Journal Reply With Quote
The following 2 users say Thank You to Nicolas11 for this post:
 
(login for full post details)
  #11 (permalink)
near Paris, France
 
Experience: Beginner
Platform: -
Trading: -
 
Nicolas11's Avatar
 
Posts: 1,071 since Aug 2011
Thanks: 2,232 given, 1,751 received

Quandl proposes (free) futures daily data.

For instance :
ES June 2014: https://www.quandl.com/CME/ESM2014
ES continuous contract: https://www.quandl.com/CHRIS/CME_ES1 or https://www.quandl.com/OFDP/FUTURE_ES1

More information on:
Quandl futures page: Futures - Data from Quandl
Quandl API for futures : Quandl - Find, Use and Share Numerical Data
Quandl futures continuous contracts : Continuous Contracts - Data from Quandl

I will try to play with it in my journal, from that message on.

Nicolas

Visit my futures io Trade Journal Reply With Quote
The following user says Thank You to Nicolas11 for this post:
 
(login for full post details)
  #12 (permalink)
near Paris, France
 
Experience: Beginner
Platform: -
Trading: -
 
Nicolas11's Avatar
 
Posts: 1,071 since Aug 2011
Thanks: 2,232 given, 1,751 received

Take care that, even if Yahoo Finance and Google Finance quickly update their data with the OHLC of the day, Quandl does not reflect this update as quickly. More information in that message.

Nicolas

Visit my futures io Trade Journal Reply With Quote
 
(login for full post details)
  #13 (permalink)
near Paris, France
 
Experience: Beginner
Platform: -
Trading: -
 
Nicolas11's Avatar
 
Posts: 1,071 since Aug 2011
Thanks: 2,232 given, 1,751 received

A R package (IKTrading) to construct "clean" continuous futures series from Quandl:
Intermission: A Data File For Futures Data (from Quandl) | QuantStrat TradeR
Constructing a Continuous Futures Series From Quandl
(not tested)

Visit my futures io Trade Journal Reply With Quote
The following user says Thank You to Nicolas11 for this post:
 
(login for full post details)
  #14 (permalink)
near Paris, France
 
Experience: Beginner
Platform: -
Trading: -
 
Nicolas11's Avatar
 
Posts: 1,071 since Aug 2011
Thanks: 2,232 given, 1,751 received

E-mail just received from Quandl...
(reminder: Quandl is free)


... 40,000 NASDAQ OMX Global Indexes now available on Quandl | quandl blog


... Quandl - Find, Use and Share Numerical Data



Nicolas

Visit my futures io Trade Journal Reply With Quote
 
(login for full post details)
  #15 (permalink)
Site Administrator
Swing Trader
Data Scientist & DevOps
Manta, Ecuador
 
Experience: Advanced
Platform: My own custom solution
Trading: Emini Futures
 
Big Mike's Avatar
 
Posts: 49,785 since Jun 2009
Thanks: 32,314 given, 97,575 received


Nicolas11 View Post
A R package (IKTrading) to construct "clean" continuous futures series from Quandl:
Intermission: A Data File For Futures Data (from Quandl) | QuantStrat TradeR
Constructing a Continuous Futures Series From Quandl
(not tested)

@IlyaKipnis is on futures.io (formerly BMT) now as well if there are any questions about the package.

Mike

We're here to help -- just ask

For the best trading education, watch our webinars
Searching for trading reviews? Review this list

Follow us on Twitter, YouTube, and Facebook

Support our community as an Elite Member:
https://futures.io/elite/
Follow me on Twitter Visit my futures io Trade Journal Started this thread Reply With Quote
 
(login for full post details)
  #16 (permalink)
Bellingham, WA USA
 
Experience: Beginner
Platform: NT
Broker: Mirus (Broker), Continuum (Data), Dorman (Clearing)
Trading: Futures
 
aventeren's Avatar
 
Posts: 202 since Mar 2013
Thanks: 428 given, 201 received

Whoa.

Quandl is WikiLeaks for futures data. So much for my weekend.

Reply With Quote
 
(login for full post details)
  #17 (permalink)
Buffalo, NY
 
 
Posts: 64 since Jul 2014
Thanks: 4 given, 37 received

That java example is really cool to see. I feel like I'm being forced to learn java because of Hadoop.

I have thought a good bit about errors in data and it has kind of led to a more hazy view of the markets in general.
The process creating the data is so noisy what good is a strategy that can't handle even a 5% error rate in the data.

Business wise, the quandl owners surely hold a call option on being bought out.

Reply With Quote
The following user says Thank You to NoiseTrader716 for this post:
 
(login for full post details)
  #18 (permalink)
kolkata+WB/Country
 
 
Posts: 22 since Dec 2013
Thanks: 10 given, 4 received

hi

Yes.It is good and very good quality data indeed.
can you please explain how to use fundamental and EOD data in quandl by quantmod ?
1.how can we use chartseres function with it in R?
2.how can we use getFinancials/viewFinancials function with quandl in R?

plz explain


thx
csayantan

Reply With Quote
 
(login for full post details)
  #19 (permalink)
Bellingham, WA USA
 
Experience: Beginner
Platform: NT
Broker: Mirus (Broker), Continuum (Data), Dorman (Clearing)
Trading: Futures
 
aventeren's Avatar
 
Posts: 202 since Mar 2013
Thanks: 428 given, 201 received

Howdy--

I posted some findings on Quandl's historical daily data here: .

I thought some of you might also be interested.

All best,

Aventeren

Reply With Quote


futures io Trading Community Trading Reviews and Vendors > Quandl (www.quandl.com)


Last Updated on September 16, 2014


Upcoming Webinars and Events
 

NinjaTrader Indicator Challenge!

Ongoing
 

Battlestations! Show us your trading desk - $1,500 in prizes!

March
 

Importance of Finding Your Own Way w/Adam Grimes

Elite only
 

Journal Challenge w/Jigsaw

April
     



Copyright © 2021 by futures io, s.a., Av Ricardo J. Alfaro, Century Tower, Panama, +507 833-9432, info@futures.io
All information is for educational use only and is not investment advice.
There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
no new posts