NexusFi: Find Your Edge


Home Menu

 





Accessing IB Data, Real-Time & Historical


Discussion in Platforms and Indicators

Updated
      Top Posters
    1. looks_one cesheri with 6 posts (0 thanks)
    2. looks_two PeakGrowth with 2 posts (1 thanks)
    3. looks_3 rleplae with 1 posts (1 thanks)
    4. looks_4 DarkPoolTrading with 1 posts (1 thanks)
    1. trending_up 2,486 views
    2. thumb_up 3 thanks given
    3. group 3 followers
    1. forum 9 posts
    2. attach_file 0 attachments




 
Search this Thread

Accessing IB Data, Real-Time & Historical

  #1 (permalink)
 cesheri 
Dallas, TX/USA
 
Experience: Intermediate
Platform: IB
Trading: Futures - CL, JPY, EMD, ...
Posts: 7 since May 2015
Thanks Given: 4
Thanks Received: 0

Hello All,

I'd like to download to a flat file basic OHLCV data from IB, for specific tickers/contracts, time frames, and time periods.

I use a TWS on a Mac and would prefer not to also use a Windows machine.

Does anyone have views on:

1) Off-the-shelf (open-source?) programs that do this ?

2) Preferable APIs if I were to write the program myself ? (I lean to Java)

3) Reliability of real-time and historical IB data ? -- I've seen inconsistencies in chart data for different time frames on the same stock, and occasionally see complaints about IB data. Is it reliable for basic real-time data, e.g. for MIN05 bars on one stock, from which I intend to derive some simple indicators to use for real-time, discretionary trading decisions ?

Started this thread Reply With Quote

Can you help answer these questions
from other members on NexusFi?
Trend Direction Force Index (TDFI)
Platforms and Indicators
REcommedations for programming help
Sierra Chart
Cheap historycal L1 data for stocks
Stocks and ETFs
NT7 Indicator Script Troubleshooting - Camarilla Pivots
NinjaTrader
Pivot Indicator like the old SwingTemp by Big Mike
NinjaTrader
 
  #2 (permalink)
 PeakGrowth 
Sydney, Australia
 
Experience: Intermediate
Platform: Sierra Chart, IRESS
Broker: IB, IQFeed
Trading: ES, SPI, ASX stocks, options
Posts: 399 since Jun 2015
Thanks Given: 169
Thanks Received: 465

It sucks, use something else. If you want daily you can get the free kinetic data.

If you want anything smaller you would have to pay for it.

IB also has this thing where it will throw errors when you try to pull too much data; it will annoy you to the point where you would quit within the hour.

Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #3 (permalink)
 cesheri 
Dallas, TX/USA
 
Experience: Intermediate
Platform: IB
Trading: Futures - CL, JPY, EMD, ...
Posts: 7 since May 2015
Thanks Given: 4
Thanks Received: 0


Thanks PeakGrowth. Yes, it seems that IB does not have the best reputation for this. This will be for intra-day, and relatively small queries, so perhaps it wouldn't overstress IB. I think I'll give it a go at least -- if it works reasonably well, IB may be preferable to managing an additional interface.

Regards, Charles

Started this thread Reply With Quote
  #4 (permalink)
 PeakGrowth 
Sydney, Australia
 
Experience: Intermediate
Platform: Sierra Chart, IRESS
Broker: IB, IQFeed
Trading: ES, SPI, ASX stocks, options
Posts: 399 since Jun 2015
Thanks Given: 169
Thanks Received: 465


cesheri View Post
Thanks PeakGrowth. Yes, it seems that IB does not have the best reputation for this. This will be for intra-day, and relatively small queries, so perhaps it wouldn't overstress IB. I think I'll give it a go at least -- if it works reasonably well, IB may be preferable to managing an additional interface.

Regards, Charles

Make sure you only use time bars and nothing fancy (no range bars, tick bars, etc), their data is filtered which means you get order flow data in bundles a few times per second rather than per tick as it happens.

Their data is also dirty sometimes, I remember when I use to trade SPI, they always had this one 100 point spike in the data every morning at 9:30am that doesn't seem to fix itself until the market opened - it was very odd...

Visit my NexusFi Trade Journal Reply With Quote
  #5 (permalink)
 cesheri 
Dallas, TX/USA
 
Experience: Intermediate
Platform: IB
Trading: Futures - CL, JPY, EMD, ...
Posts: 7 since May 2015
Thanks Given: 4
Thanks Received: 0

Yes, my main concern is handling bad data. Does IB follow bad data w/ 'corrected' data for the same time-frame/timestamp ? Or is it a case of needing to write code that filters out unusual moves unless the subsequent data is consistent with them ?

Started this thread Reply With Quote
  #6 (permalink)
 cesheri 
Dallas, TX/USA
 
Experience: Intermediate
Platform: IB
Trading: Futures - CL, JPY, EMD, ...
Posts: 7 since May 2015
Thanks Given: 4
Thanks Received: 0

Does anyone have familiarity JTWSDATA, a commercial product for this --
jTWSdata for Interactive Brokers

I've also found some well-regarded open source alts --
https://cran.r-project.org/web/packages/IBrokers/index.html
https://github.com/rudimeier/twstools

These recs came from the 'TWS API' group on Yahoo.

Started this thread Reply With Quote
  #7 (permalink)
 
DarkPoolTrading's Avatar
 DarkPoolTrading   is a Vendor
 
Posts: 1,036 since May 2012
Thanks Given: 1,244
Thanks Received: 1,326


cesheri View Post
Does IB follow bad data w/ 'corrected' data for the same time-frame/timestamp ?

By definition of how IB send you intraday data, it is not bad or in need of correcting provided you understand what you are receiving. In other words, they bundle data together and send it to you in 'bursts/intervals'. This means the lower your timeframe, the less you can trust the accuracy of the data. There is nothing you can 'fix', it is simply how it is.

If you are using longer timeframes, eg: hourly, daily etc then there's no problem. But if you need accurate minute/sub-minute data then you need to look elsewhere (eg: iqfeed). Once again, there is nothing you can 'fix' or 'filter' to sort out IB's data, it is simply how they send it to you. It's a take it or leave it scenario.

It really just depends on how short your timeframe is, and also if your trading is ok with 'burst' (for lack of a better word) data.

Diversification is the only free lunch
Follow me on Twitter Reply With Quote
Thanked by:
  #8 (permalink)
 
rleplae's Avatar
 rleplae 
Gits (Hooglede) Belgium
Legendary Market Wizard
 
Experience: Master
Platform: NinjaTrader, Proprietary,
Broker: Ninjabrokerage/IQfeed + Synthetic datafeed
Trading: 6A, 6B, 6C, 6E, 6J, 6S, ES, NQ, YM, AEX, CL, NG, ZB, ZN, ZC, ZS, GC
Posts: 3,003 since Sep 2013
Thanks Given: 2,442
Thanks Received: 5,863

I do use IQfeed,
you will need to buy a developer license also
that allows you to connect your application to the feed

Once you have that in place, it is piece of cake to dowload
to a text file any data you have subscribed to, on tick realtime, or historical

Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #9 (permalink)
 cesheri 
Dallas, TX/USA
 
Experience: Intermediate
Platform: IB
Trading: Futures - CL, JPY, EMD, ...
Posts: 7 since May 2015
Thanks Given: 4
Thanks Received: 0

Thanks DarkPoolTrading. I will be trading timeframes not shorter than MIN03, with real-time update every 30-60 seconds while a bar is open. Planning on putting the shortest-term bars into Postgres, then assembling them into larger bars w/ several columns of derived data.

Started this thread Reply With Quote
  #10 (permalink)
 cesheri 
Dallas, TX/USA
 
Experience: Intermediate
Platform: IB
Trading: Futures - CL, JPY, EMD, ...
Posts: 7 since May 2015
Thanks Given: 4
Thanks Received: 0


Thanks rleplae, I think what I'll do is start w/ my local IB interface just to reduce the number of vendors in my env, if I find IB data is not satisfactory, then I'll look at another data provider.

Started this thread Reply With Quote




Last Updated on August 14, 2015


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts