Unfiltered Data - Reviews of Brokers and Data Feeds | futures io social day trading
futures io futures trading


Unfiltered Data
Updated: Views / Replies:26,448 / 41
Created: by RM99 Attachments:4

Welcome to futures io.

(If you already have an account, login at the top of the page)

futures io is the largest futures trading community on the planet, with over 90,000 members. At futures io, our goal has always been and always will be to create a friendly, positive, forward-thinking community where members can openly share and discuss everything the world of trading has to offer. The community is one of the friendliest you will find on any subject, with members going out of their way to help others. Some of the primary differences between futures io and other trading sites revolve around the standards of our community. Those standards include a code of conduct for our members, as well as extremely high standards that govern which partners we do business with, and which products or services we recommend to our members.

At futures io, our focus is on quality education. No hype, gimmicks, or secret sauce. The truth is: trading is hard. To succeed, you need to surround yourself with the right support system, educational content, and trading mentors – all of which you can find on futures io, utilizing our social trading environment.

With futures io, you can find honest trading reviews on brokers, trading rooms, indicator packages, trading strategies, and much more. Our trading review process is highly moderated to ensure that only genuine users are allowed, so you don’t need to worry about fake reviews.

We are fundamentally different than most other trading sites:
  • We are here to help. Just let us know what you need.
  • We work extremely hard to keep things positive in our community.
  • We do not tolerate rude behavior, trolling, or vendors advertising in posts.
  • We firmly believe in and encourage sharing. The holy grail is within you, we can help you find it.
  • We expect our members to participate and become a part of the community. Help yourself by helping others.

You'll need to register in order to view the content of the threads and start contributing to our community.  It's free and simple.

-- Big Mike, Site Administrator

Reply
 4  
 
Thread Tools Search this Thread
 

Unfiltered Data

  #31 (permalink)
Site Administrator
Manta, Ecuador
 
Futures Experience: Advanced
Platform: My own custom solution
Favorite Futures: E-mini ES S&P 500
 
Big Mike's Avatar
 
Posts: 46,240 since Jun 2009
Thanks: 29,352 given, 83,232 received


MethylSeasons View Post
So it appears that using either Rithmic or Zenfire with IB would be the best and cheapest option... Would you agree?

Now I just need to see if I can use either or those with IB.

Zenfire is dead after NinjaTrader acquired Mirus (who owned Zen-Fire).

https://futures.io/brokers-data-feeds/32165-ninjatrader-introduces-brokerage-services-acquisition-mirus-futures.html

I don't know what "use with IB" means. But it sounds like you think you can use a data feed other than IB with TWS, and that is definitely never going to happen.

If you mean "use with IB" as in IB for execution, and data feed for data, then of course that is fine so long as you don't use TWS. You can do it with Sierra Chart for example (which I use) or with NinjaTrader for example (which many others use). Both of which are off-topic for this thread, which is supposed to be about unfiltered data.

Mike

Due to time constraints, please do not PM me if your question can be resolved or answered on the forum.

Need help?
1) Stop changing things. No new indicators, charts, or methods. Be consistent with what is in front of you first.
2) Start a journal and post to it daily with the trades you made to show your strengths and weaknesses.
3) Set goals for yourself to reach daily. Make them about how you trade, not how much money you make.
4) Accept responsibility for your actions. Stop looking elsewhere to explain away poor performance.
5) Where to start as a trader? Watch this webinar and read this thread for hundreds of questions and answers.
6)
Help using the forum? Watch this video to learn general tips on using the site.

If you want
to support our community, become an Elite Member.

Reply With Quote
 
  #32 (permalink)
Elite Member
Europe
 
Futures Experience: Intermediate
Platform: IRT, Ninja
Favorite Futures: ZC
 
Posts: 8 since Jul 2011
Thanks: 20 given, 1 received

CQG on Amp


Big Mike View Post
Here is my opinion.

Filtering isn't about getting rid of bad ticks. It's about latency and completeness (accuracy).

Interactive Brokers is widely known for filtering data. It's snapshot data, meaning that they aggregate info, and send you a 'snapshot' of what it looks like every 250ms or so. This means you are not getting all the ticks, not getting all the L2 depth changes, not even getting all the volume. If you trade daily bars or even minute data, then you won't care about this. But if you are using tick based data: ie tick, range, renko, volume or other exotic bar types, then you should not be using IB for data.

On top of that, IB has big restrictions on their historical data. For this reason, my conclusion is that IB filters data simply due to lack of resources on their end, and probably because overwhelming majority of their customers are using minute based or daily based data.

IB is a combination execution + feed provider.

Next we have the Rithmic's and Zen Fire's of the world. They send every tick. They are well known in the industry as unfiltered data. They also have a reputation for being ultra low latency (fast). This is very appealing to a large amount of more 'advanced' traders that want to use tick based charting.

However, they don't have their own historical servers (some platforms provide it for their users, it varies). They also do filter some L2 depth changes. In order to be as fast as possible, and get you that tick as fast as possible, the trade off is to not send some of the L2 changes. Even most of the 'advanced' traders today are not measuring L2 changes so pretty much no one is complaining about this or cares about it.

Rithmic/Zen Fire is an execution/risk system more than it is a data feed. The focus on the feed is execution, which is also why the focus on the feed is latency. They do this extremely well. I've heard rumors for many years that Zen Fire is branching out and adding other exchanges or breadth tools soon. Maybe they will? But for now, it's really designed as execution only, although a lot of people use it for data as well and are completely happy with it, provided they also use a platform (like NinjaTrader) that gives them historical data.

Next we have the IQFeed's and Kinetick's (oem) of the world. They send every tick. They also have an extensive historical database and ticker plants. They all major exchanges. They have something like 500 breadth tickers.

IQFeed's (and Kinetick) business is data. Not execution. Since their focus is on data, they send every L2 update. They send every tick. They send everything, and they also send it in the right sequence. It is the best quality feed currently available to a retail trader, in my opinion. They do give up some latency when compared to Rithmic/Zen Fire, as there is a price to be paid for completeness.

IQFeed also provides historical bid/ask backfill. If you don't know what that is, you don't need it. Only some platforms support it, such as Sierra Chart, Investor/RT, MarketDelta. NinjaTrader 8 is supposed to support it. If you need this then IQFeed is not only an excellent choice, but pretty much the only choice.

As for TradingTechnologies TT FIX, it is an execution feed. It's focus is on execution, although many do use it for data as well.

As for which feed is right for you, only you can answer that.

Mike

Hi is someone able to provide any more recent info on this:
I am looking at the options offered by AMP Global. I am looking for an unfiltered feed and the options are
CQG , TTnet and Rithmic.
Latency of the feed would be less of a concern on my side. More of a concern would be all the ticks should be non aggregrated. Accurate Bid / Ask trade classification

Can anyone advise if these feeds are all unfiltered? Any views on the Bid Ask trade classification

Thank you in advance

Reply With Quote
 
  #33 (permalink)
Elite Member
Toronto, Canada
 
Futures Experience: Advanced
Platform: NinjaTrader, MT4
Broker/Data: Amp/CQG, Citibank
Favorite Futures: CL, GC, 6E, ES, TF, EURUSD, GBPJPY, AUDUSD
 
Beljevina's Avatar
 
Posts: 349 since Sep 2010
Thanks: 379 given, 564 received



eagle View Post
Hi is someone able to provide any more recent info on this:
I am looking at the options offered by AMP Global. I am looking for an unfiltered feed and the options are
CQG , TTnet and Rithmic.
Latency of the feed would be less of a concern on my side. More of a concern would be all the ticks should be non aggregrated. Accurate Bid / Ask trade classification

Can anyone advise if these feeds are all unfiltered? Any views on the Bid Ask trade classification

I use the CQG from Amp option, as provided to it's Ninjatrader users (now only available to new NT7 users that have purchased their own NT7 license.). The feed is slightly different from the full (and much more expensive) CQG datafeed: it is made up of realtime incoming data and is provided by CQG directly - it is completely unfiltered, meaning you get all trade ticks and all the bid/ask info in that is available. This allows me to have completely accurate footprint charts showing exact buyers and sellers at every price level (which I record via GOM, for the entire opening duration of the market through each and every week). I have compared my footprint charts to the other datafeeds you have mentioned, and they are almost always exactly the same.

The difference with the Amp CQG feed for NT7 users is that whenever NT7 makes a request for historical data, it comes from NT's own housed servers, from data they have recorded for that instrument. They used to have issues where their servers would go down every so often on the weekend or an overnight and then when you request historical data, it is not available to you: this problem appears to have been rectified by them and it has been quite some time where this has now not been an issue.

Reply With Quote
The following 3 users say Thank You to Beljevina for this post:
 
  #34 (permalink)
Elite Member
Europe
 
Futures Experience: Intermediate
Platform: IRT, Ninja
Favorite Futures: ZC
 
Posts: 8 since Jul 2011
Thanks: 20 given, 1 received

Thank you Beljevina for providing some more insight.

I am wanting to use it with IRT who routes CQG data through the marketdelta trader platform. Interestingly I got a reply from IRT which said I should go with Rithmic.
With IRT there is the option to backfill through I believe DTN. The only concern with Rithmic is the additional per side pricing fee which adds up over time.

When you have tested you CQG feed, have you eyeballed it ( which I tend to do) or have you dug into data on different feeds with excel or something similar. What sort of discrepancies have you noticed or picked up with regards any of this?

Thanks

Reply With Quote
 
  #35 (permalink)
 Vendor: www.traderwerks.com 
Taipei Taiwan
 
Futures Experience: Advanced
Platform: NinjaTrader
Broker/Data: Optimus
Favorite Futures: TW
 
Posts: 693 since Jun 2009
Thanks: 440 given, 440 received


Beljevina View Post
The difference with the Amp CQG feed for NT7 users is that whenever NT7 makes a request for historical data, it comes from NT's own housed servers, from data they have recorded for that instrument. They used to have issues where their servers would go down every so often on the weekend or an overnight and then when you request historical data, it is not available to you: this problem appears to have been rectified by them and it has been quite some time where this has now not been an issue.

I am still having a problem with NT7 & NT8 requests to the Ninja servers. They have been missing some data and I have been getting an error on the front month contract since the last week of December. @NinjaTrader siad there is a problem , but they do not have an ETA on a fix. It has been a week already so I don't think they are in a hurry.

Math. A gateway drug to reality.
Reply With Quote
 
  #36 (permalink)
Elite Member
Toronto, Canada
 
Futures Experience: Advanced
Platform: NinjaTrader, MT4
Broker/Data: Amp/CQG, Citibank
Favorite Futures: CL, GC, 6E, ES, TF, EURUSD, GBPJPY, AUDUSD
 
Beljevina's Avatar
 
Posts: 349 since Sep 2010
Thanks: 379 given, 564 received


eagle View Post
I am wanting to use it with IRT who routes CQG data through the marketdelta trader platform. Interestingly I got a reply from IRT which said I should go with Rithmic.
With IRT there is the option to backfill through I believe DTN. The only concern with Rithmic is the additional per side pricing fee which adds up over time.

When you have tested you CQG feed, have you eyeballed it ( which I tend to do) or have you dug into data on different feeds with excel or something similar. What sort of discrepancies have you noticed or picked up with regards any of this?

I don't know enough about MarketDelta and how it does it's cumulative delta/footprint (if you are using that feature), and hence how it builds, collects, stores that data, either real-time or historically; I mention this as a contrast to GOMi's fabulous tools for NT footprint and delta, which I completely depend on, and find essentially flawless in their operation. Hopefully you have a technical understanding of why they would recommend Rithmic; I mention that because help-desks usually have a bias and often steer their customers one way, for non-technical reasons.

My CQG/Amp usage over the past 4+ years I'd say is somewhat beyond generic eyeballing: I've compared the footprint chart's bid x ask prints in entire bars, trying to focus in on what I knew to be fast moving periods in the market, and comparing colleague's charts either on SierraChart and/or MarketDelta, and matching up those bid x ask levels. I've done this for ES, CL, ZN, 6E and others. Yes, there are rare differences, but, on say a $CL print of 720 x 674 at $34.70, if it's 5 to 10 to 20 contracts more or less, I don't see a reason to be concerned; usually I can find the discrepancy in the tick above or below, which, is indicative of an incredibly fast moving market as well as uncontrollable software where the GOMi indicator 'slotted' the up/down ticks perhaps in the opening or closing seconds into a price level above or below, or, it is in the next bar if that was the opening or closing tick. In other words, because delta is not part of the datafeed, there can be minor software impacts that will make a 5 minute footprint chart appear different on NT vs SC vs MD. My sense is that it is better than 99% similar. And, if one is different versus the other (by 1% at an incredibly fast point in the market), the question is ... so what? Will it impact one's profitability? I don't think so. My advice is that there is a far greater spectrum of impact we as a trader introduce to the mix, making potentially bad decisions completely unrelated to incredibly small variances in a footprint or delta print: note I am assuming your chart's individual bar's high, low and other non-footprint data is completely the same. Also, things like OCO-server side, and latency frankly I feel are more important. I hear you on the pricing differences, but brokers can adjust those for their clients to be more competitive (just ask them) and, with ES at $12.50 per tick, I will put in limited effort/concern towards a 20¢ full-turn price variance.


traderwerks View Post
I am still having a problem with NT7 & NT8 requests to the Ninja servers. They have been missing some data and I have been getting an error on the front month contract since the last week of December. @NinjaTrader siad there is a problem , but they do not have an ETA on a fix. It has been a week already so I don't think they are in a hurry.

I'm not aware of any chart gaps, but, I could be wrong and not seeing it, or, because I also run my NT7 during every waking minute of the futures markets and my charts will get built from historical data when I do restart NT7, perhaps I am not impacted. If you want to PM with details, I'd be happy to see if I'm experiencing the same issue, or, if I could help or somehow shed light on the topic.

Reply With Quote
The following 2 users say Thank You to Beljevina for this post:
 
  #37 (permalink)
Elite Member
Europe
 
Futures Experience: Intermediate
Platform: IRT, Ninja
Favorite Futures: ZC
 
Posts: 8 since Jul 2011
Thanks: 20 given, 1 received

Thank you Beljevina for the clarifications.

You've obviously spent some time with this by the looks of things , and bring through some great understanding.
You point as well on the tick size and price per trade is a valid one as well. i sometimes tend to forget its just the cost of doing business.

Thanks for the lucid explanations, Good luck with your trading

Reply With Quote
 
  #38 (permalink)
Trading Apprentice
NY, NY
 
Futures Experience: Beginner
Platform: TradeStation
Favorite Futures: Emini ES
 
Posts: 12 since Apr 2015
Thanks: 6 given, 1 received

This is a helpful post. I was looking at charts/data in tradestation and then going into Interactive Brokers to place some trades and I realized that the high and low of day columns did not match. At first I thought it was due to IB considering the premarket and tradestation using the actual trading day.

I then looked at 5 min charts in both platforms and those don't match either. I find that disconcerting since many traders use 5 min bars and there is no way to know which one is accurate.

I downloaded about a year's worth of daily prices of BIIB from both brokers' software and compared them. I am surprised to see that even on daily bars there is a decent amount of difference, particularly in the opening prices. I have attached the sheet with differences. Tradestation is the first set, IB is in the second set starting in column G and the IB Value less the respective Tradestation Value is the third set starting in column M.

As an aside, I find that Tradestation and ThinkorSwim data matches for whatever that is worth.

Attached Files
Register to download File Type: xlsx Difference in Daily data From IB and Tradestation.xlsx (73.6 KB, 14 views)
Reply With Quote
The following user says Thank You to mks212 for this post:
 
  #39 (permalink)
Market Wizard
London UK
 
Futures Experience: Beginner
Platform: CQG
Favorite Futures: Futures
 
xplorer's Avatar
 
Posts: 3,052 since Sep 2015
Thanks: 6,569 given, 4,823 received
Forum Reputation: Legendary


Beljevina View Post
I use the CQG from Amp option [...] The feed is slightly different from the full (and much more expensive) CQG datafeed: it is made up of realtime incoming data and is provided by CQG directly - it is completely unfiltered, meaning you get all trade ticks and all the bid/ask info in that is available.

What difference in price do you see?

Reply With Quote
 
  #40 (permalink)
Elite Member
Toronto, Canada
 
Futures Experience: Advanced
Platform: NinjaTrader, MT4
Broker/Data: Amp/CQG, Citibank
Favorite Futures: CL, GC, 6E, ES, TF, EURUSD, GBPJPY, AUDUSD
 
Beljevina's Avatar
 
Posts: 349 since Sep 2010
Thanks: 379 given, 564 received



xplorer View Post
What difference in price do you see?

I am not exactly sure how to determine the precise price for an equivalent CQG set of instrument and data feeds; their page at Products | CQG, Inc. doesn't seem to specifically offer pricing solely for the datafeed, but may bundle it with their other products. In general terms and without doing specific research for you, the cost for datafeeds can be as little as $60/month (Kinetick?, but may not include markets like the Russell, Brent, FDAX, etc) and from past memory, Rithmic, which is likely upwards of $90). Bear in mind too, that a datafeed is one thing, but, entering and exiting trades is determine by whatever broker you choose, and thus their infrastructure to successfully route your trade to your instrument's exchange.

My point simply in my posts(s) was that there are many bundled solutions from brokers or other sources, that will provide for an incredibly high quality datafeed at minimal cost. And, my advice is to pick a reputable unfiltered data source, and not spend silly amounts of time exploring that avenue, when, it is the quality and success of each of our abilities to successfully trade in to and out of positions, that are the real cornerstone of making it or breaking it as a trader.

Reply With Quote
The following user says Thank You to Beljevina for this post:

Reply



futures io > > > > Unfiltered Data

Thread Tools Search this Thread
Search this Thread:

Advanced Search



Upcoming Webinars and Events (4:30PM ET unless noted)

Jigsaw Trading: TBA

Elite only

FuturesTrader71: TBA

Elite only

NinjaTrader: TBA

Jan 18

RandBots: TBA

Jan 23

GFF Brokers & CME Group: Futures & Bitcoin

Elite only

Adam Grimes: TBA

Elite only

Ran Aroussi: TBA

Elite only
     

Similar Threads
Thread Thread Starter Forum Replies Last Post
Unfiltered data feeds and HFT, detecting algos with orderflow? cashinvestor Reviews of Brokers and Data Feeds 17 May 3rd, 2014 01:11 PM
Chart Bar OHLC data DOESNT match with the value in data box Koepisch NinjaTrader 4 May 12th, 2012 03:52 AM
Data Manager fails to receive data from eSignal rsbtrader TradeStation 1 April 17th, 2012 03:03 PM
IQfeed vs IB data as data provider for Multicharts arjfca Reviews of Brokers and Data Feeds 21 January 16th, 2012 11:39 AM
Best Data Provider to compliment Zen-Fire for Mkt Internals & EOD Data? waverider Reviews of Brokers and Data Feeds 17 October 14th, 2010 11:33 AM


All times are GMT -4. The time now is 03:09 PM.

Copyright © 2017 by futures io, s.a., Av Ricardo J. Alfaro, Century Tower, Panama, +507 833-9432, info@futures.io
All information is for educational use only and is not investment advice.
There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
no new posts
Page generated 2017-12-14 in 0.19 seconds with 20 queries on phoenix via your IP 54.145.16.43