CME DataMine T&S vs IQFeed's millisecond Time Stamps - Reviews of Brokers and Data Feeds | futures io social day trading
futures io futures trading


CME DataMine T&S vs IQFeed's millisecond Time Stamps
Updated: Views / Replies:2,890 / 12
Created: by Cashish Attachments:11

Welcome to futures io.

(If you already have an account, login at the top of the page)

futures io is the largest futures trading community on the planet, with over 90,000 members. At futures io, our goal has always been and always will be to create a friendly, positive, forward-thinking community where members can openly share and discuss everything the world of trading has to offer. The community is one of the friendliest you will find on any subject, with members going out of their way to help others. Some of the primary differences between futures io and other trading sites revolve around the standards of our community. Those standards include a code of conduct for our members, as well as extremely high standards that govern which partners we do business with, and which products or services we recommend to our members.

At futures io, our focus is on quality education. No hype, gimmicks, or secret sauce. The truth is: trading is hard. To succeed, you need to surround yourself with the right support system, educational content, and trading mentors Ė all of which you can find on futures io, utilizing our social trading environment.

With futures io, you can find honest trading reviews on brokers, trading rooms, indicator packages, trading strategies, and much more. Our trading review process is highly moderated to ensure that only genuine users are allowed, so you donít need to worry about fake reviews.

We are fundamentally different than most other trading sites:
  • We are here to help. Just let us know what you need.
  • We work extremely hard to keep things positive in our community.
  • We do not tolerate rude behavior, trolling, or vendors advertising in posts.
  • We firmly believe in and encourage sharing. The holy grail is within you, we can help you find it.
  • We expect our members to participate and become a part of the community. Help yourself by helping others.

You'll need to register in order to view the content of the threads and start contributing to our community.  It's free and simple.

-- Big Mike, Site Administrator

Reply
 11  
 
Thread Tools Search this Thread
 

CME DataMine T&S vs IQFeed's millisecond Time Stamps

  #1 (permalink)
Elite Member
Miami FL USA
 
Futures Experience: Advanced
Platform: Ensign 10, NT7 DOM
Broker/Data: IB, IQ
Favorite Futures: Currency Futures
 
Cashish's Avatar
 
Posts: 803 since May 2011
Thanks: 811 given, 2,103 received

CME DataMine T&S vs IQFeed's millisecond Time Stamps

There are over 47,000 members on this forum and I'm searching for one of them that has access to the latest CME DataMine Time and Sales Report to come forward and participate in proving (or not) the CME sequence numbers directly correlate with the IQFeed millisecond time stamps.

I personally don't have the means (I'm not a DataMine subscriber) to compare the CME DataMine Time and Sales sequence numbers to the millisecond time stamps now provided by IQFeed 5.0 nor have I seen it compared anywhere on the web, I'm asking for your help.

It is my understanding these two Time and Sales reports should align perfectly (at least on a small sample). I'm asking the members who can prove this theory to step up and prove it to me, the members and all the visitors of Big Mike's Trading Forum.

In my opinion it's one thing to think your analysis is correct, and another to know it's correct.




Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).



Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).




Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).



The images above state the DataMine data records are time stamped to the second and the trades within that second are given a sequence number. As I wrote in the text box, I question the accuracy of these statements mainly due to the dates on the sample data and the dates on the documentation. Does the CME DataMine still record data time stamped to the second, or has that changed during the last year (months), I would like to see someone verify this by posting a view of current data.

If the, "Trades that happen in the same second are each given a specific sequence number and are ordered in the same sequence that they were sent out over the market data feed," and the following statement is proven to be correct then the sequence numbers and the millisecond time stamps along with the volume numbers should align perfectly. I simply want help to verify this absolutely.


Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).



I snipped this comment from this thread:

https://futures.io/brokers-data-feeds/25853-dtn-iqfeed-s-robert-carrillo-global-...thing-16.html#post362960


So from all this poppycock I ascertain that the CME actually has millisecond time stamp data but they don't publish it, instead they use sequence numbers to identify the order of trades traded within the second. IQFeed gets the millisecond time stamps from the CME (that the CME doesn't publish) but does not get the sequence numbers, or don't publish them. All this sounds like normal trading stuff, a lot of gray area and NOT much black and white. I hope those who can help will come forth and offer to participate in this Myth Busting.

Please, Post or PM.


Last edited by Cashish; October 20th, 2013 at 05:14 PM.
Reply With Quote
 
  #2 (permalink)
Quick Summary
Quick Summary Post

Quick Summary is created and edited by users like you... Add FAQ's, Links and other Relevant Information by clicking the edit button in the lower right hand corner of this message.

 
  #3 (permalink)
Elite Member
Columbia MO/US
 
Futures Experience: Intermediate
Platform: Sierra Chart
Favorite Futures: Futures
 
Posts: 17 since May 2012
Thanks: 135 given, 19 received


The Sierra Chart engineers recently said they don't think IQ Feed is actually receiving millisecond time stamping from CME.

http://www.sierrachart.com/SupportBoard.php?ThreadID=3528

Reply With Quote
The following user says Thank You to CurrentCatcher for this post:
 
  #4 (permalink)
Elite Member
Miami FL USA
 
Futures Experience: Advanced
Platform: Ensign 10, NT7 DOM
Broker/Data: IB, IQ
Favorite Futures: Currency Futures
 
Cashish's Avatar
 
Posts: 803 since May 2011
Thanks: 811 given, 2,103 received

Well,,,,,,, this thread didn't create much interest but I just couldn't let it go. I know these snips are kind-of crude but I believe they lay to rest the notion I had about the alignment/correlation of IQFeed's millisecond timestamped data and the CME's DataMine sequence numbers. FWIW, my charting program doesn't timestamp T&S Data sub-second, but it is IQFeed data and when running side by side with the (crude and simple) IQFeed T&S program that does show the millisecond stamps, of course they print exactly the same, tick for tick.

What I did here was take the Largest Tick traded (according to the CME DataMine T&S data) of the last three trading days and Dissected all the trades during that one second period. When I first looked into this data I was surprised and thought the findings were interesting, I thought others might as well.






January 15, 2014

Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).




January 16, 2014

Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).




January 17, 2014

Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).

Reply With Quote
The following 3 users say Thank You to Cashish for this post:
 
  #5 (permalink)
Site Administrator
Manta, Ecuador
 
Futures Experience: Advanced
Platform: My own custom solution
Favorite Futures: E-mini ES S&P 500
 
Big Mike's Avatar
 
Posts: 46,240 since Jun 2009
Thanks: 29,356 given, 83,237 received

I wouldn't put much belief in those results.

You need to instead just access the IQFeed API directly where you can see the TickID as sent by the exchange, along with the actual Exchange timestamp in milliseconds.

I am doing this and have not noticed any problems.

Mike

Due to time constraints, please do not PM me if your question can be resolved or answered on the forum.

Need help?
1) Stop changing things. No new indicators, charts, or methods. Be consistent with what is in front of you first.
2) Start a journal and post to it daily with the trades you made to show your strengths and weaknesses.
3) Set goals for yourself to reach daily. Make them about how you trade, not how much money you make.
4) Accept responsibility for your actions. Stop looking elsewhere to explain away poor performance.
5) Where to start as a trader? Watch this webinar and read this thread for hundreds of questions and answers.
6)
Help using the forum? Watch this video to learn general tips on using the site.

If you want
to support our community, become an Elite Member.

Reply With Quote
The following 2 users say Thank You to Big Mike for this post:
 
  #6 (permalink)
Elite Member
Miami FL USA
 
Futures Experience: Advanced
Platform: Ensign 10, NT7 DOM
Broker/Data: IB, IQ
Favorite Futures: Currency Futures
 
Cashish's Avatar
 
Posts: 803 since May 2011
Thanks: 811 given, 2,103 received


Big Mike View Post
I wouldn't put much belief in those results.

You need to instead just access the IQFeed API directly where you can see the TickID as sent by the exchange, along with the actual Exchange timestamp in milliseconds.

I am doing this and have not noticed any problems.

Mike


That's a hell of a thing to say! Why would you say that @Big Mike and not even give a hint as to what or why you're questioning? Do you see a "problem"?


I assume you dis-"believe" something, what is it, the CME DataMine data or the or the or the IQ Data?

And BTW,,,,,,,, I don't NEED to do anything.



Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).

Reply With Quote
 
  #7 (permalink)
Site Administrator
Manta, Ecuador
 
Futures Experience: Advanced
Platform: My own custom solution
Favorite Futures: E-mini ES S&P 500
 
Big Mike's Avatar
 
Posts: 46,240 since Jun 2009
Thanks: 29,356 given, 83,237 received

There might be a misunderstanding.

I was simply suggesting it is difficult to analyze millisecond data and TickID on a platform that doesn't support it (NinjaTrader) and draw any conclusions.

Better to instead use the IQFeed API directly if you are determining the capabilities of IQFeed, and not NinjaTrader.

Mike

Due to time constraints, please do not PM me if your question can be resolved or answered on the forum.

Need help?
1) Stop changing things. No new indicators, charts, or methods. Be consistent with what is in front of you first.
2) Start a journal and post to it daily with the trades you made to show your strengths and weaknesses.
3) Set goals for yourself to reach daily. Make them about how you trade, not how much money you make.
4) Accept responsibility for your actions. Stop looking elsewhere to explain away poor performance.
5) Where to start as a trader? Watch this webinar and read this thread for hundreds of questions and answers.
6)
Help using the forum? Watch this video to learn general tips on using the site.

If you want
to support our community, become an Elite Member.


Last edited by Big Mike; January 20th, 2014 at 01:33 AM. Reason: type-o, changed tick data to TickID
Reply With Quote
The following user says Thank You to Big Mike for this post:
 
  #8 (permalink)
Site Administrator
Manta, Ecuador
 
Futures Experience: Advanced
Platform: My own custom solution
Favorite Futures: E-mini ES S&P 500
 
Big Mike's Avatar
 
Posts: 46,240 since Jun 2009
Thanks: 29,356 given, 83,237 received


Cashish View Post
IQFeed gets the millisecond time stamps from the CME (that the CME doesn't publish) but does not get the sequence numbers, or don't publish them. All this sounds like normal trading stuff, a lot of gray area and NOT much black and white. I hope those who can help will come forth and offer to participate in this Myth Busting.

Please, Post or PM.

I just saw this in your post. IQFeed does publish the CME sequence number, it is available in the feed. I am using it in my app. I can't speak to NinjaTrader.

Mike

Due to time constraints, please do not PM me if your question can be resolved or answered on the forum.

Need help?
1) Stop changing things. No new indicators, charts, or methods. Be consistent with what is in front of you first.
2) Start a journal and post to it daily with the trades you made to show your strengths and weaknesses.
3) Set goals for yourself to reach daily. Make them about how you trade, not how much money you make.
4) Accept responsibility for your actions. Stop looking elsewhere to explain away poor performance.
5) Where to start as a trader? Watch this webinar and read this thread for hundreds of questions and answers.
6)
Help using the forum? Watch this video to learn general tips on using the site.

If you want
to support our community, become an Elite Member.

Reply With Quote
The following user says Thank You to Big Mike for this post:
 
  #9 (permalink)
Elite Member
Miami FL USA
 
Futures Experience: Advanced
Platform: Ensign 10, NT7 DOM
Broker/Data: IB, IQ
Favorite Futures: Currency Futures
 
Cashish's Avatar
 
Posts: 803 since May 2011
Thanks: 811 given, 2,103 received

When I started using NinjaTrader, the program didn't have charts! I've still never really figured out how to open one.

Reply With Quote
 
  #10 (permalink)
 Vendor: www.iqfeed.net 
Omaha NE
 
Futures Experience: Intermediate
Platform: IQFeed compatible
Favorite Futures: ES
 
Robert Carrillo's Avatar
 
Posts: 271 since Jun 2012
Thanks: 234 given, 374 received


Hi @Cashish,

The CME sell sheet you posted showing second time stamps is not current. There is no date on it, but this one from CME Group showing millisecond time stamps is copyrighted 2012, well before we began providing millisecond time stamps in IQFeed:

http://www.cmegroup.com/market-data/datamine-information-sheet.html

Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).


Thanks.

Robert


Last edited by Robert Carrillo; January 20th, 2014 at 02:38 PM. Reason: clarity
Reply With Quote
The following 2 users say Thank You to Robert Carrillo for this post:

Reply



futures io > > > > CME DataMine T&S vs IQFeed's millisecond Time Stamps

Thread Tools Search this Thread
Search this Thread:

Advanced Search



Upcoming Webinars and Events (4:30PM ET unless noted)

Jigsaw Trading: TBA

Elite only

FuturesTrader71: TBA

Elite only

NinjaTrader: TBA

Jan 18

RandBots: TBA

Jan 23

GFF Brokers & CME Group: Futures & Bitcoin

Elite only

Adam Grimes: TBA

Elite only

Ran Aroussi: TBA

Elite only
     

Similar Threads
Thread Thread Starter Forum Replies Last Post
Order Flow Analytics & IQfeed - my experience Righteous7 Trading Reviews and Vendors 1 September 11th, 2013 07:04 PM
Current Time CME mk77ch NinjaTrader Programming 6 May 15th, 2013 05:26 PM
IQFeed now offers millisecond precision (At least to developers) dcooke888 The Elite Circle 2 January 20th, 2013 02:19 PM
NT7, IQfeed, Qcollector & backfill CL..I`m so lost neko333 The Elite Circle 11 November 2nd, 2012 07:41 AM
cme latency over time published bidask201 Traders Hideout 1 May 20th, 2012 05:59 PM


All times are GMT -4. The time now is 07:14 AM.

Copyright © 2017 by futures io, s.a., Av Ricardo J. Alfaro, Century Tower, Panama, +507 833-9432, info@futures.io
All information is for educational use only and is not investment advice.
There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
no new posts
Page generated 2017-12-18 in 0.16 seconds with 20 queries on phoenix via your IP 54.163.209.109