NexusFi: Find Your Edge


Home Menu

 





CME DataMine T&S vs IQFeed's millisecond Time Stamps


Discussion in Brokers

Updated
      Top Posters
    1. looks_one Cashish with 5 posts (4 thanks)
    2. looks_two Big Mike with 4 posts (6 thanks)
    3. looks_3 artemiso with 2 posts (0 thanks)
    4. looks_4 Jigsaw Trading with 1 posts (4 thanks)
      Best Posters
    1. looks_one Jigsaw Trading with 4 thanks per post
    2. looks_two Robert Carrillo with 2 thanks per post
    3. looks_3 Big Mike with 1.5 thanks per post
    4. looks_4 Cashish with 0.8 thanks per post
    1. trending_up 6,299 views
    2. thumb_up 17 thanks given
    3. group 4 followers
    1. forum 12 posts
    2. attach_file 8 attachments




 
Search this Thread

CME DataMine T&S vs IQFeed's millisecond Time Stamps

  #1 (permalink)
 
Cashish's Avatar
 Cashish 
Miami FL USA
 
Experience: Advanced
Platform: Ensign 10, NT7 DOM
Broker: IB, IQ
Trading: Currency Futures
Posts: 802 since May 2011
Thanks Given: 811
Thanks Received: 2,102

There are over 47,000 members on this forum and I'm searching for one of them that has access to the latest CME DataMine Time and Sales Report to come forward and participate in proving (or not) the CME sequence numbers directly correlate with the IQFeed millisecond time stamps.

I personally don't have the means (I'm not a DataMine subscriber) to compare the CME DataMine Time and Sales sequence numbers to the millisecond time stamps now provided by IQFeed 5.0 nor have I seen it compared anywhere on the web, I'm asking for your help.

It is my understanding these two Time and Sales reports should align perfectly (at least on a small sample). I'm asking the members who can prove this theory to step up and prove it to me, the members and all the visitors of Big Mike's Trading Forum.

In my opinion it's one thing to think your analysis is correct, and another to know it's correct.














The images above state the DataMine data records are time stamped to the second and the trades within that second are given a sequence number. As I wrote in the text box, I question the accuracy of these statements mainly due to the dates on the sample data and the dates on the documentation. Does the CME DataMine still record data time stamped to the second, or has that changed during the last year (months), I would like to see someone verify this by posting a view of current data.

If the, "Trades that happen in the same second are each given a specific sequence number and are ordered in the same sequence that they were sent out over the market data feed," and the following statement is proven to be correct then the sequence numbers and the millisecond time stamps along with the volume numbers should align perfectly. I simply want help to verify this absolutely.





I snipped this comment from this thread:



So from all this poppycock I ascertain that the CME actually has millisecond time stamp data but they don't publish it, instead they use sequence numbers to identify the order of trades traded within the second. IQFeed gets the millisecond time stamps from the CME (that the CME doesn't publish) but does not get the sequence numbers, or don't publish them. All this sounds like normal trading stuff, a lot of gray area and NOT much black and white. I hope those who can help will come forth and offer to participate in this Myth Busting.

Please, Post or PM.

Visit my NexusFi Trade Journal Started this thread Reply With Quote

Can you help answer these questions
from other members on NexusFi?
Futures True Range Report
The Elite Circle
NexusFi Journal Challenge - April 2024
Feedback and Announcements
Are there any eval firms that allow you to sink to your …
Traders Hideout
New Micros: Ultra 10-Year & Ultra T-Bond -- Live Now
Treasury Notes and Bonds
Deepmoney LLM
Elite Quantitative GenAI/LLM
 
Best Threads (Most Thanked)
in the last 7 days on NexusFi
Get funded firms 2023/2024 - Any recommendations or word …
61 thanks
Funded Trader platforms
39 thanks
NexusFi site changelog and issues/problem reporting
26 thanks
Battlestations: Show us your trading desks!
24 thanks
The Program
18 thanks
  #3 (permalink)
 CurrentCatcher 
Columbia MO/US
 
Experience: Intermediate
Platform: Sierra Chart
Trading: Futures
Posts: 18 since May 2012
Thanks Given: 229
Thanks Received: 23


The Sierra Chart engineers recently said they don't think IQ Feed is actually receiving millisecond time stamping from CME.

https://www.sierrachart.com/SupportBoard.php?ThreadID=3528

Reply With Quote
Thanked by:
  #4 (permalink)
 
Cashish's Avatar
 Cashish 
Miami FL USA
 
Experience: Advanced
Platform: Ensign 10, NT7 DOM
Broker: IB, IQ
Trading: Currency Futures
Posts: 802 since May 2011
Thanks Given: 811
Thanks Received: 2,102

Well,,,,,,, this thread didn't create much interest but I just couldn't let it go. I know these snips are kind-of crude but I believe they lay to rest the notion I had about the alignment/correlation of IQFeed's millisecond timestamped data and the CME's DataMine sequence numbers. FWIW, my charting program doesn't timestamp T&S Data sub-second, but it is IQFeed data and when running side by side with the (crude and simple) IQFeed T&S program that does show the millisecond stamps, of course they print exactly the same, tick for tick.

What I did here was take the Largest Tick traded (according to the CME DataMine T&S data) of the last three trading days and Dissected all the trades during that one second period. When I first looked into this data I was surprised and thought the findings were interesting, I thought others might as well.






January 15, 2014





January 16, 2014





January 17, 2014


Visit my NexusFi Trade Journal Started this thread Reply With Quote
Thanked by:
  #5 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,396 since Jun 2009
Thanks Given: 33,172
Thanks Received: 101,535

I wouldn't put much belief in those results.

You need to instead just access the IQFeed API directly where you can see the TickID as sent by the exchange, along with the actual Exchange timestamp in milliseconds.

I am doing this and have not noticed any problems.

Mike

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #6 (permalink)
 
Cashish's Avatar
 Cashish 
Miami FL USA
 
Experience: Advanced
Platform: Ensign 10, NT7 DOM
Broker: IB, IQ
Trading: Currency Futures
Posts: 802 since May 2011
Thanks Given: 811
Thanks Received: 2,102


Big Mike View Post
I wouldn't put much belief in those results.

You need to instead just access the IQFeed API directly where you can see the TickID as sent by the exchange, along with the actual Exchange timestamp in milliseconds.

I am doing this and have not noticed any problems.

Mike


That's a hell of a thing to say! Why would you say that @Big Mike and not even give a hint as to what or why you're questioning? Do you see a "problem"?


I assume you dis-"believe" something, what is it, the CME DataMine data or the or the or the IQ Data?

And BTW,,,,,,,, I don't NEED to do anything.




Visit my NexusFi Trade Journal Started this thread Reply With Quote
  #7 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,396 since Jun 2009
Thanks Given: 33,172
Thanks Received: 101,535

There might be a misunderstanding.

I was simply suggesting it is difficult to analyze millisecond data and TickID on a platform that doesn't support it (NinjaTrader) and draw any conclusions.

Better to instead use the IQFeed API directly if you are determining the capabilities of IQFeed, and not NinjaTrader.

Mike

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #8 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,396 since Jun 2009
Thanks Given: 33,172
Thanks Received: 101,535


Cashish View Post
IQFeed gets the millisecond time stamps from the CME (that the CME doesn't publish) but does not get the sequence numbers, or don't publish them. All this sounds like normal trading stuff, a lot of gray area and NOT much black and white. I hope those who can help will come forth and offer to participate in this Myth Busting.

Please, Post or PM.

I just saw this in your post. IQFeed does publish the CME sequence number, it is available in the feed. I am using it in my app. I can't speak to NinjaTrader.

Mike

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #9 (permalink)
 
Cashish's Avatar
 Cashish 
Miami FL USA
 
Experience: Advanced
Platform: Ensign 10, NT7 DOM
Broker: IB, IQ
Trading: Currency Futures
Posts: 802 since May 2011
Thanks Given: 811
Thanks Received: 2,102

When I started using NinjaTrader, the program didn't have charts! I've still never really figured out how to open one.

Visit my NexusFi Trade Journal Started this thread Reply With Quote
  #10 (permalink)
 
Robert Carrillo's Avatar
 Robert Carrillo 
Omaha NE
 
Experience: Intermediate
Platform: IQFeed compatible
Trading: ES
Posts: 271 since Jun 2012
Thanks Given: 234
Thanks Received: 376


Hi @Cashish,

The CME sell sheet you posted showing second time stamps is not current. There is no date on it, but this one from CME Group showing millisecond time stamps is copyrighted 2012, well before we began providing millisecond time stamps in IQFeed:

https://www.cmegroup.com/market-data/datamine-information-sheet.html



Thanks.

Robert

Reply With Quote
Thanked by:




Last Updated on January 21, 2014


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts