NexusFi: Find Your Edge


Home Menu

 





MDP 3.0, is CME migrating to a new data comm protocol?


Discussion in Brokers

Updated
      Top Posters
    1. looks_one Big Mike with 17 posts (34 thanks)
    2. looks_two artemiso with 6 posts (2 thanks)
    3. looks_3 LukeGeniol with 6 posts (1 thanks)
    4. looks_4 Malthus with 5 posts (18 thanks)
      Best Posters
    1. looks_one SierraChart with 13.5 thanks per post
    2. looks_two aslan with 7 thanks per post
    3. looks_3 trendwaves with 3.6 thanks per post
    4. looks_4 Big Mike with 2 thanks per post
    1. trending_up 46,135 views
    2. thumb_up 193 thanks given
    3. group 50 followers
    1. forum 86 posts
    2. attach_file 0 attachments




 
Search this Thread

MDP 3.0, is CME migrating to a new data comm protocol?

  #31 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,404 since Jun 2009
Thanks Given: 33,181
Thanks Received: 101,542


LukeGeniol View Post
At this point that the data will not more based on tick but on time, and this is the microsecond, I'm curious to see how many trades will be made on the same microsecond....

Not very many, for sure. Guessing it would be an extremely tiny percentage.

My understanding is this: The only issue here is bundling a trade. When I submit a market order for a 50 lot on ES, I get filled with lots of 1's and 2's and some 5's usually. Prior to MDP 3.0, each fill would count as a trade. Now my one order for 50 gets counted as one trade, regardless of the incremental fills, within an allowable limit of time.

I've not seen specific documentation on the elapsed time that is allowable.

Mike

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote

Can you help answer these questions
from other members on NexusFi?
Online prop firm The Funded Trader (TFT) going under?
Traders Hideout
Exit Strategy
NinjaTrader
Deepmoney LLM
Elite Quantitative GenAI/LLM
New Micros: Ultra 10-Year & Ultra T-Bond -- Live Now
Treasury Notes and Bonds
Futures True Range Report
The Elite Circle
 
  #32 (permalink)
 
Seahn's Avatar
 Seahn 
New York, New Jersey/USA
 
Experience: Intermediate
Platform: NinjaTrader
Trading: Futures
Posts: 161 since Jan 2013
Thanks Given: 63
Thanks Received: 274

FYI

It appears Ninjatrader backfill data is using the new data while real time Rithmic data is still the old format data. Makes for confusing and less than useful tick charts.

Reply With Quote
  #33 (permalink)
 Ruffcut 
South Lyon Michigan USA
 
Experience: Intermediate
Platform: Ninjatrader, AMP, tradeking thinkorswim
Trading: CL, TF
Posts: 61 since Sep 2012
Thanks Given: 617
Thanks Received: 106


Tick trading has grown in popularity. I know this one guy used a bunch of them, even a 70 tick chart on the CL. I tried it. Wow was that ever a data stream. It showed some nice basing action for entry. Boy, did it clog up my ninja data base though, besides making me a little dizzy. Even midday I would have to clean the NT database tick files and cache. Lucky enuff for me someone showed me how to clean that stuff up. Ninja might encourage CME to lighten the load on their platform, with a wink wink?
My CL 2400 tick chart is not as affected as the 2000 tick ES. This is one of those days I'm glad to have time based charts, volume ladder and volume charts,also. "you only need one chart to succeed in trading". Another axiom bites the dust.

Reply With Quote
  #34 (permalink)
 
LukeGeniol's Avatar
 LukeGeniol 
Italy (IT) Italy
 
Experience: Advanced
Platform: ATAS, R|Trader, NT8
Broker: Rithmic
Trading: CL, Brent, GC, TF
Frequency: Daily
Duration: Minutes
Posts: 1,499 since Apr 2010
Thanks Given: 408
Thanks Received: 985

This will affect also the backtesting and also the indicators based on tick......Now they will have to be rethought.

Take your Pips, go out and Live.
Luke.
Reply With Quote
  #35 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,404 since Jun 2009
Thanks Given: 33,181
Thanks Received: 101,542


LukeGeniol View Post
At this point that the data will not more based on tick but on time, and this is the microsecond, I'm curious to see how many trades will be made on the same microsecond....

I did a test on millisecond data on ES from Friday.

 
Code
MariaDB [ticks]> select count(`TickID`) as `Ticks`,count(distinct `Date`) as `Unique` from `@ES#` where `Date` between '2015-05-01 00:00:00' and '2015-05-01 23:59:59';
+--------+--------+
| Ticks  | Unique |
+--------+--------+
| 305305 |  77722 |
+--------+--------+
1 row in set (0.00 sec)
Here is a snippet. You can make assumptions on how these would be grouped together under the new protocol. Keeping in mind my data is millisecond resolution, not microsecond.

 
Code
MariaDB [ticks]> select * from `@ES#` where `Date` between '2015-05-01 00:00:00' and '2015-05-01 23:59:59' order by 1 limit 20;
+-------------------------+------------+----------+------------+------------+----------+--------------+-------------------+-----------------+
| Date                    | Last       | LastSize | Bid        | Ask        | TickID   | BasisForLast | TradeMarketCenter | TradeConditions |
+-------------------------+------------+----------+------------+------------+----------+--------------+-------------------+-----------------+
| 2015-05-01 00:00:04.883 | 2083.25000 |        2 | 2083.00000 | 2083.25000 | 17885107 | C            |                43 | 01              |
| 2015-05-01 00:00:04.883 | 2083.25000 |        3 | 2083.00000 | 2083.25000 | 17885108 | C            |                43 | 01              |
| 2015-05-01 00:00:04.883 | 2083.25000 |        1 | 2083.00000 | 2083.25000 | 17885109 | C            |                43 | 01              |
| 2015-05-01 00:00:04.883 | 2083.25000 |        1 | 2083.00000 | 2083.25000 | 17885110 | C            |                43 | 01              |
| 2015-05-01 00:00:04.883 | 2083.25000 |        1 | 2083.00000 | 2083.25000 | 17885114 | C            |                43 | 01              |
| 2015-05-01 00:00:04.883 | 2083.25000 |        1 | 2083.00000 | 2083.25000 | 17885115 | C            |                43 | 01              |
| 2015-05-01 00:00:04.883 | 2083.25000 |        1 | 2083.00000 | 2083.25000 | 17885116 | C            |                43 | 01              |
| 2015-05-01 00:00:04.902 | 2083.25000 |        1 | 2083.25000 | 2083.50000 | 17885148 | C            |                43 | 01              |
| 2015-05-01 00:00:08.077 | 2083.25000 |        1 | 2083.25000 | 2083.50000 | 17885160 | C            |                43 | 01              |
| 2015-05-01 00:00:08.077 | 2083.25000 |        1 | 2083.25000 | 2083.50000 | 17885162 | C            |                43 | 01              |
| 2015-05-01 00:00:08.077 | 2083.25000 |        1 | 2083.25000 | 2083.50000 | 17885163 | C            |                43 | 01              |
| 2015-05-01 00:00:08.077 | 2083.25000 |        2 | 2083.25000 | 2083.50000 | 17885165 | C            |                43 | 01              |
| 2015-05-01 00:00:08.077 | 2083.25000 |        1 | 2083.25000 | 2083.50000 | 17885166 | C            |                43 | 01              |
| 2015-05-01 00:00:08.077 | 2083.25000 |        1 | 2083.25000 | 2083.50000 | 17885167 | C            |                43 | 01              |
| 2015-05-01 00:00:25.641 | 2083.50000 |        3 | 2083.25000 | 2083.50000 | 17885216 | C            |                43 | 01              |
| 2015-05-01 00:00:25.641 | 2083.50000 |        1 | 2083.25000 | 2083.50000 | 17885217 | C            |                43 | 01              |
| 2015-05-01 00:01:03.551 | 2083.25000 |        1 | 2083.25000 | 2083.50000 | 17885252 | C            |                43 | 01              |
| 2015-05-01 00:01:35.204 | 2083.25000 |        1 | 2083.25000 | 2083.50000 | 17885273 | C            |                43 | 01              |
| 2015-05-01 00:01:35.240 | 2083.25000 |        1 | 2083.25000 | 2083.50000 | 17885289 | C            |                43 | 01              |
| 2015-05-01 00:01:40.100 | 2083.25000 |        1 | 2083.25000 | 2083.50000 | 17885291 | C            |                43 | 01              |
+-------------------------+------------+----------+------------+------------+----------+--------------+-------------------+-----------------+
20 rows in set (0.00 sec)
Mike

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
  #36 (permalink)
 hobart 
charlotte nc
 
Experience: Master
Platform: Sierra Chart, TOS, Tradestation, NinjaTrader
Trading: energy
Posts: 114 since Jul 2012
Thanks Given: 81
Thanks Received: 172


i did 120 day analysis and came up with an avg of 5500 volume equivalent to 2000t on ES. i know a lot of tick chart folks use 2k. You can see in the pic, its not much different, and in many cases has cleaner price action signals. dont want to get into a tick chart discussion in this thread, just wanted to show that the alternatives are pretty clean.

Reply With Quote
  #37 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,404 since Jun 2009
Thanks Given: 33,181
Thanks Received: 101,542


Big Mike View Post
I don't understand why someone would prefer a tick chart over a volume chart. And the volume chart is not changed in this scenario.

Year to date - Day of week ticks vs volume (and average trade size per 'tick'). This is why I think everyone should just be using a volume chart.

 
Code
MariaDB [ticks]> select dayname(`Date`) as `Day`,count(`TickID`) as `Ticks`,sum(`LastSize`) as `Volume`, avg(`LastSize`) as `Avg Size` from `@ES#` where `Date` > '2015-01-01' group by dayname(`Date`) order by dayofweek(`Date`);
+-----------+---------+----------+----------+
| Day       | Ticks   | Volume   | Avg Size |
+-----------+---------+----------+----------+
| Sunday    |  254940 |   562530 |   2.2065 |
| Monday    | 6597981 | 19930080 |   3.0206 |
| Tuesday   | 8317437 | 25580179 |   3.0755 |
| Wednesday | 8601387 | 26411379 |   3.0706 |
| Thursday  | 7923696 | 24058165 |   3.0362 |
| Friday    | 8078934 | 24749009 |   3.0634 |
+-----------+---------+----------+----------+
6 rows in set (0.00 sec)
And here is by hour, basically showing it's 3 contracts during cash, 2 after hours.

 
Code
MariaDB [ticks]> select hour(`Date`) as `Hour`,count(`TickID`) as `Ticks`,sum(`LastSize`) as `Volume`, avg(`LastSize`) as `Avg Size` from `@ES#` where `Date` > '2015-01-01' group by hour(`Date`) order by hour(`Date`);
+------+---------+----------+----------+
| Hour | Ticks   | Volume   | Avg Size |
+------+---------+----------+----------+
|    0 |  111340 |   226530 |   2.0346 |
|    1 |  124062 |   259898 |   2.0949 |
|    2 |  269543 |   621971 |   2.3075 |
|    3 |  723267 |  1696901 |   2.3462 |
|    4 |  639796 |  1550635 |   2.4236 |
|    5 |  511400 |  1233989 |   2.4130 |
|    6 |  524084 |  1311047 |   2.5016 |
|    7 |  691526 |  1816778 |   2.6272 |
|    8 | 1358361 |  3550095 |   2.6135 |
|    9 | 6449196 | 18166526 |   2.8169 |
|   10 | 6689408 | 19446288 |   2.9070 |
|   11 | 4694523 | 14390248 |   3.0653 |
|   12 | 3227247 |  9790631 |   3.0337 |
|   13 | 3008669 |  8956046 |   2.9767 |
|   14 | 3543164 | 10690341 |   3.0172 |
|   15 | 5004344 | 18414997 |   3.6798 |
|   16 | 1143050 |  6748071 |   5.9036 |
|   17 |   49259 |   176906 |   3.5913 |
|   18 |  208143 |   539635 |   2.5926 |
|   19 |  162642 |   358279 |   2.2029 |
|   20 |  228663 |   484316 |   2.1180 |
|   21 |  165081 |   355348 |   2.1526 |
|   22 |  138199 |   283878 |   2.0541 |
|   23 |  109408 |   221988 |   2.0290 |
+------+---------+----------+----------+
24 rows in set (47.70 sec)
Mike

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
  #38 (permalink)
 
Malthus's Avatar
 Malthus 
Madrid Spain
 
Experience: Intermediate
Platform: Ninjatrader, TOS
Trading: ES
Posts: 251 since Oct 2014
Thanks Given: 1,252
Thanks Received: 708


Big Mike View Post
Year to date - Day of week ticks vs volume (and average trade size per 'tick'). This is why I think everyone should just be using a volume chart.


And here is by hour, basically showing it's 3 contracts during cash, 2 after hours.


Mike

Thanks Mike, priceless information.

I updated the original post since it's clear now that it wasn't a data feed problem.

Started this thread Reply With Quote
Thanked by:
  #39 (permalink)
 macgwrite 
Raleigh NC USA
 
Experience: Advanced
Platform: NinjaTrader
Broker: FXCM, NTB
Trading: YM, CL, EUR/USD
Posts: 67 since Jan 2013
Thanks Given: 75
Thanks Received: 78

An FYI for the good folks using BetterRenko:

I compared my realtime journal chart of the YM on a 5 BetterRenko from 4/30/15 with the current historical chart in NT (Continuum data feed from NTB). They look exactly the same, so BetterRenko folks shouldn't be affected by the data change - at least not after the bar forms (unless NT is using old historical data...)

Visit my NexusFi Trade Journal Reply With Quote
  #40 (permalink)
 
Silvester17's Avatar
 Silvester17 
Columbus, OH
Market Wizard
 
Experience: None
Platform: NT 8, TOS
Trading: ES
Posts: 3,603 since Aug 2009
Thanks Given: 5,139
Thanks Received: 11,527



LukeGeniol View Post
This will affect also the exotic bars type like the various custom renko based on tick, the backtesting and also the indicators based on tick......Now they will have to be rethought.


macgwrite View Post
An FYI for the good folks using BetterRenko:

I compared my realtime journal chart of the YM on a 5 BetterRenko from 4/30/15 with the current historical chart in NT (Continuum data feed from NTB). They look exactly the same, so BetterRenko folks shouldn't be affected by the data change - at least not after the bar forms (unless NT is using old historical data...)

now don't get confused about tick charts and ticks in price

renko and also range charts need a certain amount of "ticks" (as in price) before creating a new bar. it doesn't matter if a trade is reported as 1 trade with 500 contracts or 500 trades with 1 contract. with other words the meaning of a tick here is like a 1/4 point in ES.

Reply With Quote




Last Updated on May 19, 2017


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts