NexusFi: Find Your Edge


Home Menu

 





Mystic phenomena in Continuum datafeed


Discussion in Brokers

Updated
      Top Posters
    1. looks_one Rory with 3 posts (6 thanks)
    2. looks_two Renkotrader with 3 posts (1 thanks)
    3. looks_3 sam028 with 2 posts (4 thanks)
    4. looks_4 Quick Summary with 1 posts (0 thanks)
      Best Posters
    1. looks_one Rory with 2 thanks per post
    2. looks_two sam028 with 2 thanks per post
    3. looks_3 HoopyTrading with 2 thanks per post
    4. looks_4 Renkotrader with 0.3 thanks per post
    1. trending_up 4,730 views
    2. thumb_up 14 thanks given
    3. group 6 followers
    1. forum 10 posts
    2. attach_file 4 attachments




 
Search this Thread

Mystic phenomena in Continuum datafeed

  #1 (permalink)
 
Renkotrader's Avatar
 Renkotrader 
Frankfurt, Hessen, Germany
 
Experience: Advanced
Platform: NinjaTrader 8
Broker: APEX & NinjaTrader Brokerage
Trading: 6E, 6J, CL, ES, FDAX, FGBL, GC, HG, NQ, RTY, SI, YM
Posts: 547 since May 2012
Thanks Given: 1,419
Thanks Received: 227

Hello traders,

in this thread I am giving you a short movie and 3 screenshots from its for showing, what is scary in this market data feed from Continuum for me. The instrument is Crude Oil, CL, and this scary movements I had seen at least at 28. of April 2016. This video now are from today, the 12. of March 2016.

Please: I know, what spread expansions are. And that, what you can watching here are not typical spread expansions. In this short video you can see, that in one case the bid-line is jumping (second 21), in another situation the ask-line is jumping (second 43) and in a third case both are jumping together (second 26).

This is not a price moving. Its a very fast jump and back for a reason.

I want to know, REALLY TO KNOW - EXACTLY, what the holy grail that is. Its Continuum? Its an algorithm, that f***s the traders special in crude oil? Or its an cable problem, that is only in special times doing crazy things? Can I trust Continuum fully? Do I get my money back from Ninjatraderbrokerage in case of filling by this strange irregular movements (losts or stopping out more than 60 ticks) AGAINST me?

Best regards,
Renkotrader

Attached Thumbnails
Click image for larger version

Name:	21.png
Views:	283
Size:	444.1 KB
ID:	208182   Click image for larger version

Name:	26.PNG
Views:	283
Size:	574.5 KB
ID:	208183   Click image for larger version

Name:	43.PNG
Views:	312
Size:	567.0 KB
ID:	208184  
Attached Files
Elite Membership required to download: Aufnahme_2016_05_12_15_59_21_299.flv
Started this thread Reply With Quote

Can you help answer these questions
from other members on NexusFi?
My NT8 Volume Profile Split by Asian/Euro/Open
NinjaTrader
Build trailing stop for micro index(s)
Psychology and Money Management
The space time continuum and the dynamics of a financial …
Emini and Emicro Index
NexusFi Journal Challenge - April 2024
Feedback and Announcements
Deepmoney LLM
Elite Quantitative GenAI/LLM
 
Best Threads (Most Thanked)
in the last 7 days on NexusFi
Get funded firms 2023/2024 - Any recommendations or word …
59 thanks
Funded Trader platforms
37 thanks
NexusFi site changelog and issues/problem reporting
24 thanks
GFIs1 1 DAX trade per day journal
22 thanks
The Program
19 thanks
  #3 (permalink)
 
rleplae's Avatar
 rleplae 
Gits (Hooglede) Belgium
Legendary Market Wizard
 
Experience: Master
Platform: NinjaTrader, Proprietary,
Broker: Ninjabrokerage/IQfeed + Synthetic datafeed
Trading: 6A, 6B, 6C, 6E, 6J, 6S, ES, NQ, YM, AEX, CL, NG, ZB, ZN, ZC, ZS, GC
Posts: 3,003 since Sep 2013
Thanks Given: 2,442
Thanks Received: 5,863


Do you have the same issue without any indicators loaded, just raw bid/ask trade volume ?

Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #4 (permalink)
 
sam028's Avatar
 sam028 
Site Moderator
 
Posts: 3,765 since Jun 2009
Thanks Given: 3,825
Thanks Received: 4,629

@Renkotrader, it looks like a kind of artifact, not a real bid/ask.
You should try to:
- download the market replay for this specific day and check if it was "real". As it will come from another data source it will confirm it did not happen on the NYMEX itself
- create a simple indicator which will log these events (on a 1 tick chart, bid (or ask) for bar 0 x% higher/lower than bid (or ask) for bar 1)

Success requires no deodorant! (Sun Tzu)
Follow me on Twitter Reply With Quote
Thanked by:
  #5 (permalink)
 
Renkotrader's Avatar
 Renkotrader 
Frankfurt, Hessen, Germany
 
Experience: Advanced
Platform: NinjaTrader 8
Broker: APEX & NinjaTrader Brokerage
Trading: 6E, 6J, CL, ES, FDAX, FGBL, GC, HG, NQ, RTY, SI, YM
Posts: 547 since May 2012
Thanks Given: 1,419
Thanks Received: 227

Hello traders!

@Pure charts: no, I have no test by a pure chart without indicators. And really only in CL and and only sometimes I had seen its. Do you think, that its possible, that an indicator is creating this problem?
@market data: now not at trading computer, back in some days. I hope, that I will find this. In NT7 there are the option for this, isnt it?

@Creating indicator: sorry, I dont know, how and what.

Thank you for your help!

Best regards,
Renkotrader

Started this thread Reply With Quote
  #6 (permalink)
Rory
 
Posts: 2,743 since May 2014
Thanks Given: 5,444
Thanks Received: 8,140

In Ireland I had a similar (possibly the same? but I was using ES mostly) problem with random price moves. It was NT 7 and in 2014.

It was (in my case) my particular e-fibre broadband technology was corrupting packets coming from Chicago. NT is not good with error correction. Not a problem specific to my home but the ISP nationwide, confirmed by their support and my tests in 3 locations. On a different ISP no problem and then I moved to Colombia (same laptops, no issues).

Other times when the market was busy an ATM order would be partially submitted (and accepted live), e.g. missing stop or target.

For certain you need to test using a network cable and not on Wifi (I'm sure you have).

You might try a continuous ping logged to a text file e.g. ping -t YourCQGserver > ping.txt

NT brokerage support would certainly help seeing your video but they would in no way actually admit that NT was worse than other leading apps on a poor connection (and it is). It was bordering comical how they avoided saying this, I suspect it was support policy.

They did (surprisingly helpfully) offer to "pilot customer" connect me to CQG's gateway in London but I discovered the issue was my ISP(then moved to Colombia). I am not sure if NT brokerage still route everything to Chicago or they have opened gateways in Europe but support could give you your current servers or netstat -n may show them.

Reply With Quote
  #7 (permalink)
 
sam028's Avatar
 sam028 
Site Moderator
 
Posts: 3,765 since Jun 2009
Thanks Given: 3,825
Thanks Received: 4,629


Rory View Post
In Ireland I had a similar (possibly the same? but I was using ES mostly) problem with random price moves. It was NT 7 and in 2014.

It was (in my case) my particular e-fibre broadband technology was corrupting packets coming from Chicago. NT is not good with error correction. Not a problem specific to my home but the ISP nationwide, confirmed by their support and my tests in 3 locations. On a different ISP no problem and then I moved to Colombia (same laptops, no issues).

Other times when the market was busy an ATM order would be partially submitted (and accepted live), e.g. missing stop or target.

For certain you need to test using a network cable and not on Wifi (I'm sure you have).

You might try a continuous ping logged to a text file e.g. ping -t YourCQGserver > ping.txt

NT brokerage support would certainly help seeing your video but they would in no way actually admit that NT was worse than other leading apps on a poor connection (and it is). It was bordering comical how they avoided saying this, I suspect it was support policy.

They did (surprisingly helpfully) offer to "pilot customer" connect me to CQG's gateway in London but I discovered the issue was my ISP(then moved to Colombia). I am not sure if NT brokerage still route everything to Chicago or they have opened gateways in Europe but support could give you your current servers or netstat -n may show them.

Hmm, that's very very strange.
There are error corrections in multiple places: on the broadband size (fiber or DSL or whatever) and then in the Ethernet packets themselves (Frame check sequence). I assume there are also CRC in the data feed provider API itself so I don't see how the broadband link could be the root cause.
I f the payload is corrupted (the useful data in the network frame) then it's CRC will failed and the packet will be dropped at layer 2, higher layers (operating system) won't see it.

So I assume your ISP was corrupting packets and was sending valid CRC what a shame, that's criminal!

Success requires no deodorant! (Sun Tzu)
Follow me on Twitter Reply With Quote
Thanked by:
  #8 (permalink)
Rory
 
Posts: 2,743 since May 2014
Thanks Given: 5,444
Thanks Received: 8,140


sam028 View Post
Hmm, that's very very strange.
There are error corrections in multiple places: on the broadband size (fiber or DSL or whatever) and then in the Ethernet packets themselves (Frame check sequence). I assume there are also CRC in the data feed provider API itself so I don't see how the broadband link could be the root cause.
I f the payload is corrupted (the useful data in the network frame) then it's CRC will failed and the packet will be dropped at layer 2, higher layers (operating system) won't see it.

So I assume your ISP was corrupting packets and was sending valid CRC what a shame, that's criminal!

@Renkotrader first I would say, the problem I describe is only a possibility to check, but NT support are helpful and you have video evidence.

@sam028 Indeed strange. I doubt it was a false CRC issue though there were many bad packets, it was at the application level inside NT when dealing with a high error rate connection. Perhaps a threading or buffer size issue? Everything else perfectly fine, Web sites, torrents, data file downloads (6GB ISOs etc, perfect, not damaged files). Sierrachart running in parallel (on CQG data) perfect when these glitches/artifacts appeared in NT.

Eircom's e-fiber ran the last section over old copper phone lines however the speeds were remarkably fast. Their support confirmed that certain gamers also encountered a problem and it was 'nature of the technology'. They are rolling out fibre to house nationwide now to eliminate the copper leg and going to 1Gb standard.

I was an IT consultant and I took a long time to accept it (and it cost me $$). PathPing showed various problems even leaving the house (in 3 homes around the country).

A guy in Australia confirmed the same issue with his ISP & NT and a friend in the US had it recently though this was probably down to faulty equipment (certainly we had ATM orders with no Stop submitted twice and other issues). NT has a hand in it though as something is poorly written.

I know to anyone technical it seems... strange... easy to think could have been this or that. NT support very obviously knew (by how they skirted it on the phone and in email) but were not going to admit it.

This was very frustrating however they did offer to connect me (or try to arrange) via a European CQG Gateway so I have to give them credit for that. It may have reduced the problem however my move to Colombia fix is much better.

Reply With Quote
  #9 (permalink)
 HoopyTrading 
Boston, MA
 
Posts: 264 since Apr 2014


Quoting 
Web sites, torrents, data file downloads (6GB ISOs etc, perfect, not damaged files). Sierrachart running in parallel (on CQG data) perfect when these glitches/artifacts appeared in NT.

A trading PC should be used for nothing but trading...Not running in tandem with all that junk mentioned above. In fact, posting to websites on your trading PC should be frowned upon. Get another PC to have fun on. (To download torrents and movies, etc). They are cheap. A full PC package with a monitor these days costs what, 500 bux? Treat your trading like a business, your trading PC as a piece of the business, and you will get farther along I reckon'.

Reply With Quote
  #10 (permalink)
Rory
 
Posts: 2,743 since May 2014
Thanks Given: 5,444
Thanks Received: 8,140



HoopyTrading View Post
A trading PC should be used for nothing but trading...Not running in tandem with all that junk mentioned above. In fact, posting to websites on your trading PC should be frowned upon. Get another PC to have fun on. (To download torrents and movies, etc). They are cheap. A full PC package with a monitor these days costs what, 500 bux? Treat your trading like a business, your trading PC as a piece of the business, and you will get farther along I reckon'.



Rory View Post
@Renkotrader
I was an IT consultant and I took a long time to accept it (and it cost me $$). PathPing showed various problems even leaving the house (in 3 homes around the country).

Good advice however.... IT consultant.. ? just kidding. A few minutes to kill waiting for someone...

In truth you can get away with a lot of crap running no problem but certainly keep it simple if your not an old pro and clearly nothing running when diagnosing a problem. Also no WiFi as this can lead to congestion and losses, use an RJ45 cable.

The best thing anyone can do is enough ram (8Gb+) and a decent SSD. This really smooths out the bumps with wait states and locking etc. It makes a world of a difference in NT 7. Excluding your NT folders from AV active scanning is also a good idea and was Ninjatrader's advice also.

Reply With Quote




Last Updated on May 18, 2016


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts