NexusFi: Find Your Edge


Home Menu

 





Unofficial NinjaTrader 8 wish list thread (NT8)!


Discussion in NinjaTrader

Updated
      Top Posters
    1. looks_one NinjaTrader with 96 posts (106 thanks)
    2. looks_two Big Mike with 81 posts (78 thanks)
    3. looks_3 OpalDragon with 35 posts (12 thanks)
    4. looks_4 AdvancedIndicators with 29 posts (26 thanks)
      Best Posters
    1. looks_one Fat Tails with 5.3 thanks per post
    2. looks_two NinjaTrader with 1.1 thanks per post
    3. looks_3 Big Mike with 1 thanks per post
    4. looks_4 AdvancedIndicators with 0.9 thanks per post
    1. trending_up 378,179 views
    2. thumb_up 692 thanks given
    3. group 221 followers
    1. forum 1,036 posts
    2. attach_file 63 attachments




 
Search this Thread

Unofficial NinjaTrader 8 wish list thread (NT8)!

  #601 (permalink)
 andorre 
Cologne/Germany
 
Experience: Advanced
Platform: NinjaTrader
Trading: FDAX, YM
Posts: 41 since Oct 2011
Thanks Given: 17
Thanks Received: 9


ratfink View Post
Users and developers have spent the last 30 years defeating Moore's Law with bad software and poor choices. I see no reason for this to change with either 100 cores and active threads or TeraHertz clocks. The problem is nearly always bad software, usually badly coded or unrealistic indicators or data source frequencies, or bad choices of what to look at or how to look at it. NT7 is not the problem, I can run 8 workspaces and 140 charts with 100 indicators for 2% of an i7, and support other-world systems. Only my head explodes, so I've stopped doing it, the system just laughs.

I want the multi-core support too, for now I just write my own threads, it's mainly the graphics library that blocks it for NT, but it won't solve any problems, just make things sweeter.

For now I suggest you think carefully about the value of each instrument/time series and indicator that you use, and evaluate what they really give you towards each trade that you execute.

Hi ratfink,

Could you please tell me more about your own threads on the graphics library which blocks NT?

Sometimes I see in Windows Task-Manager the dwm.exe being very busy.
Especially if I have several chess engines with (only) 3 cores working. Together with NT and browser
about 5 cores are used but NT has major problems and stutters (3 cores don't work!!).

Maybe you or someone else has similar problems?

Thank you.

Reply With Quote

Can you help answer these questions
from other members on NexusFi?
New Micros: Ultra 10-Year & Ultra T-Bond -- Live Now
Treasury Notes and Bonds
Exit Strategy
NinjaTrader
Deepmoney LLM
Elite Quantitative GenAI/LLM
NT7 Indicator Script Troubleshooting - Camarilla Pivots
NinjaTrader
My NT8 Volume Profile Split by Asian/Euro/Open
NinjaTrader
 
Best Threads (Most Thanked)
in the last 7 days on NexusFi
Get funded firms 2023/2024 - Any recommendations or word …
61 thanks
Funded Trader platforms
38 thanks
NexusFi site changelog and issues/problem reporting
27 thanks
GFIs1 1 DAX trade per day journal
18 thanks
The Program
18 thanks
  #602 (permalink)
 
ratfink's Avatar
 ratfink 
Birmingham UK
Market Wizard
 
Experience: Intermediate
Platform: NinjaTrader
Broker: TST/Rithmic
Trading: YM/Gold
Posts: 3,633 since Dec 2012
Thanks Given: 17,423
Thanks Received: 8,425


andorre View Post
Hi ratfink,

Could you please tell me more about your own threads on the graphics library which blocks NT?

Sometimes I see in Windows Task-Manager the dwm.exe being very busy.
Especially if I have several chess engines with (only) 3 cores working. Together with NT and browser
about 5 cores are used but NT has major problems and stutters (3 cores don't work!!).

Maybe you or someone else has similar problems?

Thank you.

The problems you describe are common for all of us, the main NT7 event and chart code loop is by default single-threaded, largely restricted by the Windows graphics and GUI library that it uses. Current Ninja only really makes much use of the extra cores when backtesting, although this is not an area I use. My own threads are used for independent stuff, e.g. special work, centralised logging, off-platform I/O, etc where I can safely control all issues.

What you see in the TM is that independent processes rather than threads can appear to make better use of the other cores, but of course they suffer other overheads.

In most cases when NT is running slowly it is caused by poor quality (i.e. inefficient) indicator code, or using a lot of cpu intensive data sources (e.g. tick or custom bar type charts,) which is why I suggest you make an evaluation. For example you could run record market data for a day and then run a series of high-speed tests using the recorded data, each time removing one of the indicators or one of the charts and measuring the impact to identify the main culprits. (NB I haven't used that approach, but I'd be interested if it helps )

There are also several threads on futures.io (formerly BMT) on Ninja tuning and other performance tips that are worth a search for.

Cheers

Travel Well
Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #603 (permalink)
 
Zondor's Avatar
 Zondor 
Portland Oregon, United States
 
Experience: Beginner
Platform: Ninjatrader®
Broker: CQG, Kinetick
Trading: Gameplay Klownbine® Trading of Globex
Posts: 1,333 since Jul 2009
Thanks Given: 1,246
Thanks Received: 2,731


@andorre said

Quoting 
Hi,

I have more than 20 charts on several monitors and a lot of indicators.

I have always problems with smooth calculation of all charts.
My PC is a Pentium i7-920 with 4+4 cores, BUT NT uses only ONE core!!

NT8 --- MUST --- support all available cores.

This is absolutely necessary!!!!!!!!

I write this today because I choose an additional indicator and again all charts stutter.
So, trading is almost impossible.


Best

In the meantime bear in mind that many indicators are coded in a manner that extravagantly wastes CPU resources. Reductions of 2 to 3 ORDERS OF MAGNITUDE are often possible. If it wasn't coded by Gomi, Fat Tails, or me, be wary.

If you are driving your car 500 miles to go around the block, a faster car is not the best solution.

"If we don't loosen up some money, this sucker is going down." -GW Bush, 2008
“Lack of proof that something is true does not prove that it is not true - when you want to believe.” -Humpty Dumpty, 2014
“The greatest shortcoming of the human race is our inability to understand the exponential function.”
Prof. Albert Bartlett
Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #604 (permalink)
 
wldman's Avatar
 wldman 
Chicago Illinois USA
Legendary Market Wizard
 
Experience: Advanced
Broker: IB, ToS
Trading: /ES, US Equities/Options
Frequency: Several times daily
Duration: Hours
Posts: 3,507 since Aug 2011
Thanks Given: 2,046
Thanks Received: 9,491


Zondor View Post
@andorre said


In the meantime bear in mind that many indicators are coded in a manner that extravagantly wastes CPU resources. Reductions of 2 to 3 ORDERS OF MAGNITUDE are often possible. If it wasn't coded by Gomi, Fat Tails, or me, be wary.

If you are driving your car 500 miles to go around the block, a faster car is not the best solution.

I wanted to be a smart ass and say obviously you need some more charts and monitors and indicators or trading will continue to be impossible.

Then I realized everything on my screen is coded or improved by one of the three mentioned and they are not making smart assed remarks, so I'll avoid doing so.

Visit my NexusFi Trade Journal Reply With Quote
  #605 (permalink)
 
Jura's Avatar
 Jura   is a Vendor
 
Posts: 775 since Apr 2010
Thanks Given: 2,352
Thanks Received: 690


greenroomhoo View Post
in one of Ray's futures.io (formerly BMT) webinars he said timing for N8 was "sometime during 2013". Does anyone have any sense if that is still the case?

I'm curious to hear if there is any unofficial release date communicated recently. Anyone has more on that?

Reply With Quote
  #606 (permalink)
 ericson 
Sacramento, CA
 
Experience: Advanced
Platform: NinjaTrader
Broker: NA
Trading: Stocks, Forex
Posts: 64 since Nov 2013
Thanks Given: 14
Thanks Received: 19

Hello all,

I would really like to have something which can reload ninjascript from strategy/chart from a strategy or something to dynamically add instruments while running a strategy!!

Also some easy way to save variables into file to use for strategy iterations ( variables get lost after consecutive onbarupdates or whatever).



Thank you!!

Reply With Quote
  #607 (permalink)
 
kronie's Avatar
 kronie 
NYC + NY / USA
 
Experience: Advanced
Platform: "I trade, therefore, I AM!"; Theme Song: "Atomic Dog!"
Trading: EMD, 6J, ZB
Posts: 796 since Oct 2009


ratfink View Post
Users and developers have spent the last 30 years defeating Moore's Law with bad software and poor choices. I see no reason for this to change with either 100 cores and active threads or TeraHertz clocks. The problem is nearly always bad software, usually badly coded or unrealistic indicators or data source frequencies, or bad choices of what to look at or how to look at it. NT7 is not the problem, I can run 8 workspaces and 140 charts with 100 indicators for 2% of an i7, and support other-world systems. Only my head explodes, so I've stopped doing it, the system just laughs.

I want the multi-core support too, for now I just write my own threads, it's mainly the graphics library that blocks it for NT, but it won't solve any problems, just make things sweeter.

For now I suggest you think carefully about the value of each instrument/time series and indicator that you use, and evaluate what they really give you towards each trade that you execute.

I have my roots planted firmly in programming, of the ancient san-scrit mainframe languages, and while I could keep up with what you were saying and trying to convey, I seriously doubt even the modern day programmers and self taught programmers knew even two sentences of what you just said

I also doubt, whether most will understand that when you rattled off the notion of "time series" really means which bar type is chosen on any particular chart as an interval. You could easily have spent three or four (minimally) 8 sentence paragraphs explaining that brief barrage of "what's wrong".

its outstanding that you were able to program and redesign all your indicators and not let in not one badly written one. Actually most of those freely and paid available indicators are hack jobs of cut and paste and tweaked spaghetti. One participant on these threads, every so often reverse engineers these same indicators and improves them to the same point of high efficiency you spoke of. But that's just one guy.

what I found of particular interest was your comment regarding the graphics library blocking something, presume-ably usage of any available multiple core processors.

given the state of affairs, and the already understood notion that NT8 will invalidate all previous and prior written indicators, this very same issue might have already been forced to the fore and addressed.

who's to say. Ray, care to step in here?

Reply With Quote
  #608 (permalink)
 
kronie's Avatar
 kronie 
NYC + NY / USA
 
Experience: Advanced
Platform: "I trade, therefore, I AM!"; Theme Song: "Atomic Dog!"
Trading: EMD, 6J, ZB
Posts: 796 since Oct 2009


ratfink View Post
The problems you describe are common for all of us, the main NT7 event and chart code loop is by default single-threaded, largely restricted by the Windows graphics and GUI library that it uses. Current Ninja only really makes much use of the extra cores when backtesting, although this is not an area I use. My own threads are used for independent stuff, e.g. special work, centralised logging, off-platform I/O, etc where I can safely control all issues.

What you see in the TM is that independent processes rather than threads can appear to make better use of the other cores, but of course they suffer other overheads.

In most cases when NT is running slowly it is caused by poor quality (i.e. inefficient) indicator code, or using a lot of cpu intensive data sources (e.g. tick or custom bar type charts,) which is why I suggest you make an evaluation. For example you could run record market data for a day and then run a series of high-speed tests using the recorded data, each time removing one of the indicators or one of the charts and measuring the impact to identify the main culprits. (NB I haven't used that approach, but I'd be interested if it helps )

There are also several threads on futures.io (formerly BMT) on Ninja tuning and other performance tips that are worth a search for.

Cheers


implementation of a RamDisk of 5GB or larger dedicated solely to NT7.x db file really helps. Moving the other sub-directories helps, such as the log and error files too.

Reply With Quote
  #609 (permalink)
 andorre 
Cologne/Germany
 
Experience: Advanced
Platform: NinjaTrader
Trading: FDAX, YM
Posts: 41 since Oct 2011
Thanks Given: 17
Thanks Received: 9

I have to increase my complaints about NT7:

Within the last weeks I observe that NT7 stops to show the data flow, as soon as I start another program with say 3 cores.
Hence, if the other program works for 1 hour, all charts stop; if the other program ends all charts start to show the data from the last hour.
There is not only stuttering (which makes trading already difficult) as I wrote earlier.
My PC is an 8-core-i920 processor, NT7 uses 1 core (the browser about 1 additional core).
Hence, I can't do an additional job parallel because NT7 stops working at all.
I had to buy a second PC. Ridiculous!

Hopefully some NT guys read this and solve this problem in NT8.

Reply With Quote
  #610 (permalink)
 
ratfink's Avatar
 ratfink 
Birmingham UK
Market Wizard
 
Experience: Intermediate
Platform: NinjaTrader
Broker: TST/Rithmic
Trading: YM/Gold
Posts: 3,633 since Dec 2012
Thanks Given: 17,423
Thanks Received: 8,425



andorre View Post
I have to increase my complaints about NT7:

Within the last weeks I observe that NT7 stops to show the data flow, as soon as I start another program with say 3 cores.
Hence, if the other program works for 1 hour, all charts stop; if the other program ends all charts start to show the data from the last hour.
There is not only stuttering (which makes trading already difficult) as I wrote earlier.
My PC is an 8-core-i920 processor, NT7 uses 1 core (the browser about 1 additional core).
Hence, I can't do an additional job parallel because NT7 stops working at all.
I had to buy a second PC. Ridiculous!

Hopefully some NT guys read this and solve this problem in NT8.

No disrespect intended, but it's not a great idea to run any other heavy duty programs on a trading box anyway. Regardless of cpu core usage, Windows will still crap anything out once they start fighting for other resources like caches, ram or disk as well.

Travel Well
Visit my NexusFi Trade Journal Reply With Quote




Last Updated on December 24, 2023


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts