NexusFi: Find Your Edge


Home Menu

 





Does NT8 use all Cores/Threads when backtesting?


Discussion in NinjaTrader

Updated
      Top Posters
    1. looks_one TAJTrades with 5 posts (2 thanks)
    2. looks_two userque with 2 posts (0 thanks)
    3. looks_3 Brad T with 1 posts (1 thanks)
    4. looks_4 awesomizer with 1 posts (0 thanks)
    1. trending_up 1,958 views
    2. thumb_up 3 thanks given
    3. group 3 followers
    1. forum 9 posts
    2. attach_file 0 attachments




 
Search this Thread

Does NT8 use all Cores/Threads when backtesting?

  #1 (permalink)
TAJTrades
Here, GA
 
Posts: 158 since Jun 2009
Thanks Given: 1
Thanks Received: 86

Does NT8 use all the computer resources when optimizing / Strategy Analyzer?

I have an 8 Core / 16 Thread CPU, X570 Mobo and SSD. When looking at the Task Manager it appears that NT8 is only using 2 Cores / 4 Threads when running an optimization. This was confirmed when I looked at AI Suite 3. It does not appear to be Thermal Throttling as temps are nowhere close to the danger zone. Total CPU Utilization is always under 10%. Is this normal? Or has something gone wrong with my system? I also noticed the same thing when using Market Analyzer for an EOD Stock Screener. I have never noticed this before.

Seems like a waste of money for a dedicated NT8 machine upgrade.

If someone wants to try to duplicate I was optimizing the stock strategy 'Sample MA crossover' on the SP500 Select All.

Reply With Quote

Can you help answer these questions
from other members on NexusFi?
Build trailing stop for micro index(s)
Psychology and Money Management
The space time continuum and the dynamics of a financial …
Emini and Emicro Index
Deepmoney LLM
Elite Quantitative GenAI/LLM
NexusFi Journal Challenge - April 2024
Feedback and Announcements
Exit Strategy
NinjaTrader
 
Best Threads (Most Thanked)
in the last 7 days on NexusFi
Get funded firms 2023/2024 - Any recommendations or word …
59 thanks
Funded Trader platforms
36 thanks
NexusFi site changelog and issues/problem reporting
25 thanks
GFIs1 1 DAX trade per day journal
19 thanks
The Program
18 thanks
  #2 (permalink)
 
awesomizer's Avatar
 awesomizer 
Portage, MI
 
Experience: Intermediate
Platform: Bookmap, Tradingview
Trading: NQ
Posts: 82 since Nov 2020
Thanks Given: 219
Thanks Received: 63

I have a 8 core cpu too and it does the same thing

Reply With Quote
  #3 (permalink)
patricia
Berlin Germany
 
Posts: 113 since Jul 2020
Thanks Given: 9
Thanks Received: 100


see my reply on [AUTOLINK]Ninjatrader[/AUTOLINK] support forum

looking forward to comments

Reply With Quote
  #4 (permalink)
TAJTrades
Here, GA
 
Posts: 158 since Jun 2009
Thanks Given: 1
Thanks Received: 86

NT Forum gave a long reply. I went through it and nothing seemed to help. And I have no idea why NT8 is not using all available resources.

For what it is worth the machine is:

Ryzen 7 3700X
Asus Tuf Gaming X570 plus
Western Digital SSD 500 Gb
Corsair Vengance LPX DDR4 3600

Not finding any joy with NT right now. Maybe I will figure it out.

https://forum.ninjatrader.com/forum/ninjatrader-8/platform-technical-support-aa/1128700-does-nt8-use-all-cores-threads-when-backtesting

Reply With Quote
  #5 (permalink)
userque
Chicago IL
 
Posts: 180 since Apr 2016
Thanks Given: 573
Thanks Received: 129


TAJTrades View Post
Does NT8 use all the computer resources when optimizing / Strategy Analyzer?

I have an 8 Core / 16 Thread CPU, X570 Mobo and SSD. When looking at the Task Manager it appears that NT8 is only using 2 Cores / 4 Threads when running an optimization. This was confirmed when I looked at AI Suite 3. It does not appear to be Thermal Throttling as temps are nowhere close to the danger zone. Total CPU Utilization is always under 10%. Is this normal? Or has something gone wrong with my system? I also noticed the same thing when using Market Analyzer for an EOD Stock Screener. I have never noticed this before.

Seems like a waste of money for a dedicated NT8 machine upgrade.

If someone wants to try to duplicate I was optimizing the stock strategy 'Sample MA crossover' on the SP500 Select All.

NT seems to process one instrument at a time. So I don't think doing a batch run will encourage it to use more cores.

I believe it depends more so on the complexity of the strategy, and/or the difficulty in finding 'good' parameters for the strategy.

I normally get utilizations >80% for my optimizations. (4Ghz, 4 core gaming notebook)

I ran the Sample MA crossover, 1-200,1 for both fast and slow, default optimizer, SPY, 1/1/2019-11/22/2020;
and I was able to see the CPU go over 50% before it quickly finished the optimization.

You haven't revealed which optimizer you used, nor etc.; but maybe try what I tried, and see if your usage goes up.

Reply With Quote
  #6 (permalink)
TAJTrades
Here, GA
 
Posts: 158 since Jun 2009
Thanks Given: 1
Thanks Received: 86

The same. SampleMACrossover.

Backtest Type: Optimization
Fast: 10 : 10 : 1
Slow: 25 : 50 : 5
Instrument: SP 500 | Select All
Type: Day
Start Date: 01/01/2000
Trading Hours: US Equities RTH

Reply With Quote
  #7 (permalink)
userque
Chicago IL
 
Posts: 180 since Apr 2016
Thanks Given: 573
Thanks Received: 129


TAJTrades View Post
The same. SampleMACrossover.

Backtest Type: Optimization
Fast: 10 : 10 : 1
Slow: 25 : 50 : 5
Instrument: SP 500 | Select All
Type: Day
Start Date: 01/01/2000
Trading Hours: US Equities RTH

Try it with my settings.
1:200:1 for fast and slow
SPY
1/1/2019

Reply With Quote
  #8 (permalink)
TAJTrades
Here, GA
 
Posts: 158 since Jun 2009
Thanks Given: 1
Thanks Received: 86

I went thru my code and confirmed that I had followed NT Best Practices. I have.
Then I started to think if I had changed any Windows 10 Pro settings that might have created the problem. Then I remembered that a few weeks ago I Updated the Bios. So I got into the Bios and Cliked the 'Set Defaults' option . Rebooted and started NT8. Strategy Analyzer worked has expected, single instrument optimization firing on all cores and CPU Utilization running 70's and low 80'.s. Batch Test Optimization ( SP 500 | Select All) was firing all cores with CPU Utilization in the high 40's.

So I am guessing that some setting while Flashing the Bios did not catch. Or when I was looking around the Bios screens I accidentally changed a setting. This was probably causing Windows issues and it flowed down to NT8 while the computer was under heavy load. I have no idea what setting(s) was the culprit.

If anyone following this thread is experiencing the same issues you can not rule out the Bios as a potential problem. Either from Flashing the Bios, Over Clocking or changing any Bios Settings.

Reply With Quote
Thanked by:
  #9 (permalink)
 
Brad T's Avatar
 Brad T 
Langhorne, Pennsylvania
 
Experience: Advanced
Platform: Ninjatrader, Nadex
Broker: Ninjatrader Brokerage, Interactive Brokers, TD Ameritrade, Robinhood
Trading: Emini NQ, YM, ES, CL, GC, NG
Posts: 6 since Feb 2020
Thanks Given: 2
Thanks Received: 2

Not sure if this will help anyone... But I got mixed results. I have 3 different machines with NT8. 2/3 machines reached 75%+ utilization when running the optimizer. My 3rd machine reached only about 15% utilization.



Here is what I found:

First Machine:
CPU: x2 Intel Xeon 8-core , 16 cores total
OS: Windows 10
Peak Utilization: 81%

Second Machine:
CPU: Intel Xeon 10-core
OS: Windows Server Standard 2019
Peak Utilization: 76%


Third Machine:
CPU: 4-core Intel i7 CPU
Windows 10 (Bootcamp'd Macbook Pro 15 2017)
Peak Utilization: 15%



I tried some of my own strategies, and also tried the settings recommended by Userque. Similar results for each test.

Have you tried doing a fresh install of NT8? I've run into issues like this in the past (Especially after updates) and reinstalling seemed to fix a lot.


Best of luck

Reply With Quote
Thanked by:
  #10 (permalink)
TAJTrades
Here, GA
 
Posts: 158 since Jun 2009
Thanks Given: 1
Thanks Received: 86


Thanks for the info.

Have you tried loading up Market Analyzer with 3000+ stock and ETF Symbols? I was trying to use the Market Analyzer as an EOD Stock Screener. It is hit or miss with me. Sometimes there is high Cap Utilization sometimes not so much.

I think it would be helpful if the Brain Trust of Futures IO would create a standard Strategy for people to use and post results ( elapsed time, Cap Utilization....) as will as specs of their rig(CPU, MOBO, Storage, GPU). I have a feeling that some HW setups perform much better than others. I just don't now what they are.

Reply With Quote
Thanked by:




Last Updated on November 30, 2020


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts