NT8 optimization fills 100% of physical memory then crashes - futures io
futures io futures trading



NT8 optimization fills 100% of physical memory then crashes


Discussion in NinjaTrader

Updated by pnguyen720
      Top Posters
    1. looks_one paulrobert with 7 posts (1 thanks)
    2. looks_two rleplae with 6 posts (0 thanks)
    3. looks_3 Big Mike with 1 posts (2 thanks)
    4. looks_4 dstrader with 1 posts (1 thanks)
    1. trending_up 2,934 views
    2. thumb_up 4 thanks given
    3. group 10 followers
    1. forum 20 replies
    2. attach_file 1 attachments




Welcome to futures io: the largest futures trading community on the planet, with well over 100,000 members
  • Genuine reviews from real traders, not fake reviews from stealth vendors
  • Quality education from leading professional traders
  • We are a friendly, helpful, and positive community
  • We do not tolerate rude behavior, trolling, or vendors advertising in posts
  • We are here to help, just let us know what you need
You'll need to register in order to view the content of the threads and start contributing to our community.  It's free and simple.

-- Big Mike, Site Administrator

(If you already have an account, login at the top of the page)

 
Thread Tools Search this Thread
 

NT8 optimization fills 100% of physical memory then crashes

  #11 (permalink)
Arlington VA
 
 
Posts: 11 since Feb 2017
Thanks: 0 given, 2 received

NanoScalper


Sent from my iPhone using futures.io

Reply With Quote

Can you help answer these questions
from other members on futures io?
Convert NinjaTrader NT7 indicator to Tradestation EasyLanguage and RADARSCREEN
Platforms and Indicators
Issue meeting order entry conditions
Elite Automated NinjaTrader Trading
Last 5 minutes Label
ThinkOrSwim
Moving average with Lag reduction
NinjaTrader
Linux?
ThinkOrSwim
 
 
  #12 (permalink)
Gits (Hooglede) Belgium
 
Experience: Master
Platform: NinjaTrader, Proprietary,
Broker: Ninjabrokerage/IQfeed + Synthetic datafeed
Trading: 6A, 6B, 6C, 6E, 6J, 6S, ES, NQ, YM, AEX, CL, NG, ZB, ZN, ZC, ZS, GC
 
rleplae's Avatar
 
Posts: 2,990 since Sep 2013
Thanks: 2,437 given, 5,791 received


paulrobert View Post
NanoScalper


Sent from my iPhone using futures.io

Ask the vendor to do the same thing and confirm if an issue or not on his side

Follow me on Twitter Visit my Facebook Visit my futures io Trade Journal Reply With Quote
 
  #13 (permalink)
Chicago, USA
 
Experience: Advanced
Platform: TS, NT, TOS, SSE, IRT
Trading: ES, currency futures, options, stocks
 
Posts: 195 since Dec 2010
Thanks: 328 given, 264 received



paulrobert View Post
I am attempting to run an NT8 optimization on a fully-automated strategy called NanoScalper.I have an Intel i7, SSD, and 32 GB of RAM.

Regardless of the number of iterations, the physical memory used climbs to around 100% at which point NT8 crashes. The CPU usage spikes and eventually returns to around 5%, but the physical memory % never decreases.

I have considerably more processing power than what is recommended for NT8, so I am trying to figure out if I need to change a setting within the application.

Thanks in advance!

Paul


I believe this to be a bug with NT8.
I noticed the same with several of my strategies that I upgraded to NT 8.
I haven't filed the issue with NT yet. As a workaround, I don't put an extreme level of variables in the strategy to optimize (work 3 or 4 variables each time, with not too many iterations).
After running several times, I need to exit NT8 and come back in, so it will release the memory.

Reply With Quote
The following user says Thank You to dstrader for this post:
 
  #14 (permalink)
Arlington VA
 
 
Posts: 11 since Feb 2017
Thanks: 0 given, 2 received

Interesting. I appreciate your help.


Sent from my iPhone using futures.io

Reply With Quote
The following user says Thank You to paulrobert for this post:
 
  #15 (permalink)
Madrid, Spain
 
Experience: Advanced
Platform: NinjaTrader
Broker: NinjaTrader Brokerage
Trading: ES
 
Posts: 18 since Oct 2009
Thanks: 7 given, 14 received

If the strategy (or any called indicator) uses drawing elements with individual labels, remove all drawing elements in the code.

This problem I had in version 8.0.3, I do not know if it will already be fixed in 8.0.4, I have not yet migrated.

Reply With Quote
 
  #16 (permalink)
Shanghai,China
 
 
Posts: 3 since Aug 2016
Thanks: 1 given, 0 received

It actually freezes when the memory is full

I encountered the same problem today. 4-parameters strategy with the built-in strategy builder.

Reply With Quote
 
  #17 (permalink)
Melbourne, Australia
 
Experience: Beginner
Platform: Ninja Trader
Broker: Ninjatrader Brokerage
Trading: Many
 
Posts: 113 since May 2012
Thanks: 102 given, 67 received

Hi,
I also had this problem for a few months which drove me nuts and almost had me quitting NT. I have cured it (so far anyway) by doing this:

- Open a new chart and progressively add indicators, until I identified which one gave me problems
- When I have multiple work spaces open I always have one work space with one simple chart only. So no indicators 5 days of data (someting small)...lets call it Workspace A. Then when I close down NT8 I always close every workspace, until I get to the Workspace A, leave that open and then close NT8. So when it re-opens, that Workspace A is the first to start up. Another FIO member gave that tip and it works
- The usual other platform maintenance, re DB Folder.

Now, I think that if a platform is this 'sensitive' there is something not right with the product.

best
S

Reply With Quote
 
  #18 (permalink)
Washington DC
 
 
Posts: 1 since Jun 2015
Thanks: 0 given, 0 received

NT8 file management issue it seems

Figured I post here, since there is a memory dump issue for sure with NT8 when running large strategies or optimization. I went from 32 GB to 64 GB ram, and it doesn't matter - it will fill to 100% and slow computer to a crawl - or crash if you try to be "fast". At 16 GB NT8 used to crash, but it was also the previous version, so that may have been addressed (crash issue itself). Now I just click close and wait literally 5 minutes to respond, and once NT8 closes, the speed returns, as physical Ram is released.

What I did was to sync my NT8 folder, and AFTER I closed NT8, I noticed hundreds of files created in my synced google drive folder. Upon closure, NT8 deletes all those files, and so it seems like it just keeps creating and opening more and more files forever in the background, without closing them.

My theory is that WHILE NT8 is running all those files (let's say a strategy for 500+ stocks) continually updates minute data, but rather than opening the new minute data, it also keeps the previous file open. It's a single stock, it should have ONE file that updates, and instead, it creates a new file for every data point it seems - and they must be all being accessed. I'd attach a screenshot of what my sync folder looks like, versus what NT8 folder looks like. However, these files are created in this folder:

DRIVE:\Documents\NinjaTrader 8\db\cache\US Equities RTH.Eastern Standard Time\MINUTE

Open any ticker, and you will see the insanity that ensues, as the program runs longer, until seemingly every file is open as more are being created and left open.

So.... not viable still for continuous usage sadly =(

Reply With Quote
 
  #19 (permalink)
Site Administrator
Manta, Ecuador
 
Experience: Advanced
Platform: My own custom solution
Trading: Emini Futures
 
Big Mike's Avatar
 
Posts: 48,729 since Jun 2009
Thanks: 31,462 given, 94,000 received

Should tag @NinjaTrader and open a support ticket, maybe this is a bug instead of by design.

Sent using the futures.io mobile app

We're here to help -- just ask

For the best trading education, watch our webinars
Searching for trading reviews? Review this list

Follow us on Twitter, YouTube, and Facebook

Support our community as an Elite Member:
https://futures.io/elite/
Follow me on Twitter Visit my Facebook Visit my futures io Trade Journal Reply With Quote
The following 2 users say Thank You to Big Mike for this post:
 
  #20 (permalink)
Shanghai
 
 
Posts: 162 since Sep 2013
Thanks: 10 given, 44 received


This might be related but off-topic:

I thought I read a thread here somewhere that was a how to guide on this forum to fixing NinjaTrader to get rid of performance / ram issues. Does anyone have a link?

Reply With Quote



futures io Trading Community Platforms and Indicators NinjaTrader > NT8 optimization fills 100% of physical memory then crashes




Upcoming Webinars and Events
 

Understanding Order Flow Stop Runs & Icebergs w/Bookmap

May 28
 

Free BloodHound Licenses to everyone!

June
     



Copyright © 2020 by futures io, s.a., Av Ricardo J. Alfaro, Century Tower, Panama, +507 833-9432, info@futures.io
All information is for educational use only and is not investment advice.
There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
no new posts