NexusFi: Find Your Edge


Home Menu

 





NT8 optimization fills 100% of physical memory then crashes


Discussion in NinjaTrader

Updated
      Top Posters
    1. looks_one paulrobert with 7 posts (1 thanks)
    2. looks_two rleplae with 6 posts (0 thanks)
    3. looks_3 Big Mike with 1 posts (2 thanks)
    4. looks_4 dstrader with 1 posts (1 thanks)
    1. trending_up 6,816 views
    2. thumb_up 4 thanks given
    3. group 10 followers
    1. forum 20 posts
    2. attach_file 1 attachments




 
Search this Thread

NT8 optimization fills 100% of physical memory then crashes

  #11 (permalink)
paulrobert
Arlington VA
 
Posts: 11 since Feb 2017
Thanks Given: 0
Thanks Received: 2

NanoScalper


Sent from my iPhone using futures.io

Reply With Quote

Can you help answer these questions
from other members on NexusFi?
PowerLanguage & EasyLanguage. How to get the platfor …
EasyLanguage Programming
ZombieSqueeze
Platforms and Indicators
Exit Strategy
NinjaTrader
How to apply profiles
Traders Hideout
REcommedations for programming help
Sierra Chart
 
Best Threads (Most Thanked)
in the last 7 days on NexusFi
Just another trading journal: PA, Wyckoff & Trends
31 thanks
Spoo-nalysis ES e-mini futures S&P 500
28 thanks
Tao te Trade: way of the WLD
24 thanks
Bigger Wins or Fewer Losses?
20 thanks
GFIs1 1 DAX trade per day journal
17 thanks
  #12 (permalink)
 
rleplae's Avatar
 rleplae 
Gits (Hooglede) Belgium
Legendary Market Wizard
 
Experience: Master
Platform: NinjaTrader, Proprietary,
Broker: Ninjabrokerage/IQfeed + Synthetic datafeed
Trading: 6A, 6B, 6C, 6E, 6J, 6S, ES, NQ, YM, AEX, CL, NG, ZB, ZN, ZC, ZS, GC
Posts: 3,003 since Sep 2013
Thanks Given: 2,442
Thanks Received: 5,863


paulrobert View Post
NanoScalper


Sent from my iPhone using futures.io

Ask the vendor to do the same thing and confirm if an issue or not on his side

Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
  #13 (permalink)
 dstrader 
Chicago, USA
 
Experience: Advanced
Platform: TS, NT, TOS, SSE, IRT
Trading: ES, currency futures, options, stocks
Posts: 195 since Dec 2010
Thanks Given: 330
Thanks Received: 275



paulrobert View Post
I am attempting to run an NT8 optimization on a fully-automated strategy called NanoScalper.I have an Intel i7, SSD, and 32 GB of RAM.

Regardless of the number of iterations, the physical memory used climbs to around 100% at which point NT8 crashes. The CPU usage spikes and eventually returns to around 5%, but the physical memory % never decreases.

I have considerably more processing power than what is recommended for NT8, so I am trying to figure out if I need to change a setting within the application.

Thanks in advance!

Paul


I believe this to be a bug with NT8.
I noticed the same with several of my strategies that I upgraded to NT 8.
I haven't filed the issue with NT yet. As a workaround, I don't put an extreme level of variables in the strategy to optimize (work 3 or 4 variables each time, with not too many iterations).
After running several times, I need to exit NT8 and come back in, so it will release the memory.

Reply With Quote
Thanked by:
  #14 (permalink)
paulrobert
Arlington VA
 
Posts: 11 since Feb 2017
Thanks Given: 0
Thanks Received: 2

Interesting. I appreciate your help.


Sent from my iPhone using futures.io

Reply With Quote
Thanked by:
  #15 (permalink)
 cls71 
Madrid, Spain
 
Experience: Advanced
Platform: NinjaTrader
Broker: NinjaTrader Brokerage
Trading: ES
Posts: 18 since Oct 2009
Thanks Given: 7
Thanks Received: 14

If the strategy (or any called indicator) uses drawing elements with individual labels, remove all drawing elements in the code.

This problem I had in version 8.0.3, I do not know if it will already be fixed in 8.0.4, I have not yet migrated.

Reply With Quote
  #16 (permalink)
hmgl
Shanghai,China
 
Posts: 3 since Aug 2016
Thanks Given: 1
Thanks Received: 0

I encountered the same problem today. 4-parameters strategy with the built-in strategy builder.

Reply With Quote
  #17 (permalink)
 sienna 
Melbourne, Australia
 
Experience: Beginner
Platform: Ninja Trader
Broker: Ninjatrader Brokerage
Trading: Many
Frequency: Several times daily
Duration: Minutes
Posts: 162 since May 2012
Thanks Given: 281
Thanks Received: 124

Hi,
I also had this problem for a few months which drove me nuts and almost had me quitting NT. I have cured it (so far anyway) by doing this:

- Open a new chart and progressively add indicators, until I identified which one gave me problems
- When I have multiple work spaces open I always have one work space with one simple chart only. So no indicators 5 days of data (someting small)...lets call it Workspace A. Then when I close down NT8 I always close every workspace, until I get to the Workspace A, leave that open and then close NT8. So when it re-opens, that Workspace A is the first to start up. Another FIO member gave that tip and it works
- The usual other platform maintenance, re DB Folder.

Now, I think that if a platform is this 'sensitive' there is something not right with the product.

best
S

Reply With Quote
  #18 (permalink)
lmatiukas
Washington DC
 
Posts: 1 since Jun 2015
Thanks Given: 0
Thanks Received: 0

Figured I post here, since there is a memory dump issue for sure with NT8 when running large strategies or optimization. I went from 32 GB to 64 GB ram, and it doesn't matter - it will fill to 100% and slow computer to a crawl - or crash if you try to be "fast". At 16 GB NT8 used to crash, but it was also the previous version, so that may have been addressed (crash issue itself). Now I just click close and wait literally 5 minutes to respond, and once NT8 closes, the speed returns, as physical Ram is released.

What I did was to sync my NT8 folder, and AFTER I closed NT8, I noticed hundreds of files created in my synced google drive folder. Upon closure, NT8 deletes all those files, and so it seems like it just keeps creating and opening more and more files forever in the background, without closing them.

My theory is that WHILE NT8 is running all those files (let's say a strategy for 500+ stocks) continually updates minute data, but rather than opening the new minute data, it also keeps the previous file open. It's a single stock, it should have ONE file that updates, and instead, it creates a new file for every data point it seems - and they must be all being accessed. I'd attach a screenshot of what my sync folder looks like, versus what NT8 folder looks like. However, these files are created in this folder:

DRIVE:\Documents\NinjaTrader 8\db\cache\US Equities RTH.Eastern Standard Time\MINUTE

Open any ticker, and you will see the insanity that ensues, as the program runs longer, until seemingly every file is open as more are being created and left open.

So.... not viable still for continuous usage sadly =(

Reply With Quote
  #19 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,442 since Jun 2009
Thanks Given: 33,215
Thanks Received: 101,603

Should tag @NinjaTrader and open a support ticket, maybe this is a bug instead of by design.

Sent using the NexusFi mobile app

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #20 (permalink)
ycomp
Europe-ish
 
Posts: 177 since Sep 2013
Thanks Given: 12
Thanks Received: 58


This might be related but off-topic:

I thought I read a thread here somewhere that was a how to guide on this forum to fixing NinjaTrader to get rid of performance / ram issues. Does anyone have a link?

Reply With Quote




Last Updated on December 12, 2018


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts