Speeding up NinjaTrader with a RAM drive (ramdisk) - NinjaTrader | futures io social day trading
futures io futures trading


Speeding up NinjaTrader with a RAM drive (ramdisk)
Updated: Views / Replies:25,326 / 110
Created: by pawnbroker Attachments:6

Welcome to futures io.

(If you already have an account, login at the top of the page)

futures io is the largest futures trading community on the planet, with over 90,000 members. At futures io, our goal has always been and always will be to create a friendly, positive, forward-thinking community where members can openly share and discuss everything the world of trading has to offer. The community is one of the friendliest you will find on any subject, with members going out of their way to help others. Some of the primary differences between futures io and other trading sites revolve around the standards of our community. Those standards include a code of conduct for our members, as well as extremely high standards that govern which partners we do business with, and which products or services we recommend to our members.

At futures io, our focus is on quality education. No hype, gimmicks, or secret sauce. The truth is: trading is hard. To succeed, you need to surround yourself with the right support system, educational content, and trading mentors – all of which you can find on futures io, utilizing our social trading environment.

With futures io, you can find honest trading reviews on brokers, trading rooms, indicator packages, trading strategies, and much more. Our trading review process is highly moderated to ensure that only genuine users are allowed, so you don’t need to worry about fake reviews.

We are fundamentally different than most other trading sites:
  • We are here to help. Just let us know what you need.
  • We work extremely hard to keep things positive in our community.
  • We do not tolerate rude behavior, trolling, or vendors advertising in posts.
  • We firmly believe in and encourage sharing. The holy grail is within you, we can help you find it.
  • We expect our members to participate and become a part of the community. Help yourself by helping others.

You'll need to register in order to view the content of the threads and start contributing to our community.  It's free and simple.

-- Big Mike, Site Administrator

Reply
 6  
 
Thread Tools Search this Thread
 

Speeding up NinjaTrader with a RAM drive (ramdisk)

  #91 (permalink)
Banned: trolling
NYC + NY / USA
 
Futures Experience: Advanced
Platform: "I trade, therefore, I AM!"; Theme Song: "Atomic Dog!"
Favorite Futures: EMD, 6J, ZB
 
kronie's Avatar
 
Posts: 798 since Oct 2009
Thanks: 216 given, 498 received


Big Mike View Post
Yes. BTW, after more uptime my cache hit ratio is 75%

Sent from my LG Optimus G Pro

@bigmike


I left a few Q's as replies, above, please see if there's an answer.

I got instructions from one of the vendors, that said, the first step with a ramdisk was to create an image file, then create or allocate the available or desired additional ram as a ramdisk and associate that ram to that image, then proceed.

this detail is important, as it has something more to do with linkage and save/restore features. did you encounter this issue?

(btw - on a very serious note! congrats on achieving your goals early (under 40's) in life and in moving to where you have already found your peace! We all wish to achieve similar results, but you actually did, so we live vicariously through your experience!)

Reply With Quote
 
  #92 (permalink)
Elite Member
@ Germany
 
Futures Experience: Beginner
Platform: NinjaTrader
Broker/Data: Mirus Futures/Zen-Fire
Favorite Futures: FDAX
 
Posts: 441 since Nov 2011
Thanks: 254 given, 369 received

I also use an ramdisk but i don't know in detail if the windows file cache system exclude the files at the ramdisk. I know that there is a flag (Win32_Volume|DriveType|6) in the internals that mark a volume as ramdisk, but i'm not sure if the cache subsystem take care of that (don't cache anything from that volume!!!!). Has anyone more knowledge about that topic?

Releated to BigMike's solution i've looked at the product and read that this work's as a sector level cache. Due to the lower level interface i think that the file cache is still active.

Reply With Quote
 
  #93 (permalink)
Site Administrator
Manta, Ecuador
 
Futures Experience: Advanced
Platform: My own custom solution
Favorite Futures: E-mini ES S&P 500
 
Big Mike's Avatar
 
Posts: 46,240 since Jun 2009
Thanks: 29,354 given, 83,237 received


My recommendation is not to use the ramdisk, but instead to use PrimoCache. There is a free trial.

Mike

Due to time constraints, please do not PM me if your question can be resolved or answered on the forum.

Need help?
1) Stop changing things. No new indicators, charts, or methods. Be consistent with what is in front of you first.
2) Start a journal and post to it daily with the trades you made to show your strengths and weaknesses.
3) Set goals for yourself to reach daily. Make them about how you trade, not how much money you make.
4) Accept responsibility for your actions. Stop looking elsewhere to explain away poor performance.
5) Where to start as a trader? Watch this webinar and read this thread for hundreds of questions and answers.
6)
Help using the forum? Watch this video to learn general tips on using the site.

If you want
to support our community, become an Elite Member.

Reply With Quote
 
  #94 (permalink)
Banned: trolling
NYC + NY / USA
 
Futures Experience: Advanced
Platform: "I trade, therefore, I AM!"; Theme Song: "Atomic Dog!"
Favorite Futures: EMD, 6J, ZB
 
kronie's Avatar
 
Posts: 798 since Oct 2009
Thanks: 216 given, 498 received


Big Mike View Post
My recommendation is not to use the ramdisk, but instead to use PrimoCache. There is a free trial.

Mike

thanks


that's a very good recommendation, after more research, the level-2 cache settings are recommended as being alternate storage, such as an SSD or USB drive (although one has to decide whether that's useful)

ASRock includes a completely unlocked version of a ramdisk implementation that provides auto load, auto save, auto shutdown upon using its implementation. Fortunately they're the mfgr of my mobo(s)

one tech support email response made the instructions mentioned previously in this thread seem childishly simplistic. He stated first one establishes an image file; then a ramdisk and associates that image to it; then begins to profile it.

However, in the use of Ninja with its static location files (essential for operation), these solutions require more steps to implement. One would need to junction selected files and folders within the sub-folder "\db" of the ninja files in order to achieve the performance gains that one trader claimed.

Clearly ninja needs serious re-work to achieve Sierra Charts, AT Traders and other package(s) performance standards and reliability. So many work around(s) and maintenance steps, and the gap having been closed on indicators and complex indicator setups; Ninja is in serious challenge from other packages, and hence, threads like these only serve to detract instead of attract.

I can share more details on this journey, but they only serve to retrace the faults and flaws of using the speed up steps. I am sure there is a working methodology, but it has not been as advertised earlier.

@bigmike; using the UIM (unused memory) just below the 4gb threshhold is useful, however, be prepared for the occasional system BSOD or terminal hang/hung screen. I will say that it was noteworthy that you brought that additional speed up approach to our attention

Reply With Quote
 
  #95 (permalink)
Site Administrator
Manta, Ecuador
 
Futures Experience: Advanced
Platform: My own custom solution
Favorite Futures: E-mini ES S&P 500
 
Big Mike's Avatar
 
Posts: 46,240 since Jun 2009
Thanks: 29,354 given, 83,237 received

I am making the assumption everyone already has an SSD, no hard drives. And that everyone is using x64 Windows with at minimum 8GB of RAM.

If not, you should make those a priority over anything else.

Mike

Due to time constraints, please do not PM me if your question can be resolved or answered on the forum.

Need help?
1) Stop changing things. No new indicators, charts, or methods. Be consistent with what is in front of you first.
2) Start a journal and post to it daily with the trades you made to show your strengths and weaknesses.
3) Set goals for yourself to reach daily. Make them about how you trade, not how much money you make.
4) Accept responsibility for your actions. Stop looking elsewhere to explain away poor performance.
5) Where to start as a trader? Watch this webinar and read this thread for hundreds of questions and answers.
6)
Help using the forum? Watch this video to learn general tips on using the site.

If you want
to support our community, become an Elite Member.

Reply With Quote
 
  #96 (permalink)
Elite Member
@ Germany
 
Futures Experience: Beginner
Platform: NinjaTrader
Broker/Data: Mirus Futures/Zen-Fire
Favorite Futures: FDAX
 
Posts: 441 since Nov 2011
Thanks: 254 given, 369 received

SuperSpeed SuperCache

Due to the loyalty to my current RamDisk software producer SuperSpeed i will check the SuperCache product first, if it can improve my overall performance (for my daily working stuff). It has an interesting mirror mode, which creates a 1:1 copy of a volume into the RAM.

Reply With Quote
 
  #97 (permalink)
Banned: trolling
NYC + NY / USA
 
Futures Experience: Advanced
Platform: "I trade, therefore, I AM!"; Theme Song: "Atomic Dog!"
Favorite Futures: EMD, 6J, ZB
 
kronie's Avatar
 
Posts: 798 since Oct 2009
Thanks: 216 given, 498 received

If you've made it this far, you've gone too far!

Here's help

Attached Thumbnails
Speeding up NinjaTrader with a RAM drive (ramdisk)-link-shell-extentions-creating-juntions.pdf  
Reply With Quote
The following user says Thank You to kronie for this post:
 
  #98 (permalink)
Banned: trolling
NYC + NY / USA
 
Futures Experience: Advanced
Platform: "I trade, therefore, I AM!"; Theme Song: "Atomic Dog!"
Favorite Futures: EMD, 6J, ZB
 
kronie's Avatar
 
Posts: 798 since Oct 2009
Thanks: 216 given, 498 received


Big Mike View Post
My recommendation is not to use the ramdisk, but instead to use PrimoCache. There is a free trial.

Mike

Primo Cache didn't work and crashed my system more than once; operating system. I wasn't able to discern any appreciable improvement in caching or speed of access to the internals of Ninja, hence faster loading and handling times. @bigmike - didn't you move off of Ninja quite sometime ago, and adopted another (superior) or comparable trading / charting system? Perhaps those improvements from that trading platform were able to take advantage of the operating implementation of a super cache.

After some serious work effort and findings, and sloshing through the technical internals and contradictions of what seemingly was a simple endeavour, I will condense my findings here:

A) in the main NinjaTrader directory, I had no success (ninja aborted upon start up) with moving to Ramdisk the sub-directories of:

\\cache
\\templates
\\workspaces
\\tmp

b) in the sub-directory of "\db" the data files, I had success in moving these components to a persistent RamDisk, and verify that they were being preserved during shutdown and restored after start-up (of the operating system)

\NinjaTrader.sdf
\db\cache
\db\data

** note: just having the ".sdf" in ram really sped things up substantially
** note: \workspace -- would be excellent to junction
** note: \templates -- would be double excellent since this is where the hanging occurred

If you have the additional ram to dedicate to a ramdisk, then assigning the entire "\db" file would be easier. This occurs when you have above 8GB overall system ram, because some "\db" sub-directories easily acquire over 12gb themselves, not counting what the GomFolder would be, if you use Gomi stuff. So, a system memory of 16GB would be appropriate, especially when your "\db" is in the 12gb range.


more results to be posted,

one thing so far, is the conclusion that it was all worth the efforts!

Reply With Quote
 
  #99 (permalink)
Site Administrator
Manta, Ecuador
 
Futures Experience: Advanced
Platform: My own custom solution
Favorite Futures: E-mini ES S&P 500
 
Big Mike's Avatar
 
Posts: 46,240 since Jun 2009
Thanks: 29,354 given, 83,237 received


kronie View Post
Primo Cache didn't work and crashed my system more than once; operating system. I wasn't able to discern any appreciable improvement in caching or speed of access to the internals of Ninja, hence faster loading and handling times. @bigmike - didn't you move off of Ninja quite sometime ago, and adopted another (superior) or comparable trading / charting system? Perhaps those improvements from that trading platform were able to take advantage of the operating implementation of a super cache.

Yikes. I'm just guessing it has something to do with your 32-bit OS and <4GB of RAM (if I remember right from your prior posts) and you trying to use the extended area of RAM. None of these apply to me luckily. I have never tried anything like that (using RAM outside the boundary)

Did you look up the blue screen codes and contact the author to see what he said?

I still use Ninja for backtesting, and the point of the cache is really just for Ninja as I don't notice any slow down with any other activities on my system. I would say it has made a considerable improvement, but don't have time right now to do any type of actual benchmarking with it on and off.

Mike

Due to time constraints, please do not PM me if your question can be resolved or answered on the forum.

Need help?
1) Stop changing things. No new indicators, charts, or methods. Be consistent with what is in front of you first.
2) Start a journal and post to it daily with the trades you made to show your strengths and weaknesses.
3) Set goals for yourself to reach daily. Make them about how you trade, not how much money you make.
4) Accept responsibility for your actions. Stop looking elsewhere to explain away poor performance.
5) Where to start as a trader? Watch this webinar and read this thread for hundreds of questions and answers.
6)
Help using the forum? Watch this video to learn general tips on using the site.

If you want
to support our community, become an Elite Member.

Reply With Quote
 
  #100 (permalink)
Banned: trolling
NYC + NY / USA
 
Futures Experience: Advanced
Platform: "I trade, therefore, I AM!"; Theme Song: "Atomic Dog!"
Favorite Futures: EMD, 6J, ZB
 
kronie's Avatar
 
Posts: 798 since Oct 2009
Thanks: 216 given, 498 received



Big Mike View Post
Yikes. I'm just guessing it has something to do with your 32-bit OS and <4GB of RAM (if I remember right from your prior posts) and you trying to use the extended area of RAM. None of these apply to me luckily. I have never tried anything like that (using RAM outside the boundary)

Did you look up the blue screen codes and contact the author to see what he said?

I still use Ninja for backtesting, and the point of the cache is really just for Ninja as I don't notice any slow down with any other activities on my system. I would say it has made a considerable improvement, but don't have time right now to do any type of actual benchmarking with it on and off.

Mike

win 7 x64 ultimate

actually the ramdisk lumps in the 4GB memory stick of the 8GB system memory, with all the other un-accessed memory of the 1st 4GB memory stick, and manages it as one block, surprisingly

fortunately I didn't go as far a BSOD, but the resulting system lock up caused the power button to be the only way of recovery and subsequent invokation of Ninja to be avoided, effectively locking up the system

either way to Sunday, these are in the hind-sight mirror a few miles back.

worthy of note, because Ninja is not consistent and has not been in their reference to files and locations within their directories and sub-directories, simply moving enmasse entire sub-components of these directories does not work. Junctions of a higher level directory "in theory" makes access to any lower level directory redirected. Because of the direct references in code, xml and other means within their code, and other templates, processes and schemas, its next to impossible to move the "bin" master directory to ram. By extention, its impossible to move the entire NT directory structure to ram. However, because of indirect access to the "\db" directories, moving that entire master directory works almost without problems.


more findings to be released, I'm 85% there.



one thing I noticed is when launching or changing or initalizing / serializing a workspace, Ninja gets stuck in a repetitive loop without handlers and as such will remain there adnauseum or for hours unless forced shutdown. watching the handlers and processes shows that pattern

Reply With Quote

Reply



futures io > > > > Speeding up NinjaTrader with a RAM drive (ramdisk)

Thread Tools Search this Thread
Search this Thread:

Advanced Search



Upcoming Webinars and Events (4:30PM ET unless noted)

Jigsaw Trading: TBA

Elite only

FuturesTrader71: TBA

Elite only

NinjaTrader: TBA

Jan 18

RandBots: TBA

Jan 23

GFF Brokers & CME Group: Futures & Bitcoin

Elite only

Adam Grimes: TBA

Elite only

Ran Aroussi: TBA

Elite only
     

Similar Threads
Thread Thread Starter Forum Replies Last Post
.....SEC May Ticket Speeding Traders kbit News and Current Events 0 February 23rd, 2012 04:08 PM
NT7.4 - RAM hog kashter NinjaTrader 40 April 14th, 2011 02:10 PM
Drive cory Off-Topic 3 October 1st, 2010 04:17 PM
ram nt7 vps MyTraderAdvisor NinjaTrader 5 August 18th, 2010 04:49 PM
Toyota Blames Driver Error for Unwanted Speeding Quick Summary News and Current Events 0 July 14th, 2010 03:20 AM


All times are GMT -4. The time now is 08:07 AM.

Copyright © 2017 by futures io, s.a., Av Ricardo J. Alfaro, Century Tower, Panama, +507 833-9432, info@futures.io
All information is for educational use only and is not investment advice.
There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
no new posts
Page generated 2017-12-17 in 0.17 seconds with 20 queries on phoenix via your IP 54.145.16.43