Speeding up NinjaTrader with a RAM drive (ramdisk) - NinjaTrader | futures io social day trading
futures io futures trading


Speeding up NinjaTrader with a RAM drive (ramdisk)
Updated: Views / Replies:25,231 / 110
Created: by pawnbroker Attachments:6

Welcome to futures io.

(If you already have an account, login at the top of the page)

futures io is the largest futures trading community on the planet, with over 90,000 members. At futures io, our goal has always been and always will be to create a friendly, positive, forward-thinking community where members can openly share and discuss everything the world of trading has to offer. The community is one of the friendliest you will find on any subject, with members going out of their way to help others. Some of the primary differences between futures io and other trading sites revolve around the standards of our community. Those standards include a code of conduct for our members, as well as extremely high standards that govern which partners we do business with, and which products or services we recommend to our members.

At futures io, our focus is on quality education. No hype, gimmicks, or secret sauce. The truth is: trading is hard. To succeed, you need to surround yourself with the right support system, educational content, and trading mentors – all of which you can find on futures io, utilizing our social trading environment.

With futures io, you can find honest trading reviews on brokers, trading rooms, indicator packages, trading strategies, and much more. Our trading review process is highly moderated to ensure that only genuine users are allowed, so you don’t need to worry about fake reviews.

We are fundamentally different than most other trading sites:
  • We are here to help. Just let us know what you need.
  • We work extremely hard to keep things positive in our community.
  • We do not tolerate rude behavior, trolling, or vendors advertising in posts.
  • We firmly believe in and encourage sharing. The holy grail is within you, we can help you find it.
  • We expect our members to participate and become a part of the community. Help yourself by helping others.

You'll need to register in order to view the content of the threads and start contributing to our community.  It's free and simple.

-- Big Mike, Site Administrator

Reply
 6  
 
Thread Tools Search this Thread
 

Speeding up NinjaTrader with a RAM drive (ramdisk)

  #81 (permalink)
Site Administrator
Manta, Ecuador
 
Futures Experience: Advanced
Platform: My own custom solution
Favorite Futures: E-mini ES S&P 500
 
Big Mike's Avatar
 
Posts: 46,238 since Jun 2009
Thanks: 29,350 given, 83,217 received


futuretrader View Post
Hi all,

I have a notebook with a SSD as the primary disk and a SD for some extra storage. Would it make sense to move the GOMFOLDER and NT db to the SD in order to save wear and tear on the SSD? And would it possibly make some difference to NT getting a bit sluggish in high volume bursts?

Thanks

See post 71 from me. It will delay writes and save wear and tear on SSD. But be certain your system is 100% stable and on a UPS.

Mike

Due to time constraints, please do not PM me if your question can be resolved or answered on the forum.

Need help?
1) Stop changing things. No new indicators, charts, or methods. Be consistent with what is in front of you first.
2) Start a journal and post to it daily with the trades you made to show your strengths and weaknesses.
3) Set goals for yourself to reach daily. Make them about how you trade, not how much money you make.
4) Accept responsibility for your actions. Stop looking elsewhere to explain away poor performance.
5) Where to start as a trader? Watch this webinar and read this thread for hundreds of questions and answers.
6)
Help using the forum? Watch this video to learn general tips on using the site.

If you want
to support our community, become an Elite Member.

Reply With Quote
 
  #82 (permalink)
Elite Member
Paris
 
Futures Experience: None
Platform: NinjaTrader
 
Posts: 1,173 since Oct 2009
Thanks: 227 given, 4,089 received

I'm not sure you should make any decision that would only be justified by the sole reduction of SSD "wear",even with TLC cells.

Here are tests of Samsung 840 SSDs
Hardware.Info tests lifespan of Samsung SSD 840 250GB TLC SSD [Updated with final conclusion] - Final update (20-6-2013) | Hardware.Info United States
AnandTech | Samsung SSD 840: Testing the Endurance of TLC NAND

=> estimation about 10-20 years of life if you write 10 GB/day on it.

Reply With Quote
 
  #83 (permalink)
Site Administrator
Manta, Ecuador
 
Futures Experience: Advanced
Platform: My own custom solution
Favorite Futures: E-mini ES S&P 500
 
Big Mike's Avatar
 
Posts: 46,238 since Jun 2009
Thanks: 29,350 given, 83,217 received



gomi View Post
I'm not sure you should make any decision that would only be justified by the sole reduction of SSD "wear",even with TLC cells.

Here are tests of Samsung 840 SSDs
Hardware.Info tests lifespan of Samsung SSD 840 250GB TLC SSD [Updated with final conclusion] - Final update (20-6-2013) | Hardware.Info United States
AnandTech | Samsung SSD 840: Testing the Endurance of TLC NAND

=> estimation about 10-20 years of life if you write 10 GB/day on it.

Very true.

I am writing about 50GB a day on my personal workstation, over 2x256GB in a R0. This is calculated by looking at system up time and total writes.

I do all my heavy lifting on network drives, such as storing daily images, music, movies, etc. So for me the number represents just typical usage (trading, email, browsing, running small business).

Mike

Due to time constraints, please do not PM me if your question can be resolved or answered on the forum.

Need help?
1) Stop changing things. No new indicators, charts, or methods. Be consistent with what is in front of you first.
2) Start a journal and post to it daily with the trades you made to show your strengths and weaknesses.
3) Set goals for yourself to reach daily. Make them about how you trade, not how much money you make.
4) Accept responsibility for your actions. Stop looking elsewhere to explain away poor performance.
5) Where to start as a trader? Watch this webinar and read this thread for hundreds of questions and answers.
6)
Help using the forum? Watch this video to learn general tips on using the site.

If you want
to support our community, become an Elite Member.

Reply With Quote
 
  #84 (permalink)
Elite Member
Milan Italy
 
Futures Experience: Intermediate
Platform: Ninjatrader, Sierra Chart
Favorite Futures: ES
 
Posts: 523 since Feb 2010
Thanks: 470 given, 629 received


Big Mike View Post
See post 71 from me. It will delay writes and save wear and tear on SSD. But be certain your system is 100% stable and on a UPS.

Mike

Thanks Mike, I only have 4GB of RAM on the notebook (and it's one of those new-fangled ones you can't drop another chip into). Is it possible / worthwhile to have a chunk of it devoted to a such a cache?

Reply With Quote
 
  #85 (permalink)
Elite Member
Milan Italy
 
Futures Experience: Intermediate
Platform: Ninjatrader, Sierra Chart
Favorite Futures: ES
 
Posts: 523 since Feb 2010
Thanks: 470 given, 629 received


gomi View Post
I'm not sure you should make any decision that would only be justified by the sole reduction of SSD "wear",even with TLC cells.

Here are tests of Samsung 840 SSDs
Hardware.Info tests lifespan of Samsung SSD 840 250GB TLC SSD [Updated with final conclusion] - Final update (20-6-2013) | Hardware.Info United States
AnandTech | Samsung SSD 840: Testing the Endurance of TLC NAND

=> estimation about 10-20 years of life if you write 10 GB/day on it.

That's interesting, thanks. I'd come across a number of references to SSD performance degeneration and endurance, where people seemed to think constant writing was something to be avoided. But I suppose compared to video and photo editing, trading data doesn't add up to anything much.

Reply With Quote
 
  #86 (permalink)
Banned: trolling
NYC + NY / USA
 
Futures Experience: Advanced
Platform: "I trade, therefore, I AM!"; Theme Song: "Atomic Dog!"
Favorite Futures: EMD, 6J, ZB
 
kronie's Avatar
 
Posts: 798 since Oct 2009
Thanks: 216 given, 498 received


Big Mike View Post
I've been trying out PrimoCache. Under most circumstances it makes more sense than a dedicated ramdisk, and will offer the same performance benefits.

I am using a delayed write setting of 60 seconds. I see NinjaTrader writing 50,000 blocks per minute during large backtests, so this can really help both in terms of performance as well as lifespan (SSD wear level).

I am using an 8GB cache and with my normal day to day stuff, my cache hit ratio is only around 25%. If I increased my cache size to 16GB I would have much higher ratio, as I've only read 16.4GB from disk total since my last reboot. The problem is, I need around 20GB of memory to start Sierra Chart when it is loading all my charts (once it loads them, usage is only 1GB), so the max I can safely use for the cache disk is around 8GB. I have 32GB total.

Anyway, you might try it. No need for symlink and it will work with any program, not just ones you've configured to use the ramdrive.

Naturally you should always have a backup of any important data before using something like this.

Mike



@mike

so in lieu of the entire process of establishing a ramdisk, establishing an image for that ramdisk, copying files to initialize that ramdisk, having it start when windows starts, initiating a full dump / write to disk before windows shuts down (which has been said takes minutes or noticable amounts of time), and establishing procedures to backup and possibly restore (other users comments of their various ramdisk software experiences) from.

so in lieu of all the above, you alternately use PrimoCache (PrimoCache Overview) instead and have reaped similar performance improvements all around.

if so, brilliant!


reason being is, after reading two sets of instructions from both Dataram and SoftPerfect; getting basic questions answered from their tech support, and implementing this solution, then to notice this as a complete alternative (logically I could not see the need to implement both solutions as they would both be competing for the unused RAM), this seems almost too good to be true

thanks for bringing this alternate solution to the fore, as it especially eliminates the shutdown pre-step of making sure you have backups in case of system crashes and losses of data, as well as the write before shutdown phase not working, should that happen. One user said his systems froze and so did his other appplications, so this does happen.

Reply With Quote
 
  #87 (permalink)
Site Administrator
Manta, Ecuador
 
Futures Experience: Advanced
Platform: My own custom solution
Favorite Futures: E-mini ES S&P 500
 
Big Mike's Avatar
 
Posts: 46,238 since Jun 2009
Thanks: 29,350 given, 83,217 received

Yes. BTW, after more uptime my cache hit ratio is 75%

Sent from my LG Optimus G Pro

Due to time constraints, please do not PM me if your question can be resolved or answered on the forum.

Need help?
1) Stop changing things. No new indicators, charts, or methods. Be consistent with what is in front of you first.
2) Start a journal and post to it daily with the trades you made to show your strengths and weaknesses.
3) Set goals for yourself to reach daily. Make them about how you trade, not how much money you make.
4) Accept responsibility for your actions. Stop looking elsewhere to explain away poor performance.
5) Where to start as a trader? Watch this webinar and read this thread for hundreds of questions and answers.
6)
Help using the forum? Watch this video to learn general tips on using the site.

If you want
to support our community, become an Elite Member.

Reply With Quote
 
  #88 (permalink)
Elite Member
Toronto, Canada
 
Futures Experience: Advanced
Platform: NinjaTrader, MT4
Broker/Data: Amp/CQG, Citibank
Favorite Futures: CL, GC, 6E, ES, TF, EURUSD, GBPJPY, AUDUSD
 
Beljevina's Avatar
 
Posts: 349 since Sep 2010
Thanks: 379 given, 564 received


Guss View Post
Thank you for your informative reply, much appreciated
will build a new workspace over the weekend, and test the performance again
Regards
Guss

@Guss, For the benefit of others, reading this perhaps down the road, were you able to make your situation better?

Reply With Quote
 
  #89 (permalink)
Banned: trolling
NYC + NY / USA
 
Futures Experience: Advanced
Platform: "I trade, therefore, I AM!"; Theme Song: "Atomic Dog!"
Favorite Futures: EMD, 6J, ZB
 
kronie's Avatar
 
Posts: 798 since Oct 2009
Thanks: 216 given, 498 received


Big Mike View Post
Yes. BTW, after more uptime my cache hit ratio is 75%

Sent from my LG Optimus G Pro

how?

did you assign the entire ninjatrader 7\db to this cache?, or it simply intercepts any and all accesses to the HDD by managing its own cache space based on some frequency of access?

or did you specify some files to be considered for the smart cache service, and let it handle space issues?

Reply With Quote
 
  #90 (permalink)
Banned: trolling
NYC + NY / USA
 
Futures Experience: Advanced
Platform: "I trade, therefore, I AM!"; Theme Song: "Atomic Dog!"
Favorite Futures: EMD, 6J, ZB
 
kronie's Avatar
 
Posts: 798 since Oct 2009
Thanks: 216 given, 498 received



Big Mike View Post
Yes. BTW, after more uptime my cache hit ratio is 75%

Sent from my LG Optimus G Pro



at this time, only the Beta version is available for usage, not even the standard version, just beneath it. What settings did you choose, that provided such remarked and noticeable improvements?

step1) hit the folder with the green plus to establish a cache on the primary C drive logical NTFS portion, no the smaller system reserve partition


step2) which configuration did you choose? improve read; improve write; custom?
step3) memory overhead read what value? 963.02MB? because its using not any additional memory, just what is remaining up to the 4GB limit (so if you have a 16gb system, its not even offering to use those 12+gb area)

step4) change any preconfigured settings?; change the quota limit max UIM to 960mb? confirm IMM has started?, confirm Level-1 size is 128mb?

just curious, because after doing some HDD file maintenance (cuts / paste, deletes) as well as running Ninja with 6 workspaces the machine never shut down, even after 20+ minutes in the shutdown phase. eventually pressing the power button was the solution

have you been able to assign the "above 4gb" memory to be used, or is this only with a ramcache? (I am beginning to think these are indeed two non-compete methods)

Reply With Quote

Reply



futures io > > > > Speeding up NinjaTrader with a RAM drive (ramdisk)

Thread Tools Search this Thread
Search this Thread:

Advanced Search



Upcoming Webinars and Events (4:30PM ET unless noted)

Linda Bradford Raschke: Reading The Tape

Elite only

Adam Grimes: TBA

Elite only

NinjaTrader: TBA

January

Ran Aroussi: TBA

Elite only
     

Similar Threads
Thread Thread Starter Forum Replies Last Post
.....SEC May Ticket Speeding Traders kbit News and Current Events 0 February 23rd, 2012 04:08 PM
NT7.4 - RAM hog kashter NinjaTrader 40 April 14th, 2011 02:10 PM
Drive cory Off-Topic 3 October 1st, 2010 04:17 PM
ram nt7 vps MyTraderAdvisor NinjaTrader 5 August 18th, 2010 04:49 PM
Toyota Blames Driver Error for Unwanted Speeding Quick Summary News and Current Events 0 July 14th, 2010 03:20 AM


All times are GMT -4. The time now is 03:13 PM.

Copyright © 2017 by futures io, s.a., Av Ricardo J. Alfaro, Century Tower, Panama, +507 833-9432, info@futures.io
All information is for educational use only and is not investment advice.
There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
no new posts
Page generated 2017-12-11 in 0.14 seconds with 20 queries on phoenix via your IP 54.226.172.30