Disaster Strikes! Backup your data - futures io
futures io



Disaster Strikes! Backup your data


Discussion in Tech Support

Updated
      Top Posters
    1. looks_one Big Mike with 10 posts (21 thanks)
    2. looks_two Peter2150 with 5 posts (6 thanks)
    3. looks_3 stephenszpak with 3 posts (1 thanks)
    4. looks_4 keymoo with 3 posts (4 thanks)
      Best Posters
    1. looks_one Big Mike with 2.1 thanks per post
    2. looks_two Silver Dragon with 1.5 thanks per post
    3. looks_3 keymoo with 1.3 thanks per post
    4. looks_4 Peter2150 with 1.2 thanks per post
    1. trending_up 20,434 views
    2. thumb_up 42 thanks given
    3. group 15 followers
    1. forum 40 posts
    2. attach_file 1 attachments




Welcome to futures io: the largest futures trading community on the planet, with well over 150,000 members
  • Genuine reviews from real traders, not fake reviews from stealth vendors
  • Quality education from leading professional traders
  • We are a friendly, helpful, and positive community
  • We do not tolerate rude behavior, trolling, or vendors advertising in posts
  • We are here to help, just let us know what you need
You'll need to register in order to view the content of the threads and start contributing to our community.  It's free and simple.

-- Big Mike, Site Administrator

(If you already have an account, login at the top of the page)

 
Search this Thread
 

Disaster Strikes! Backup your data

(login for full post details)
  #11 (permalink)
 Big Mike 
Site Administrator
Swing Trader
Data Scientist & DevOps
Manta, Ecuador
 
Experience: Advanced
Platform: Custom solution
Trading: Futures & Crypto
 
Big Mike's Avatar
 
Posts: 50,182 since Jun 2009
Thanks: 32,681 given, 99,579 received

Just a quick note:

Carbonite seems limited to 4GB files, not 100% clear
iDrive 10GB
Jungledisk 5GB

This kind of thing still upsets me. I have many files over this size that are important data to me (compressed archives generally). I suspect for most it is not an issue, but thought I would report my findings.

Mike

We're here to help -- just ask

For the best trading education, watch our webinars
Searching for trading reviews? Review this list

Follow us on Twitter, YouTube, and Facebook

Support our community as an Elite Member:
https://futures.io/elite/

Visit other sites? Please spread the word about your experience with our community!
Follow me on Twitter Visit my futures io Trade Journal Started this thread Reply With Quote

Can you help answer these questions
from other members on futures io?
Hey! Is there a way to change the date and symbol on a c …
EasyLanguage Programming
Pinescript to EL conversion - ema cloud indicator
TradeStation
Order Flow Volume Profile POC parameters in Ninjatrder
NinjaTrader
NT8 Batch load strategies from xml
NinjaTrader
use of Ultimate Oscillator in NT8
NinjaTrader
 
Best Threads (Most Thanked)
in the last 7 days on futures io
Spoo-nalysis ES e-mini futures S&P 500
12 thanks
Cycle Analysis... a way of looking at price action.
8 thanks
Want your NinjaTrader indicator created, free?
7 thanks
Basic Education for Beginner Trader
7 thanks
TST/OneUp/LeeLoo/Earn2Trade
4 thanks
 
(login for full post details)
  #12 (permalink)
 sptrader 
Colorado
 
Experience: Advanced
Platform: MultiCharts
Broker: IB & Iqfeed
Trading: ES , CL
 
sptrader's Avatar
 
Posts: 543 since Apr 2010
Thanks: 1,094 given, 699 received

I've debated using the cloud like Carbonite, but for now, I use a 500gig WD USB3 external drive (about $50), that I plug in to backup weekly.. Takes about 15 minutes for a complete drive image (80gb or so of data) using "Casper" backup software.. I leave my trading computer on 24/7; I usually change drives every 3-4 years, to prevent problems..I also export my new studies or other important items, to my laptop upon completion..
If you're really paranoid about losing files, the external drive is small enough, to fit easily in a small, fire-proof safe..
Quick, cheap and painless.

Reply With Quote
The following 2 users say Thank You to sptrader for this post:
 
(login for full post details)
  #13 (permalink)
 cory 
virginia
 
Experience: Intermediate
Platform: ninja
Trading: NQ
 
cory's Avatar
 
Posts: 6,096 since Jun 2009
Thanks: 877 given, 8,034 received


my hd crashed, I used another machine and this product to recover most of data EaseUS provides professional Data Recovery, Partition Manager, Data Backup Software Products.

Reply With Quote
 
(login for full post details)
  #14 (permalink)
init77
Switzerland
 
 
Posts: 12 since Dec 2011
Thanks: 5 given, 7 received

Since I do not rely on trading (it's just a hobby), there is no need for exteme fail over solutions. But what seem to work for me:

1.) running an imaging software like Norton Ghost on my primary trading platform (desktop pc) as well as on my notebook. I have a basic image where only Win7 SP1 and Office 2010 with the latest patches are installed and registered (if you want to have a fresh and clean installation). Then i have an up2date image (two weekly, daily is exaggerated for me) of my desktop PC. If you are relying heavily on it, you could have a spare disk where you can restore your ghost image in less than 5 minutes from the image stored on another backup disk in your PC or from the Nas (you could even think of having a spare disk around for generic emergency cases).

2.) Nas with raid5/raid6 (depending on your needs) that provides SMB/CIFS services (network drive) to store non-essential stuff (since desktop PC has an SSD) and generic data. Besides that, specific config files/indicators are also backuped there. (my music collection gets backuped infrequently to an external drive that I store then at an offsite location, since I really love my music collection and already had to start three times over due to disk failures and theft)

3.) The Nas replicates only the most important files to Amazon S3 in an encrypted form (ssl transfer and encrypted files). If you have a "full Linux" distribution for your server or Windows Server, Zmanda/Amanda Backup Server Community Edition is worth a look.

- I also maintain a KeePass (password safe) list, which is backuped trough Dropbox (no problem since it is encrypted). Source Code of programming projects are stored on off-site repositories (SVN) like origo (origo.ethz.ch), that should be backuped by them (and you can also get a whole svn dump).

- Last but not least, I have also a GSM/UMTS/LTE internet stick for my notebook, so in case of emergency and internet disconnect, I am still able to handle orders etc...

My solution seems like an overkill for private users and hobby traders, but hey, everyone has his own needs for data redundancy.

Reply With Quote
 
(login for full post details)
  #15 (permalink)
 Peter2150 
Washington DC
 
Experience: Intermediate
Platform: NinjaTrader
 
Posts: 214 since Jun 2009
Thanks: 110 given, 117 received


Big Mike View Post
Just a quick note:

Carbonite seems limited to 4GB files, not 100% clear
iDrive 10GB
Jungledisk 5GB

This kind of thing still upsets me. I have many files over this size that are important data to me (compressed archives generally). I suspect for most it is not an issue, but thought I would report my findings.

Mike

Hi Mike

Not familiar with Carbonite, but the other two yes.

On Idrive Pro which I use, it says it has been tested up to 10gb, not that there is a limit. The upload time on 10gb would be horrific

On Jungledisk Desktop Edition which is what I use, there is only a 5gb limit using the network feature. Otherwise there is no limit. Also you can break up archives like zip/rar files into smaller pieces.

Jungledisk has two backup modes you can set up. What they call a legacy mode which offers certain features like the ability to search thru the backup for files. An organized local disk makes this unnecessary to me. This mode stores the files uncompressed, and uses more space

The other mode is the backup vault which is more limited in it's feature set, but stores the files compressed. This mode has worked fine for me.

Jungledisk is the most versatile, albeit the less user friendly. It is also very price friendly.

Pete

PS. If you want me to test one of them for you, I will.

Reply With Quote
 
(login for full post details)
  #16 (permalink)
 aslan 
Madison, WI
 
Experience: Advanced
Platform: ALT
Trading: ES
 
aslan's Avatar
 
Posts: 623 since Jan 2010
Thanks: 351 given, 1,121 received


Big Mike View Post
For example, Sierra Charts ignores Windows best practices and by default installs itself to the root of your C: drive. 99% of backup software would never include this location in its default backup set. The same can be said of MultiCharts. MultiCharts saves its files in a non-traditional "ProgramData" directory, while not as bad as the root of the drive like Sierra Chart, it is still a path that most backup software will exclude from default backups.

The fact is, most backup software only backs up your "Documents" directory by default. So if you use NinjaTrader, you are covered. But if you use MC or SC, not so much.

"Windows best practices" -> that is comical.

There are good reasons SC does it that way, but I think it is good that you are pointing out this pitfall though. SC users can of course place their data directory anywhere they want by changing one preference in the Global Settings. So, if you wanted to place it in the Documents dir, you certainly could do that. Personally, I love having my entire install in a single dir, that I can dump to a thumb drive and copy somewhere else. I do the same thing for some other apps as well.

Reply With Quote
 
(login for full post details)
  #17 (permalink)
 Big Mike 
Site Administrator
Swing Trader
Data Scientist & DevOps
Manta, Ecuador
 
Experience: Advanced
Platform: Custom solution
Trading: Futures & Crypto
 
Big Mike's Avatar
 
Posts: 50,182 since Jun 2009
Thanks: 32,681 given, 99,579 received


aslan View Post
"Windows best practices" -> that is comical.

There are good reasons SC does it that way

What is the good reason that SC defaults to C:\SierraChart, instead of C:\Program Files (x86)\SierraChart? And that it stores it's data in the Program Files directory, instead of in the well accepted and industry standard Documents directory for user data?

I like Sierra. I know you like it too. But it seems like a poor design choice, and now they are just sticking with it because change is hard (?). We know the SC devs are smart guys, but we also know they are not receptive to change or critical feedback. Twenty years ago I liked to have well organized directories off the root too, in DOS 3.3 or so. But in the Windows world, it is not the standard and is frowned upon.

Mike

We're here to help -- just ask

For the best trading education, watch our webinars
Searching for trading reviews? Review this list

Follow us on Twitter, YouTube, and Facebook

Support our community as an Elite Member:
https://futures.io/elite/

Visit other sites? Please spread the word about your experience with our community!
Follow me on Twitter Visit my futures io Trade Journal Started this thread Reply With Quote
 
(login for full post details)
  #18 (permalink)
 emini_Holy_Grail 
Dallas,TX
 
Experience: Intermediate
Platform: NinjaTrader, OpenQuant
Broker: Zaner/Zen Fire
Trading: ES,6E,6B,GC,CL
 
Posts: 597 since Nov 2009
Thanks: 176 given, 126 received

also, you can look at iomega usb drive with vclone that can take image of whole PC
Iomega v.Clone App Portable-izes Your Entire PC
2 benefits
1) restore if your PC fails
2) run PC from usb drive when you are travelling

Reply With Quote
 
(login for full post details)
  #19 (permalink)
 aslan 
Madison, WI
 
Experience: Advanced
Platform: ALT
Trading: ES
 
aslan's Avatar
 
Posts: 623 since Jan 2010
Thanks: 351 given, 1,121 received


Big Mike View Post
What is the good reason that SC defaults to C:\SierraChart, instead of C:\Program Files (x86)\SierraChart? And that it stores it's data in the Program Files directory, instead of in the well accepted and industry standard Documents directory for user data?

That "(x86)" did not use to be there. Notice how windows programs might be there or in the old program folder etc. Thats why I say it is comical. My backup program should not need to know about special dirs etc. Upgrading to a new PC is a nightmare.

Ever use a MAC? Most apps are the same, everything under one tree. Sure makes moving an app to another system easy. Also, to uninstall, you blow away the entire dir. Want to make a copy of an SC instance, copy the dir and you are off and running. Want to take it with you on a thumb drive, copy one dir done.

In any case, you could install SC into that dir, as you have a choice when you install, and as I mentioned you can also move your data dir wherever you want it. Once you install once, further upgrades from within the program know where the install is and install in place.


Quoting 
But it seems like a poor design choice, and now they are just sticking with it because change is hard (?). We know the SC devs are smart guys, but we also know they are not receptive to change or critical feedback.

Use some sugar ;-)

Reply With Quote
 
(login for full post details)
  #20 (permalink)
 monpere 
Bala, PA, USA
 
Experience: Intermediate
Platform: NinjaTrader
Broker: Mirus, IB
Trading: SPY, Oil, Euro
 
monpere's Avatar
 
Posts: 1,858 since Jul 2010
Thanks: 300 given, 3,355 received



emini_Holy_Grail View Post
also, you can look at iomega usb drive with vclone that can take image of whole PC
Iomega v.Clone App Portable-izes Your Entire PC
2 benefits
1) restore if your PC fails
2) run PC from usb drive when you are travelling

Got hit last week with a cpu intensive virus, that kept crashing the machine because it was overheating the cpu. Mawarebytes, Norton, and Windows Security Essentials would not detect it. Had to reinstall vista from my recovery disk. Good thing this happened during the holidays, an I also had backups.

Reply With Quote


futures io Trading Community Off-Topic Tech Support > Disaster Strikes! Backup your data


Last Updated on January 24, 2016


Upcoming Webinars and Events
 

NinjaTrader Indicator Challenge!

Ongoing
     



Copyright © 2022 by futures io, s.a., Av Ricardo J. Alfaro, Century Tower, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada), info@futures.io
All information is for educational use only and is not investment advice.
There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
no new posts