NexusFi: Find Your Edge


Home Menu

 





How much data is needed?


Discussion in Traders Hideout

Updated
      Top Posters
    1. looks_one bukkan with 2 posts (0 thanks)
    2. looks_two Big Mike with 2 posts (0 thanks)
    3. looks_3 togier with 2 posts (0 thanks)
    4. looks_4 Fat Tails with 1 posts (0 thanks)
    1. trending_up 4,007 views
    2. thumb_up 0 thanks given
    3. group 4 followers
    1. forum 7 posts
    2. attach_file 0 attachments




 
Search this Thread

How much data is needed?

  #1 (permalink)
 togier 
Boston, MA
 
Experience: Advanced
Platform: NinjaTrader
Broker: IB
Trading: EUR/USD
Posts: 42 since Apr 2010
Thanks Given: 1
Thanks Received: 3

When developing an automated strategy, in your opinion, how much historical tick data would you need in order to feel comfortable with the results? This particular strategy is an automated scalping strategy trading off of Euro tick data.

Started this thread Reply With Quote

Can you help answer these questions
from other members on NexusFi?
Better Renko Gaps
The Elite Circle
How to apply profiles
Traders Hideout
Pivot Indicator like the old SwingTemp by Big Mike
NinjaTrader
NT7 Indicator Script Troubleshooting - Camarilla Pivots
NinjaTrader
REcommedations for programming help
Sierra Chart
 
  #3 (permalink)
 bukkan 
Calcutta, India
 
Experience: Intermediate
Platform: ArthaChitra
Posts: 278 since Jun 2009
Thanks Given: 161
Thanks Received: 271


watching some documentary where they criticized LTCM for backtesting only 5 years of data. had they backtested a bit more they could get a "feel" of the 1987 black monday.

Reply With Quote
  #4 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,463 since Jun 2009
Thanks Given: 33,236
Thanks Received: 101,661

You need to also factor in the frequency of trades.

For my backtests, I look for the strategy to trade at least 3-5 times a day and I optimize over at least 2 years of tick data. It is still very easy to over curve fit to data, but strategies that only trade once a day or once a week, etc, are obviously much easier to curve fit.

Mike

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
  #5 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,463 since Jun 2009
Thanks Given: 33,236
Thanks Received: 101,661


bukkan View Post
watching some documentary where they criticized LTCM for backtesting only 5 years of data. had they backtested a bit more they could get a "feel" of the 1987 black monday.

Which documentary? I like watching this type of stuff.

Mike

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
  #6 (permalink)
 bukkan 
Calcutta, India
 
Experience: Intermediate
Platform: ArthaChitra
Posts: 278 since Jun 2009
Thanks Given: 161
Thanks Received: 271


Big Mike View Post
Which documentary? I like watching this type of stuff.

Mike

sorry, dont remember the name.

same here. love to watch movies and docu on trading.

have a peep here. some nice series. YouTube - DarkAngelStarQ's Channel

Reply With Quote
  #7 (permalink)
 togier 
Boston, MA
 
Experience: Advanced
Platform: NinjaTrader
Broker: IB
Trading: EUR/USD
Posts: 42 since Apr 2010
Thanks Given: 1
Thanks Received: 3

I loved the video. I saw the movie that CNBC put out re: the Lehman collapse but I think the youtube video was even better. Anyway, the automated trading that I am doing places between 3 and 5 trades per day. That said, it sounds like I need to back test against 2 or more years of data.

Started this thread Reply With Quote
  #8 (permalink)
 
Fat Tails's Avatar
 Fat Tails 
Berlin, Europe
Market Wizard
 
Experience: Advanced
Platform: NinjaTrader, MultiCharts
Broker: Interactive Brokers
Trading: Keyboard
Posts: 9,888 since Mar 2010
Thanks Given: 4,242
Thanks Received: 27,103


bukkan View Post
watching some documentary where they criticized LTCM for backtesting only 5 years of data. had they backtested a bit more they could get a "feel" of the 1987 black monday.

They were backtesting on daily data. 5 years of data is equivalent to 1250 bars. This is insufficient anyway. 1 week of 5 min data of ES would be 1395 bars, which is about equivalent.

If the strategy makes 3 trades per day and you have two years of intraday data, then this would be roughly 1500 trades (750 per year), which is a good base. You can then divide the data into your backtest and the walk forward sample.

Reply With Quote




Last Updated on December 4, 2010


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts