Is back testing a waste of time? - Emini Index Futures Trading |
futures io futures trading

Is back testing a waste of time?
Started: by Ninj4Man Views / Replies:836 / 12
Last Reply: Attachments:0

Welcome to futures io.

Welcome, Guest!

This forum was established to help traders (especially futures traders) by openly sharing indicators, strategies, methods, trading journals and discussing the psychology of trading.

We are fundamentally different than most other trading forums:
  • We work extremely hard to keep things positive on our forums.
  • We do not tolerate rude behavior, trolling, or vendor advertising in posts.
  • We firmly believe in openness and encourage sharing. The holy grail is within you, it is not something tangible you can download.
  • We expect our members to participate and become a part of the community. Help yourself by helping others.

You'll need to register in order to view the content of the threads and start contributing to our community. It's free and simple, and we will never resell your private information.

-- Big Mike

Thread Tools Search this Thread

Is back testing a waste of time?

  #11 (permalink)
Trading Apprentice
méxico df, méxico
Futures Experience: Intermediate
Platform: ninjatrader, multicharts
Broker/Data: demo so far
Favorite Futures: stocks, @nq, @es
Posts: 44 since Mar 2013
Thanks: 114 given, 21 received


in my opinion, back testing, optimization and real time simulated testing are the best tools you have available to put together an automated strategy that does make more money than it loses.

the first part of my advice to you would be that you learned how to optimize the settings for the parameters in your strategies, as it is apparent you do not know how to do that. all the most popular trading platforms offer optimization engines, learn how to use them for the particular platform you happen to be using (there are even video tutorials availble on the internet). make sure to include realistic and even exaggerated values for commissions and slippage which all will be going against you all the time.

if your strategies lose more money than they make even when all the parameters have been optimized, you can be sure they will never work and it would be a waste of time to continue trying to develop them.

second, maybe the most advantageous thing you can do to determine if your strategies are winners or not is to optimize them always leaving a sizable period of time out of sample. optimize the parameters in your strategies over long enough periods of time (4 years or more), so that, ideally, your strategies will be tested on all kinds of market conditions; uptrends, downtrends and flat / ranging periods. leaving an extended period of time out of sample means that you would never optimize your strategies to the present day and consider those results to be overly credible, always optimize up to 6 - 12 months ago. once you have optimized your strategies, let's say, to 12 months ago and they made money up to that point, and then you included the latest 12 months of market data keeping the same values for your parameters and your strategies still turned a profit consistently over that period, then you can be certain you have a winner.

the next step would be to test your strategies for a number of weeks as they make trades in real time on a simulated account. if any of your strategies makes more than it loses over all these tests (remember to always use realistic / exaggerated values for total commissions and slippage when evaluating simulated results), you can be certain that as long as the market keeps moving in fairly similar patterns as it has done in the past you could make real money going forward.

Reply With Quote
The following user says Thank You to maggtrading for this post:
  #12 (permalink)
Trading Apprentice
Futures Experience: Beginner
Platform: NinjaTrader
Favorite Futures: Emini
Posts: 10 since Jul 2016
Thanks: 4 given, 4 received

JonnyBoy View Post
One suggestion is you parcel out your back test data. For example, let’s say you have 18 months of data you can back test against - split that into 3 parcels of data. You should then look to exclude an entire parcel from ever being back tested against with your system. Then optimise your setup on the 2 parcels of data you have. Human nature says that you will curve fit to the 2 parcels of data.

When you believe the system is the best you will ever get it, proceed to back test it against the parcel of data you have kept in reserve. That is a good way to avoid curve fitting to your entire back test catalogue of data.

I would say back testing is not a waste of time as it can eliminate some very bad systems very quickly.

thanks for the advice I will look into testing with this approach as I think the problem I have been having is only backtesting and not doing any out of sample testing / walk forward.

Reply With Quote
The following user says Thank You to Ninj4Man for this post:
  #13 (permalink)
Every Day I'm a n00b
San Tan Valley, AZ/USA
Futures Experience: Advanced
Platform: NT7
Broker/Data: IB, Tallinex, & 10 others.
Favorite Futures: Futures
Posts: 195 since Jun 2013
Thanks: 693 given, 159 received

Use BT as an out of sample developmental tool.

Then forward test, live.


Reply With Quote


futures io > > > > Is back testing a waste of time?

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Upcoming Webinars and Events (4:30PM ET unless noted)

PTMC Protrader Platform First Look w/Sergey Sokolov

Elite only

Spring Grains Outlook w/Sean Lusk @ Walsh Trading

Elite only

FIO Video Journal Challenge featuring NinjaTrader ($2,000+ of prizes)


Process above all else w/Anthony Crudele @ Futures Radio Show

Elite only

Machine Learning - Quantitative Trading w/Martin Froehler @ Quantiacs

Elite only

Market Dynamics w/Peter Davies @ Jigsaw Trading

Elite only

Ask Me Anything w/Patrick Rooney @ Trading Technologies

Apr 18

Ask Me Anything w/FuturesTrader71

Apr 19

Machine Learning w/Kris Longmore

Elite only

Market Analysis w/Dave Forss

Apr 25

Introducing iSystems with Stage 5 Trading

Apr 27

Similar Threads
Thread Thread Starter Forum Replies Last Post
Running 2 s back testing simulating optimization strategies and the same time fractal TradeStation 0 March 8th, 2012 06:13 AM
Platform for back testing andyw Platforms and Indicators 2 December 15th, 2011 12:10 AM
Back to the Future! Back testing multi time frame strategy trades occuring in future mrticks The Elite Circle 10 April 2nd, 2011 09:54 AM
back testing sam028 Terms (Glossary) 0 June 28th, 2010 06:20 PM
Back Testing / Optimization esscalper The Elite Circle 2 November 19th, 2009 02:00 PM

All times are GMT -4. The time now is 06:11 PM.

no new posts
Page generated 2017-03-24 in 0.08 seconds with 19 queries on phoenix via your IP