Is back testing a waste of time? (Page 2) - Index Futures Trading | futures trading

Go Back

> Futures Trading, News, Charts and Platforms > Traders Hideout > Index Futures Trading

Is back testing a waste of time?
Started:July 19th, 2016 (12:49 AM) by Ninj4Man Views / Replies:600 / 12
Last Reply:July 23rd, 2016 (07:26 PM) Attachments:0

Welcome to

Welcome, Guest!

This forum was established to help traders (especially futures traders) by openly sharing indicators, strategies, methods, trading journals and discussing the psychology of trading.

We are fundamentally different than most other trading forums:
  • We work extremely hard to keep things positive on our forums.
  • We do not tolerate rude behavior, trolling, or vendor advertising in posts.
  • We firmly believe in openness and encourage sharing. The holy grail is within you, it is not something tangible you can download.
  • We expect our members to participate and become a part of the community. Help yourself by helping others.

You'll need to register in order to view the content of the threads and start contributing to our community. It's free and simple, and we will never resell your private information.

-- Big Mike

Thread Tools Search this Thread

Is back testing a waste of time?

Old July 20th, 2016, 04:35 PM   #11 (permalink)
Trading Apprentice
méxico df, méxico
Futures Experience: Intermediate
Platform: ninjatrader, multicharts
Broker/Data: demo so far
Favorite Futures: stocks, @nq, @es
Posts: 43 since Mar 2013
Thanks: 109 given, 21 received


in my opinion, back testing, optimization and real time simulated testing are the best tools you have available to put together an automated strategy that does make more money than it loses.

the first part of my advice to you would be that you learned how to optimize the settings for the parameters in your strategies, as it is apparent you do not know how to do that. all the most popular trading platforms offer optimization engines, learn how to use them for the particular platform you happen to be using (there are even video tutorials availble on the internet). make sure to include realistic and even exaggerated values for commissions and slippage which all will be going against you all the time.

if your strategies lose more money than they make even when all the parameters have been optimized, you can be sure they will never work and it would be a waste of time to continue trying to develop them.

second, maybe the most advantageous thing you can do to determine if your strategies are winners or not is to optimize them always leaving a sizable period of time out of sample. optimize the parameters in your strategies over long enough periods of time (4 years or more), so that, ideally, your strategies will be tested on all kinds of market conditions; uptrends, downtrends and flat / ranging periods. leaving an extended period of time out of sample means that you would never optimize your strategies to the present day and consider those results to be overly credible, always optimize up to 6 - 12 months ago. once you have optimized your strategies, let's say, to 12 months ago and they made money up to that point, and then you included the latest 12 months of market data keeping the same values for your parameters and your strategies still turned a profit consistently over that period, then you can be certain you have a winner.

the next step would be to test your strategies for a number of weeks as they make trades in real time on a simulated account. if any of your strategies makes more than it loses over all these tests (remember to always use realistic / exaggerated values for total commissions and slippage when evaluating simulated results), you can be certain that as long as the market keeps moving in fairly similar patterns as it has done in the past you could make real money going forward.

Reply With Quote
The following user says Thank You to maggtrading for this post:

Old July 20th, 2016, 08:53 PM   #12 (permalink)
Trading Apprentice
Futures Experience: Beginner
Platform: NinjaTrader
Favorite Futures: Emini
Posts: 10 since Jul 2016
Thanks: 4 given, 4 received

JonnyBoy View Post
One suggestion is you parcel out your back test data. For example, let’s say you have 18 months of data you can back test against - split that into 3 parcels of data. You should then look to exclude an entire parcel from ever being back tested against with your system. Then optimise your setup on the 2 parcels of data you have. Human nature says that you will curve fit to the 2 parcels of data.

When you believe the system is the best you will ever get it, proceed to back test it against the parcel of data you have kept in reserve. That is a good way to avoid curve fitting to your entire back test catalogue of data.

I would say back testing is not a waste of time as it can eliminate some very bad systems very quickly.

thanks for the advice I will look into testing with this approach as I think the problem I have been having is only backtesting and not doing any out of sample testing / walk forward.

Reply With Quote
The following user says Thank You to Ninj4Man for this post:

Old July 23rd, 2016, 07:26 PM   #13 (permalink)
San Tan Valley, AZ/USA
Futures Experience: Advanced
Platform: HFT-Proprietary Systems
Broker/Data: IB, Tallinex, & 10 others.
Favorite Futures: Futures
Posts: 192 since Jun 2013
Thanks: 680 given, 157 received

Use BT as an out of sample developmental tool.

Then forward test, live.


Reply With Quote

Reply > Futures Trading, News, Charts and Platforms > Traders Hideout > Index Futures Trading > Is back testing a waste of time?

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Upcoming Webinars and Events (4:30PM ET unless noted)

An Afternoon with FIO trader bobwest

Elite only

NinjaTrader 8: Programming Profitable Trading Edges w/Scott Hodson

Elite only

Anthony Drager: Executing on Intermarket Correlations & Order Flow, Part 2

Elite only

Adam Grimes: Five critically important keys to professional trading

Elite only

Machine Learning Concepts w/FIO member NJAMC

Elite only

MarketDelta Cloud Platform: Announcing new mobile features

Dec 1

NinjaTrader 8: Features and Enhancements

Dec 6

Similar Threads
Thread Thread Starter Forum Replies Last Post
Running 2 s back testing simulating optimization strategies and the same time fractal TradeStation 0 March 8th, 2012 06:13 AM
Platform for back testing andyw Platforms and Indicators 2 December 15th, 2011 12:10 AM
Back to the Future! Back testing multi time frame strategy trades occuring in future mrticks The Elite Circle 10 April 2nd, 2011 09:54 AM
back testing sam028 Terms (Glossary) 0 June 28th, 2010 06:20 PM
Back Testing / Optimization esscalper The Elite Circle 2 November 19th, 2009 02:00 PM

All times are GMT -4. The time now is 02:02 PM.

Copyright © 2016 by All information is for educational use only and is not investment advice.
There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
no new posts

Page generated 2016-10-22 in 0.08 seconds with 19 queries on phoenix via your IP