Backtesting results from different platforms - Platforms and Indicators | futures io social day trading
futures io futures trading


Backtesting results from different platforms
Updated: Views / Replies:1,229 / 6
Created: by dryg Attachments:0

Welcome to futures io.

(If you already have an account, login at the top of the page)

futures io is the largest futures trading community on the planet, with over 100,000 members. At futures io, our goal has always been and always will be to create a friendly, positive, forward-thinking community where members can openly share and discuss everything the world of trading has to offer. The community is one of the friendliest you will find on any subject, with members going out of their way to help others. Some of the primary differences between futures io and other trading sites revolve around the standards of our community. Those standards include a code of conduct for our members, as well as extremely high standards that govern which partners we do business with, and which products or services we recommend to our members.

At futures io, our focus is on quality education. No hype, gimmicks, or secret sauce. The truth is: trading is hard. To succeed, you need to surround yourself with the right support system, educational content, and trading mentors Ė all of which you can find on futures io, utilizing our social trading environment.

With futures io, you can find honest trading reviews on brokers, trading rooms, indicator packages, trading strategies, and much more. Our trading review process is highly moderated to ensure that only genuine users are allowed, so you donít need to worry about fake reviews.

We are fundamentally different than most other trading sites:
  • We are here to help. Just let us know what you need.
  • We work extremely hard to keep things positive in our community.
  • We do not tolerate rude behavior, trolling, or vendors advertising in posts.
  • We firmly believe in and encourage sharing. The holy grail is within you, we can help you find it.
  • We expect our members to participate and become a part of the community. Help yourself by helping others.

You'll need to register in order to view the content of the threads and start contributing to our community.  It's free and simple.

-- Big Mike, Site Administrator

Thread Tools Search this Thread

Backtesting results from different platforms

  #1 (permalink)
Trading Apprentice
Futures Experience: Intermediate
Platform: Metastock
Favorite Futures: ES, EC, QM, GLD, SPY, QQQ
Posts: 32 since May 2012
Thanks: 5 given, 15 received

Backtesting results from different platforms

Is anyone else besides me occasionally getting different backtesting performance results when using different platforms with the same exact system and same historical data?

Reply With Quote
  #2 (permalink)
Quick Summary
Quick Summary Post

Quick Summary is created and edited by users like you... Add FAQ's, Links and other Relevant Information by clicking the edit button in the lower right hand corner of this message.

  #3 (permalink)
Site Administrator
Manta, Ecuador
Futures Experience: Advanced
Platform: My own custom solution
Favorite Futures: E-mini ES S&P 500
Big Mike's Avatar
Posts: 46,762 since Jun 2009
Thanks: 29,823 given, 86,106 received

dryg View Post
Is anyone else besides me occasionally getting different backtesting performance results when using different platforms with the same exact system and same historical data?

Of course, each platforms has its own backtest rules and its own capabilities. Some can test intrabar, some cannot. Some assume winners where they should not, some assume losers. Some are more sophisticated order management, some are not.


Due to time constraints, please do not PM me if your question can be resolved or answered on the forum.

Need help?
1) Stop changing things. No new indicators, charts, or methods. Be consistent with what is in front of you first.
2) Start a journal and post to it daily with the trades you made to show your strengths and weaknesses.
3) Set goals for yourself to reach daily. Make them about how you trade, not how much money you make.
4) Accept responsibility for your actions. Stop looking elsewhere to explain away poor performance.
5) Where to start as a trader? Watch this webinar and read this thread for hundreds of questions and answers.
Help using the forum? Watch this video to learn general tips on using the site.

If you want
to support our community, become an Elite Member.

Reply With Quote
  #4 (permalink)
Elite Member
New York
Futures Experience: Intermediate
Platform: NinjaTrader, TradeNavigator
Broker/Data: Optimus Futures
Favorite Futures: Piano
Ironman9973's Avatar
Posts: 111 since Jul 2012
Thanks: 53 given, 58 received

I have the same problem. I am testing a strategy on two different plattforms (NinjaTrader7 and TradeNavigator).
With two different data providers. But how do I know which results are correct?

I think TradeNavigator is the better plattform, because it works with TickData and it calculates with tickdata for backtesting.

While I am testing the strategy with NT7 I use the data from InteractiveBrokers.

But the strategy is an automated strategy that will run with NT7 and IB.
So which of the backtesting results can I trust? Or what is the best way to backtest a strategy?

Reply With Quote
  #5 (permalink)
Elite Member
Oberhausen, Germany
Futures Experience: Advanced
Platform: Sierracharts
Broker/Data: Interactive Brokers/DTN IQFeed
Favorite Futures: Bund Future
Posts: 278 since Aug 2011
Thanks: 100 given, 310 received

Didn't know about this thread when I posted this:

I don't know how to decide which platform you should trust. The conservative approach would be to select the one with the worse result. Though now you have to define "worse": less profit, smaller profit factor, larger draw down? Whatever.

I guess live results will be different from any platform anyway.

Reply With Quote
  #6 (permalink)
Elite Member
Futures Experience: None
Platform: None Yet
Favorite Futures: Guitar
MrYou's Avatar
Posts: 403 since Jun 2011
Thanks: 618 given, 194 received

Your only option is to perform a Market Replay over a shorter (and probably more recent) period of time. Such as the last 2-4 months depending on your processors speed. NinjaTrader provides data for free and you'll probably want to use the AutoIt download script for downloading multiple days.

Reply With Quote
  #7 (permalink)
Fortitudo et Honor
Austin, TX
Futures Experience: Advanced
Platform: TradeStation
Favorite Futures: Futures
Posts: 882 since Mar 2011
Thanks: 128 given, 710 received

Even market replay won't totally solve the issue if the data are different. All data is not the same, it's filtered and stamped differently.

This issue is more prevalent/impactful on lower timeframe/increment strategies.....

If you're employing a long term, high net trade strategy, the results will approach identical, as the disparities in data and data procesing will be marginal to non-existant.

This is one of the very reasons that I've steered more away from small trades and scalping.

When your system features a net trade of $30 on an instrument like CL, even a small discrepancy/variation in natural slippage or system slippage or data variation can have drastic and usually catastrophic effects.

It's bad enough that you have to overcome fees and slippage....when you throw in execution variations as well, you'd better make absolutely certain you've anticipated/accounted for any execution variation.

A single tick on each side of a $30 net/trade system can totally destroy profitability and at the very least, make drawdowns simply untenable.

Additionally, beyond simple execution challenges, there are processing variations, where slight variances in data can result indicator variations. When you employ a system that has virtually NO room for error, even the signal generation for entries and exits can have a drastic effect on how close your system will execute forward live, vs. backtest.

This is why strategy development and process is so important. Even the most solid backtests need to be thoroughly tested forward, in real time. I've seen indicators that were slightly different on live data than the engine's replication in backtesting.

"A dumb man never learns. A smart man learns from his own failure and success. But a wise man learns from the failure and success of others."
Reply With Quote
The following 4 users say Thank You to RM99 for this post:


futures io > > > Backtesting results from different platforms

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Upcoming Webinars and Events (4:30PM ET unless noted)

Implementing a Practical Process to Improve w/Peter Davies @ Jigsaw Trading

Dec 6

How to use the Footprint Tool to Execute Trades w/Brannigan Barrett

Elite only

Ask Me Anything (Brokers & Platforms) w/Ilan Levy Mayer @ Cannon Trading

Dec 13

Battlestations! Show us your trading desks w/GFF Brokers ($750 in Prizes)


Similar Threads
Thread Thread Starter Forum Replies Last Post
What trading platforms can you use on a Mac? dmane Platforms and Indicators 15 January 3rd, 2016 12:57 PM
Backtesting identical strategy tradestation and multicharts different results crbucks MultiCharts 7 April 26th, 2012 08:30 AM
Other platforms more or less buggy than TWS? maxplanck Platforms and Indicators 2 November 11th, 2011 04:38 AM
Ninja Trader and backtesting results. sinisa NinjaTrader 2 November 9th, 2011 01:40 AM
How does ESignal compare to other platforms? JohnPS eSignal 10 June 24th, 2011 12:47 AM

automated strategy, backtest, backtesting, cl, data, dow, drawdowns, es, futures, historical data, how to, indicator, indicators, information, interactivebrokers, intrabar, long term, market replay, market_replay, ninjatrader, nt7, order management, real time, replay, scalping, signal, simulation, slippage, strategies, strategy, strategy development, timeframe, trade system

All times are GMT -4. The time now is 02:56 AM. (this page content is cached, log in for real-time version)

Copyright © 2018 by futures io, s.a., Av Ricardo J. Alfaro, Century Tower, Panama, +507 833-9432,
All information is for educational use only and is not investment advice.
There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
no new posts
Page generated 2018-12-09 in 0.13 seconds with 14 queries on phoenix