Of course, each platforms has its own backtest rules and its own capabilities. Some can test intrabar, some cannot. Some assume winners where they should not, some assume losers. Some are more sophisticated order management, some are not.
Due to time constraints, please do not PM me if your question can be resolved or answered on the forum.
Need help? 1) Stop changing things. No new indicators, charts, or methods. Be consistent with what is in front of you first. 2) Start a journal and post to it daily with the trades you made to show your strengths and weaknesses. 3) Set goals for yourself to reach daily. Make them about how you trade, not how much money you make. 4) Accept responsibility for your actions. Stop looking elsewhere to explain away poor performance. 5) Where to start as a trader? Watch this webinar and read this thread for hundreds of questions and answers. 6) Help using the forum? Watch this video to learn general tips on using the site.
If you want to support our community, become an Elite Member.
I don't know how to decide which platform you should trust. The conservative approach would be to select the one with the worse result. Though now you have to define "worse": less profit, smaller profit factor, larger draw down? Whatever.
I guess live results will be different from any platform anyway.
Your only option is to perform a Market Replay over a shorter (and probably more recent) period of time. Such as the last 2-4 months depending on your processors speed. NinjaTrader provides data for free and you'll probably want to use the AutoIt download script for downloading multiple days.
Even market replay won't totally solve the issue if the data are different. All data is not the same, it's filtered and stamped differently.
This issue is more prevalent/impactful on lower timeframe/increment strategies.....
If you're employing a long term, high net trade strategy, the results will approach identical, as the disparities in data and data procesing will be marginal to non-existant.
This is one of the very reasons that I've steered more away from small trades and scalping.
When your system features a net trade of $30 on an instrument like CL, even a small discrepancy/variation in natural slippage or system slippage or data variation can have drastic and usually catastrophic effects.
It's bad enough that you have to overcome fees and slippage....when you throw in execution variations as well, you'd better make absolutely certain you've anticipated/accounted for any execution variation.
A single tick on each side of a $30 net/trade system can totally destroy profitability and at the very least, make drawdowns simply untenable.
Additionally, beyond simple execution challenges, there are processing variations, where slight variances in data can result indicator variations. When you employ a system that has virtually NO room for error, even the signal generation for entries and exits can have a drastic effect on how close your system will execute forward live, vs. backtest.
This is why strategy development and process is so important. Even the most solid backtests need to be thoroughly tested forward, in real time. I've seen indicators that were slightly different on live data than the engine's replication in backtesting.
"A dumb man never learns. A smart man learns from his own failure and success. But a wise man learns from the failure and success of others."
The following 4 users say Thank You to RM99 for this post: