What is the best way to compare multiple strategies PnL charts? - Traders Hideout | futures.io
futures.io futures trading


What is the best way to compare multiple strategies PnL charts?
Started: by Wil70 Views / Replies:279 / 6
Last Reply: Attachments:0

Welcome to futures.io.

Welcome, Guest!

This forum was established to help traders (especially futures traders) by openly sharing indicators, strategies, methods, trading journals and discussing the psychology of trading.

We are fundamentally different than most other trading forums:
  • We work extremely hard to keep things positive on our forums.
  • We do not tolerate rude behavior, trolling, or vendor advertising in posts.
  • We firmly believe in openness and encourage sharing. The holy grail is within you, it is not something tangible you can download.
  • We expect our members to participate and become a part of the community. Help yourself by helping others.


You'll need to register in order to view the content of the threads and start contributing to our community. It's free and simple, and we will never resell your private information.

-- Big Mike

Reply
 
Thread Tools Search this Thread
 

What is the best way to compare multiple strategies PnL charts?

  #1 (permalink)
Elite Member
SF (CA/USA)
 
Futures Experience: Beginner
Platform: NT / Proprietary
Broker/Data: IB / may be Kinetic
Favorite Futures: ES, CL, NQ, YM, 6E
 
Posts: 20 since Nov 2015
Thanks: 156 given, 5 received

What is the best way to compare multiple strategies PnL charts?

Hello, I'm looking for a mathematical formula to compare strategies pnl curves (they have diff # months/years, diff pnl, diff drawdown), I guess my goal is to classify them so the longest consistent result with the smoothest and highest pnl are first.
What do you use?

I cc some ways I found on the web
http://www.tradingblox.com/Manuals/UsersGuideHTML/tradingperformancestatistics.htm

Modified Sharpe Ratio and Annualized Sortino, seems interesting
What do you think?

thanks for your advises, have nice weekend
w


Last edited by Wil70; October 14th, 2016 at 06:59 PM.
Reply With Quote
The following user says Thank You to Wil70 for this post:
 
  #2 (permalink)
Quick Summary
Quick Summary Post

Quick Summary is created and edited by users like you... Add FAQ's, Links and other Relevant Information by clicking the edit button in the lower right hand corner of this message.

 
  #3 (permalink)
Get In, Get Out, Get Paid
Springfield, MO/USA
 
Futures Experience: Advanced
Platform: Jigsaw
Broker/Data: AMP CQG
Favorite Futures: ZN, ZB
 
Heph333's Avatar
 
Posts: 26 since Oct 2009
Thanks: 35 given, 36 received

Answer
This post has been selected as an answer to the original posters question Answer


I think Sharpe ratio is an excellent method of distilling system performance down to one number, factoring risk ibto the equation. Personally, the next step I would take would be to find a way to identify outliers in each candidate.
I would have a problem with a system that outperforms others, yet has rare outliers of high loss. The averaging effect of any rating method might tend to disguise a few very bad trades.

Reply With Quote
 
  #4 (permalink)
Elite Member
SF (CA/USA)
 
Futures Experience: Beginner
Platform: NT / Proprietary
Broker/Data: IB / may be Kinetic
Favorite Futures: ES, CL, NQ, YM, 6E
 
Posts: 20 since Nov 2015
Thanks: 156 given, 5 received


Heph333 View Post
I think Sharpe ratio is an excellent method of distilling system performance down to one number, factoring risk ibto the equation. Personally, the next step I would take would be to find a way to identify outliers in each candidate.
I would have a problem with a system that outperforms others, yet has rare outliers of high loss. The averaging effect of any rating method might tend to disguise a few very bad trades.

Thanks a lot Heph333
To remove outliers on each candidates, do you remove the biggest abnormal positive and negative (both) trades even if they seems legitimate (like I understand if they are cause by some input data abnormally) but do you still remove them when everything looks fair?
thanks
w

Reply With Quote
 
  #5 (permalink)
Elite Member
Boise, Idaho
 
Futures Experience: Advanced
Platform: Sierra Charts
Broker/Data: IB
Favorite Futures: TF
 
Posts: 33 since Sep 2014
Thanks: 6 given, 41 received

Answer
This post has been selected as an answer to the original posters question Answer

Futures Edge on FIO

Which products do you trade?

 
Van Tharp has a system quality number, SQN, designed to make it possible to compare systems. His SQN rewards consistent performance because a system that is consistent and profitable can be ramped. Profitable systems with large swings are much riskier to ramp up your position size due to the increased risk of ruin.

Sharpe ratio is roundly criticized for confusing variability with risk. It is also very popular with the mutual fund industry, therefore it is automatically suspect as possible snake oil.

Let me add because it does not measure market risk just variability. So they imply to customers that it is a risk measure. See how that worked out in the last crash. Your concerns about outliers says you are interested in the deviation in results. Trading systems are hardly ever examples of the normal distribution. Re-read Taleb on fat tails.


Last edited by Trailer Guy; October 17th, 2016 at 08:51 PM. Reason: Clarify thought.
Reply With Quote
 
  #6 (permalink)
Elite Member
Luxembourg, Luxembourg
 
Futures Experience: Advanced
Platform: TWS
Broker/Data: Interactive Brokers
Favorite Futures: Stocks
 
Posts: 444 since May 2012
Thanks: 1,523 given, 970 received

Answer
This post has been selected as an answer to the original posters question Answer

Cool to see someone still referencing the Tradingblox website - lots of useful info to be found there.

I personally like MAR since it gives me a decent reflection of maximum pain and the expected gain. However, it can punish one severely if there is only one large drawdown and all other drawdowns are much smaller. Of course, the largest drawdown may still be coming, which will then again influence the MAR.

Once of the big downsides of this type of performance measuring is that performance changes with various start/end dates. A system that ends in a big drawdown when testing stops could be the one that outperforms all other systems over the next year, but when the decision needs to be made which system to use, its performance numbers will be rather poor.

Regarding your two favourites, Sharpe ratio also penalises upside volatility. If you have stops in place, then perhaps Sortino would be a better measure of performance.

Regarding the removal of outliers, I would say you do so at your own risk. Unless you understand why the outliers occurred and you can accurately assess that they won't happen again you could be understating the risk of your system.

Reply With Quote
 
  #7 (permalink)
Elite Member
SF (CA/USA)
 
Futures Experience: Beginner
Platform: NT / Proprietary
Broker/Data: IB / may be Kinetic
Favorite Futures: ES, CL, NQ, YM, 6E
 
Posts: 20 since Nov 2015
Thanks: 156 given, 5 received

Just to reference some similar threads
https://futures.io/ninjatrader-programming/4979-system-optimization-fitness-functions-3.html
Big Mike's Trading Blog: Van Tharp's Max Expectancy and System Quality Number (SQN)

Reply With Quote

Reply



futures.io > > > What is the best way to compare multiple strategies PnL charts?

Thread Tools Search this Thread
Search this Thread:

Advanced Search



Upcoming Webinars and Events (4:30PM ET unless noted)

2016 True Edge Awards: Voting is open until Jan 21!

Now
 

Anthony Drager: Pulling the trigger with confidence

Elite only
 

Leo Murphy: The Art and Science of Technical Analysis

Elite only
 

FuturesTrader71: Ask Me Anything

Elite only
     

Similar Threads
Thread Thread Starter Forum Replies Last Post
Multiple strategies on one instrument daniely MultiCharts 11 June 8th, 2016 01:21 PM
Multiple strategies / limit positions hawks67 NinjaTrader Programming 2 January 19th, 2015 12:28 AM
Multiple strategies on ES calhawk01 NinjaTrader 1 August 18th, 2013 10:39 PM
How to Run Multiple strategies on one security wallsteetking Platforms and Indicators 4 October 9th, 2011 02:48 PM
Multiple non-correlating strategies or portfolio Big Mike Psychology and Money Management 27 April 5th, 2010 07:03 PM


All times are GMT -4. The time now is 12:32 AM.

no new posts
Page generated 2017-01-20 in 0.12 seconds with 32 queries on phoenix via your IP 54.211.148.181