What is the best way to compare multiple strategies PnL charts? - Traders Hideout | futures.io
futures.io futures trading
 

Go Back   futures.io

> Futures Trading, News, Charts and Platforms > Traders Hideout


What is the best way to compare multiple strategies PnL charts?
Started:October 14th, 2016 (06:52 PM) by Wil70 Views / Replies:252 / 6
Last Reply:October 20th, 2016 (09:52 PM) Attachments:0

Welcome to futures.io.

Welcome, Guest!

This forum was established to help traders (especially futures traders) by openly sharing indicators, strategies, methods, trading journals and discussing the psychology of trading.

We are fundamentally different than most other trading forums:
  • We work extremely hard to keep things positive on our forums.
  • We do not tolerate rude behavior, trolling, or vendor advertising in posts.
  • We firmly believe in openness and encourage sharing. The holy grail is within you, it is not something tangible you can download.
  • We expect our members to participate and become a part of the community. Help yourself by helping others.


You'll need to register in order to view the content of the threads and start contributing to our community. It's free and simple, and we will never resell your private information.

-- Big Mike
     

Reply
 
Thread Tools Search this Thread

What is the best way to compare multiple strategies PnL charts?

Old October 14th, 2016, 06:52 PM   #1 (permalink)
Elite Member
SF (CA/USA)
 
Futures Experience: Beginner
Platform: NT / Proprietary
Broker/Data: IB / may be Kinetic
Favorite Futures: ES, CL, NQ, YM, 6E
 
Posts: 19 since Nov 2015
Thanks: 140 given, 5 received

What is the best way to compare multiple strategies PnL charts?

Hello, I'm looking for a mathematical formula to compare strategies pnl curves (they have diff # months/years, diff pnl, diff drawdown), I guess my goal is to classify them so the longest consistent result with the smoothest and highest pnl are first.
What do you use?

I cc some ways I found on the web
http://www.tradingblox.com/Manuals/UsersGuideHTML/tradingperformancestatistics.htm

Modified Sharpe Ratio and Annualized Sortino, seems interesting
What do you think?

thanks for your advises, have nice weekend
w


Last edited by Wil70; October 14th, 2016 at 06:59 PM.
Reply With Quote
     
The following user says Thank You to Wil70 for this post:
     

Old October 14th, 2016, 06:52 PM   #2 (permalink)
Quick Summary
Quick Summary Post

Quick Summary is created and edited by users like you... Add FAQ's, Links and other Relevant Information by clicking the edit button in the lower right hand corner of this message.

     

Old October 16th, 2016, 01:43 PM   #3 (permalink)
Get In, Get Out, Get Paid
Springfield, MO/USA
 
Futures Experience: Advanced
Platform: Jigsaw
Broker/Data: AMP CQG
Favorite Futures: ZN, ZB
 
Heph333's Avatar
 
Posts: 22 since Oct 2009
Thanks: 34 given, 24 received

Answer
This post has been selected as an answer to the original posters question Answer


I think Sharpe ratio is an excellent method of distilling system performance down to one number, factoring risk ibto the equation. Personally, the next step I would take would be to find a way to identify outliers in each candidate.
I would have a problem with a system that outperforms others, yet has rare outliers of high loss. The averaging effect of any rating method might tend to disguise a few very bad trades.

Reply With Quote
     

Old October 17th, 2016, 06:44 PM   #4 (permalink)
Elite Member
SF (CA/USA)
 
Futures Experience: Beginner
Platform: NT / Proprietary
Broker/Data: IB / may be Kinetic
Favorite Futures: ES, CL, NQ, YM, 6E
 
Posts: 19 since Nov 2015
Thanks: 140 given, 5 received


Heph333 View Post
I think Sharpe ratio is an excellent method of distilling system performance down to one number, factoring risk ibto the equation. Personally, the next step I would take would be to find a way to identify outliers in each candidate.
I would have a problem with a system that outperforms others, yet has rare outliers of high loss. The averaging effect of any rating method might tend to disguise a few very bad trades.

Thanks a lot Heph333
To remove outliers on each candidates, do you remove the biggest abnormal positive and negative (both) trades even if they seems legitimate (like I understand if they are cause by some input data abnormally) but do you still remove them when everything looks fair?
thanks
w

Reply With Quote
     

Old October 17th, 2016, 08:42 PM   #5 (permalink)
Elite Member
Boise, Idaho
 
Futures Experience: Advanced
Platform: Sierra Charts
Broker/Data: IB
Favorite Futures: TF
 
Posts: 19 since Sep 2014
Thanks: 6 given, 27 received

Answer
This post has been selected as an answer to the original posters question Answer

Futures Edge on FIO
Van Tharp has a system quality number, SQN, designed to make it possible to compare systems. His SQN rewards consistent performance because a system that is consistent and profitable can be ramped. Profitable systems with large swings are much riskier to ramp up your position size due to the increased risk of ruin.

Sharpe ratio is roundly criticized for confusing variability with risk. It is also very popular with the mutual fund industry, therefore it is automatically suspect as possible snake oil.

Let me add because it does not measure market risk just variability. So they imply to customers that it is a risk measure. See how that worked out in the last crash. Your concerns about outliers says you are interested in the deviation in results. Trading systems are hardly ever examples of the normal distribution. Re-read Taleb on fat tails.


Last edited by Trailer Guy; October 17th, 2016 at 08:51 PM. Reason: Clarify thought.
Reply With Quote
     

Old October 18th, 2016, 04:42 AM   #6 (permalink)
Elite Member
Luxembourg, Luxembourg
 
Futures Experience: Advanced
Platform: TWS
Broker/Data: Interactive Brokers
Favorite Futures: Stocks
 
Posts: 429 since May 2012
Thanks: 1,478 given, 923 received

Answer
This post has been selected as an answer to the original posters question Answer

Cool to see someone still referencing the Tradingblox website - lots of useful info to be found there.

I personally like MAR since it gives me a decent reflection of maximum pain and the expected gain. However, it can punish one severely if there is only one large drawdown and all other drawdowns are much smaller. Of course, the largest drawdown may still be coming, which will then again influence the MAR.

Once of the big downsides of this type of performance measuring is that performance changes with various start/end dates. A system that ends in a big drawdown when testing stops could be the one that outperforms all other systems over the next year, but when the decision needs to be made which system to use, its performance numbers will be rather poor.

Regarding your two favourites, Sharpe ratio also penalises upside volatility. If you have stops in place, then perhaps Sortino would be a better measure of performance.

Regarding the removal of outliers, I would say you do so at your own risk. Unless you understand why the outliers occurred and you can accurately assess that they won't happen again you could be understating the risk of your system.

Reply With Quote
     

Reply



futures.io > Futures Trading, News, Charts and Platforms > Traders Hideout > What is the best way to compare multiple strategies PnL charts?

Thread Tools Search this Thread
Search this Thread:

Advanced Search



Upcoming Webinars and Events (4:30PM ET unless noted)
 

NinjaTrader 8: Features and Enhancements, Tips and Tricks

Dec 6
 

Al Brooks: Stop Losing when a Good Trade goes Bad, Correcting Mistakes

Elite only
 

Trading Technologies: Algo Design Lab hands-on

Dec 13
     

Similar Threads
Thread Thread Starter Forum Replies Last Post
Multiple strategies on one instrument daniely MultiCharts 11 June 8th, 2016 01:21 PM
Multiple strategies / limit positions hawks67 NinjaTrader Programming 2 January 19th, 2015 12:28 AM
Multiple strategies on ES calhawk01 NinjaTrader 1 August 18th, 2013 10:39 PM
How to Run Multiple strategies on one security wallsteetking Platforms and Indicators 4 October 9th, 2011 02:48 PM
Multiple non-correlating strategies or portfolio Big Mike Psychology and Money Management 27 April 5th, 2010 07:03 PM


All times are GMT -4. The time now is 10:00 AM.

Copyright © 2016 by futures.io. All information is for educational use only and is not investment advice.
There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
 
no new posts
Page generated 2016-12-08 in 0.12 seconds with 31 queries on phoenix via your IP 54.205.176.107