NexusFi: Find Your Edge


Home Menu

 





Best trading system metrics


Discussion in Traders Hideout

Updated
      Top Posters
    1. looks_one Albnd with 7 posts (5 thanks)
    2. looks_two kevinkdog with 3 posts (3 thanks)
    3. looks_3 mwtzzz with 2 posts (1 thanks)
    4. looks_4 Big Mike with 2 posts (2 thanks)
      Best Posters
    1. looks_one Big Mike with 1 thanks per post
    2. looks_two kevinkdog with 1 thanks per post
    3. looks_3 Albnd with 0.7 thanks per post
    4. looks_4 mwtzzz with 0.5 thanks per post
    1. trending_up 12,176 views
    2. thumb_up 11 thanks given
    3. group 8 followers
    1. forum 18 posts
    2. attach_file 1 attachments




 
Search this Thread

Best trading system metrics

  #11 (permalink)
mwtzzz
Sunnyvale, CA
 
Posts: 171 since Dec 2012
Thanks Given: 8
Thanks Received: 107


Albnd View Post
Tradestation (and probably also MC) refers to this kind of smoothness by means of the PPC (Perfect Profit Correlation), defined as follows: "the correlation of the actual equity curve vs. a "perfect" curve as if the strategy was able to buy every bottom and sell every top. The genetic optimizer will target an equity curve, that closely matches a "perfect" equity curve".

Anyone having experience with this kind of parameter?

No, but this is not an appropriate metric to compare your results. How does the optimizer decide what is a bottom or a top? Which time frame will it use? Will it pick a single bottom every fifteen minutes? Every hour?

this is not the right way to approach the issue, because it will compare your results against a fictitious standard (buying and selling at exactly the "right" point in an arbitrary timeframe.) Google "curve-fitting" in reference to trading to understand the problem here.

In my opinion, a better metric is a simple one: compare your results (your net ROI) to the current deposit rates - the interest rate you get in a money market - and if you're achieving several times that amount, then you're doing well.

Reply With Quote

Can you help answer these questions
from other members on NexusFi?
Pivot Indicator like the old SwingTemp by Big Mike
NinjaTrader
What broker to use for trading palladium futures
Commodities
REcommedations for programming help
Sierra Chart
Better Renko Gaps
The Elite Circle
ZombieSqueeze
Platforms and Indicators
 
  #12 (permalink)
mwtzzz
Sunnyvale, CA
 
Posts: 171 since Dec 2012
Thanks Given: 8
Thanks Received: 107

Sorry about the second post... Regarding "general metrics" for the fitness of your system, the main ones would be those that quantify your periods of drawdown as a portion of your total trading capital. Tradestation gathers these statistics for you and gives you a nice report that includes your maximum intraday and trade-to-trade drawdowns, percentage of winning trades vs. percentage of losing trades, etc. These type of metrics are as close as you can get to determining the efficiency or overall viability and sustainability of your trading system.

Reply With Quote
Thanked by:
  #13 (permalink)
Albnd
Rome, Italy
 
Posts: 62 since Feb 2012
Thanks Given: 27
Thanks Received: 28


Some interesting links:

https://seykota.com/tribe/faq/2004_Oct/Oct_11/index.htm
(browse the page for Seykota's definition of Bliss Function and his own Lake Ratio)

Risk


Reply With Quote
  #14 (permalink)
asimsaim
Lahore Pakistan
 
Posts: 40 since Aug 2012
Thanks Given: 12
Thanks Received: 6

No of winners may be a good metric to judge the system efficiency ...

Reply With Quote
  #15 (permalink)
 kevinkdog   is a Vendor
 
Posts: 3,666 since Jul 2012
Thanks Given: 1,892
Thanks Received: 7,360


Albnd View Post
This won't help anyone in looking for a more objective and verifiable parameter. It's basically like saying that this parameter does not exist at all...

I probably did not explain myself well enough, but I definitely did not mean to imply that this "best" parameter does not exist at all. That is not what I am saying at all.

I will gladly explain, if you wish. If not, that is OK too.

Follow me on Twitter Reply With Quote
  #16 (permalink)
Albnd
Rome, Italy
 
Posts: 62 since Feb 2012
Thanks Given: 27
Thanks Received: 28


kevinkdog View Post
I probably did not explain myself well enough, but I definitely did not mean to imply that this "best" parameter does not exist at all. That is not what I am saying at all.

I will gladly explain, if you wish. If not, that is OK too.

Of course, please.

My point was: I simply cannot discuss a too subjective parameter. IMHO, it's useless. I'd rather interested in a "scientific" logical device that can help me to improve my trading. If I can understand which variables are involved in my trading, I can master (even psichologically) my system. This will result in a better learning curve: I can analyze the flaws in my trading, share the results and compare them with others.
Of course, this may work just from a mechanical point of view. But for me it's a must.

Reply With Quote
  #17 (permalink)
 kevinkdog   is a Vendor
 
Posts: 3,666 since Jul 2012
Thanks Given: 1,892
Thanks Received: 7,360


Albnd View Post
Of course, please.

My point was: I simply cannot discuss a too subjective parameter. IMHO, it's useless. I'd rather interested in a "scientific" logical device that can help me to improve my trading. If I can understand which variables are involved in my trading, I can master (even psichologically) my system. This will result in a better learning curve: I can analyze the flaws in my trading, share the results and compare them with others.
Of course, this may work just from a mechanical point of view. But for me it's a must.


I hate subjective criteria, too. I like objective "rules." In my experience, there is no "one size fits all" fitness metric, and ultimately you'll find different metrics work best in different situations (ultimately borne out by real time performance). So, it becomes a multi-branched objective result, if you will.


My point is that the best metric depends on 1) your objectives and 2) your development process. Here's what I mean:

Let's say your primary objective is risk aversion. Net Profit/Max DD, or Max Drawdown might be very good metrics in this case. But, if your development process allows runs with a small number of trades (or even zero trades), those metrics will be useless, since the best case will be 0 trades (and therefore zero drawdown).

Let's say instead you want to maximize overall profit. Net Profit, Net Profit/Max DD, Return on Account may all be good metrics. But, if your development process allows a ton of trades, the best case will likely be a ton of trades with a low average profit per trade (like a scalping strat). However, if you are off a bit in your slippage estimate during development, you will likely be in big trouble. So a good fitness metric might still lead to real time disaster, where another metric (not as sensitive to number of trades) might not.

Finally, if you were creating a strategy with aggressive position sizing, as opposed to one with no position sizing, your fitness criteria almost has to be different.


Certainly, posts in this thread have given you many very good metrics, which all have their place and time for use.

My point, which hopefully I've made more clear, is that no metric will be best in all situations.

Follow me on Twitter Reply With Quote
Thanked by:
  #18 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,464 since Jun 2009
Thanks Given: 33,242
Thanks Received: 101,662

For those running NT, there is a big collection of custom fitness optimizers here:



Mike



Join the free Markets Chat beta: one platform, all the trade rooms!

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #19 (permalink)
Albnd
Rome, Italy
 
Posts: 62 since Feb 2012
Thanks Given: 27
Thanks Received: 28


kevinkdog View Post
My point, which hopefully I've made more clear, is that no metric will be best in all situations.

Absolutely. Thanks.

Reply With Quote




Last Updated on March 5, 2013


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts