NexusFi: Find Your Edge


Home Menu

 





4 System Rules - Which would you choose?


Discussion in Psychology and Money Management

Updated
      Top Posters
    1. looks_one daedalus with 5 posts (0 thanks)
    2. looks_two Richard with 3 posts (3 thanks)
    3. looks_3 darthtrader3.6 with 1 posts (1 thanks)
    4. looks_4 Quick Summary with 1 posts (0 thanks)
    1. trending_up 2,298 views
    2. thumb_up 4 thanks given
    3. group 2 followers
    1. forum 9 posts
    2. attach_file 3 attachments




 
Search this Thread

4 System Rules - Which would you choose?

  #1 (permalink)
daedalus
Omaha, NE
 
Posts: 47 since Nov 2009
Thanks Given: 15
Thanks Received: 25

I think this is the appropriate forum for this kind of question.

I am developing a new method and have some backtesting results done which were then filtered 4 different ways.

My question to you is which of these outcomes would you consider the best?



My stumble point has been the trade effeciency vs. overall $ profit per contract. I don't know which one is best...

I like high efficiency but passing up on essentially double the profit (net of commissions) seems like a somewhat stupid idea...

Any thoughts?

Reply With Quote

Can you help answer these questions
from other members on NexusFi?
NT7 Indicator Script Troubleshooting - Camarilla Pivots
NinjaTrader
ZombieSqueeze
Platforms and Indicators
About a successful futures trader who didnt know anythin …
Psychology and Money Management
What broker to use for trading palladium futures
Commodities
Trade idea based off three indicators.
Traders Hideout
 
  #3 (permalink)
daedalus
Omaha, NE
 
Posts: 47 since Nov 2009
Thanks Given: 15
Thanks Received: 25


I don't know if this would make a difference but here are the two of the equity curves...

The first attachment is for Outcome 1, the second attachment for Outcome 2.

As you can see both have minimal drawdowns but Outcome 2 has a decidedly more upwards and direct equity curve.

Outcome 1:



Outcome 2:

Reply With Quote
  #4 (permalink)
Richard
Dallas TX/USA
 
Posts: 153 since Jun 2009
Thanks Given: 33
Thanks Received: 284

If that's the amount of data you have to go on, then personally I'd ignore it and go with the system that fit my understanding of the markets the best. Look, if I flip a coin 19 times I can easily get a "win %" around 80%. Should I trust that I'll continue to get 80% going forward? No way.

When you consider that the same goes for your average win and average loss, etc., they are essentially still unknown parameters, and the backtest data at best just gives you a warm and fuzzy feeling.

Trading platforms try to convince you that they tell you what you need to evaluate a strategy, but they absolutely do not. To name just one Statistics 101 issue: if you are taking a frequency count, and you want any chance of having a reliable prediction of future long-term results, you need that count to converge on a single level with diminishing variance over time. That's how you can verify that a coin has a 50/50 chance... even though you can get long runs of 100% heads, over time you settle on the 50% level with diminishing variance. But guess what, it can take 100's or 1000's of flips before you settle down properly on a value you can trust. Yet fancy backtest spreadsheets encourage retailers to bet their savings on 42 example trades, and no regularity analysis.

Just like in Vegas, they know that some backtest runs will get lucky and appear to win, and that customers will blame themselves or the markets when things don't work out as planned. It's a total con.

Reply With Quote
Thanked by:
  #5 (permalink)
daedalus
Omaha, NE
 
Posts: 47 since Nov 2009
Thanks Given: 15
Thanks Received: 25

Richard - Completely understand that this backtest is not statistically significant in ANY way.

My question I guess was more of a hypothetical on what is better... Higher efficiency (less trades, less profit, but higher profit per trade) vs. Lower efficiency (more trades, more Profit, but less profit per trade).

Which one is more advantageous? In general do you give something up to achieve more profit? Obviously more trades = more risk wich I can see as an obvious downside, but other than that i'm at a bit of an impasse.

Richard - you're crazy smart and some of your statistical .pdf's have left me in awe of applying mathematics to understand situations like this and I guess thats what i'm getting at... is there a mathematical advantage to one over the other?

Thanks for your help!

Reply With Quote
  #6 (permalink)
Richard
Dallas TX/USA
 
Posts: 153 since Jun 2009
Thanks Given: 33
Thanks Received: 284


daedalus View Post
My question I guess was more of a hypothetical on what is better... Higher efficiency (less trades, less profit, but higher profit per trade) vs. Lower efficiency (more trades, more Profit, but less profit per trade).

Ok, let's say you can trust your numbers, and that you can trust that future time periods will provide the systems with about the same number of trades as they had during the test. It really comes down to how deep your pockets are, and how much you care to risk.

If you want to make more total profit, you go with the one that made the most money. You might want to check risk of ruin and compromise, though, because often the best performing system long-term has the biggest drawdowns along the way!

On the other hand, if you want to be profitable at least x% of your days/weeks/whatever, you need to look at your profit factor versus the number of trades available to you as outlined here: How To Be Consistently Profitable in the Markets|Move the Markets (hard to believe I wrote that over 3 years ago now. ). This time, the danger is that you are profitable most of the time, but not by much. So, you starve by avoiding bad days.

Probably the best system for most people is somewhere in between, and no free lunches means you have to give up some profit for consistency, and vice-versa. Leverage on futures means you can also play games like seeing if doubling your size on system B makes it more attractive than system A, if system A makes more money with unacceptable drawdowns but system B earns less with a smooth curve.

I'm sure there are other philosophies and opinions about tuning a single system, but that's what makes sense to me.

Reply With Quote
Thanked by:
  #7 (permalink)
daedalus
Omaha, NE
 
Posts: 47 since Nov 2009
Thanks Given: 15
Thanks Received: 25

Awesome post. Thanks!

Since i'm a dunce when it comes to math can I throw some hypotetical numbers into your the profit factor equation and see if i'm on the same page...

Using the Avg. Profit (78.13), the Win 74%% (Win/Loss only, no Pars), and the Avg Loss (-70.00), and Loss% (26%)....


Then, 78.13 X .74 = 57.74,
and .26 X -70 = -18.26

Then does that mean that 57.74/-18.26 = -3.16 = a profit factor of 3.16?

Reply With Quote
  #8 (permalink)
Richard
Dallas TX/USA
 
Posts: 153 since Jun 2009
Thanks Given: 33
Thanks Received: 284


daedalus View Post
Then does that mean that 57.74/-18.26 = -3.16 = a profit factor of 3.16?

yeah, make the avg loss a positive number so 57.74/18.26 = 3.16

Reply With Quote
Thanked by:
  #9 (permalink)
 
darthtrader3.6's Avatar
 darthtrader3.6 
wny
 
Experience: Intermediate
Platform: ninja, excel
Trading: YM, equities
Posts: 86 since Jan 2010


daedalus View Post
Obviously more trades = more risk wich I can see as an obvious downside

This isn't totally true though. While more trades will obviously put more capital at risk, you reduce your risk that you are not just trading variance with more trades, especially since it will give you a much better feel if your EV+ after transaction cost.
Also why limit yourself to a or b or c or d?
What does it look like trading all 4 togather? What does it look like trading A + C + 1/2 capital/leverage with D and not trading B at all?

Visit my NexusFi Trade Journal Reply With Quote
  #10 (permalink)
daedalus
Omaha, NE
 
Posts: 47 since Nov 2009
Thanks Given: 15
Thanks Received: 25


^ I've actually kind of done exactly that and am trading two of the four in tandem and the results seem to be the best yet. While statistically insignificant, the current backtesting results (using around 400 trades) are yielding profit factors of 5.1 and 6.0 respectively.

And the results live with them have been exactly in line with the backtest results. To say the least i'm super stoked but again, without the help of Richard and others figuring out what really matters when looking for a profitable method i'd still be spinning my wheels.

Thanks again to everyone that kind of pushed me along into the right direction!

Reply With Quote




Last Updated on February 25, 2010


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts