NexusFi: Find Your Edge


Home Menu

 





Emini S&P 500 Strategy Performance Report Benchmark


Discussion in Traders Hideout

Updated
      Top Posters
    1. looks_one fiverr with 13 posts (2 thanks)
    2. looks_two rleplae with 3 posts (2 thanks)
    3. looks_3 Tymbeline with 3 posts (0 thanks)
    4. looks_4 TheTradeSlinger with 3 posts (1 thanks)
      Best Posters
    1. looks_one PeakGrowth with 3 thanks per post
    2. looks_two Dionysus with 0.7 thanks per post
    3. looks_3 rleplae with 0.7 thanks per post
    4. looks_4 fiverr with 0.2 thanks per post
    1. trending_up 13,358 views
    2. thumb_up 15 thanks given
    3. group 7 followers
    1. forum 29 posts
    2. attach_file 2 attachments




 
Search this Thread

Emini S&P 500 Strategy Performance Report Benchmark

  #11 (permalink)
 fiverr 
Calgary
 
Experience: None
Platform: TradeStation, MT4
Trading: ES, Stocks
Posts: 73 since Aug 2015
Thanks Given: 4
Thanks Received: 11


Tymbeline View Post
I'd do a little bit of trading wherever/however you're actually going to trade, moving forward, and see what commissions and slippage actually come to, realistically, rather than guessing. That should give you some figures to test?

Finding out the MAE will resolve that issue for you, I think? (I have no specific reason to imagine that you're about to unearth a disaster, on that front - it's just something you need to know?).

People's answers to that will vary a lot, I think. For myself, I'm interested in principle in investigating anything with a PF above 1.5, provided it doesn't fall foul of other sensible parameters - but I suspect that many here may give a higher figure than that.

It doesn't for me (but I don't hold positions overnight, anyway, myself).

Tymbeline,

Thank you very much for your feedback. I was hoping to get some general benchmark on setting the commission and slippage. My background is in currency trading; hence, trading S&P is new to me. As for PF >1.5, it is easily achieved by reducing the number of trades i.e. trending systems. In my experience, when PF is too high, you don't have a large enough sample of trades and your system will tend to curve fit. All of my trading systems must have over 500 trades else I would not use them.

Started this thread Reply With Quote
Thanked by:

Can you help answer these questions
from other members on NexusFi?
REcommedations for programming help
Sierra Chart
Better Renko Gaps
The Elite Circle
Quant vue
Trading Reviews and Vendors
MC PL editor upgrade
MultiCharts
Pivot Indicator like the old SwingTemp by Big Mike
NinjaTrader
 
  #12 (permalink)
 Dionysus 
Monterey, CA
 
Experience: Intermediate
Platform: Ninjatrader
Trading: CL
Posts: 80 since Jan 2014
Thanks Given: 28
Thanks Received: 99


fiverr View Post
Tymbeline,

Thank you very much for your feedback. I was hoping to get some general benchmark on setting the commission and slippage. My background is in currency trading; hence, trading S&P is new to me. As for PF >1.5, it is easily achieved by reducing the number of trades i.e. trending systems. In my experience, when PF is too high, you don't have a large enough sample of trades and your system will tend to curve fit. All of my trading systems must have over 500 trades else I would not use them.

Howdy, Fiverr!

It looks like it may have some potential. . . what I was initially impressed with is your data pool of trades, as most people that bring strategies to the forum seem to be thrilled with their holy grail strategy that has some 100 or less trades over the past 10 years. The larger the data pool, the more *potentially* trustworthy that your underlying logic is saying something real, though its absolutely no guarantee.

RP had an excellent point, the best thing you can do, by far, is to test the 'live walk' period of time, now. . i.e. from the date of creation, to the present date, and see if it falls flat.

You asked if there was room for improvement, and to that I would say 'absolutely'. . . The profit factor is certainly a bit low for anything you'd want to realistically trade live, *but* since your data pool of total trades is still quite large, you have room to make some tweaks and refinements.

Have you tested it yet over any similar instruments, such as NQ, YM, etc, to determine whether it performs decently there? Or any market wide testing in general? This would be another valuable step, its extremely useful 'confirmation' to see that a strategies underlying logic works across multiple instruments, especially instruments that tend to be highly correlative with the one you've created the strategy for.

Also, do you have any information as to the average 'time in market' of your average trade?
Lastly, I don't use tradestation, can you be sure that your tests aren't taking trades on top of one another, i.e. entering into another trade even if the first trade is still active? This can produce very large trade counts that aren't actually realistic, because what its actually doing, in effect, is entering several times, each time your conditions are triggered, over a short and staggered period of time. .

Lastly, just to confirm, the long/short directions use mirror image logic, right. . the same logic, flipped, for both directions? Oh, and lastly lastly, in regards to ballpark numbers you should be looking to obtain, I agree with Tymb, roughly, in that anything below 1.5 PF is generally uninteresting, but you can obtain that, at least, with just a little TLC here, I believe.

Let me know the answers to those q's, and perhaps I can be a bit of further help, if you'd like

Reply With Quote
  #13 (permalink)
 
TheTradeSlinger's Avatar
 TheTradeSlinger 
Huntington WV
 
Experience: Advanced
Platform: TradeStation
Trading: ES, CL
Posts: 483 since Jun 2015
Thanks Given: 877
Thanks Received: 682


100% guaranteed to be overfitted due to improper design and testing based on other posts you've made regarding automated strategies @fiverr.

Can you explain in detail the design and testing of this system?

Not trying to be harsh, it's just the cold reality of retail automated trading.

Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
  #14 (permalink)
 Dionysus 
Monterey, CA
 
Experience: Intermediate
Platform: Ninjatrader
Trading: CL
Posts: 80 since Jan 2014
Thanks Given: 28
Thanks Received: 99

To give you some idea of what I consider to be decent results, here is a strategy I've been running live for a few months now. . . however, its *vital* to note that no strategy should ever be trusted solely on the merit of its own backtest results in isolation. This strategy has been tested marketwide, and 'scored' according to not only its own backtest results, but the backtest results of every other instrument upon which the core logic was tested. . . I also look at its performance numbers relative to all other optimization results I've ever had with the same Instrument/HourOfDay/MarketDirection combination, as I think its vital that you compare apples to apples insofar as is possible. . and this is just the tip of the iceberg, unfortunately. Long story short, backtest results like this do mean something, but woe to anyone that trusts them implicitly, in isolation, without examining a plethora of other data points/factors. The healthy looking backtest is only a starting point, and a somewhat weak one, at that.

Also, its vital to note that one should never expect live results to perform equal or better to the backtest results, over a significant enough period of time, a large enough data pool of trades. . . it will virtually always, without exception, perform worse. This is to be expected, since attaining a strategy with *zero* curve fitting is simply an absolute impossibility. . the goal here is to create as robust and high-confidence of a strategy as is possible, with the expectation that it will earn more than it loses. . not that it will produce a 2.0/3.0+ PF across all market conditions.

Now that the disclaimers are out of the way:



It's my first time uploading graphics to this forum, fingers crossed that I did so properly. . .!

Reply With Quote
Thanked by:
  #15 (permalink)
 PeakGrowth 
Sydney, Australia
 
Experience: Intermediate
Platform: Sierra Chart, IRESS
Broker: IB, IQFeed
Trading: ES, SPI, ASX stocks, options
Posts: 399 since Jun 2015
Thanks Given: 169
Thanks Received: 465

You need to forward test or your system will be curve fitted with data snooping bias. You should try do your analysis on a small set of data and then forward test for around the same amount of data.

If your forward test PF doesn't degrade significantly (it will almost certainly degrade), then it's probably workable. However your PF is a bit low, so any slight degradation will make this unviable.

Also the market has changed heaps since 2001, you should try test from 2008~ onwards as you would need to cater for all the algo activity present today.

Final thing is $12-15 net per trade is too low, any sort of additional slippage, or any degradation can turn this negative very fast.

Also not sure why you chose $2.50 for slippage? ES is $12.50 a tick so you're slippage is $10 too low.

Commission at IB, which is one of the cheapest is $4.04 per round turn, so your commission also too low.

If you fix those two, then your $12-15 net profit will now be less than 0 I believe.

You might want to try discretionary trading the ES for a few months first so you understand how the market behaves and then try to automate that understanding, at the moment it looks like you have just data mined this, which is pretty much guaranteed to not work.

Visit my NexusFi Trade Journal Reply With Quote
  #16 (permalink)
 
Tymbeline's Avatar
 Tymbeline 
Leeds UK
Market Wizard
 
Experience: Intermediate
Platform: Tradovate
Broker: Tradovate
Trading: MES, MNQ
Frequency: Several times daily
Duration: Minutes
Posts: 647 since Apr 2015
Thanks Given: 2,348
Thanks Received: 1,057


PeakGrowth View Post
your PF is a bit low

Absoutely. The combination of a PF of only 1.17 and inadequate allowance for dealing costs is almost bound to turn the method described from overall profit into overall loss, I'm afraid. This was all pointed out in some detail in the other thread, a month or so ago, though.

Reply With Quote
  #17 (permalink)
 fiverr 
Calgary
 
Experience: None
Platform: TradeStation, MT4
Trading: ES, Stocks
Posts: 73 since Aug 2015
Thanks Given: 4
Thanks Received: 11


TheTradeSlinger View Post
100% guaranteed to be overfitted due to improper design and testing based on other posts you've made regarding automated strategies @fiverr.

Can you explain in detail the design and testing of this system?

Not trying to be harsh, it's just the cold reality of retail automated trading.

TradeSlinger,

Thank you for your comment. Can you be more specific on your criteria on how you judge a trading system to be curve fitted? As for me, I have a few simple rules for a system design to avoid curve fitting:
1) number of trades must be greater than 1,000 to avoid curve fitting
2) the test period must be over 10+ years or longer
3) single year profit can not account for more than 30% of the total profit
4) Ratio of total profit divided by max drawdown must be greater than 20
5) Use WFO whenever possible
6) Fixed lot trading during system design i.e. no compounding or manipulation of trading lot size

Started this thread Reply With Quote
Thanked by:
  #18 (permalink)
 fiverr 
Calgary
 
Experience: None
Platform: TradeStation, MT4
Trading: ES, Stocks
Posts: 73 since Aug 2015
Thanks Given: 4
Thanks Received: 11


Dionysus View Post
Howdy, Fiverr!
RP had an excellent point, the best thing you can do, by far, is to test the 'live walk' period of time, now. . i.e. from the date of creation, to the present date, and see if it falls flat.

Currently, I don't have access to the ES datafeed; hence, I have not tested from the date of creation to the present date. If you have the 1M data, please PM me and I try to run it.

Have you tested it yet over any similar instruments, such as NQ, YM, etc, to determine whether it performs decently there? Or any market wide testing in general? This would be another valuable step, its extremely useful 'confirmation' to see that a strategies underlying logic works across multiple instruments, especially instruments that tend to be highly correlative with the one you've created the strategy for.

This system is designed specifically for ES. It will require additional WFO and other adjustments for NQ and YM since different trading instruments have different personalities. It is like getting a driver license in the west coast; hence, you think that you can drive anywhere. There are always some adjustments required to drive in the East Coast, the Mountains or in the Prairie and etc.

Can someone post their performance report with 1.5PF and their number of trades? My background in currency trading and ES trading is new to me. In the past, I have not focused on pf; hence, I am trying to understand more about it.

Currently, I am focused on currency trading and have not made the switch to ES. My 8-month old daughter is a handful and most of the time, I am not getting enough sleep. If anyone have a demo account, I can run this system on your account for free. As long as your broker can work with MC, we should be good. If the performance is good after 3-6 months, I also offer to run on your live accounts for free for another year or so. This way you have a stake in the project to ensure it is success.

Started this thread Reply With Quote
  #19 (permalink)
 fiverr 
Calgary
 
Experience: None
Platform: TradeStation, MT4
Trading: ES, Stocks
Posts: 73 since Aug 2015
Thanks Given: 4
Thanks Received: 11


Dionysus View Post
To give you some idea of what I consider to be decent results, here is a strategy I've been running live for a few months now. . . however, its *vital* to note that no strategy should ever be trusted solely on the merit of its own backtest results in isolation. This strategy has been tested marketwide, and 'scored' according to not only its own backtest results, but the backtest results of every other instrument upon which the core logic was tested. . . I also look at its performance numbers relative to all other optimization results I've ever had with the same Instrument/HourOfDay/MarketDirection combination, as I think its vital that you compare apples to apples insofar as is possible. . and this is just the tip of the iceberg, unfortunately. Long story short, backtest results like this do mean something, but woe to anyone that trusts them implicitly, in isolation, without examining a plethora of other data points/factors. The healthy looking backtest is only a starting point, and a somewhat weak one, at that.

Also, its vital to note that one should never expect live results to perform equal or better to the backtest results, over a significant enough period of time, a large enough data pool of trades. . . it will virtually always, without exception, perform worse. This is to be expected, since attaining a strategy with *zero* curve fitting is simply an absolute impossibility. . the goal here is to create as robust and high-confidence of a strategy as is possible, with the expectation that it will earn more than it loses. . not that it will produce a 2.0/3.0+ PF across all market conditions.

Now that the disclaimers are out of the way:



It's my first time uploading graphics to this forum, fingers crossed that I did so properly. . .!

Dionysus,

Thanks for sharing. Are you using market orders or limit orders to enter the trades? What will happen if you extend your back testing from 2000 to 2015? BTW, are you holding orders overnight and during the weekends?

Started this thread Reply With Quote
  #20 (permalink)
 
TheTradeSlinger's Avatar
 TheTradeSlinger 
Huntington WV
 
Experience: Advanced
Platform: TradeStation
Trading: ES, CL
Posts: 483 since Jun 2015
Thanks Given: 877
Thanks Received: 682



fiverr View Post
TradeSlinger,

Thank you for your comment. Can you be more specific on your criteria on how you judge a trading system to be curve fitted? As for me, I have a few simple rules for a system design to avoid curve fitting:
1) number of trades must be greater than 1,000 to avoid curve fitting
2) the test period must be over 10+ years or longer
3) single year profit can not account for more than 30% of the total profit
4) Ratio of total profit divided by max drawdown must be greater than 20
5) Use WFO whenever possible
6) Fixed lot trading during system design i.e. no compounding or manipulation of trading lot size

@PeakGrowth nailed it:

Quoting 
"Final thing is $12-15 net per trade is too low, any sort of additional slippage, or any degradation can turn this negative very fast.

Also not sure why you chose $2.50 for slippage? ES is $12.50 a tick so you're slippage is $10 too low.

Commission at IB, which is one of the cheapest is $4.04 per round turn, so your commission also too low.

If you fix those two, then your $12-15 net profit will now be less than 0 I believe."

Also, how did you design this system? Did you come up with an idea and test it for the first time and these are the results or did you design, test, modify and these are the results?

You might be on to something or you might not, it really depends on the design and testing methodology you employed.

Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
Thanked by:




Last Updated on February 11, 2016


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts