NexusFi: Find Your Edge


Home Menu

 





What should be the next step in my backtesting??


Discussion in Emini and Emicro Index

Updated
      Top Posters
    1. looks_one budfox with 40 posts (2 thanks)
    2. looks_two treydog999 with 21 posts (25 thanks)
    3. looks_3 tellytub with 6 posts (4 thanks)
    4. looks_4 Fat Tails with 2 posts (1 thanks)
      Best Posters
    1. looks_one Ming80 with 2.5 thanks per post
    2. looks_two treydog999 with 1.2 thanks per post
    3. looks_3 shodson with 1 thanks per post
    4. looks_4 tellytub with 0.7 thanks per post
    1. trending_up 16,301 views
    2. thumb_up 41 thanks given
    3. group 9 followers
    1. forum 76 posts
    2. attach_file 4 attachments




 
Search this Thread

What should be the next step in my backtesting??

  #21 (permalink)
 budfox 
Toronto
 
Experience: Beginner
Platform: Sierra
Broker: MB
Trading: ES
Posts: 313 since Jun 2013


Ming80 View Post
Hi BudFox,


2. On Monte Carlo - It is an interesting measure but wouldn't put too much faith in it. Actual drawdowns are a function of a specific market events/environment in relation a series of bad trades produced. Trade scrambling removes the serial correlation which happens during this period and how the drawdown was actually produced. It would be useful to look into the periods which drawdowns occured and understand what caused them. This is crucial to deduce if risk management approaches are needed (stopping the trading model, develop non-correlated models etc.) ... All these decisions have 'costs' to the long term outcome of the eventual pnl. Alternatively, one could accept that this is a function of markets where drawdowns are inevitable from time to time and just continue to stick to the plan.

Why do so many people use Monte Carlo Analysis then?

Thanks

BF

Started this thread Reply With Quote

Can you help answer these questions
from other members on NexusFi?
The space time continuum and the dynamics of a financial …
Emini and Emicro Index
Better Renko Gaps
The Elite Circle
NexusFi Journal Challenge - April 2024
Feedback and Announcements
Deepmoney LLM
Elite Quantitative GenAI/LLM
Exit Strategy
NinjaTrader
 
Best Threads (Most Thanked)
in the last 7 days on NexusFi
Get funded firms 2023/2024 - Any recommendations or word …
59 thanks
Funded Trader platforms
36 thanks
NexusFi site changelog and issues/problem reporting
25 thanks
GFIs1 1 DAX trade per day journal
19 thanks
The Program
18 thanks
  #22 (permalink)
 
Ming80's Avatar
 Ming80 
Singapore
 
Experience: None
Platform: -
Trading: Diversified
Posts: 41 since Jan 2012
Thanks Given: 25
Thanks Received: 51


budfox View Post
Why do so many people use Monte Carlo Analysis then?

Thanks

BF

I don't know too. Perhaps it sounds better to quantify the future when presenting to yourself/wife/boss/capital allocators/investors or whoever that maybe ... "Using monte carlo simulations, there is a 90% chance that our portfolio returns might fall between -10% to 20% for the next 12 months .... assuming no material changes to market environment etc etc." This beats saying .... "I honestly have no clue what's going to happen next year, for sure things are going to change but in the long run we sure are going to make some serious money."

Jokes aside, apart from monte carlo understating the severity of drawdowns, with a perfect smooth equity curve, random scrambling of trades or equity curve would be unable to detect flawed assumptions in the original model (e.g breakouts based on lunar cycles), or soon to change market environments (low vix in 2007). All this does nothing to address the quality of inputs in the trading model to give the 'confidence' of going forward. The number of people using a particular framework should have little bearing on your work but most important what your conclusions from your research lead you too developing your own risk framework.

Reply With Quote
Thanked by:
  #23 (permalink)
 budfox 
Toronto
 
Experience: Beginner
Platform: Sierra
Broker: MB
Trading: ES
Posts: 313 since Jun 2013


HI there,



As most of you will know I have a model which I have deceloped manually in excel, but since it only has N= 55 trades, I am not too confident in its long term potential (and it has large DD ~ 90%).

So now my next decision is whether I should

1) Continue to manually develop this model in excel and after 10 more trades try to wing it live

-or-


2) Learn the basics of C# and convert this model into NInjascript and take it from there ( I already have two more trading ideas in the "R&D" department of my factory that I may put into the prototype phase).

These ideas could be accomplished in a one month timeframe.

Just wondering what some more experienced members like @kevinkdog @treydog999 would advise me to do.

Thank You

Started this thread Reply With Quote
  #24 (permalink)
 
treydog999's Avatar
 treydog999 
seoul, Korea
 
Experience: Intermediate
Platform: Multicharts
Broker: CQG, DTN IQfeed
Trading: YM 6E
Posts: 897 since Jul 2012
Thanks Given: 291
Thanks Received: 1,039


budfox View Post
HI there,



As most of you will know I have a model which I have deceloped manually in excel, but since it only has N= 55 trades, I am not too confident in its long term potential (and it has large DD ~ 90%).

So now my next decision is whether I should

1) Continue to manually develop this model in excel and after 10 more trades try to wing it live

-or-


2) Learn the basics of C# and convert this model into NInjascript and take it from there ( I already have two more trading ideas in the "R&D" department of my factory that I may put into the prototype phase).

These ideas could be accomplished in a one month timeframe.

Just wondering what some more experienced members like @kevinkdog @treydog999 would advise me to do.

Thank You

Personally anything that requires trading real money and "winging it" is usually not a good idea. So I would go with 2.

Reply With Quote
  #25 (permalink)
 budfox 
Toronto
 
Experience: Beginner
Platform: Sierra
Broker: MB
Trading: ES
Posts: 313 since Jun 2013

@treydog999 @kevinkdog



What is the minimum win rate you need in order to continue to the next steps in your model development?

70% 80%

would you pursue a model that only has a 55% win rate?

Sorry, but I just feel uncertain of where my next move should be

Thank you and have a great day,

BF

Started this thread Reply With Quote
  #26 (permalink)
 
treydog999's Avatar
 treydog999 
seoul, Korea
 
Experience: Intermediate
Platform: Multicharts
Broker: CQG, DTN IQfeed
Trading: YM 6E
Posts: 897 since Jul 2012
Thanks Given: 291
Thanks Received: 1,039


budfox View Post
@treydog999 @kevinkdog



What is the minimum win rate you need in order to continue to the next steps in your model development?

70% 80%

would you pursue a model that only has a 55% win rate?

Sorry, but I just feel uncertain of where my next move should be

Thank you and have a great day,

BF

Mathematically win rate does not matter, only expectancy (average trade value). Psychologically win rate does matter, especially if you are trading only 1 or 2 systems. This is because trading something with a 30% win rate while profitable with positive expectancy you may not be able to psychologically hold out a drawdown for 6 months + even though that is within probable bounds. However if you have a basket of 20 systems, then the psychological factor of that single 30% win rate system is buffered by the rest. even if you had 5 of the systems with that kind of win rate, your draw downs would not be as magnified since they would be able to help counter act each other.

Reply With Quote
  #27 (permalink)
 budfox 
Toronto
 
Experience: Beginner
Platform: Sierra
Broker: MB
Trading: ES
Posts: 313 since Jun 2013


treydog999 View Post
Mathematically win rate does not matter, only expectancy (average trade value). Psychologically win rate does matter, especially if you are trading only 1 or 2 systems. This is because trading something with a 30% win rate while profitable with positive expectancy you may not be able to psychologically hold out a drawdown for 6 months + even though that is within probable bounds. However if you have a basket of 20 systems, then the psychological factor of that single 30% win rate system is buffered by the rest. even if you had 5 of the systems with that kind of win rate, your draw downs would not be as magnified since they would be able to help counter act each other.

20 systems? I am just focusing on one system now.

Trey, have you ever encountered a sitation where your model could not be backtested at all? (couldn't be coded)

Thanks,

BF

Started this thread Reply With Quote
  #28 (permalink)
 
treydog999's Avatar
 treydog999 
seoul, Korea
 
Experience: Intermediate
Platform: Multicharts
Broker: CQG, DTN IQfeed
Trading: YM 6E
Posts: 897 since Jul 2012
Thanks Given: 291
Thanks Received: 1,039


budfox View Post
20 systems? I am just focusing on one system now.

Trey, have you ever encountered a sitation where your model could not be backtested at all? (couldn't be coded)

Thanks,

BF

No, if you are using a low level language. But if you are using something like ninjascript or easylanguage there are going to be limitations due to functions that are lacking or made for ease of use. But if you are programming from the ground up, you can pretty much make anything.

Reply With Quote
Thanked by:
  #29 (permalink)
 budfox 
Toronto
 
Experience: Beginner
Platform: Sierra
Broker: MB
Trading: ES
Posts: 313 since Jun 2013


treydog999 View Post
No, if you are using a low level language. But if you are using something like ninjascript or easylanguage there are going to be limitations due to functions that are lacking or made for ease of use. But if you are programming from the ground up, you can pretty much make anything.

But you have to be quite an experienced programmer to 'make anything' right?

Started this thread Reply With Quote
  #30 (permalink)
 
treydog999's Avatar
 treydog999 
seoul, Korea
 
Experience: Intermediate
Platform: Multicharts
Broker: CQG, DTN IQfeed
Trading: YM 6E
Posts: 897 since Jul 2012
Thanks Given: 291
Thanks Received: 1,039



budfox View Post
But you have to be quite an experienced programmer to 'make anything' right?

Just like any craftsmen, you have to learn and develop your skills. So yes, you will not be able to make extremely complex programs at the start. But as you learn and grow more advanced things will be within your grasp.

Reply With Quote




Last Updated on December 1, 2014


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts