NexusFi: Find Your Edge


Home Menu

 





Win Rate %?


Discussion in Traders Hideout

Updated
      Top Posters
    1. looks_one rocketstock with 24 posts (5 thanks)
    2. looks_two kevinkdog with 13 posts (49 thanks)
    3. looks_3 rezak with 5 posts (2 thanks)
    4. looks_4 bobwest with 4 posts (16 thanks)
      Best Posters
    1. looks_one Tymbeline with 6 thanks per post
    2. looks_two bobwest with 4 thanks per post
    3. looks_3 kevinkdog with 3.8 thanks per post
    4. looks_4 SMCJB with 2.5 thanks per post
    1. trending_up 10,076 views
    2. thumb_up 88 thanks given
    3. group 10 followers
    1. forum 54 posts
    2. attach_file 3 attachments




 
Search this Thread

Win Rate %?

  #31 (permalink)
 kevinkdog   is a Vendor
 
Posts: 3,647 since Jul 2012
Thanks Given: 1,890
Thanks Received: 7,338


rocketstock View Post
honestly man i dont know what you are talking about. why would you game yourself.

I'll give two examples, maybe you don't do them with Market Replay (congrats if that is the case), but I know I have done them and probably everyone has too:

1. "The Do Over" - running through Market Replay over the same data more than once, in the name of "learning." Guess what, results always get better the second time, giving you a lot of false hope and unrealistic expectations on what your approach/strategy/system is capable of.

2. "Almost Fills" - convincing yourself that, even though your target was only touched or almost hit, you definitely would have had the foresight to exit before the trade turned on you.


Note these might not even be intentional, might not even be conscious decisions. But they sneak up on you and make the Market Replay results look much better than they would actually have been.


That's what I mean by gaming.

Follow me on Twitter Reply With Quote

Can you help answer these questions
from other members on NexusFi?
Online prop firm The Funded Trader (TFT) going under?
Traders Hideout
New Micros: Ultra 10-Year & Ultra T-Bond -- Live Now
Treasury Notes and Bonds
ZombieSqueeze
Platforms and Indicators
Are there any eval firms that allow you to sink to your …
Traders Hideout
Ninja Mobile Trader VPS (ninjamobiletrader.com)
Trading Reviews and Vendors
 
Best Threads (Most Thanked)
in the last 7 days on NexusFi
Get funded firms 2023/2024 - Any recommendations or word …
60 thanks
Funded Trader platforms
43 thanks
NexusFi site changelog and issues/problem reporting
24 thanks
GFIs1 1 DAX trade per day journal
22 thanks
The Program
19 thanks
  #32 (permalink)
 
bobwest's Avatar
 bobwest 
Western Florida
Site Moderator
 
Experience: Advanced
Platform: Sierra Chart
Trading: ES, YM
Frequency: Several times daily
Duration: Minutes
Posts: 8,162 since Jan 2013
Thanks Given: 57,343
Thanks Received: 26,267


Tymbeline View Post
the live market to which you then apply your automated method may turn out to be materially different from how it behaved over the period of the backtest.


rocketstock View Post
backtest and market replay are completely different things. market replay is close to real time.

Indeed it is, and it has exactly the same issues, the difference being that the period of time being tested is fairly recent -- but you still don't know that the conditions that you had in that segment of the past will repeat in the future, when you're going to be trading it.

If you fit your strategy carefully to any particular span of time, including a very recent one, you are betting that nothing important will change. But the market changes all the time.

Bob.

------------------

Edit: I just saw that Kevin gave a better response than I did. But the issue of testing is generally the same: if you fit the past too well, you are going to set up for failure. So tuning your test to get a better backtest, or better replay results, whichever you do, can be very harmful.

When one door closes, another opens.
-- Cervantes, Don Quixote
Reply With Quote
  #33 (permalink)
rocketstock
Denver CO
 
Posts: 40 since Dec 2021
Thanks Given: 6
Thanks Received: 8



bobwest View Post
Indeed it is, and it has exactly the same issues, the difference being that the period of time being tested is fairly recent -- but you still don't know that the conditions that you had in that segment of the past will repeat in the future, when you're going to be trading it.

If you fit your strategy carefully to any particular span of time, including a very recent one, you are betting that nothing important will change. But the market changes all the time.

Bob.

------------------

Edit: I just saw that Kevin gave a better response than I did. But the issue of testing is generally the same: if you fit the past too well, you are going to set up for failure. So tuning your test to get a better backtest, or better replay results, whichever you do, can be very harmful.

Tell that to the alsog that do most of the trading in the market nowadays. :-)

Reply With Quote
  #34 (permalink)
 
bobwest's Avatar
 bobwest 
Western Florida
Site Moderator
 
Experience: Advanced
Platform: Sierra Chart
Trading: ES, YM
Frequency: Several times daily
Duration: Minutes
Posts: 8,162 since Jan 2013
Thanks Given: 57,343
Thanks Received: 26,267


rocketstock View Post
Tell that to the alsog that do most of the trading in the market nowadays. :-)

Well, OK. The intent of the comments in this thread has been to be helpful, but if they are not needed, then no problem. I do hope you will be successful in your trading, and that you become one of the algo traders you speak of.

Good luck, and keep us informed.

Bob.

When one door closes, another opens.
-- Cervantes, Don Quixote
Reply With Quote
Thanked by:
  #35 (permalink)
 
rezak's Avatar
 rezak 
Genova.Italy
 
Experience: Intermediate
Platform: TradingView
Broker: retail prop firms
Trading: setups
Posts: 298 since Mar 2021
Thanks Given: 187
Thanks Received: 181


rocketstock View Post
Tell that to the alsog that do most of the trading in the market nowadays. :-)

Nothing personal, but I think it's better to shut up and listen to all ears, what experienced speculators are telling you.

Reply With Quote
Thanked by:
  #36 (permalink)
rocketstock
Denver CO
 
Posts: 40 since Dec 2021
Thanks Given: 6
Thanks Received: 8


bobwest View Post
Well, OK. The intent of the comments in this thread has been to be helpful, but if they are not needed, then no problem. I do hope you will be successful in your trading, and that you become one of the algo traders you speak of.

Good luck, and keep us informed.

Bob.

Will do. Yeah, all this is not easy to program. That was said in humor and not to get anyone touchy. I have really appreciated your inputs but you lost me now after becoming sensitive on something so silly. Also the only thing people on this thread keep expressing is why strategies or things cannot be successful. Good to hear negatives. But you guys gotta present positive things too. I'm sure you are making profits, I hope. It's bad attitude to say that if you dont agree with all that I say "in disguise of calling it helpful". Then I'm gonna take my ball and go home.

But good luck to you also my friend. Us retail gotta beat the hedge funds. I wish you the best.

Reply With Quote
Thanked by:
  #37 (permalink)
 
bobwest's Avatar
 bobwest 
Western Florida
Site Moderator
 
Experience: Advanced
Platform: Sierra Chart
Trading: ES, YM
Frequency: Several times daily
Duration: Minutes
Posts: 8,162 since Jan 2013
Thanks Given: 57,343
Thanks Received: 26,267


rocketstock View Post
Will do. Yeah, all this is not easy to program. That was said in humor and not to get anyone touchy. I have really appreciated your inputs but you lost me now after becoming sensitive on something so silly. Also the only thing people on this thread keep expressing is why strategies or things cannot be successful. Good to hear negatives. But you guys gotta present positive things too. I'm sure you are making profits, I hope. It's bad attitude to say that if you dont agree with all that I say "in disguise of calling it helpful". Then I'm gonna take my ball and go home.

But good luck to you also my friend. Us retail gotta beat the hedge funds. I wish you the best.

It did sound touchy, didn't it? That's because it was, and I apologize for that. I should not have responded that way. So let me retract that sentiment.

There was a point, though. Yes, as you said, a lot of the commentary was how something wouldn't work, and it's hard to put those kinds of comments to use. But the fact is that backtesting is only going to do so much, and the weak point in it is that markets do change. So a too-exact fitting of a strategy to any period of time will often get you in trouble.

So what else do you do? Well, I'm a purely discretionary trader, and it's a little hard to translate from one world to the other. I can talk a little bit, for a while, about algorithmic topics, and then I have to stop, because the differences are too large.

The small point I had was to be cautious about any kind of becktested results, because of the curve-fitting possibility -- the fitting of a strategy to a set of circumstances that never happen again, even if it's very current and you're just using replay data from yesterday. The same issue, in a less-exact form, occurs for the purely discretionary trader too. Dealing with it is crucial to all traders.

This is not a plug, exactly, but many pure algorithmic traders on this forum have read and deeply benefited from Kevin Davey's book, "Building Winning Algorithmic Trading Systems," which you can get on Amazon. It's kind of pricey, but it is very commonly referred to by algorithmic traders here as a good source. If you want to dip your toe in first, he's got some more basic books up on Amazon also. My point in mentioning it is that it addresses the process of building an automated trading system and testing it. Disclosure: I'm going by the comments of others here. It's not my area and I haven't tried the book. However, the author is actually @kevinkdog, who is well-known here and who has left some comments in this thread already.

-----------------

There are some very accomplished traders on this site, who will chip in to try to help and who want others to be successful. It's perfectly OK to ask them to substantiate or clarify what they say, and it's OK to disagree too. But they often do have something to say.

Good luck, and I do mean this.

Bob.

When one door closes, another opens.
-- Cervantes, Don Quixote
Reply With Quote
  #38 (permalink)
rocketstock
Denver CO
 
Posts: 40 since Dec 2021
Thanks Given: 6
Thanks Received: 8


bobwest View Post
It did sound touchy, didn't it? That's because it was, and I apologize for that. I should not have responded that way. So let me retract that sentiment.

There was a point, though. Yes, as you said, a lot of the commentary was how something wouldn't work, and it's hard to put those kinds of comments to use. But the fact is that backtesting is only going to do so much, and the weak point in it is that markets do change. So a too-exact fitting of a strategy to any period of time will often get you in trouble.

So what else do you do? Well, I'm a purely discretionary trader, and it's a little hard to translate from one world to the other. I can talk a little bit, for a while, about algorithmic topics, and then I have to stop, because the differences are too large.

The small point I had was to be cautious about any kind of becktested results, because of the curve-fitting possibility -- the fitting of a strategy to a set of circumstances that never happen again, even if it's very current and you're just using replay data from yesterday. The same issue, in a less-exact form, occurs for the purely discretionary trader too. Dealing with it is crucial to all traders.

This is not a plug, exactly, but many pure algorithmic traders on this forum have read and deeply benefited from Kevin Davey's book, "Building Winning Algorithmic Trading Systems," which you can get on Amazon. It's kind of pricey, but it is very commonly referred to by algorithmic traders here as a good source. If you want to dip your toe in first, he's got some more basic books up on Amazon also. My point in mentioning it is that it addresses the process of building an automated trading system and testing it. Disclosure: I'm going by the comments of others here. It's not my area and I haven't tried the book. However, the author is actually @kevinkdog, who is well-known here and who has left some comments in this thread already.

-----------------

There are some very accomplished traders on this site, who will chip in to try to help and who want others to be successful. It's perfectly OK to ask them to substantiate or clarify what they say, and it's OK to disagree too. But they often do have something to say.

Good luck, and I do mean this.

Bob.

It's all good man. I appreciate your refreshed sentiment. I agree with you about backtesting. Its no good. Market replay is better. That is what I use. Its the only best thing so far that's close to real time. It all has to be run to on real market like you said. Which I will do eventually. but I think its still good to test programs prior. I know you were trying to be helpful. So thanks. I have been trading on charts manually for over 10 years. Started this thread to understand automated strategies and programs and see what other people have achieved. Just curiosity. I ran market replay on 1 month. Now running it on 3 months. There is slight variation as you noted. nothing wild. Maybe I'll run it on 6 months. Takes about 25 minutes for 3 months of market replay. I use my fav indicators that have helped me for years manually. Gonna run it on real market soon. Programming eyes and human brain is hard but the positive side is human emotions are out the door which is awesome with algos.

Reply With Quote
  #39 (permalink)
 kevinkdog   is a Vendor
 
Posts: 3,647 since Jul 2012
Thanks Given: 1,890
Thanks Received: 7,338


rocketstock View Post
It's all good man... but the positive side is human emotions are out the door which is awesome with algos.

I see similar statements a lot "algo trading mean no emotions."

A word of warning - this thinking is not true. Not even close to true.

PLENTY of emotions when algo trading, they just might appear in different ways, for different reasons.

Example: Your algo has lost on last 5 trades, should you let it keep trading, or should you turn it off? That can be an emotional decision, even if you feel the algo is still good.


The only way to avoid emotions in live trading is to demo/sim/paper trade - no real emotions in that. Alternatively, trade so small relative to your net worth that the money gain/lost does not matter (but then why even bother trading?)


If emotions are an issue for your discretionary trading, I can pretty much guarantee they will be an issue for your algo trading.

And believe it or not, emotions can also impact your backtest or market replay testing.

Follow me on Twitter Reply With Quote
  #40 (permalink)
 
bobwest's Avatar
 bobwest 
Western Florida
Site Moderator
 
Experience: Advanced
Platform: Sierra Chart
Trading: ES, YM
Frequency: Several times daily
Duration: Minutes
Posts: 8,162 since Jan 2013
Thanks Given: 57,343
Thanks Received: 26,267


Moderator Notice
Moderator Notice


When one door closes, another opens.
-- Cervantes, Don Quixote
Reply With Quote
Thanked by:




Last Updated on January 14, 2022


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts