NexusFi: Find Your Edge


Home Menu

 





KJ Trading Systems Kevin Davey - Ask Me Anything (AMA)


Discussion in Trading Reviews and Vendors

Updated
      Top Posters
    1. looks_one kevinkdog with 180 posts (416 thanks)
    2. looks_two SMCJB with 23 posts (40 thanks)
    3. looks_3 Mabi with 17 posts (12 thanks)
    4. looks_4 bluefightingcat with 16 posts (9 thanks)
      Best Posters
    1. looks_one grausch with 2.8 thanks per post
    2. looks_two kevinkdog with 2.3 thanks per post
    3. looks_3 SMCJB with 1.7 thanks per post
    4. looks_4 Big Mike with 1.5 thanks per post
    1. trending_up 170,385 views
    2. thumb_up 649 thanks given
    3. group 111 followers
    1. forum 433 posts
    2. attach_file 15 attachments




Closed Thread
 
Search this Thread

KJ Trading Systems Kevin Davey - Ask Me Anything (AMA)

  #281 (permalink)
 bluefightingcat 
Espoo Finland
 
Experience: Intermediate
Platform: TradingBlox, Tradestation
Trading: Stocks
Posts: 41 since Sep 2015
Thanks Given: 2
Thanks Received: 10


SMCJB View Post
Walkforward (the way Kevin teaches it) is the bane of my existance, but also probably a life saver. I have so many things that look good at first but never can get past walkforward. That tells me they wouldn't work in real life either.

Do you have any examples (settings/features not packages) where this is the case. If done correctly I can't see how your walkforwards could be increasing curve fitting.

Well you have to choose "parameters" for Walk Forward e.g. length of in-sample vs length of out-sample. Which measure of goodness to use. It's easily possible to start "optimizing" the walk forward process.

Kevin: Do you have more information about your WAlk-Forward process and the practicalities related to it. Maybe a webinar or something?

Thanked by:

Can you help answer these questions
from other members on NexusFi?
Exit Strategy
NinjaTrader
Are there any eval firms that allow you to sink to your …
Traders Hideout
ZombieSqueeze
Platforms and Indicators
Better Renko Gaps
The Elite Circle
New Micros: Ultra 10-Year & Ultra T-Bond -- Live Now
Treasury Notes and Bonds
 
  #282 (permalink)
 kevinkdog   is a Vendor
 
Posts: 3,647 since Jul 2012
Thanks Given: 1,890
Thanks Received: 7,338


SMCJB View Post
Walkforward (the way Kevin teaches it) is the bane of my existance, but also probably a life saver. I have so many things that look good at first but never can get past walkforward. That tells me they wouldn't work in real life either.

Do you have any examples (settings/features not packages) where this is the case. If done correctly I can't see how your walkforwards could be increasing curve fitting.


I would say Cluster Analysis feature of some platforms could be curvefitting.

Follow me on Twitter
  #283 (permalink)
 kevinkdog   is a Vendor
 
Posts: 3,647 since Jul 2012
Thanks Given: 1,890
Thanks Received: 7,338



bluefightingcat View Post
Well you have to choose "parameters" for Walk Forward e.g. length of in-sample vs length of out-sample. Which measure of goodness to use. It's easily possible to start "optimizing" the walk forward process.

Kevin: Do you have more information about your WAlk-Forward process and the practicalities related to it. Maybe a webinar or something?


Yes, but only available to students...

Follow me on Twitter
  #284 (permalink)
 
SMCJB's Avatar
 SMCJB 
Houston TX
Legendary Market Wizard
 
Experience: Advanced
Platform: TT and Stellar
Broker: Advantage Futures
Trading: Primarily Energy but also a little Equities, Fixed Income, Metals and Crypto.
Frequency: Many times daily
Duration: Never
Posts: 5,041 since Dec 2013
Thanks Given: 4,375
Thanks Received: 10,192


bluefightingcat View Post
Well you have to choose "parameters" for Walk Forward e.g. length of in-sample vs length of out-sample. Which measure of goodness to use. It's easily possible to start "optimizing" the walk forward process.

Ahh okay. Yes I agree you can optimize the walkforward itself, different is/os periods, different start dates etc etc and that would obviously could lead to over fitting, which is why you shouldn't do it.


kevinkdog View Post
I would say Cluster Analysis feature of some platforms could be curvefitting.

Thank's Kevin that's interesting. As you know I've looked at Cluster Analysis, and would say in that 4 out of 5 cases my cluster analysis produces better/more stable results. My clustering is just 'average gross profit of nearest neighbors' but maybe that is the exact type of overfitting you mean. I've had so few systems pass either walkforward test though it's difficult to analyze the effect of clustering on my results.

Off topic - for many years the Texans were called Denver South. After last night I'm not sure whether we should be Cleveland South or whether you should be Houston North!

  #285 (permalink)
 kevinkdog   is a Vendor
 
Posts: 3,647 since Jul 2012
Thanks Given: 1,890
Thanks Received: 7,338


SMCJB View Post
Ahh okay. Yes I agree you can optimize the walkforward itself, different is/os periods, different start dates etc etc and that would obviously could lead to over fitting, which is why you shouldn't do it.


Thank's Kevin that's interesting. As you know I've looked at Cluster Analysis, and would say in that 4 out of 5 cases my cluster analysis produces better/more stable results. My clustering is just 'average gross profit of nearest neighbors' but maybe that is the exact type of overfitting you mean. I've had so few systems pass either walkforward test though it's difficult to analyze the effect of clustering on my results.

Off topic - for many years the Texans were called Denver South. After last night I'm not sure whether we should be Cleveland South or whether you should be Houston North!

Pretty soon, the Browns will have all the Texans picks in future drafts. But it does not matter, the Browns would screw up a draft even if they had every single pick!

I think there are ways to do Cluster analysis correctly, and ways to just curve fit with it. In any analysis/testing, I always like to see as much performance as possible with unseen data. That to me is the key.

Follow me on Twitter
Thanked by:
  #286 (permalink)
 alko 
San Diego, USA
 
Experience: Intermediate
Platform: MC
Trading: All
Posts: 48 since Aug 2016
Thanks Given: 7
Thanks Received: 14

Kevin, which system would you say is more robust - the one that uses no variables (or in other words the variable is fixed and is not wf) or a system where you wf a single variable after a certain time frame? Assume here that systems are built in the same manner where IS period is all data except for the past 2 years. I am asking this question as you come across both systems but not sure which one you should strive for as logic behind both of them is usually different.

Thanked by:
  #287 (permalink)
 kevinkdog   is a Vendor
 
Posts: 3,647 since Jul 2012
Thanks Given: 1,890
Thanks Received: 7,338


alko View Post
Kevin, which system would you say is more robust - the one that uses no variables (or in other words the variable is fixed and is not wf) or a system where you wf a single variable after a certain time frame? Assume here that systems are built in the same manner where IS period is all data except for the past 2 years. I am asking this question as you come across both systems but not sure which one you should strive for as logic behind both of them is usually different.

Really, either one could be bad, or either one could be good. It all depends HOW it was developed. For example, using no variables (where you fix the variable value) can be nice, but not if it was derived after running an optimization, then realizing you could "fix" it to a set value. Similarly, you can screw up the wf approach it multiple ways (cluster analysis when done incorrectly is just one way to mess it up).

Ultimately, no matter how you do it, live (future) data is the best judge of which is better.

Not the answer you hoped for, but I hope it helps...

Kevin

Follow me on Twitter
Thanked by:
  #288 (permalink)
 
Mabi's Avatar
 Mabi 
sweden
 
Experience: Advanced
Platform: NinjaTrader,MetaTrader
Trading: futures, FX
Posts: 141 since Oct 2010
Thanks Given: 121
Thanks Received: 136

Do you think there could be an edge from counting consecutive Loser's and Winner's in a strategies history and from that analyze and implement increased or decreased position sizing . I think the key point is to cut the extrems from a sequence
when the probability of another losing trade or another winning trade is very very weak

Thanked by:
  #289 (permalink)
 montanajtt 
Como, Italy
 
Experience: Advanced
Platform: Tradestation, IB
Broker: Tradestation, IB
Trading: ES
Frequency: Daily
Duration: Minutes
Posts: 184 since Aug 2014
Thanks Given: 299
Thanks Received: 312

I have three strategies working on ES, they did pretty good the last two years since I put them live but this year I'm really having hard times keeping them working. Overall they are still in profit YTD but numbers are very small and defenitely this is due to the low volatility. I'm trying to think which could be the events that could increase volatility, French election for example were a non event.
So I was wondering if anyother who have strategies on ES is experiencing my same difficulties...

Thanked by:
  #290 (permalink)
 kevinkdog   is a Vendor
 
Posts: 3,647 since Jul 2012
Thanks Given: 1,890
Thanks Received: 7,338



Mabi View Post
Do you think there could be an edge from counting consecutive Loser's and Winner's in a strategies history and from that analyze and implement increased or decreased position sizing . I think the key point is to cut the extrems from a sequence
when the probability of another losing trade or another winning trade is very very weak

That approach might help ONLY if your trades exhibit serial correlation.

Otherwise, it would work about as well as applying it to a random coin flip, which also has consecutive loser/winner runs. In other words, it would work only be sheer luck.

Follow me on Twitter
Thanked by:

Closed Thread



Last Updated on July 5, 2019


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts