NexusFi: Find Your Edge


Home Menu

 





why Backtesting stocks difficult vs backtesting Futures


Discussion in Traders Hideout

Updated
      Top Posters
    1. looks_one emini_Holy_Grail with 4 posts (0 thanks)
    2. looks_two Neo1 with 2 posts (0 thanks)
    3. looks_3 DbPhoenix with 2 posts (1 thanks)
    4. looks_4 Quick Summary with 1 posts (0 thanks)
    1. trending_up 3,893 views
    2. thumb_up 1 thanks given
    3. group 2 followers
    1. forum 8 posts
    2. attach_file 0 attachments




 
Search this Thread

why Backtesting stocks difficult vs backtesting Futures

  #1 (permalink)
 emini_Holy_Grail 
Dallas,TX
 
Experience: Intermediate
Platform: NinjaTrader, OpenQuant
Broker: Zaner/Zen Fire
Trading: ES,6E,6B,GC,CL
Posts: 597 since Nov 2009
Thanks Given: 176
Thanks Received: 126

why Backtetsing stocks difficult vs backtesting Futures


Coming from backtesting/optimising Futures for few years using Ninja tarder and Multicharts

which I do the same instrument every day, every week all year, so backtesting is quite simple here from my experience

in the case of stocks, i struggle to backtest, as symbols are NOT the same everytime

say, for exmaple
This week, I run a scan, I get 20 symbols
Next week, I run a scan, I get 25 symbols

what period (days) would I backtest the 1st set of 20 symbols and
what period (days) would I backtest the 2nd set of 25 symbols

I am sure these are traded once and not repeated
and what software for stocks, can we backtest like this?

and how can I backtest a week past or a month earlier for a scan thats developed a setup now,
example 10EMA/30EMA

Started this thread Reply With Quote

Can you help answer these questions
from other members on NexusFi?
Trade idea based off three indicators.
Traders Hideout
Quant vue
Trading Reviews and Vendors
Better Renko Gaps
The Elite Circle
NT7 Indicator Script Troubleshooting - Camarilla Pivots
NinjaTrader
Cheap historycal L1 data for stocks
Stocks and ETFs
 
  #3 (permalink)
 
Neo1's Avatar
 Neo1 
Christchurch, New Zealand
 
Experience: Beginner
Platform: SC
Broker: IB, BC, Dx Feed
Trading: US Equities
Posts: 428 since Jul 2014
Thanks Given: 471
Thanks Received: 531



emini_Holy_Grail View Post
why Backtetsing stocks difficult vs backtesting Futures


Coming from backtesting/optimising Futures for few years using Ninja tarder and Multicharts

which I do the same instrument every day, every week all year, so backtesting is quite simple here from my experience

in the case of stocks, i struggle to backtest, as symbols are NOT the same everytime

say, for exmaple
This week, I run a scan, I get 20 symbols
Next week, I run a scan, I get 25 symbols

what period (days) would I backtest the 1st set of 20 symbols and
what period (days) would I backtest the 2nd set of 25 symbols

I am sure these are traded once and not repeated
and what software for stocks, can we backtest like this?

and how can I backtest a week past or a month earlier for a scan thats developed a setup now,
example 10EMA/30EMA

What you're saying doesn't make sense, or atleast I don't understand it.

Are you scanning a basket of stocks, and then running more specific backtest on each individual underline?

I'm not sure how you could expect symbols to be the same every-time you run a scan, each stock can act like an independent data series. So the only way you'll get the same results is if you're curve fitting.

"Free markets work because they allow people to be lucky, thanks to aggressive trial and error, not by giving rewards or incentives for skill. The strategy is, then, to tinker as much as possible and try to collect as many Black Swan opportunities as you can"
Reply With Quote
  #4 (permalink)
 emini_Holy_Grail 
Dallas,TX
 
Experience: Intermediate
Platform: NinjaTrader, OpenQuant
Broker: Zaner/Zen Fire
Trading: ES,6E,6B,GC,CL
Posts: 597 since Nov 2009
Thanks Given: 176
Thanks Received: 126


Neo1 View Post
What you're saying doesn't make sense, or atleast I don't understand it.

Are you scanning a basket of stocks, and then running more specific backtest on each individual underline?

I'm not sure how you could expect symbols to be the same every-time you run a scan, each stock can act like an independent data series. So the only way you'll get the same results is if you're curve fitting.

ok, I am coming from Futures that trades everyday against stocks that only trades when set of condition meets, so once a month or less.
let me clarify
I have a scan setup to run on entire Nasdaq, so come up with a set of symbols and I have this symbols to test my conditions to see if they have an entry
1st issue. entire Nasdaq or NYSE, is quite high # of symbols, about 3000. not sure NT can handle it. havent done it

Started this thread Reply With Quote
  #5 (permalink)
 DbPhoenix 
Phoenix AZ
 
Posts: 470 since Dec 2012


emini_Holy_Grail View Post
ok, I am coming from Futures that trades everyday against stocks that only trades when set of condition meets, so once a month or less.
let me clarify
I have a scan setup to run on entire Nasdaq, so come up with a set of symbols and I have this symbols to test my conditions to see if they have an entry
1st issue. entire Nasdaq or NYSE, is quite high # of symbols, about 3000. not sure NT can handle it. havent done it

The Naz and the NYSE are very different. But aside from that, if you're getting too many hits, narrow your universe, such as by float, both too much and too little. That may decrease the number of hits dramatically. You may also narrow it according to those who actually earned something last year and those who didn't.

Reply With Quote
  #6 (permalink)
 emini_Holy_Grail 
Dallas,TX
 
Experience: Intermediate
Platform: NinjaTrader, OpenQuant
Broker: Zaner/Zen Fire
Trading: ES,6E,6B,GC,CL
Posts: 597 since Nov 2009
Thanks Given: 176
Thanks Received: 126


DbPhoenix View Post
The Naz and the NYSE are very different. But aside from that, if you're getting too many hits, narrow your universe, such as by float, both too much and too little. That may decrease the number of hits dramatically. You may also narrow it according to those who actually earned something last year and those who didn't.

thanks for your input. my strategy doesn't have criteria to filter and scan Fundamental screening, but i dont understand " by float" pl explain

but you got my objective right. I do want to filter and less trades/symbol in a year

Started this thread Reply With Quote
  #7 (permalink)
 DbPhoenix 
Phoenix AZ
 
Posts: 470 since Dec 2012


emini_Holy_Grail View Post
thanks for your input. my strategy doesn't have criteria to filter and scan Fundamental screening, but i dont understand " by float" pl explain

but you got my objective right. I do want to filter and less trades/symbol in a year

If you don't include fundamentals, then you'll probably get just as many hits as you're getting now. Technical analysis is of limited value if no one wants whatever the scan yields. It is of most value when applied to actively-traded stocks, and unless you want to trade penny stocks, actively-traded stocks are going to have a reasonably high float, i.e., a reasonably high number of shares available for purchase. This doesn't mean limiting yourself to MSFT and AAPL, but it does suggest avoiding stocks that no one has ever heard of.

A universe of a hundred highly-desirable stocks is plenty. You can review these in a few minutes if you know what you're looking for. Thousands is excessive.

Reply With Quote
  #8 (permalink)
 
Neo1's Avatar
 Neo1 
Christchurch, New Zealand
 
Experience: Beginner
Platform: SC
Broker: IB, BC, Dx Feed
Trading: US Equities
Posts: 428 since Jul 2014
Thanks Given: 471
Thanks Received: 531


DbPhoenix View Post

A universe of a hundred highly-desirable stocks is plenty. You can review these in a few minutes if you know what you're looking for. Thousands is excessive.

Exactly, there's no point scanning multiple stock indices when many stocks could have completely different characteristics eg volatility/volume/ liquidity- you could expect the data set on alot of stocks to be independent of one another. So you need to know what you're looking for, and at-least have a basic criteria that filters out the junk to a universe that is tradeable and shares more of the same characteristics. Once you've optimized it then be sure to out of sample test it.

"Free markets work because they allow people to be lucky, thanks to aggressive trial and error, not by giving rewards or incentives for skill. The strategy is, then, to tinker as much as possible and try to collect as many Black Swan opportunities as you can"
Reply With Quote
  #9 (permalink)
 emini_Holy_Grail 
Dallas,TX
 
Experience: Intermediate
Platform: NinjaTrader, OpenQuant
Broker: Zaner/Zen Fire
Trading: ES,6E,6B,GC,CL
Posts: 597 since Nov 2009
Thanks Given: 176
Thanks Received: 126


Neo1 View Post
Exactly, there's no point scanning multiple stock indices when many stocks could have completely different characteristics eg volatility/volume/ liquidity- you could expect the data set on alot of stocks to be independent of one another. So you need to know what you're looking for, and at-least have a basic criteria that filters out the junk to a universe that is tradeable and shares more of the same characteristics. Once you've optimized it then be sure to out of sample test it.

thks to both of you. sorry, didn't get time until today to respond

Started this thread Reply With Quote




Last Updated on July 4, 2015


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts