NexusFi: Find Your Edge


Home Menu

 





Best data feed for backtesting?


Discussion in Brokers

Updated
      Top Posters
    1. looks_one NetTecture with 3 posts (5 thanks)
    2. looks_two Corinne with 3 posts (0 thanks)
    3. looks_3 Lampert with 2 posts (2 thanks)
    4. looks_4 kiloguru with 2 posts (0 thanks)
      Best Posters
    1. looks_one GoldStandard with 3 thanks per post
    2. looks_two program with 2 thanks per post
    3. looks_3 NetTecture with 1.7 thanks per post
    4. looks_4 Lampert with 1 thanks per post
    1. trending_up 12,217 views
    2. thumb_up 13 thanks given
    3. group 8 followers
    1. forum 15 posts
    2. attach_file 0 attachments




 
Search this Thread

Best data feed for backtesting?

  #1 (permalink)
 Xyzzy 
Seattle, WA
 
Experience: Advanced
Platform: MultiCharts
Broker: IB/IQFeed
Trading: ES
Posts: 24 since Dec 2010
Thanks Given: 27
Thanks Received: 22

Hi,

I'm a complete newbie. My goal is to develop an automated trading strategy, most likely using MultiCharts. Before I commit any real money, I'm planning on spending a lot of time experimenting and backtesting. I'll probably start with stocks and ETFs.

I'm trying to pick a data feed to use with MultiCharts. I've reviewed the ones listed in their chart:
Data Feeds | [AUTOLINK]MultiCharts[/AUTOLINK] Charting Software

I'm a bit surprised that many of these data providers only have intra-day data going back a few months. My instinct is that for purposes of backtesting, more historical data is better. I'd prefer to develop a strategy and backtest it against different periods of time to make sure that it holds together in different market conditions -- and make sure that any winning strategy isn't just a fluke based on the conditions of the past two months or six months. Is my assumption correct?

If so, what would people recommend for the data provider? According to the MultiCharts information, the TradeStation 8 feed seems to be the most complete, with minute data going back 20 years. Would this be the best candidate, or is it overkill? Many thanks.

Started this thread Reply With Quote

Can you help answer these questions
from other members on NexusFi?
Trade idea based off three indicators.
Traders Hideout
NT7 Indicator Script Troubleshooting - Camarilla Pivots
NinjaTrader
ZombieSqueeze
Platforms and Indicators
MC PL editor upgrade
MultiCharts
How to apply profiles
Traders Hideout
 
Best Threads (Most Thanked)
in the last 7 days on NexusFi
Just another trading journal: PA, Wyckoff & Trends
33 thanks
Tao te Trade: way of the WLD
24 thanks
My NQ Trading Journal
14 thanks
GFIs1 1 DAX trade per day journal
11 thanks
HumbleTraders next chapter
11 thanks
  #3 (permalink)
 NetTecture 
Szczecin
 
Experience: Intermediate
Platform: Ninja, writing own now
Posts: 211 since Mar 2010



Xyzzy View Post
Hi,

I'm a complete newbie. My goal is to develop an automated trading strategy, most likely using MultiCharts. Before I commit any real money, I'm planning on spending a lot of time experimenting and backtesting. I'll probably start with stocks and ETFs.

I'm trying to pick a data feed to use with MultiCharts. I've reviewed the ones listed in their chart:
Data Feeds | [AUTOLINK]MultiCharts[/AUTOLINK] Charting Software

I'm a bit surprised that many of these data providers only have intra-day data going back a few months. My instinct is that for purposes of backtesting, more historical data is better. I'd prefer to develop a strategy and backtest it against different periods of time to make sure that it holds together in different market conditions -- and make sure that any winning strategy isn't just a fluke based on the conditions of the past two months or six months. Is my assumption correct?

If so, what would people recommend for the data provider? According to the MultiCharts information, the TradeStation 8 feed seems to be the most complete, with minute data going back 20 years. Would this be the best candidate, or is it overkill? Many thanks.

After the last months I would say Nanex / NxCore. Point. The only feed that makes sure you have ALL the data, regardless pretty much what happens on your end. Sadly also one of the more expensive ones, and one that requires.... own programming. Nearly noone implements them. Plus they ONLY deliver complete exchanges, so some heavy programming is needed.

But their support is VERY focused on making sure ther are no gaps. Even if your network is down some days.

Reply With Quote
  #4 (permalink)
 
GoldStandard's Avatar
 GoldStandard 
arizona
 
Experience: Intermediate
Platform: rolling my own
Trading: ES,CL,GC,6E
Posts: 205 since Oct 2009
Thanks Given: 324
Thanks Received: 191

NetTecture's recommendation is a good one. One nice thing about nxcore is you can buy very complete historical data ($100 for a month of the entire CME) that includes all the level 2 information , which makes it possible for you to do detailed, accurate backtesting. You do have to write your own backtesting application or hire a programmer do it for you. This is the path I'm taking, but I've started a small group to share testing duties and defray expenses. We're using nxcore historical data for backtesting, and DTN IQfeed data for forward testing. We may eventually upgrade to an nxcore live feed if we feel the need.

DTN IQfeed seems to be the best quality retail data feed. It's owned by the same company as nxcore, and they seem to take the quality of their data and service more seriously than other affordable vendors.

Reply With Quote
Thanked by:
  #5 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,440 since Jun 2009
Thanks Given: 33,209
Thanks Received: 101,599

IMO, DTN IQfeed is the best data feed solution and also well priced.

For backtesting, the best thing is to ask a friend to send you data. There are several historical data threads on the site in the Elite section with years of backfill shared among friends.

Mike

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #6 (permalink)
kiloguru
US
 
Posts: 6 since Jan 2011
Thanks Given: 3
Thanks Received: 1

Yahoo Finance gives free EOD data for atleast 20 years (and even more in some cases). If you are experimenting, this is a good place to start.

Reply With Quote
  #7 (permalink)
 NetTecture 
Szczecin
 
Experience: Intermediate
Platform: Ninja, writing own now
Posts: 211 since Mar 2010


kiloguru View Post
Yahoo Finance gives free EOD data for atleast 20 years (and even more in some cases). If you are experimenting, this is a good place to start.

Ah - yes. That it going to be very helpfull in automatic trading. Especially without knowing the real data, the data quality and a ton of other factors.

With Yahoo:

* You only have EOD
* You dont know how to simulate executions at all (what about VERY thin days?)
* You dont know about gaps
* You dont know about possible data errors
* You dont know about posst trading changes that may have hit you (NxCore, for example, gives you raw data - traes as they happen, corrections / cancel as they happen, so you can consolidate your feed as you want).

Trading like "more active than buy and hold some months" - Yahoo is pretty much worth what you pay for it, zero.

Reply With Quote
  #8 (permalink)
 MetalTrade 
 
Posts: 1,055 since May 2010

DTN/IQfeed or E-signal.

Reply With Quote
  #9 (permalink)
kiloguru
US
 
Posts: 6 since Jan 2011
Thanks Given: 3
Thanks Received: 1


NetTecture View Post
Ah - yes. That it going to be very helpfull in automatic trading. Especially without knowing the real data, the data quality and a ton of other factors.

With Yahoo:

* You only have EOD
* You dont know how to simulate executions at all (what about VERY thin days?)
* You dont know about gaps
* You dont know about possible data errors
* You dont know about posst trading changes that may have hit you (NxCore, for example, gives you raw data - traes as they happen, corrections / cancel as they happen, so you can consolidate your feed as you want).

Trading like "more active than buy and hold some months" - Yahoo is pretty much worth what you pay for it, zero.

I did mention that Yahoo data was EOD, right! So, if your strategy is based on EOD data then it can be used. You can have automated EOD trading.

I think Yahoo data is actually pretty good quality. I have benchmarked it against a couple of other sources (Google, Fidelity) and find it accurate. Yahoo data needs to be adjusted for dividends and splits. There are a lot of people doing that already and I have some scripts that do that.

Reply With Quote
  #10 (permalink)
 Corinne 
Toronto, Ontario, Canada
 
Experience: Intermediate
Platform: NinjaTrader
Trading: forex, Eminis
Posts: 4 since Jul 2012
Thanks Given: 9
Thanks Received: 0



Xyzzy View Post
Hi,

I'm a complete newbie. My goal is to develop an automated trading strategy, most likely using MultiCharts. Before I commit any real money, I'm planning on spending a lot of time experimenting and backtesting. I'll probably start with stocks and ETFs.

I'm trying to pick a data feed to use with MultiCharts. I've reviewed the ones listed in their chart

I'm a bit surprised that many of these data providers only have intra-day data going back a few months. My instinct is that for purposes of backtesting, more historical data is better. I'd prefer to develop a strategy and backtest it against different periods of time to make sure that it holds together in different market conditions -- and make sure that any winning strategy isn't just a fluke based on the conditions of the past two months or six months. Is my assumption correct?

If so, what would people recommend for the data provider? According to the MultiCharts information, the TradeStation 8 feed seems to be the most complete, with minute data going back 20 years. Would this be the best candidate, or is it overkill? Many thanks.



Big Mike View Post
IMO, DTN IQfeed is the best data feed solution and also well priced.


Hi,

This is my first post on futures.io (formerly BMT). Xyzzy's post pretty much described my situation...developing autotrading strategy using Multicharts for backtesting, trading through IB and am looking for a quality data provider with historical minute data going back +10 years.

I've been trying out DTN IQFeed for a couple of weeks and I finally figured out that IQFeed does not provide weekend data. I first noticed the weekend data gaps because the backtesting results always look unreasonable on the weekends. Has anyone also come across this a problem?

Is the top recommended data feed provider still Nanex/NXcore?

What are some other quality data feed provider I can explore...long historical minute data with weekend data and reasonably priced? Metastock? eSignal? FXCM?

Thanks.

Reply With Quote




Last Updated on July 26, 2012


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts