Software for basic statistical analysis? - Platforms and Indicators | futures io social day trading
futures io futures trading


Software for basic statistical analysis?
Updated: Views / Replies:4,974 / 15
Created: by Xyzzy Attachments:0

Welcome to futures io.

(If you already have an account, login at the top of the page)

futures io is the largest futures trading community on the planet, with over 90,000 members. At futures io, our goal has always been and always will be to create a friendly, positive, forward-thinking community where members can openly share and discuss everything the world of trading has to offer. The community is one of the friendliest you will find on any subject, with members going out of their way to help others. Some of the primary differences between futures io and other trading sites revolve around the standards of our community. Those standards include a code of conduct for our members, as well as extremely high standards that govern which partners we do business with, and which products or services we recommend to our members.

At futures io, our focus is on quality education. No hype, gimmicks, or secret sauce. The truth is: trading is hard. To succeed, you need to surround yourself with the right support system, educational content, and trading mentors Ė all of which you can find on futures io, utilizing our social trading environment.

With futures io, you can find honest trading reviews on brokers, trading rooms, indicator packages, trading strategies, and much more. Our trading review process is highly moderated to ensure that only genuine users are allowed, so you donít need to worry about fake reviews.

We are fundamentally different than most other trading sites:
  • We are here to help. Just let us know what you need.
  • We work extremely hard to keep things positive in our community.
  • We do not tolerate rude behavior, trolling, or vendors advertising in posts.
  • We firmly believe in and encourage sharing. The holy grail is within you, we can help you find it.
  • We expect our members to participate and become a part of the community. Help yourself by helping others.

You'll need to register in order to view the content of the threads and start contributing to our community.  It's free and simple.

-- Big Mike, Site Administrator

Reply
 
Thread Tools Search this Thread
 

Software for basic statistical analysis?

  #1 (permalink)
Elite Member
Seattle, WA
 
Futures Experience: Intermediate
Platform: MultiCharts
Broker/Data: IB/IQFeed
Favorite Futures: ES
 
Posts: 20 since Dec 2010
Thanks: 27 given, 7 received

Software for basic statistical analysis?

I've been using the Portfolio Backtesting features of MultiCharts, and I'm liking it quite a bit. However, it's limited in that it can only backtest 100 symbols at a time. Also, sometimes I feel like I'm throwing spaghetti at the wall to see what sticks -- I'm following recommended strategies based on "conventional wisdom" from technical analysis books, many of which seem to be completely useless, and optimizing lots of parameters to see what works (with the risk of curve fitting).

I'm looking for something a bit different, namely software to do some "what if" statistical analysis of strategies across a broader universe of symbols (e.g., all of the symbols on the NYSE). I'd like to be able to test certain strategies or patterns to see if they correlate with a positive outcome. This seems to be somewhat different than backtesting -- I don't want to know how much money I would have made or lost on a particular strategy, but instead the statistical correlation between a certain event and a certain outcome.

E.g., what if I go long when the 3 SMA crosses over the 9 SMA on daily bars and the price is above the 200 SMA? Or, what if I go short 30 minutes after the market open on a gap down day, and close at the end of the day? I'd like to know in either case how often, on a percentage basis, the price rises or falls after a certain period on a percentage basis, and the degree of correlation.

I could probably hack together something in Excel, but I'm hoping that I don't have to reinvent the wheel. I also know about more sophisticated software like Matlab and R, but from what little I know, they seem both quite complicated and rather "general purpose" -- I'd prefer to use something that's more geared towards technical analysis of financial markets, and I don't have a statistics background.

Does software like this exist? Many thanks in advance.

Reply With Quote
 
  #2 (permalink)
Quick Summary
Quick Summary Post

Quick Summary is created and edited by users like you... Add FAQ's, Links and other Relevant Information by clicking the edit button in the lower right hand corner of this message.

 
  #3 (permalink)
Membership Revoked
Oslo, Norway
 
Futures Experience: Advanced
Platform: CQG, Excel
Favorite Futures: CL
 
Lornz's Avatar
 
Posts: 1,198 since Apr 2010
Thanks: 500 given, 1,235 received



Xyzzy View Post
I've been using the Portfolio Backtesting features of MultiCharts, and I'm liking it quite a bit. However, it's limited in that it can only backtest 100 symbols at a time. Also, sometimes I feel like I'm throwing spaghetti at the wall to see what sticks -- I'm following recommended strategies based on "conventional wisdom" from technical analysis books, many of which seem to be completely useless, and optimizing lots of parameters to see what works (with the risk of curve fitting).

I'm looking for something a bit different, namely software to do some "what if" statistical analysis of strategies across a broader universe of symbols (e.g., all of the symbols on the NYSE). I'd like to be able to test certain strategies or patterns to see if they correlate with a positive outcome. This seems to be somewhat different than backtesting -- I don't want to know how much money I would have made or lost on a particular strategy, but instead the statistical correlation between a certain event and a certain outcome.

E.g., what if I go long when the 3 SMA crosses over the 9 SMA on daily bars and the price is above the 200 SMA? Or, what if I go short 30 minutes after the market open on a gap down day, and close at the end of the day? I'd like to know in either case how often, on a percentage basis, the price rises or falls after a certain period on a percentage basis, and the degree of correlation.

I could probably hack together something in Excel, but I'm hoping that I don't have to reinvent the wheel. I also know about more sophisticated software like Matlab and R, but from what little I know, they seem both quite complicated and rather "general purpose" -- I'd prefer to use something that's more geared towards technical analysis of financial markets, and I don't have a statistics background.

Does software like this exist? Many thanks in advance.

You could check out the following sites:

The Most Advanced Tool for Analyzing Price Action and Discovering Trading Systems

Trading System Lab

They will let you find patterns within predefined risk parameters, and that might be a good starting point for building a system. I assume MATLAB would be the best for your needs, but others can probably answer that better than me. I am not a strong coder, and I've found CQG IC to be sufficient for my simple backtests. The language is relatively intuitive, and the optimization is pretty good too.

Good Luck!


Last edited by Lornz; May 7th, 2011 at 11:30 PM.
Reply With Quote
The following 3 users say Thank You to Lornz for this post:
 
  #4 (permalink)
Membership Permanently Revoked
 
Futures Experience: Intermediate
 
Posts: 1,176 since Nov 2009
Thanks: 221 given, 844 received

you can look at tradingblox builder.. it might fit your needs, they have a 10 day trial/demo.. you can also look at CQGIC backtester and signal evaluator, it might meet your needs as well.. and they have some rather great features that will even allow you to implement the ideas you test succesfully... you can get a 2 week trial...

you are already aware of matlab and R, so I wont bother mention them ... but they are usually one of the best tool for those statistically inclined that can code.

Reply With Quote
The following user says Thank You to sysot1t for this post:
 
  #5 (permalink)
Elite Member
Asia
 
Futures Experience: Beginner
Platform: NinjaTrader, TOS
 
Posts: 798 since Jun 2009
Thanks: 109 given, 786 received

This may sound lame but here you go. What I do:

Where I don't want want to reinvent the wheel (or spend too much money) is on the tick database and a code library that can build time series from those ticks, and has most of the TA functions built in. For an off-the-shelf system that has that functionality I use Ninja Trader. But wait...

I'm not using it on its own.

I code my trade ideas to output data that can be exported to Excel/R/Matlab and do analysis outside of Ninja, so I am primarily using Ninja for its database, code functions, and ability to interface with a variety of data providers.

One of my primary tools I share here in the downloads section. Its a Ninja Strategy called ExportData. Take a look at this code snippet:

 
Code
case MyDateTime.CustomCode2:
{
//This is an example showing a trade signal bool being output.

int goLong = 0;
int goShort = 0;
if (CrossAbove(EMA(7), EMA(14), 1)) goLong = 1;
else goLong = 0;
if (CrossBelow(EMA(7), EMA(14), 1)) goShort = 1;
else goShort = 0;
 
string data = (Time[0].ToString("yyyy-MM-dd HH:mm:ss") + dataSeparator + Close[0] + dataSeparator + goLong + dataSeparator + goShort);
if (splitDateTime == true)
{
data = data.Replace(' ',dataSeparator);
}
 
sw.WriteLine(data);
break; 
}
That basically opens up in an Excel spreadsheet with four columns... DateTime, Closing Price and a Column each for GoLong or GoShort where a 1 or 0 represent a true/false bool state of the trade logic, which in this case is a 7/14 EMA cross.

I can use Ninja itself to manage the data and aggregate ticks into bars of varying periodcity.

The possibilities of what can be tested in this way is limited only by your imagination and coding skills. I've coded things to look at running PnL on portfolios so I can watch daily VAR, for example.

The free Statistics add-in to Excel is a good place to start if you wanted to look at things such as the Gap idea you mentioned. You would need to be able to express that idea in C#, probably with a bool variable output that indicates a winning or non-winning trade and a PnL. As you progress you may find you prefer to do some simple things in R or Matlab because they are better than Excel for certain things... but again using Ninja and its database as source of data.

The other thing Ninja is good for is static data management. Again something I don't necessarily want to build myself. Instrument Manager and Instrument Lists are very handy for this type of work. You could run your script against the S&P500, or if you have it, a list of everything traded at the NYSE.

For a free product (if you are not trading through it) Ninja is pretty cool. R is also free, and if you don't have Excel, OpenOffice is free. Where I spend money is on data. I'm an IQFeed subscriber.

I liked your comment:


Quoting 
I'm following recommended strategies based on "conventional wisdom" from technical analysis books, many of which seem to be completely useless

You are on the right path if you are testing and debunking things. This may come out the wrong way... but if you start with the idea that nothing works and you continue to test ideas to confirm that thesis, you might be pleasantly surprised one day and will have saved yourself some money and grief in the process.


Last edited by MXASJ; May 8th, 2011 at 11:44 PM.
Reply With Quote
The following 2 users say Thank You to MXASJ for this post:
 
  #6 (permalink)
Membership Permanently Revoked
 
Futures Experience: Intermediate
 
Posts: 1,176 since Nov 2009
Thanks: 221 given, 844 received

@MXASJ ... you should look at qcollector... less cumbersome to collect data with it..

QCollector Expert for DTN IQFeed

Reply With Quote
 
  #7 (permalink)
Membership Temporarily Revoked
NYC
 
Futures Experience: None
Platform: graph paper and pencil
Favorite Futures: harp
 
dutchbookmaker's Avatar
 
Posts: 187 since Dec 2010
Thanks: 9 given, 107 received

I think Trade Ideas is exactly for what you are talking about if you dont want to get into much code.
Trade-Ideas.com - Real-Time Stock Scanner and Market Alerts
Brett Steenbarger use to talk about it alot in his blog but I've never tried it.
It is in real time though and I think they supply the data so it is not the cheapest.

I think you could also do something crude in ninja, backtesting a strategy on a list of instruments and spitting out the % stuff to the output window.

Reply With Quote
 
  #8 (permalink)
Elite Member
Asia
 
Futures Experience: Beginner
Platform: NinjaTrader, TOS
 
Posts: 798 since Jun 2009
Thanks: 109 given, 786 received


sysot1t View Post
@MXASJ ... you should look at qcollector... less cumbersome to collect data with it..

QCollector Expert for DTN IQFeed

I've tried that, and a new one not quite ready for prime time here: QuoteCore - Home.

But it is not just the raw market data I use. There are some useful event-driven methods in Ninja (and most trading platforms) that greatly reduce time-to-market for a trade idea. So I run ExportData not just to export data, but to run an ETL process on the data that does things the built-in backtesting engine can't do.

Reply With Quote
 
  #9 (permalink)
Membership Permanently Revoked
 
Futures Experience: Intermediate
 
Posts: 1,176 since Nov 2009
Thanks: 221 given, 844 received


dutchbookmaker View Post
I think Trade Ideas is exactly for what you are talking about if you dont want to get into much code.
Trade-Ideas.com - Real-Time Stock Scanner and Market Alerts
Brett Steenbarger use to talk about it alot in his blog but I've never tried it.
It is in real time though and I think they supply the data so it is not the cheapest.

I think you could also do something crude in ninja, backtesting a strategy on a list of instruments and spitting out the % stuff to the output window.

TIPro with OddsMaker is a good way to get quick results... I have to agree... a bit limited, but you can scan through a universe of stocks with a simple idea rather quickly and backtest that idea.

Reply With Quote
 
  #10 (permalink)
Elite Member
Seattle, WA
 
Futures Experience: Intermediate
Platform: MultiCharts
Broker/Data: IB/IQFeed
Favorite Futures: ES
 
Posts: 20 since Dec 2010
Thanks: 27 given, 7 received


Thanks everyone for the great suggestions. The Odds Maker looks close to what I"m looking for, although it also doesn't seem to be as robust as I'd like in terms of entry and exit conditions.

The suggestions with NinjaTrader sound like a great idea. One downside with MultiCharts is that their backtesting module is limited to 100 symbols at the present (they're promising to expand that soon...), so I can't do a scan of a broad portfolio with hundreds or thousands of symbols. If NinjaTrader can do that, then that might be the ticket. I'll give it a try.

Reply With Quote

Reply



futures io > > > Software for basic statistical analysis?

Thread Tools Search this Thread
Search this Thread:

Advanced Search



Upcoming Webinars and Events (4:30PM ET unless noted)

Linda Bradford Raschke: Reading The Tape

Elite only

Adam Grimes: TBA

Elite only

NinjaTrader: TBA

January

Ran Aroussi: TBA

Elite only
     

Similar Threads
Thread Thread Starter Forum Replies Last Post
Miscellaneous Statistical Analysis (the big thread) trendisyourfriend The Elite Circle 29 July 15th, 2013 01:51 PM
DOM Analysis Software aviat72 The Elite Circle 30 April 19th, 2012 05:11 PM
basic R question sam028 Matlab, R project and Python 2 March 20th, 2010 07:32 PM
Seeking collaborator on statistical swing predictor cclsys NinjaTrader Programming 4 November 30th, 2009 01:53 PM
Statistical Definitions for Newbies NMTrader Traders Hideout 1 July 28th, 2009 02:39 AM


All times are GMT -4. The time now is 03:11 AM.

Copyright © 2017 by futures io, s.a., Av Ricardo J. Alfaro, Century Tower, Panama, +507 833-9432, info@futures.io
All information is for educational use only and is not investment advice.
There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
no new posts
Page generated 2017-12-13 in 0.17 seconds with 19 queries on phoenix via your IP 54.226.132.197