S#.Data (Hydra) - market-data downloader - Platforms and Indicators | futures io social day trading
futures io futures trading


S#.Data (Hydra) - market-data downloader
Updated: Views / Replies:338 / 1
Created: by stocksharp Attachments:0

Welcome to futures io.

(If you already have an account, login at the top of the page)

futures io is the largest futures trading community on the planet, with over 90,000 members. At futures io, our goal has always been and always will be to create a friendly, positive, forward-thinking community where members can openly share and discuss everything the world of trading has to offer. The community is one of the friendliest you will find on any subject, with members going out of their way to help others. Some of the primary differences between futures io and other trading sites revolve around the standards of our community. Those standards include a code of conduct for our members, as well as extremely high standards that govern which partners we do business with, and which products or services we recommend to our members.

At futures io, our focus is on quality education. No hype, gimmicks, or secret sauce. The truth is: trading is hard. To succeed, you need to surround yourself with the right support system, educational content, and trading mentors – all of which you can find on futures io, utilizing our social trading environment.

With futures io, you can find honest trading reviews on brokers, trading rooms, indicator packages, trading strategies, and much more. Our trading review process is highly moderated to ensure that only genuine users are allowed, so you don’t need to worry about fake reviews.

We are fundamentally different than most other trading sites:
  • We are here to help. Just let us know what you need.
  • We work extremely hard to keep things positive in our community.
  • We do not tolerate rude behavior, trolling, or vendors advertising in posts.
  • We firmly believe in and encourage sharing. The holy grail is within you, we can help you find it.
  • We expect our members to participate and become a part of the community. Help yourself by helping others.

You'll need to register in order to view the content of the threads and start contributing to our community.  It's free and simple.

-- Big Mike, Site Administrator

Reply
 
Thread Tools Search this Thread
 

S#.Data (Hydra) - market-data downloader

  #1 (permalink)
StockSharp dev
Moscow, RU
 
Futures Experience: Advanced
Platform: StockSharp
Favorite Futures: ES
 
stocksharp's Avatar
 
Posts: 28 since Mar 2014
Thanks: 3 given, 12 received

S#.Data (Hydra) - market-data downloader

Hydra is a free application for downloading and storage of market data.

Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).

Hydra supports great choice of market data sources. It this topic will explain how to download the history from most popular sources: Google Finance, Gain Capital broker and IQFeed service.

To begin we tell a little bit about the program interface. After the first start you will see the main window, which prompts you to select the data sources.

Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).

Pay attention to the description of each source, if the following is written next to it:

Source is designed to get history data … - then it means the ability to download historical data,

and if the following is written:

Source is designed to get market-data .. - then it means the ability to connect to the real-time data source and one's own history collection. Looking ahead, a similar process is often cheaper than a simple data purchase from a data vendor.

Now select the number of sources and try to get the market data. As such, we propose to use: Google (as a source of historical data), OECTrader (as a source of real-time data, which the broker gives you when opening an account), IQFeed (as a source of real-time data with the maximum number of concurrent subscriptions).

Click the check-boxes in the selected sources.

After you click OK, the program prompts you to enable additional features.

Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).

They are well documented in the program itself, so we will not go into a description of each of them.

In order to move forward it will be enough just to click OK without selecting anything in this window. If necessary, you can always restore this setting via the ADD -> Tools button and select the required.

After all the previous procedure, we have got added sources in the left pane, all of which must now be set up.

Google Finance


This is done simply by pressing the pen button,
Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).


that opens the settings window.

Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).

Quickly go over each of them to get a full understanding. So:
  • Start date – the date from which Hydra will receive market data
  • Time Offset – In this case, 1 means that the today data will not be downloaded. This is necessary in order not to download half a day, when the trading have not yet been completed.
  • Weekend – weekends ignored when checkbox is selected.
  • Time interval – Hydra downloads data in parts. This parameter allows to specify how large data part will be used. With a value of 30, the program will download data packages for 30 days.
  • Header, work from, work until, work interval – settings for the program itself, the time interval during which the program should download data (from and to)
  • Data directory – a directory in which the downloaded data will be stored, you can leave the default, or choose any other. We recommend to create a separate directory for each source, in order to not overwrite the data.
  • Format - the format of the stored data. BIN supported – Hydra’s special format allows to get a unique compression ratio (2 bytes per tick, 7 bytes per order book) or well-known CSV (it is normal volume)
  • Max.errors - the maximum number of errors in the source.
  • Dependency - specifies the added task that must be completed before the current (in this case, it may be either IQFeed, or OEC Trader)
  • Logging level - the level of logging.

Let's leave all the default data and choose the securities on which the data will be downloaded. Let's say we choose 5 tickers included in the S&P500 index, for example: MMM, AFL, GOOG, AAPl, T.

For this purpose, all these tools you need to add:

Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).

Since Google source does not support the automatic addition of the tools you should to add them to the database manually

Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).

Then repeat the procedure for each security and move them to the Selected section

Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).

Then simply connect the source
Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).
and press Start.

After the end of the downloading you have to get the following results

Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).

OpenECry (Gain Futures)


The market data source for the Gain Capital clients, which a broker gives you for free when opening an account. The source key settings in many ways similar to the settings that we have made in Google with the only difference that now you should enter your account username/password to access the data stream and select the correct address from which the data will come. Preset 3 possibilities: the test server (to which we connect and which is intended for developers), the simulator (server for demo accounts), the real server (the server that has the connection to the real market and real accounts). If you have an opened account, then your choice is the real server.

Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).

The CandleFromDate parameter is needed to specify the starting date from which you want to download the history in the form of candles.

Once it has been done, we add instruments by which we want to get data, because OEC supports automatic downloading and searching of instruments. We do it through the Download Securities button, and then adding them through the instrument code. Our selection ESZ6 (mini S&P) and NQZ6 (mini Nasdaq).

Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).

After adding you should get the same as shown in the picture.

Now turn your attention to the bottom part of the window. At the beginning of this article, we talked about the fact that Hydra supports downloading and storing a plurality of market data types, settings about what data to download can be done using the appropriate panel:

Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).

On Ticks - means that ticks will be downloaded
On Market Depth - means that order books will be downloaded
Candles has additional setting, by clicking the button you can select the candles types which will be downloaded, that's how it looks:

Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).

On Level 1 - means that the best bid/ask will be downloaded, as well as some fields of the ticker basic statistics.

Now just click the Start button, and Hydra will start to receive data and store them locally. In this case, both historical and real-time market data will be received.

Thus, you can collect and store the market data yourself, and then use them for testing your own strategies.

IQFeed


IQFeed provides as OpenECry, intraday data. But, in contrast to the OEC, IQFeed supports a very wide range of parallel subscriptions, as well as a much greater depth of history, both for candles and tick data.

The source settings similar to OpenEcry:

Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).

The CandleFromDate parameter is needed to specify the starting date from which you want to download the history in the form of candles.

The TicksFromDate parameter is needed to specify the starting date from which you want to download the history in the form of ticks.

All other steps are similar to those described above.

Data viewing


Now, after all the manipulations, you need to understand, and how to work with these data, and what the program can do else. Recall that data is stored in the directory where you downloaded them, but how to see what is a result.

For this we refer to the OEC Trader source from which a lot of data has been downloaded, select it and click the right mouse button.

Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).

Thereafter, we can choose in the menu the way to work with the instrument. Let's choose Market Depths and then in the window that opens, click the magnifying glass.
As a result, we will get a similar picture

Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).

Next, similarly we select Level 1, and then Candles 1 min, but in the window with candles we do not choose the magnifying glass, and Chart button. The results are shown in the figures below

Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).


Please register on futures.io to view futures trading content such as post attachment(s), image(s), and screenshot(s).

That's the way you can view the data and work with them directly from the program.

We hope our product will help you in trading and development of profitable trading systems.

Reply With Quote
 
  #2 (permalink)
Quick Summary
Quick Summary Post

Quick Summary is created and edited by users like you... Add FAQ's, Links and other Relevant Information by clicking the edit button in the lower right hand corner of this message.


Reply



futures io > > > S#.Data (Hydra) - market-data downloader

Thread Tools Search this Thread
Search this Thread:

Advanced Search



Upcoming Webinars and Events (4:30PM ET unless noted)

July Journal Challenge w/$1100 in prizes from TopstepTrader

July
 

An Afternoon with FIO member Softsoap

Elite only

Battlestations: Show us your trading desks and win $750 in prizes

August
 

Extended Ask Me Anything w/Brett Steenbarger

Elite only

Prototyping Python Strategies (part 3) w/Ran Aroussi

Elite only

Brannigan Barrett w/Axia Futures

Elite only

Introduction to Phillip Capital futures brokerage services

Aug TBD

How Monte Carlo Analysis Can Help Your Trading w/Kevin Davey

Elite only
     

Similar Threads
Thread Thread Starter Forum Replies Last Post
Ninjatrader Historical Data and Market Replay data, how to get it! kidvic NinjaTrader Programming 16 June 9th, 2016 05:19 PM
Market Replay Downloader Freezing resirca52009 NinjaTrader 4 November 7th, 2015 01:47 PM
what's the difference between Market Replay data, and historical data shots fired NinjaTrader 2 June 16th, 2013 08:36 PM
Market Analyzer as a Historical Downloader? LostTrader NinjaTrader 2 February 17th, 2013 09:49 PM
Data Downloader StockJock AmiBroker 22 April 8th, 2012 01:44 PM


All times are GMT -4. The time now is 02:54 AM.

Copyright © 2017 by futures io, s.a., Av Ricardo J. Alfaro, Century Tower, Panama, +507 833-9432, info@futures.io
All information is for educational use only and is not investment advice.
There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
no new posts
Page generated 2017-07-21 in 0.14 seconds with 19 queries on phoenix via your IP 54.144.36.228