QCollector, Is it possible to download with millisecond or microsecond stamps - futures io
futures io futures trading



QCollector, Is it possible to download with millisecond or microsecond stamps


Discussion in Traders Hideout

Updated by Big Mike
      Top Posters
    1. looks_one treydog999 with 6 posts (0 thanks)
    2. looks_two rleplae with 6 posts (0 thanks)
    3. looks_3 Big Mike with 3 posts (2 thanks)
    4. looks_4 Quick Summary with 1 posts (0 thanks)
    1. trending_up 4,984 views
    2. thumb_up 2 thanks given
    3. group 2 followers
    1. forum 14 replies
    2. attach_file 0 attachments




Welcome to futures io: the largest futures trading community on the planet, with well over 100,000 members
  • Genuine reviews from real traders, not fake reviews from stealth vendors
  • Quality education from leading professional traders
  • We are a friendly, helpful, and positive community
  • We do not tolerate rude behavior, trolling, or vendors advertising in posts
  • We are here to help, just let us know what you need
You'll need to register in order to view the content of the threads and start contributing to our community.  It's free and simple.

-- Big Mike, Site Administrator

(If you already have an account, login at the top of the page)

 
Search this Thread
 

QCollector, Is it possible to download with millisecond or microsecond stamps

(login for full post details)
  #1 (permalink)
seoul, Korea
 
Experience: Intermediate
Platform: Multicharts
Broker: CQG, DTN IQfeed
Trading: YM 6E
 
treydog999's Avatar
 
Posts: 896 since Jul 2012
Thanks: 291 given, 1,023 received

I am looking at IQfeed + Qcollector but need advice. I am using the trial and it seems like qcollector can only output whole second timestamps as opposed to millisecond or micro second which IQfeed gives?

Is there a way to keep the original time stamp from IQfeed?

Reply With Quote

Can you help answer these questions
from other members on futures io?
Horizontal Line Indicator
Platforms and Indicators
PASPro won't show on a chart for certain combinations of ticks per bar and currencies
NinjaTrader
Need a near crosses scan help for TOS
ThinkOrSwim
How to place NT8 indicator output into a grid, under each bar?
NinjaTrader
EQIX - Digital REITs - any experiences?
Stocks and ETFs
 
 
(login for full post details)
  #3 (permalink)
Gits (Hooglede) Belgium
 
Experience: Master
Platform: NinjaTrader, Proprietary,
Broker: Ninjabrokerage/IQfeed + Synthetic datafeed
Trading: 6A, 6B, 6C, 6E, 6J, 6S, ES, NQ, YM, AEX, CL, NG, ZB, ZN, ZC, ZS, GC
 
rleplae's Avatar
 
Posts: 2,990 since Sep 2013
Thanks: 2,437 given, 5,794 received



treydog999 View Post
I am looking at IQfeed + Qcollector but need advice. I am using the trial and it seems like qcollector can only output whole second timestamps as opposed to millisecond or micro second which IQfeed gives?

Is there a way to keep the original time stamp from IQfeed?

are you sure ?

What instrument are you looking at ?
I have seen with IQfeed that for some exchanges/instruments, thee is no milisecond,
could this be the case in your situation ?

Follow me on Twitter Visit my Facebook Visit my futures io Trade Journal Reply With Quote
 
(login for full post details)
  #4 (permalink)
seoul, Korea
 
Experience: Intermediate
Platform: Multicharts
Broker: CQG, DTN IQfeed
Trading: YM 6E
 
treydog999's Avatar
 
Posts: 896 since Jul 2012
Thanks: 291 given, 1,023 received


rleplae View Post
are you sure ?

What instrument are you looking at ?
I have seen with IQfeed that for some exchanges/instruments, thee is no milisecond,
could this be the case in your situation ?

I am using the Qcollector demo and the instrument is the SP 400 midcap future. I cross checked it vs directly downloading the CSV through the IQfeed application itself. The output from IQFeed does show the milliseconds, so the data is coming through. But I want to use Qcollector for batch downloading, instead of manually doing 1 by 1 with the IQfeed .

Maybe my settings are off, @rleplae does yours output milliseconds if the exchange does have them?

Reply With Quote
 
(login for full post details)
  #5 (permalink)
Gits (Hooglede) Belgium
 
Experience: Master
Platform: NinjaTrader, Proprietary,
Broker: Ninjabrokerage/IQfeed + Synthetic datafeed
Trading: 6A, 6B, 6C, 6E, 6J, 6S, ES, NQ, YM, AEX, CL, NG, ZB, ZN, ZC, ZS, GC
 
rleplae's Avatar
 
Posts: 2,990 since Sep 2013
Thanks: 2,437 given, 5,794 received


treydog999 View Post
I am using the Qcollector demo and the instrument is the SP 400 midcap future. I cross checked it vs directly downloading the CSV through the IQfeed application itself. The output from IQFeed does show the milliseconds, so the data is coming through. But I want to use Qcollector for batch downloading, instead of manually doing 1 by 1 with the IQfeed .

Maybe my settings are off, @rleplae does yours output milliseconds if the exchange does have them?

If you have the miliseconds when directly doing it with IQfeed, then there is an issue or a setting with the Qcollector
probably one of the other users, might know Qcollector in more detail, my expertise is more on the side of direct
integrartion with IQfeed

Follow me on Twitter Visit my Facebook Visit my futures io Trade Journal Reply With Quote
 
(login for full post details)
  #6 (permalink)
seoul, Korea
 
Experience: Intermediate
Platform: Multicharts
Broker: CQG, DTN IQfeed
Trading: YM 6E
 
treydog999's Avatar
 
Posts: 896 since Jul 2012
Thanks: 291 given, 1,023 received


rleplae View Post
If you have the miliseconds when directly doing it with IQfeed, then there is an issue or a setting with the Qcollector
probably one of the other users, might know Qcollector in more detail, my expertise is more on the side of direct
integrartion with IQfeed

I was looking at this paying the API fee and connecting directly. How are you doing this? I was considering using python possibly?

Reply With Quote
 
(login for full post details)
  #7 (permalink)
Gits (Hooglede) Belgium
 
Experience: Master
Platform: NinjaTrader, Proprietary,
Broker: Ninjabrokerage/IQfeed + Synthetic datafeed
Trading: 6A, 6B, 6C, 6E, 6J, 6S, ES, NQ, YM, AEX, CL, NG, ZB, ZN, ZC, ZS, GC
 
rleplae's Avatar
 
Posts: 2,990 since Sep 2013
Thanks: 2,437 given, 5,794 received


treydog999 View Post
I was looking at this paying the API fee and connecting directly. How are you doing this? I was considering using python possibly?

I did the same, i bought the API license
I use both c# and Python

The language does not mater
As long as it supports socket communicatio

Follow me on Twitter Visit my Facebook Visit my futures io Trade Journal Reply With Quote
 
(login for full post details)
  #8 (permalink)
seoul, Korea
 
Experience: Intermediate
Platform: Multicharts
Broker: CQG, DTN IQfeed
Trading: YM 6E
 
treydog999's Avatar
 
Posts: 896 since Jul 2012
Thanks: 291 given, 1,023 received


rleplae View Post
I did the same, i bought the API license
I use both c# and Python

The language does not mater
As long as it supports socket communicatio

Have you found the speed to matter if your recording say 500 symbols simultaneously? or difference between C# or Python?

If your recording are you using a queue buffer like rabbitMQ or zeroMQ in order to store it to your database?

You wouldn't have a github or shared code somewhere so I can take a peek would you?

really happy that someone here has been down this road before and can give me advice, i appreciate it

Reply With Quote
 
(login for full post details)
  #9 (permalink)
Gits (Hooglede) Belgium
 
Experience: Master
Platform: NinjaTrader, Proprietary,
Broker: Ninjabrokerage/IQfeed + Synthetic datafeed
Trading: 6A, 6B, 6C, 6E, 6J, 6S, ES, NQ, YM, AEX, CL, NG, ZB, ZN, ZC, ZS, GC
 
rleplae's Avatar
 
Posts: 2,990 since Sep 2013
Thanks: 2,437 given, 5,794 received


treydog999 View Post
Have you found the speed to matter if your recording say 500 symbols simultaneously? or difference between C# or Python?

If your recording are you using a queue buffer like rabbitMQ or zeroMQ in order to store it to your database?

You wouldn't have a github or shared code somewhere so I can take a peek would you?

really happy that someone here has been down this road before and can give me advice, i appreciate it

There is a limit of 500 symbols you can dowload simmultanously
There is a booster pack to go to 1000 symbols

I don't have issues with storing, but it
Took me some special tricks
Especially the burst at open of
FDAX and AEX for the option series

I can't share my code
But will be happy to answer
Questions should you run
Into an issue

Follow me on Twitter Visit my Facebook Visit my futures io Trade Journal Reply With Quote
 
(login for full post details)
  #10 (permalink)
seoul, Korea
 
Experience: Intermediate
Platform: Multicharts
Broker: CQG, DTN IQfeed
Trading: YM 6E
 
treydog999's Avatar
 
Posts: 896 since Jul 2012
Thanks: 291 given, 1,023 received



rleplae View Post
There is a limit of 500 symbols you can dowload simmultanously
There is a booster pack to go to 1000 symbols

I don't have issues with storing, but it
Took me some special tricks
Especially the burst at open of
FDAX and AEX for the option series

I can't share my code
But will be happy to answer
Questions should you run
Into an issue

Fair enough, here is my basic plan.

Get the socket connection in python. Listen to 500 symbols (whatever they are). Put that into a rabbitMQ queue for buffering. Then have a message receiver parse/format them, add them to my data base.

I think its pretty straight forward, although devils always in the details. Thoughts on the general architecture, and how long it would take to develop this part of it?

After its in the database everything else from my stack works.

Reply With Quote


futures io Trading Community Traders Hideout > QCollector, Is it possible to download with millisecond or microsecond stamps


July 15, 2017


Upcoming Webinars and Events
     



Copyright © 2020 by futures io, s.a., Av Ricardo J. Alfaro, Century Tower, Panama, +507 833-9432, info@futures.io
All information is for educational use only and is not investment advice.
There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
no new posts