NexusFi: Find Your Edge


Home Menu

 





QCollector, Is it possible to download with millisecond or microsecond stamps


Discussion in Traders Hideout

Updated
      Top Posters
    1. looks_one rleplae with 6 posts (0 thanks)
    2. looks_two treydog999 with 6 posts (0 thanks)
    3. looks_3 Big Mike with 3 posts (2 thanks)
    4. looks_4 Quick Summary with 1 posts (0 thanks)
    1. trending_up 6,902 views
    2. thumb_up 2 thanks given
    3. group 2 followers
    1. forum 14 posts
    2. attach_file 0 attachments




 
Search this Thread

QCollector, Is it possible to download with millisecond or microsecond stamps

  #1 (permalink)
 
treydog999's Avatar
 treydog999 
seoul, Korea
 
Experience: Intermediate
Platform: Multicharts
Broker: CQG, DTN IQfeed
Trading: YM 6E
Posts: 897 since Jul 2012
Thanks Given: 291
Thanks Received: 1,039

I am looking at IQfeed + Qcollector but need advice. I am using the trial and it seems like qcollector can only output whole second timestamps as opposed to millisecond or micro second which IQfeed gives?

Is there a way to keep the original time stamp from IQfeed?

Started this thread Reply With Quote

Can you help answer these questions
from other members on NexusFi?
Better Renko Gaps
The Elite Circle
ZombieSqueeze
Platforms and Indicators
My NT8 Volume Profile Split by Asian/Euro/Open
NinjaTrader
Are there any eval firms that allow you to sink to your …
Traders Hideout
NT7 Indicator Script Troubleshooting - Camarilla Pivots
NinjaTrader
 
  #3 (permalink)
 
rleplae's Avatar
 rleplae 
Gits (Hooglede) Belgium
Legendary Market Wizard
 
Experience: Master
Platform: NinjaTrader, Proprietary,
Broker: Ninjabrokerage/IQfeed + Synthetic datafeed
Trading: 6A, 6B, 6C, 6E, 6J, 6S, ES, NQ, YM, AEX, CL, NG, ZB, ZN, ZC, ZS, GC
Posts: 3,003 since Sep 2013
Thanks Given: 2,442
Thanks Received: 5,863



treydog999 View Post
I am looking at IQfeed + Qcollector but need advice. I am using the trial and it seems like qcollector can only output whole second timestamps as opposed to millisecond or micro second which IQfeed gives?

Is there a way to keep the original time stamp from IQfeed?

are you sure ?

What instrument are you looking at ?
I have seen with IQfeed that for some exchanges/instruments, thee is no milisecond,
could this be the case in your situation ?

Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
  #4 (permalink)
 
treydog999's Avatar
 treydog999 
seoul, Korea
 
Experience: Intermediate
Platform: Multicharts
Broker: CQG, DTN IQfeed
Trading: YM 6E
Posts: 897 since Jul 2012
Thanks Given: 291
Thanks Received: 1,039


rleplae View Post
are you sure ?

What instrument are you looking at ?
I have seen with IQfeed that for some exchanges/instruments, thee is no milisecond,
could this be the case in your situation ?

I am using the Qcollector demo and the instrument is the SP 400 midcap future. I cross checked it vs directly downloading the CSV through the IQfeed application itself. The output from IQFeed does show the milliseconds, so the data is coming through. But I want to use Qcollector for batch downloading, instead of manually doing 1 by 1 with the IQfeed .

Maybe my settings are off, @rleplae does yours output milliseconds if the exchange does have them?

Started this thread Reply With Quote
  #5 (permalink)
 
rleplae's Avatar
 rleplae 
Gits (Hooglede) Belgium
Legendary Market Wizard
 
Experience: Master
Platform: NinjaTrader, Proprietary,
Broker: Ninjabrokerage/IQfeed + Synthetic datafeed
Trading: 6A, 6B, 6C, 6E, 6J, 6S, ES, NQ, YM, AEX, CL, NG, ZB, ZN, ZC, ZS, GC
Posts: 3,003 since Sep 2013
Thanks Given: 2,442
Thanks Received: 5,863


treydog999 View Post
I am using the Qcollector demo and the instrument is the SP 400 midcap future. I cross checked it vs directly downloading the CSV through the IQfeed application itself. The output from IQFeed does show the milliseconds, so the data is coming through. But I want to use Qcollector for batch downloading, instead of manually doing 1 by 1 with the IQfeed .

Maybe my settings are off, @rleplae does yours output milliseconds if the exchange does have them?

If you have the miliseconds when directly doing it with IQfeed, then there is an issue or a setting with the Qcollector
probably one of the other users, might know Qcollector in more detail, my expertise is more on the side of direct
integrartion with IQfeed

Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
  #6 (permalink)
 
treydog999's Avatar
 treydog999 
seoul, Korea
 
Experience: Intermediate
Platform: Multicharts
Broker: CQG, DTN IQfeed
Trading: YM 6E
Posts: 897 since Jul 2012
Thanks Given: 291
Thanks Received: 1,039


rleplae View Post
If you have the miliseconds when directly doing it with IQfeed, then there is an issue or a setting with the Qcollector
probably one of the other users, might know Qcollector in more detail, my expertise is more on the side of direct
integrartion with IQfeed

I was looking at this paying the API fee and connecting directly. How are you doing this? I was considering using python possibly?

Started this thread Reply With Quote
  #7 (permalink)
 
rleplae's Avatar
 rleplae 
Gits (Hooglede) Belgium
Legendary Market Wizard
 
Experience: Master
Platform: NinjaTrader, Proprietary,
Broker: Ninjabrokerage/IQfeed + Synthetic datafeed
Trading: 6A, 6B, 6C, 6E, 6J, 6S, ES, NQ, YM, AEX, CL, NG, ZB, ZN, ZC, ZS, GC
Posts: 3,003 since Sep 2013
Thanks Given: 2,442
Thanks Received: 5,863


treydog999 View Post
I was looking at this paying the API fee and connecting directly. How are you doing this? I was considering using python possibly?

I did the same, i bought the API license
I use both c# and Python

The language does not mater
As long as it supports socket communicatio

Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
  #8 (permalink)
 
treydog999's Avatar
 treydog999 
seoul, Korea
 
Experience: Intermediate
Platform: Multicharts
Broker: CQG, DTN IQfeed
Trading: YM 6E
Posts: 897 since Jul 2012
Thanks Given: 291
Thanks Received: 1,039


rleplae View Post
I did the same, i bought the API license
I use both c# and Python

The language does not mater
As long as it supports socket communicatio

Have you found the speed to matter if your recording say 500 symbols simultaneously? or difference between C# or Python?

If your recording are you using a queue buffer like rabbitMQ or zeroMQ in order to store it to your database?

You wouldn't have a github or shared code somewhere so I can take a peek would you?

really happy that someone here has been down this road before and can give me advice, i appreciate it

Started this thread Reply With Quote
  #9 (permalink)
 
rleplae's Avatar
 rleplae 
Gits (Hooglede) Belgium
Legendary Market Wizard
 
Experience: Master
Platform: NinjaTrader, Proprietary,
Broker: Ninjabrokerage/IQfeed + Synthetic datafeed
Trading: 6A, 6B, 6C, 6E, 6J, 6S, ES, NQ, YM, AEX, CL, NG, ZB, ZN, ZC, ZS, GC
Posts: 3,003 since Sep 2013
Thanks Given: 2,442
Thanks Received: 5,863


treydog999 View Post
Have you found the speed to matter if your recording say 500 symbols simultaneously? or difference between C# or Python?

If your recording are you using a queue buffer like rabbitMQ or zeroMQ in order to store it to your database?

You wouldn't have a github or shared code somewhere so I can take a peek would you?

really happy that someone here has been down this road before and can give me advice, i appreciate it

There is a limit of 500 symbols you can dowload simmultanously
There is a booster pack to go to 1000 symbols

I don't have issues with storing, but it
Took me some special tricks
Especially the burst at open of
FDAX and AEX for the option series

I can't share my code
But will be happy to answer
Questions should you run
Into an issue

Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
  #10 (permalink)
 
treydog999's Avatar
 treydog999 
seoul, Korea
 
Experience: Intermediate
Platform: Multicharts
Broker: CQG, DTN IQfeed
Trading: YM 6E
Posts: 897 since Jul 2012
Thanks Given: 291
Thanks Received: 1,039



rleplae View Post
There is a limit of 500 symbols you can dowload simmultanously
There is a booster pack to go to 1000 symbols

I don't have issues with storing, but it
Took me some special tricks
Especially the burst at open of
FDAX and AEX for the option series

I can't share my code
But will be happy to answer
Questions should you run
Into an issue

Fair enough, here is my basic plan.

Get the socket connection in python. Listen to 500 symbols (whatever they are). Put that into a rabbitMQ queue for buffering. Then have a message receiver parse/format them, add them to my data base.

I think its pretty straight forward, although devils always in the details. Thoughts on the general architecture, and how long it would take to develop this part of it?

After its in the database everything else from my stack works.

Started this thread Reply With Quote




Last Updated on July 15, 2017


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts