Keeping track of stock delistings / changes etc - Stocks and ETFs Trading | futures io social day trading
futures io futures trading


Keeping track of stock delistings / changes etc
Updated: Views / Replies:515 / 9
Created: by DarkPoolTrading Attachments:0

Welcome to futures io.

(If you already have an account, login at the top of the page)

futures io is the largest futures trading community on the planet, with over 90,000 members. At futures io, our goal has always been and always will be to create a friendly, positive, forward-thinking community where members can openly share and discuss everything the world of trading has to offer. The community is one of the friendliest you will find on any subject, with members going out of their way to help others. Some of the primary differences between futures io and other trading sites revolve around the standards of our community. Those standards include a code of conduct for our members, as well as extremely high standards that govern which partners we do business with, and which products or services we recommend to our members.

At futures io, our focus is on quality education. No hype, gimmicks, or secret sauce. The truth is: trading is hard. To succeed, you need to surround yourself with the right support system, educational content, and trading mentors Ė all of which you can find on futures io, utilizing our social trading environment.

With futures io, you can find honest trading reviews on brokers, trading rooms, indicator packages, trading strategies, and much more. Our trading review process is highly moderated to ensure that only genuine users are allowed, so you donít need to worry about fake reviews.

We are fundamentally different than most other trading sites:
  • We are here to help. Just let us know what you need.
  • We work extremely hard to keep things positive in our community.
  • We do not tolerate rude behavior, trolling, or vendors advertising in posts.
  • We firmly believe in and encourage sharing. The holy grail is within you, we can help you find it.
  • We expect our members to participate and become a part of the community. Help yourself by helping others.

You'll need to register in order to view the content of the threads and start contributing to our community.  It's free and simple.

-- Big Mike, Site Administrator

Reply
 
Thread Tools Search this Thread
 

Keeping track of stock delistings / changes etc

  #1 (permalink)
 Vendor: diversifyportfolio.com 
PTA, Gauteng
 
Futures Experience: Advanced
Platform: Self built + Sierra + TWS
Favorite Futures: Stocks and Options
 
DarkPoolTrading's Avatar
 
Posts: 1,036 since May 2012
Thanks: 1,244 given, 1,304 received

Keeping track of stock delistings / changes etc

For those of you who maintain your own databases of stock histories, how do you keep track of stock delistings, symbol name changes, new listings etc?

Every day I download EOD data from iqfeed for +-6 000 symbols. I then check their website which has 3 sections, namely: Additions, Changes, Deletions. I go through those manually and update my db accordingly. This is a tedious process to do manually. Also, those pages only list +- 1 week worth of changes.

Does anyone handle this in a more automated way (particularly those who use iqfeed?). I guess I could write a script to scrape those 3 pages each day, but my guess is there must be a more obvious way to do it that im not aware of.

IQFeed does return error codes such as: 'E' and 'NO DATA' but that does not necessarily mean a stock has been delisted, it may have just not traded yesterday (or for whatever period you're requesting data).

Diversification is the only free lunch
Reply With Quote
 
  #2 (permalink)
Quick Summary
Quick Summary Post

Quick Summary is created and edited by users like you... Add FAQ's, Links and other Relevant Information by clicking the edit button in the lower right hand corner of this message.

 
  #3 (permalink)
Site Administrator
Manta, Ecuador
 
Futures Experience: Advanced
Platform: My own custom solution
Favorite Futures: E-mini ES S&P 500
 
Big Mike's Avatar
 
Posts: 46,240 since Jun 2009
Thanks: 29,352 given, 83,231 received


I pull the entire IQFeed repository daily with my stuff. Daily, minutes, and tick.

Never had a need for a flag for new or delisted. Why not just use the daily data and check for history? Should tell you if it's active, last day it traded, etc.


Sent from my phone

Due to time constraints, please do not PM me if your question can be resolved or answered on the forum.

Need help?
1) Stop changing things. No new indicators, charts, or methods. Be consistent with what is in front of you first.
2) Start a journal and post to it daily with the trades you made to show your strengths and weaknesses.
3) Set goals for yourself to reach daily. Make them about how you trade, not how much money you make.
4) Accept responsibility for your actions. Stop looking elsewhere to explain away poor performance.
5) Where to start as a trader? Watch this webinar and read this thread for hundreds of questions and answers.
6)
Help using the forum? Watch this video to learn general tips on using the site.

If you want
to support our community, become an Elite Member.

Reply With Quote
The following user says Thank You to Big Mike for this post:
 
  #4 (permalink)
 Vendor: diversifyportfolio.com 
PTA, Gauteng
 
Futures Experience: Advanced
Platform: Self built + Sierra + TWS
Favorite Futures: Stocks and Options
 
DarkPoolTrading's Avatar
 
Posts: 1,036 since May 2012
Thanks: 1,244 given, 1,304 received


Big Mike View Post
I pull the entire IQFeed repository daily with my stuff. Daily, minutes, and tick.

Never had a need for a flag for new or delisted. Why not just use the daily data and check for history? Should tell you if it's active, last day it traded, etc.


Sent from my phone

Maybe im just being overly pedantic, but lets say a stock is delisted. I then send a request to download any new data for it each day. Of course nothing new is available, but every day I continue requesting data because it might just be a stock that doesn't generally trade every day. Thinking about it now like you say,...maybe the best thing would just be to implement a rule whereby if a stock hasn't traded for a week, I will consider it delisted and stop requesting data for it.

However that doesn't address new listings. I have one table that lists all the NYSE+NASDAQ stocks which I request data from each day. How would I know to request data for a new listing if I don't already have that symbol name in my db?

When you say you pull the entire repository, I presume you have a table listing all the symbols you will download? Because iqfeed has +- 18 100 NYSE symbols, I presume you don't poll all of them?

Diversification is the only free lunch
Reply With Quote
 
  #5 (permalink)
Site Administrator
Manta, Ecuador
 
Futures Experience: Advanced
Platform: My own custom solution
Favorite Futures: E-mini ES S&P 500
 
Big Mike's Avatar
 
Posts: 46,240 since Jun 2009
Thanks: 29,352 given, 83,231 received


DarkPoolTrading View Post
Maybe im just being overly pedantic, but lets say a stock is delisted. I then send a request to download any new data for it each day. Of course nothing new is available, but every day I continue requesting data because it might just be a stock that doesn't generally trade every day. Thinking about it now like you say,...maybe the best thing would just be to implement a rule whereby if a stock hasn't traded for a week, I will consider it delisted and stop requesting data for it.

However that doesn't address new listings. I have one table that lists all the NYSE+NASDAQ stocks which I request data from each day. How would I know to request data for a new listing if I don't already have that symbol name in my db?

When you say you pull the entire repository, I presume you have a table listing all the symbols you will download? Because iqfeed has +- 18 100 NYSE symbols, I presume you don't poll all of them?

I download the universe from NASDAQ via ftp daily. New listings are in the list, that is how I know to download them.

I have custom dictionaries for indexes and futures.

Everything about the data download is hands off for me for well over a year, it's fully automated.

The only thing that doesn't work well is splits for non-daily data.

Sent from my phone

Due to time constraints, please do not PM me if your question can be resolved or answered on the forum.

Need help?
1) Stop changing things. No new indicators, charts, or methods. Be consistent with what is in front of you first.
2) Start a journal and post to it daily with the trades you made to show your strengths and weaknesses.
3) Set goals for yourself to reach daily. Make them about how you trade, not how much money you make.
4) Accept responsibility for your actions. Stop looking elsewhere to explain away poor performance.
5) Where to start as a trader? Watch this webinar and read this thread for hundreds of questions and answers.
6)
Help using the forum? Watch this video to learn general tips on using the site.

If you want
to support our community, become an Elite Member.

Reply With Quote
The following user says Thank You to Big Mike for this post:
 
  #6 (permalink)
 Vendor: diversifyportfolio.com 
PTA, Gauteng
 
Futures Experience: Advanced
Platform: Self built + Sierra + TWS
Favorite Futures: Stocks and Options
 
DarkPoolTrading's Avatar
 
Posts: 1,036 since May 2012
Thanks: 1,244 given, 1,304 received


Big Mike View Post
I download the universe from NASDAQ via ftp daily. New listings are in the list, that is how I know to download them.

I have custom dictionaries for indexes and futures.

Everything about the data download is hands off for me for well over a year, it's fully automated.

The only thing that doesn't work well is splits for non-daily data.

Sent from my phone

Thanks Mike, I wasn't aware of the daily ftp from NASDAQ. That's excellent.
This is going to make things so much easier!

One last question, how do you handle name changes? I presume when a symbol name changes, the new name all of a sudden starts appearing in the ftp file and the old one just disappears, however it is the same company. Do you just download the full history for the new company name (even though it is now a duplicate of an existing company in your db - seems like a waste having both the old and new).

eg: recent change:
From: TEKMIRA PHARMACEUTICALS TKMR
To: ARBUTUS BIOPHARMA CORPORAT ABUS

Diversification is the only free lunch
Reply With Quote
 
  #7 (permalink)
Site Administrator
Manta, Ecuador
 
Futures Experience: Advanced
Platform: My own custom solution
Favorite Futures: E-mini ES S&P 500
 
Big Mike's Avatar
 
Posts: 46,240 since Jun 2009
Thanks: 29,352 given, 83,231 received


DarkPoolTrading View Post
Thanks Mike, I wasn't aware of the daily ftp from NASDAQ. That's excellent.
This is going to make things so much easier!

One last question, how do you handle name changes? I presume when a symbol name changes, the new name all of a sudden starts appearing in the ftp file and the old one just disappears, however it is the same company. Do you just download the full history for the new company name (even though it is now a duplicate of an existing company in your db - seems like a waste having both the old and new).

eg: recent change:
From: TEKMIRA PHARMACEUTICALS TKMR
To: ARBUTUS BIOPHARMA CORPORAT ABUS

Yes, I just download everything again.

For mapping, you might also try here as an alternative to the NASDAQ FTP option:

BSYM: Bloomberg Open Symbology

I personally only use the NAS one, it works for me.

Mike

Due to time constraints, please do not PM me if your question can be resolved or answered on the forum.

Need help?
1) Stop changing things. No new indicators, charts, or methods. Be consistent with what is in front of you first.
2) Start a journal and post to it daily with the trades you made to show your strengths and weaknesses.
3) Set goals for yourself to reach daily. Make them about how you trade, not how much money you make.
4) Accept responsibility for your actions. Stop looking elsewhere to explain away poor performance.
5) Where to start as a trader? Watch this webinar and read this thread for hundreds of questions and answers.
6)
Help using the forum? Watch this video to learn general tips on using the site.

If you want
to support our community, become an Elite Member.

Reply With Quote
The following user says Thank You to Big Mike for this post:
 
  #8 (permalink)
 Vendor: diversifyportfolio.com 
PTA, Gauteng
 
Futures Experience: Advanced
Platform: Self built + Sierra + TWS
Favorite Futures: Stocks and Options
 
DarkPoolTrading's Avatar
 
Posts: 1,036 since May 2012
Thanks: 1,244 given, 1,304 received


Big Mike View Post
Yes, I just download everything again.

For mapping, you might also try here as an alternative to the NASDAQ FTP option:

BSYM: Bloomberg Open Symbology

I personally only use the NAS one, it works for me.

Mike

Thanks Mike, i'll have a look into the Bloomberg option, but I think the Nasdaq daily ftp is going to work perfectly.

Regarding name changes, re-downloading everything for the new name will not work for me because when I run backtests that involve sector/industry comparisons there are going to be more stocks than there should be, thus skewing the strength/weakness and size of that sector. (im surprised that is not also a concern for you, but you've probably got some clever way of handling that which I haven't thought of)

At least all I have to do now is check iqfeed daily for any name changes, then change the relevant symbol name. I don't have to worry about new listings / de-listings thanks to the daily ftp.

Good stuff.

Diversification is the only free lunch
Reply With Quote
The following user says Thank You to DarkPoolTrading for this post:
 
  #9 (permalink)
Site Administrator
Manta, Ecuador
 
Futures Experience: Advanced
Platform: My own custom solution
Favorite Futures: E-mini ES S&P 500
 
Big Mike's Avatar
 
Posts: 46,240 since Jun 2009
Thanks: 29,352 given, 83,231 received


DarkPoolTrading View Post
Thanks Mike, i'll have a look into the Bloomberg option, but I think the Nasdaq daily ftp is going to work perfectly.

Regarding name changes, re-downloading everything for the new name will not work for me because when I run backtests that involve sector/industry comparisons there are going to be more stocks than there should be, thus skewing the strength/weakness and size of that sector. (im surprised that is not also a concern for you, but you've probably got some clever way of handling that which I haven't thought of)

At least all I have to do now is check iqfeed daily for any name changes, then change the relevant symbol name. I don't have to worry about new listings / de-listings thanks to the daily ftp.

Good stuff.

My testing doesn't really rely on a single stock, or even a few small stocks, within a sector changing. Not unless AMZN dropped off and appeared a second time under a new ticker or something of similar consequence.

I agree it would be nice to be totally accurate, I've simply not put the time into it.

Mike

Due to time constraints, please do not PM me if your question can be resolved or answered on the forum.

Need help?
1) Stop changing things. No new indicators, charts, or methods. Be consistent with what is in front of you first.
2) Start a journal and post to it daily with the trades you made to show your strengths and weaknesses.
3) Set goals for yourself to reach daily. Make them about how you trade, not how much money you make.
4) Accept responsibility for your actions. Stop looking elsewhere to explain away poor performance.
5) Where to start as a trader? Watch this webinar and read this thread for hundreds of questions and answers.
6)
Help using the forum? Watch this video to learn general tips on using the site.

If you want
to support our community, become an Elite Member.

Reply With Quote
The following user says Thank You to Big Mike for this post:
 
  #10 (permalink)
Elite Member
@ Germany
 
Futures Experience: Beginner
Platform: NinjaTrader
Broker/Data: Mirus Futures/Zen-Fire
Favorite Futures: FDAX
 
Posts: 441 since Nov 2011
Thanks: 254 given, 369 received


Where can i get the historical composition of S&P 500 at a given date? I want to backtest an investment strategy which belongs to the S&P 500 members.

Thanks in advance,
Koepisch

Reply With Quote

Reply



futures io > > > > Keeping track of stock delistings / changes etc

Thread Tools Search this Thread
Search this Thread:

Advanced Search



Upcoming Webinars and Events (4:30PM ET unless noted)

Jigsaw Trading: TBA

Elite only

FuturesTrader71: TBA

Elite only

NinjaTrader: TBA

Jan 18

RandBots: TBA

Jan 23

GFF Brokers & CME Group: Futures & Bitcoin

Elite only

Adam Grimes: TBA

Elite only

Ran Aroussi: TBA

Elite only
     

Similar Threads
Thread Thread Starter Forum Replies Last Post
vvhg's Little Helpers - Keeping Them In One Place vvhg The Elite Circle 32 January 7th, 2016 11:58 PM
Keeping Forex Trading Simple AJStanbridge Currency Futures 11 March 19th, 2015 04:20 AM
Record keeping software NMadson Psychology and Money Management 4 March 11th, 2015 10:39 PM
Trading Diary - Record Keeping mikky182 Psychology and Money Management 10 November 20th, 2011 10:59 PM
Keeping it Simple Silver Dragon Trading Journals 26 September 19th, 2011 06:00 PM


All times are GMT -4. The time now is 11:18 AM.

Copyright © 2017 by futures io, s.a., Av Ricardo J. Alfaro, Century Tower, Panama, +507 833-9432, info@futures.io
All information is for educational use only and is not investment advice.
There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
no new posts
Page generated 2017-12-14 in 0.15 seconds with 19 queries on phoenix via your IP 54.227.51.103