NexusFi: Find Your Edge


Home Menu

 





Stocks Data base


Discussion in Platforms and Indicators

Updated
      Top Posters
    1. looks_one Amiuser with 10 posts (10 thanks)
    2. looks_two timmymagic07 with 6 posts (0 thanks)
    3. looks_3 StockJock with 2 posts (0 thanks)
    4. looks_4 TonyB with 2 posts (0 thanks)
    1. trending_up 18,091 views
    2. thumb_up 10 thanks given
    3. group 9 followers
    1. forum 23 posts
    2. attach_file 0 attachments




 
Search this Thread

Stocks Data base

  #11 (permalink)
Amiuser
New York NY
 
Posts: 21 since Mar 2012
Thanks Given: 3
Thanks Received: 10


timmymagic07 View Post
Cheers Amiuser, that's useful.

Are these generally kept up to date by users on the yahoo group at all?

You can keep those lists up to date very easily by yourself as you mentioned that you were a programmer.
Here is an example Amibroker - import Finviz stock lists of how it could be done via AFL and using finviz Free Stock Screener
The new app looks like this with one added option

Urlget can be downloaded from AB website https://www.amibroker.com/bin/URLGet.zip Location of the extracted zip files is Amibroker directory.
The AFL's first red button downloads the raw list(s) from finviz.
This is one raw list from there (Click pic to enlarge)


Then the AFL removes the quotations (button 2 of my AFL).

Before creating a data base containing symbols with sector and industry info you would need to create one custom broker.sectors and one custom broker.industries files according to Finviz' Morningstar Industry Classification (backup the old broker files before).

The content of the finviz broker.sectors file looks like this (Undefined Sectors is an addition by me for symbols that have no sector/industry assignment (that was a tip by Market Monk, thanks btw) ):

Undefined Sector
Basic Materials
Conglomerates
Consumer Goods
Financial
Healthcare
Industrial Goods
Services
Technology
Utilities

the same one as a picture and with additional info

So this is pretty short and simple

The broker.industries file is larger. One click of the third button of my AFL and it gets formated using the finviz raw file seen above.

The formated broker.industries file looks as follows (needs to be in place before new database creation) :


This is a snippet of the formated symbols list (button 4 of my AFL)


The last thing you need is the format file to import the symbols of the symbols list (format file saved as i.e. finviz_NYSE.format or just finviz.format to the Formats folder of AB. Format is the file extension):
 
Code
$FORMAT TICKER,FULLNAME,Skip,INDUSTRY,Skip,Skip,Skip 
$SKIPLINES 1 
$BREAKONERR 1 
$AUTOADD 1 
$NOQUOTES 1 
$MARKET 0 
$OVERWRITE 1 
$SEPARATOR |
the same one as picture


the same AFL (of the video) can be used for any provided symbols list like the ones downloaded from here
NYSE Companies - [AUTOLINK]NASDAQ[/AUTOLINK].com

If you don't need sectors and industries assignments at all then it's even much more simpler to import own/external lists of symbols

Reply With Quote

Can you help answer these questions
from other members on NexusFi?
Online prop firm The Funded Trader (TFT) going under?
Traders Hideout
Exit Strategy
NinjaTrader
NT7 Indicator Script Troubleshooting - Camarilla Pivots
NinjaTrader
My NT8 Volume Profile Split by Asian/Euro/Open
NinjaTrader
The space time continuum and the dynamics of a financial …
Emini and Emicro Index
 
  #12 (permalink)
timmymagic07
London, United Kingdom
 
Posts: 37 since Apr 2012
Thanks Given: 6
Thanks Received: 21

Thanks Amiuser - that is really very useful.

With a little modification, could this also be used for the FTSE350, for example, and other nations/indices? I assume so and see no reason why not?

Am I right in saying AmiBroker's language is essentially C/C++?

Also - how accurate is the Google finance/Yahoo finance data? I would be relying on it to make decisions, I just wonder whether it would be more worthwhile investing in a paid for provider? I would only be using EOD data mind, not intra-day, would Google/Yahoo be sufficient for my needs? If so, I see no reason not to go for AmiBroker..

Just out of interest, how far back can you get data from Google/Yahoo? Do they put a limit on how much you can download? I would be interested in as much back data as possible for the S&P500, for example...

Thank you for your help Amiuser, it has been most useful!

Reply With Quote
  #13 (permalink)
Amiuser
New York NY
 
Posts: 21 since Mar 2012
Thanks Given: 3
Thanks Received: 10


You can get a list of symbols from here Symbols lists Unfortunately it's just symbols without names, sectors and industries information. For FTSE350 scroll down on the left side. Copy and paste that list and save it as .tls file and import it via Amiquote.

I'm not into stocks (or EOD) that much as mentioned but Google and Yahoo are free sources. And because they are American sources American stocks are treated better than foreign stocks there. The data for S&P500 goes back to the '50s, AFAIK.

If you want reliable data then you should use the real-time plugins of AB.

Reply With Quote
  #14 (permalink)
timmymagic07
London, United Kingdom
 
Posts: 37 since Apr 2012
Thanks Given: 6
Thanks Received: 21

Thanks Amiuser, I will give that a go.

Would you suggest Yahoo and Google are not sufficient end of day data providers, in terms of quality/accuracy? I am looking to keep costs down as much as possible, but don't want to rely on inaccurate data.

Think I will buy Amibroker at the weekend and quickly become an active member of the yahoo group I expect!

Many thanks

Reply With Quote
  #15 (permalink)
colion
Asheville, North Carolina
 
Posts: 24 since Sep 2010
Thanks Given: 1
Thanks Received: 15


timmymagic07 View Post
Thanks Amiuser, I will give that a go.

Would you suggest Yahoo and Google are not sufficient end of day data providers, in terms of quality/accuracy? I am looking to keep costs down as much as possible, but don't want to rely on inaccurate data.

Think I will buy Amibroker at the weekend and quickly become an active member of the yahoo group I expect!

Many thanks

Yahoo and Google are not data suppliers. They simply post what is sent by their data sources which include all of the standard names such as CSI. Any errors should be reported to them or the data suppliers.

Reply With Quote
  #16 (permalink)
timmymagic07
London, United Kingdom
 
Posts: 37 since Apr 2012
Thanks Given: 6
Thanks Received: 21

Hi Colion,

So the data Yahoo/Google provide should be of good quality?

Cheers,

Tim

Reply With Quote
  #17 (permalink)
Amiuser
New York NY
 
Posts: 21 since Mar 2012
Thanks Given: 3
Thanks Received: 10


timmymagic07
Thanks Amiuser, I will give that a go. Would you suggest Yahoo and Google are not sufficient end of day data providers, in terms of quality/accuracy? I am looking to keep costs down as much as possible, but don't want to rely on inaccurate data. Think I will buy Amibroker at the weekend and quickly become an active member of the yahoo group I expect! Many thanks

They provide good quality but Yahoo is quite a bit slow when it comes to stock splits of foreign stocks other than American stocks. It's is not a fact but I've got the feeling that Google seems to be the more reliable one of those two free sources. Long story short you should treat them as what they are ... free sources. But you can choose other sources (free or commercial) with AB too. YHOO and GOOG are just two free options. Pretty much every software offers them. As for AB itself ... you won't regret using it. No frustrations because of slowness and software hanging up, i.e. Ninjatrader or Multicharts. It's a (very) fast, flexible, powerful beast. It's an addicting piece of software and pretty easy to use once you have dug up the rabbits hole, IMO.

Reply With Quote
  #18 (permalink)
colion
Asheville, North Carolina
 
Posts: 24 since Sep 2010
Thanks Given: 1
Thanks Received: 15


timmymagic07 View Post
Hi Colion,

So the data Yahoo/Google provide should be of good quality?

Cheers,

Tim

As good as their data supplier. Yahoo and Google do not change what they receive from their data suppliers so check them out if you like.

Reply With Quote
  #19 (permalink)
timmymagic07
London, United Kingdom
 
Posts: 37 since Apr 2012
Thanks Given: 6
Thanks Received: 21

Amiuser,

First of all - thank you for all your help on the forum, I have now purchased AmiBroker!

I wanted to ask whether there were some good guides for getting started with the AmiBroker code? Or perhaps some code samples for simple trading system design?

Also - did you create the Finviz stock download/import yourself? I am interested in doing something similar, for EOD data from Google/Yahoo and then ensuring the S&P500 (for example) is kept up to date.

I have been trying to read the Yahoo Group, is there a reader or mail application you can use that you know of? The web interface is really annoying imo.

Reply With Quote
  #20 (permalink)
Amiuser
New York NY
 
Posts: 21 since Mar 2012
Thanks Given: 3
Thanks Received: 10



timmymagic07 View Post
I wanted to ask whether there were some good guides for getting started with the AmiBroker code? Or perhaps some code samples for simple trading system design?

The AB manual, the AFL library at amibroker.com, wisestocktrader.com, Howard Bandy books, ... You could ask here in the AB section.


timmymagic07 View Post
Also - did you create the Finviz stock download/import yourself? I am interested in doing something similar, for EOD data from Google/Yahoo and then ensuring the S&P500 (for example) is kept up to date.

Yes, I did. It uses some code snippets of different sources that I've changed to fit my needs but 70% of that AFL program has been made by me.


timmymagic07 View Post
I have been trying to read the Yahoo Group, is there a reader or mail application you can use that you know of? The web interface is really annoying imo.

You could use Thunderbird with gmail
Thunderbird 3.0 - Gmail Help
Enabling IMAP - Gmail Help

Reply With Quote




Last Updated on November 7, 2014


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts