economical data

January 22nd, 2012, 07:17 PM

ok, I downloaded the international data from St.Louis Fed.
5053 files of 57MB in 74 directories uncompressed.

Before we can work with the data we must pick ~20 indicators from ~20 countries
for ~20 years and put them all into one file in computer-readable format and estimate the gaps.
One 3-dim array of -say- 20*20*20=8000 numbers

takes many hours to convert the data into usable form ...

Someone must have done it before ?! How else would you work with such data,
if not by computer

target is to predict stock prices or currency rates by using the data
is anyone else interested to create and analyse such a data-file ?

------------------------------------
exchange rate is essential, it's given only for these 19 countries, so I probably take those
AUS,Australia
BEL,Belgium
CAN,Canada
DNK,Denmark
FIN,Finland
FRA,France
DEU,Germany
ITA,Italy
JPN,Japan
NLD,Netherlands
NOR,Norway
SGP,Singapore
ESP,Spain
SWE,Sweden
TWN,Taiwan
CZE,Czech
KO ,Korea
GBR,United Kingdom
USA,United States

1950-2010:

Code

AUS,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,206,206,206,206,206,206,208.6,219.3,261.4,264.7,241,225.3,204,210.5,205.6,209.6,211.4,187.1,166,161.8,128.9,123.4,128.9,144.2,145.8,143.7,143.3,135.2,125.1,134.6,136.2,144,136.8,115.7,118.7,107,95.1,100,120,135.5,140.3,138.6,154.3,157,145.8,169.2
BEL,84.2,83.7,84.8,85.4,85.2,84.9,85.5,84.9,85.5,85.4,85.6,85.6,85.7,85.6,85.8,86,85.6,85.9,85.5,85.1,85.9,87.9,96.9,109.9,109.7,116.3,110.6,119.1,135.7,145.5,145.9,114.7,93.2,83.5,73.9,71.9,95.5,114.2,116,108.3,127.7,124.8,132.7,123.4,127.7,144.8,137.8,119.2,117.5,112.7,97.7,94.7,100,119.7,131.6,131.7,132.9,145,155.8,147.4,140.3
CAN,143.6,149.1,160.4,159.6,161.3,159.2,159.6,163.8,161.8,163.7,161.9,155.1,146.9,145.6,145.6,145.6,145.8,145.6,145.7,145.8,150.4,155.5,158.5,157,160.6,154.4,159.3,147.8,137.8,134.1,134.3,131,127.2,127.4,121.2,115,113,118.4,127.6,132.6,134.6,137,129.9,121.7,114.9,114.4,115.1,113.4,105.9,105.7,105.7,101.4,100,112.1,120.6,129.6,138.5,146.3,147.3,137.6,152.5
DNK,114.3,114.3,114.3,114.3,114.2,114.2,114.2,114.2,114.2,114.4,114.4,114.2,114.3,114.2,114,114,114.2,113,105.4,104.9,105.2,106.5,113.4,130.9,129.7,137.5,130.5,131.4,143.2,149.9,140,110.5,94.5,86.2,76.2,74.4,97.4,115.2,117,107.7,127.4,123.1,130.6,121.6,124.1,140.8,136,119.3,117.7,112.8,97.4,94.6,100,119.9,131.7,131.5,132.7,144.9,155,147.2,140.2
FIN,0,0,0,0,0,0,0,249.1,196.5,196.5,196.5,196.5,196.5,196.5,196.5,196.5,196.5,182.3,149.7,149.7,149.7,150.3,151.7,164.6,166.7,171,162.7,156.1,152.7,161.5,168.6,145.7,130.5,112.9,104.6,101.5,124.1,143.1,150.4,146.6,164.5,155.5,140.4,110.1,120.4,144,136.9,121.1,117.7,112.7,97.7,94.7,100,119.7,131.6,131.7,132.9,145,155.8,147.4,140.3
FRA,198.3,198.2,198.2,198.2,198.2,198.2,198.1,164.9,164.7,141.4,141.5,141.4,141.6,141.6,141.6,141.6,141.2,141,140.1,133.9,125.5,125.9,137.6,156.4,144.4,162,145.3,141.2,154.2,163.1,164.2,127.6,105.5,91.1,79.4,77.3,100.2,115.4,116.4,108.7,127.4,122.9,131.1,122.4,125.1,139.1,135.6,118.8,117.6,112.7,97.7,94.7,100,119.7,131.6,131.7,132.9,145,155.8,147.4,140.3
DEU,49.3,49.3,49.3,49.3,49.3,49.2,49.2,49.2,49.3,49.5,49.6,51.5,51.7,51.9,52,51.8,51.7,51.9,51.8,52.7,56.7,59.5,64.9,78.1,80.1,84.3,82.2,89.1,103.2,112.9,113.8,91.4,85.2,81,72.7,70.3,95.3,115.1,117.7,110,128,124.6,132.5,125,127.6,144.5,137.5,119.3,117.6,112.7,97.7,94.7,100,119.7,131.6,131.7,132.9,145,155.8,147.4,140.3
ITA,327.9,327.7,327.7,327.7,327.7,327.7,327.7,327.7,327.9,329.7,329.7,329.7,329.9,329.5,328,327.8,328,328.1,328.6,326.5,326.6,331.3,350.9,352.1,314.8,313.9,246.7,232,241.3,246.5,239.2,179.9,151.3,134.8,116.6,107.3,137.3,157.9,157.3,149.2,170.9,165,166.2,130.2,127.1,125.7,132.8,120.2,117.9,112.7,97.7,94.7,100,119.7,131.6,131.7,132.9,145,155.8,147.4,140.3
JPN,34.8,34.8,34.8,34.8,34.8,34.8,34.8,34.8,34.8,34.8,34.8,34.7,34.7,34.6,34.6,34.6,34.6,34.6,34.7,34.9,35,36,41.3,46.2,43,42.2,42.3,46.8,60.1,57.4,55.3,56.8,50.3,52.7,52.7,52.5,74.4,86.6,97.7,90.7,86.4,93,98.8,112.7,122.5,133.3,115.1,103.4,95.6,110.1,116.2,103,100,108,115.8,113.7,107.7,106.3,121.1,133.7,142.7
NLD,61.2,61.2,61.3,61.4,61.5,61.1,60.9,61,61.6,61.8,61.8,64.2,64.7,64.7,64.6,64.7,64.4,64.7,64.4,64.3,64.5,66.8,72.6,83.9,86.9,92.4,88.2,95,107.9,116.2,117.3,93.2,87.2,81.7,72.7,70.2,95.2,115,117.9,109.9,128,124.5,132.5,125.4,128.1,145.3,138.2,119.4,117.5,112.7,97.7,94.7,100,119.7,131.6,131.7,132.9,145,155.8,147.4,140.3
NOR,111.9,111.9,111.9,111.9,111.8,111.8,111.8,111.8,111.8,112,111.9,111.8,111.9,111.7,111.6,111.7,111.6,111.7,111.8,111.8,111.7,113.4,121.2,139,144.7,153.1,146.3,150,152.3,157.7,161.7,139,123.7,109.4,97.8,92.9,107.9,118.4,122.4,115.5,127.7,123,128.5,112.4,113.2,126,123.6,112.7,105.7,102.3,90.6,88.7,100,112.8,118.5,124,124.6,136.3,141.6,126.9,132.1
SGP,0,0,0,0,0,0,0,58.5,58.5,58.5,58.5,58.5,58.5,58.5,58.5,58.5,58.5,58.5,58.5,58.5,58.5,58.7,63.7,72.9,73.5,75.5,72.5,73.4,78.8,82.4,83.6,84.8,83.7,84.7,84,81.4,82.2,85,89,91.8,98.8,103.7,109.9,110.8,117.2,126.4,127,120.5,107.1,105.6,103.8,99.9,100,102.7,106,107.6,112.8,118.9,126.6,123.1,131.4
ESP,0,0,0,0,0,0,0,0,0,0,0,0,0,0,293.3,293.3,293.3,285.4,251.4,251.4,251.4,253.3,273.8,302.1,305.1,306.6,263.1,231.7,229.5,262.2,245.5,190.6,160.2,122.7,109.5,103.5,125.7,142.5,151.1,148.7,172.7,169.4,171.9,138.1,131.5,141.2,138.9,120.1,117.8,112.7,97.7,94.7,100,119.7,131.6,131.7,132.9,145,155.8,147.4,140.3
SWE,188,187.9,187.9,187.9,188,188,188,188,187.9,187.9,188.1,188.2,188.6,187.4,188.8,188.5,188.2,188.4,188.1,188.1,187.5,190.5,204.4,223.3,219.4,234.7,223.2,217.6,215.3,226.8,229.8,191.9,154.7,126.7,117.6,113,136.4,153.2,158.4,150.6,164.2,160.7,166.9,124.7,126,136.2,144.9,127.2,122.3,117.5,106,94,100,120.4,132.3,130.1,131.9,143.9,147.7,127,134.9
TWN,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,86.3,86.3,86.3,90.3,90.9,90.9,90.9,90.9,93.2,95.8,95.9,93.7,88.3,86.2,87.1,86.6,91.3,108.8,120.6,130.8,128.3,129.1,137.3,130.7,130.5,130.3,125.7,120,102.9,106.8,110.5,102.1,100,100.4,103.5,107.5,106.2,105.1,109.6,104.6,109.6
CZE,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,112.3,113.7,123.4,120.6,103.3,101.4,94.7,84.8,86.1,100,116.1,127.4,136.7,144.9,159.5,191.9,171.7,171.3
KOF,50012.4,20838.5,20838.5,6946.2,6946.2,2500.6,2500.6,2500.6,2500.6,2500.6,1923.6,961.8,961.8,961.8,584.7,469.3,460.8,462.2,451.9,433.9,402.6,360.2,318.2,313.9,309.1,258.3,258.3,258.3,258.3,258.3,205.8,183.6,170.8,161.1,154.8,145.1,141.3,151.4,170.2,185.4,175.9,169.7,159.3,155.2,154.9,161.8,155.3,131.9,89.3,105.1,110.6,96.8,100,104.9,109.2,122.1,131,134.6,113.8,98.1,108.2
GBR,186.4,186.3,185.9,187.2,186.9,185.8,186.1,185.9,187,186.9,186.9,186.5,186.9,186.4,185.8,186.1,185.9,183.1,159.3,159.1,159.5,162.7,166.4,163.1,155.8,147.9,120.1,116.1,127.7,141.3,154.8,134.7,116.3,100.9,89,86.3,97.7,109.1,118.6,109,118.7,117.6,117.6,99.9,102,105.1,103.9,109,110.3,107.6,100.9,95.8,100,108.8,122,121.2,122.7,133.2,123.4,104.2,102.8
USA,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100,100

January 22nd, 2012, 11:31 PM

exclude Taiwan,Singapore,Kore - too few data for other indicators

so far I converted

1.) currency in $
2.) GDP annual change in %
3.) stocks annual change in value in billions of local currency
4.) CPI index 2002=100

they have >100 of other indicators, but it's tedious to convert

3.) must be converted into a stock index, so we need the total capitalization
2.) is in $ ?

some are not yet updated for 2011.01.01 let alone 2012.01.01

may I even publish the tables here ?
they say copyright OECD, although afaik you can't copyright such data

economical data

Discussion in Brokers

economical data