Using OnMarketData() on Historical data with a recording engine

February 14th, 2010, 02:11 PM

Hi,

It's here in VIP section

subterfuge

Hi Gom. I've seen a few screenshots of people using 'gomvolumeladder'. I cant seem to find it though. Is it in the ninjatrader thread you linked to in your OP somewhere? thanks

February 14th, 2010, 02:13 PM

Yes I'm pretty sure this will work. I can post my current ES 0310 if you want to test.

Big Mike

I'm just now having some time to start working with this.

I have a question.

We can use this for backtesting yes? So for instance, if I normally want to do a MarketIfTouch scenario and had to use OnMarketData(), I can now use your method, and provided the recorded data is present on my system, I can recreate the proper events even during a backtest, yes?

If so, I need to setup another VM and start recording a bunch of instruments using GomRecorder... so that in a year I can use this

Mike

February 15th, 2010, 08:30 AM

Big Mike

I'm just now having some time to start working with this.

I have a question.

We can use this for backtesting yes? So for instance, if I normally want to do a MarketIfTouch scenario and had to use OnMarketData(), I can now use your method, and provided the recorded data is present on my system, I can recreate the proper events even during a backtest, yes?

If so, I need to setup another VM and start recording a bunch of instruments using GomRecorder... so that in a year I can use this

Mike

Gomi,

Is there any reason we could not use replay data to "backfill" some of this? It would be good to be able to do this.

I am also thinking of a slightly different approach but still in the concept/investigation phase so once I get a bit more crystalized I'll post back.

February 15th, 2010, 08:40 AM

Backfill with market replay works but the recorder won't write data previous to the last date/time written in the file. So it can't fill gaps.

But for that you can

convert the file to a human readable format with the file converter (flat format)
using large file editor like emeditor, you edit the file and remove the end of the file, until beginning of the gap (remember Time Zone is UTC)
populate the file with a market replay
reconvert it to binary (if necessary) and reload

February 15th, 2010, 01:14 PM

gomi

Yes I'm pretty sure this will work. I can post my current ES 0310 if you want to test.

Does this mean we don't absolutely need NT to fix their bid/ask ordering in order to code strategies that use bid/ask data for indicators and filling orders more accurately..... Is it possible we could use COMCD data for this?

Recording all the data and making it available would be a challenge, but perhaps not as insurmountable a challenge as getting NT to change course of their development.

February 15th, 2010, 02:50 PM

GoldStandard

Does this mean we don't absolutely need NT to fix their bid/ask ordering in order to code strategies that use bid/ask data for indicators and filling orders more accurately..... Is it possible we could use COMCD data for this?

Recording all the data and making it available would be a challenge, but perhaps not as insurmountable a challenge as getting NT to change course of their development.

After some thinking I don't think this will work, because I don't think you can get intrabar fills on historical backtest. It would be logical you are always filled on next bar, so I don't think you can simulate intrabar fills.

Or you could completely monitor trades by yourself without EnterLong() or EnterShort(), outputting PnL in the console. But bye bye fancy stats and optimizer.
Sorry :-(

March 24th, 2010, 11:24 AM

Hi guys,

Just wanted to mention I updated the package to 1.3 on ninja web site.
Some bug correction, a few upgrades and added a delta momentum indicator

Cheers

May 13th, 2010, 12:22 AM

Hi Gomi,

First let me just say thank you for your generosity in sharing your work with everybody in the NT world. I don't know if I can figure out how to use these codes with NT so I can't even imagine how long it took you to build them. I just switched over to NT7 from MT4 and I'm quite surprised at how long it takes to load charts when all I have on them is a few exponential stochastics and bollinger bands, wow, could I do it with a calculator that fast.

I don't think I'm going to risk the rather fragile and seemingly shaky state of the platform at present. It seems she can't take much more already. Adding custom codes sounds like a lot of fun and I'm wishing I could check it out. I did a demo of Market Delta and was quite impressed, is the Gomi CD similar? And why does the recorder need to be on 24/7 if Zen Fire saves tick data already. What does one do if they experience a power or inet outage, as I do on a regular basis?

Many Thanks,

gomi

Hi guys,

Just wanted to mention I updated the package to 1.3 on ninja web site.
Some bug correction, a few upgrades and added a delta momentum indicator

Cheers

May 23rd, 2010, 10:52 PM

Is this thread still going? I have some big areas of missing data in my 6E Gomi Folder. Can't seem to find Ztrader's post about backfilling the GomFolder with the replay function. Can anybody point me in the right direction?

thanks..

dnof

Gomi,

Is there any reason we could not use replay data to "backfill" some of this? It would be good to be able to do this.

I am also thinking of a slightly different approach but still in the concept/investigation phase so once I get a bit more crystalized I'll post back.

May 24th, 2010, 07:52 AM

Here it is:

Download: Template for building data for persistent indicators

I am in the process of running replay for 10 days to build data for the persistent indicators recorded by Gom & Zondor Recorders for the new front contract months. Since I had errors it was necessary to remove previous files before starting I set …

ZTR

Fixed this to show up in a downloads search & added keywords. Thought I did this before the webinar???

Using OnMarketData() on Historical data with a recording engine

Discussion in NinjaTrader

Using OnMarketData() on Historical data with a recording engine