NexusFi: Find Your Edge


Home Menu

 





Parallel optimization


Discussion in NinjaTrader

Updated
      Top Posters
    1. looks_one Trader.Jon with 3 posts (1 thanks)
    2. looks_two jjmmg with 3 posts (1 thanks)
    3. looks_3 Big Mike with 2 posts (0 thanks)
    4. looks_4 Quick Summary with 1 posts (0 thanks)
    1. trending_up 3,519 views
    2. thumb_up 2 thanks given
    3. group 2 followers
    1. forum 8 posts
    2. attach_file 0 attachments




 
Search this Thread

Parallel optimization

  #1 (permalink)
jjmmg
Madrid
 
Posts: 6 since Nov 2010
Thanks Given: 2
Thanks Received: 1

Hi all,

My first post, and my first problem with NT. I'm designing a parallel optimizer, I mean, run each of the iterations on diferent machines/procesors. I have the optimizer, the messaging system, and the problem. The idea is running empty iterations on the master NT, which are actually executed on a slave NT, and when the iteration is finished, replace the result in the master NT from the slave NT. And then the problem arises. Once I recover the Strategy object from the slave NT, how can I "insert" those results in the master NT? Is there any point in the code of an optimizer where I can change the strategy results for one iteration? (With change I actually mean insert)

There are other "dirties" posibilities available for exhaustive optimization, like saving all the results, from master and slaves, in the same file, or export the result of the optimization on every NT and merge them externally, etc. But the first option is the best, i f possible, because it allows to use any optimizer algorithm.

Greetings and thanks,
Juanjo

Reply With Quote

Can you help answer these questions
from other members on NexusFi?
Pivot Indicator like the old SwingTemp by Big Mike
NinjaTrader
Increase in trading performance by 75%
The Elite Circle
How to apply profiles
Traders Hideout
Better Renko Gaps
The Elite Circle
REcommedations for programming help
Sierra Chart
 
Best Threads (Most Thanked)
in the last 7 days on NexusFi
Just another trading journal: PA, Wyckoff & Trends
34 thanks
Tao te Trade: way of the WLD
24 thanks
Bigger Wins or Fewer Losses?
18 thanks
GFIs1 1 DAX trade per day journal
16 thanks
Vinny E-Mini & Algobox Review TRADE ROOM
13 thanks
  #3 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,440 since Jun 2009
Thanks Given: 33,213
Thanks Received: 101,599




This is an ambitious project, I hope you can bring it to market.

Mike

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
  #4 (permalink)
 
Trader.Jon's Avatar
 Trader.Jon 
Near the BEuTiFULL Horse Shoe
 
Experience: Beginner
Platform: NinjaTrader
Broker: MBTrading Dukascopy ZenFire
Trading: $EURUSD when it is trending
Posts: 473 since Jul 2009
Thanks Given: 401
Thanks Received: 184


Big Mike View Post


This is an ambitious project, I hope you can bring it to market.

Mike

Actually I think it is the most ambitious undertaking I have heard of someone implementing with NinjaTrader. Would be great to see working, especially on a multiple virtual machine environment. I wonder if the staff at NT support would say more than 'unsupported' if they were asked for assist in getting it working.

IMHO, in retrospect, it is actually sad that someone is even thinking along these lines: it shows how much Windows/NT is lacking in such areas (distributed computing has been around for some time).

Jon

Reply With Quote
  #5 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,440 since Jun 2009
Thanks Given: 33,213
Thanks Received: 101,599


Trader.Jon View Post
Actually I think it is the most ambitious undertaking I have heard of someone implementing with NinjaTrader. Would be great to see working, especially on a multiple virtual machine environment. I wonder if the staff at NT support would say more than 'unsupported' if they were asked for assist in getting it working.

IMHO, in retrospect, it is actually sad that someone is even thinking along these lines: it shows how much Windows/NT is lacking in such areas (distributed computing has been around for some time).

Jon

Well, if he is able to accomplish this the benefits are limitless. One possibility would be to also implement CUDA for the engine, which would increase optimization performance probably 10x over.

Mike

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
  #6 (permalink)
 
Trader.Jon's Avatar
 Trader.Jon 
Near the BEuTiFULL Horse Shoe
 
Experience: Beginner
Platform: NinjaTrader
Broker: MBTrading Dukascopy ZenFire
Trading: $EURUSD when it is trending
Posts: 473 since Jul 2009
Thanks Given: 401
Thanks Received: 184


Big Mike View Post
Well, if he is able to accomplish this the benefits are limitless. One possibility would be to also implement CUDA for the engine, which would increase optimization performance probably 10x over.

Mike

Yeahhh ... I would LIKE that! Or the ATI version of GPU ... I have a 2GB 4670 ATI ready for beta testing .. not sure about that 10x ... certainly would need lots of tweaking and NT developer support .. maybe even a GPU version of NT for full GPU-power.

Somehow I dont think just building a class or method in C# will be enough but I could be wrong .... research on google and looks like there is hope .. maybe ?

There are Parallel computing
https://blogs.msdn.com/b/pfxteam/archive/2010/07/01/10030256.aspx
and .NET C# resources available
https://brahma.ananthonline.net/
that might be helpful for anyone that is gifted with the needed skillset and tools.

At one time I was involved in a team that was first line support for some of the first HPC cluster servers 'way back when'. Glad I wasnt on the software side of the team ...I would have been fired the first day .. tools are a lot better now, and Win7 was built with parallelism in mind, but not totally installed ... the evil empire keeps us waiting again

Jon

Reply With Quote
Thanked by:
  #7 (permalink)
jjmmg
Madrid
 
Posts: 6 since Nov 2010
Thanks Given: 2
Thanks Received: 1

As CUDA is not a possibility for me right know, I've seen a MPI implementation for .NET, called MPI.NET. I'll try it and let you know the results.

Reply With Quote
Thanked by:
  #8 (permalink)
jjmmg
Madrid
 
Posts: 6 since Nov 2010
Thanks Given: 2
Thanks Received: 1

To continue with this NT improvement, I need to solve this problem before.



Any ideas?

Reply With Quote
  #9 (permalink)
 
Trader.Jon's Avatar
 Trader.Jon 
Near the BEuTiFULL Horse Shoe
 
Experience: Beginner
Platform: NinjaTrader
Broker: MBTrading Dukascopy ZenFire
Trading: $EURUSD when it is trending
Posts: 473 since Jul 2009
Thanks Given: 401
Thanks Received: 184


jjmmg View Post
To continue with this NT improvement, I need to solve this problem before.



Any ideas?

jjmmg,

Have a look at this whole thread:
writing all Trades to a file - [AUTOLINK]NinjaTrader[/AUTOLINK] Support Forum

There is some work going on using unsupported code to access more of the optimization parameters. Perhaps your collabaration with those involved might be useful for all of you.

Jon

Reply With Quote




Last Updated on February 9, 2011


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts