NexusFi: Find Your Edge


Home Menu

 





We Need a new subforum...


Discussion in Traders Hideout

Updated
      Top Posters
    1. looks_one centaurer with 11 posts (12 thanks)
    2. looks_two SMCJB with 7 posts (11 thanks)
    3. looks_3 srgtroy with 5 posts (5 thanks)
    4. looks_4 rleplae with 5 posts (17 thanks)
      Best Posters
    1. looks_one tturner86 with 5.5 thanks per post
    2. looks_two rleplae with 3.4 thanks per post
    3. looks_3 SMCJB with 1.6 thanks per post
    4. looks_4 centaurer with 1.1 thanks per post
    1. trending_up 7,703 views
    2. thumb_up 82 thanks given
    3. group 12 followers
    1. forum 43 posts
    2. attach_file 2 attachments




 
Search this Thread

We Need a new subforum...

  #1 (permalink)
 
jupiejupe's Avatar
 jupiejupe 
San Diego California
 
Experience: None
Platform: Home Grown IN Development
Broker: Broker InteractiveBrokers
Trading: CL
Posts: 146 since Apr 2011
Thanks Given: 87
Thanks Received: 68

for AI and Maching Learning

hey guys I wanted to point out a new AI made public, this time by uber called ludwig

https://uber.github.io/ludwig/

the cool thing about this AI is that there is no coding needed, I think that is super cool since i do not code, I sent the last two days getting the python on my macbook so that it had all to the required modules to be able to run ludwig, I got ludwig running about an hour ago, the next few days i am going to learn how to get it running and how to train it. here is a youtube video explaining how to do just that. I cant wait to get to the point that i have it training on market data.


"Learning to Trade: The Cost Of Tuition"
- a roadmap of my lessons learned as taught by the market
Follow me on Twitter Started this thread Reply With Quote
Thanked by:

Can you help answer these questions
from other members on NexusFi?
ZombieSqueeze
Platforms and Indicators
Better Renko Gaps
The Elite Circle
New Micros: Ultra 10-Year & Ultra T-Bond -- Live Now
Treasury Notes and Bonds
Ninja Mobile Trader VPS (ninjamobiletrader.com)
Trading Reviews and Vendors
Exit Strategy
NinjaTrader
 
Best Threads (Most Thanked)
in the last 7 days on NexusFi
Get funded firms 2023/2024 - Any recommendations or word …
59 thanks
Funded Trader platforms
36 thanks
NexusFi site changelog and issues/problem reporting
22 thanks
The Program
20 thanks
GFIs1 1 DAX trade per day journal
19 thanks
  #3 (permalink)
 
rleplae's Avatar
 rleplae 
Gits (Hooglede) Belgium
Legendary Market Wizard
 
Experience: Master
Platform: NinjaTrader, Proprietary,
Broker: Ninjabrokerage/IQfeed + Synthetic datafeed
Trading: 6A, 6B, 6C, 6E, 6J, 6S, ES, NQ, YM, AEX, CL, NG, ZB, ZN, ZC, ZS, GC
Posts: 3,003 since Sep 2013
Thanks Given: 2,442
Thanks Received: 5,863


I am looking forward to read your findings...

Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #4 (permalink)
 centaurer 
south africa
 
Posts: 169 since Dec 2018

"Applied machine learning is basically feature engineering."

— Andrew Ng

The problem with this is virtually all the work is in pre-processing data and feature engineering. The ML algorithms in scikit-learn work practically the same way. If you had the perfect data file you just feed them in that is it. All the work though is in creating the data file.
That took me quite awhile to understand.

A support vector classifier can't be just??
clf = svm.SVC(gamma='scale')
clf.fit(X, y)

That is is? No...
but that is it.

The work is all in producing X and y.

Reply With Quote
  #5 (permalink)
 
SMCJB's Avatar
 SMCJB 
Houston TX
Legendary Market Wizard
 
Experience: Advanced
Platform: TT and Stellar
Broker: Advantage Futures
Trading: Primarily Energy but also a little Equities, Fixed Income, Metals and Crypto.
Frequency: Many times daily
Duration: Never
Posts: 5,041 since Dec 2013
Thanks Given: 4,375
Thanks Received: 10,192


jupiejupe View Post
We need a new subforum for AI and Maching Learning

I think having a dedicated "Machine Learning and Artificial Intelligence" sub forum would be a good idea. I would also personally be willing to go through and identify old threads that should be moved into the new sub forum. Question is should it be Elite only or not? I would lean towards no but a lot of the ML threads here already are actually in Elite only sections. Could have both that would probably be overkill. Right now the ML threads are spread between "Traders Hideout", "Matlab, R project and Python", "Elite Circle" and "Elite Automated Trading".

@NJAMC @Mabi @rleplae @srgtroy what do you think?
@xplorer is this something you could do (if it has support) or would this need the big guy?

Reply With Quote
Thanked by:
  #6 (permalink)
 
SMCJB's Avatar
 SMCJB 
Houston TX
Legendary Market Wizard
 
Experience: Advanced
Platform: TT and Stellar
Broker: Advantage Futures
Trading: Primarily Energy but also a little Equities, Fixed Income, Metals and Crypto.
Frequency: Many times daily
Duration: Never
Posts: 5,041 since Dec 2013
Thanks Given: 4,375
Thanks Received: 10,192


centaurer View Post
"Applied machine learning is basically feature engineering."

— Andrew Ng

The problem with this is virtually all the work is in pre-processing data and feature engineering. The ML algorithms in scikit-learn work practically the same way. If you had the perfect data file you just feed them in that is it. All the work though is in creating the data file.
That took me quite awhile to understand.

A support vector classifier can't be just??
clf = svm.SVC(gamma='scale')
clf.fit(X, y)

That is is? No...
but that is it.

The work is all in producing X and y.

I agree

Reply With Quote
Thanked by:
  #7 (permalink)
 
srgtroy's Avatar
 srgtroy 
Los Angeles, California Republic
Legendary  R.I.P. 1965-2023 
 
Experience: None
Platform: Sierra Chart
Broker: CQG
Trading: ES
Posts: 1,928 since Jan 2011
Thanks Given: 1,375
Thanks Received: 3,722

I would have never started the AI and Trading thread had I seen this thread, which I am now seeing for the first time. We do need an AI and Trading thread, perhaps with a ML subforum, to centralize what is an increasingly important subject. But I'm happy to delete my thread and/or hand it over to a more informed authority like @rleplae or @NJAMC or someone else equally knowledgeable. I was just looking for a place to talk about AI and Trading and hadn't found one.

Bottom line:

1. I think we need a centralized thread, perhaps with one or more subforums.
2. Any new threads or subthreads should not be elite, the more the merrier imho.

@SMCJB

R.I.P. Roy Goldberg (srgtroy), 1965-2023.
Please visit [url="https://nexusfi.com/off-topic/60226-srgtroy-r-i-p-brotha.html[/url] for more information.
Reply With Quote
Thanked by:
  #8 (permalink)
 
NJAMC's Avatar
 NJAMC 
Atkinson, NH USA
Market Wizard
 
Experience: Intermediate
Platform: NinjaTrader 8/TensorFlow
Broker: NinjaTrader Brokerage
Trading: Futures, CL, ES, ZB
Posts: 1,970 since Dec 2010
Thanks Given: 3,037
Thanks Received: 2,394


centaurer View Post
"Applied machine learning is basically feature engineering."

— Andrew Ng

The problem with this is virtually all the work is in pre-processing data and feature engineering. The ML algorithms in scikit-learn work practically the same way. If you had the perfect data file you just feed them in that is it. All the work though is in creating the data file.
That took me quite awhile to understand.

A support vector classifier can't be just??
clf = svm.SVC(gamma='scale')
clf.fit(X, y)

That is is? No...
but that is it.

The work is all in producing X and y.

Hi @centaurer,

That is part of it, but there are other parts needed if you are not running standard IID (Independent and Identical Data) upon a well understood problem. For example, image feature detection is one that is well understood now, but you will not find much in the way of Time Series yet or Reinforcement Learning (other than a few samples).

The issue is thought needs to go into the model to make sure it doesn't over or under fit. Also, in the case of RL, stability is a problem which needs to be fine tuned. In the case of RL, the model can oscillate as it is being trained which forces an infinitely long training cycle.

I suspect an easier tool like the one Uber released is good for learning basics and experimenting with ML but might not be a good choice for a problem that hasn't been solved yet. Trading data within the stock market is a particularly difficult dataset to pre-process since it is non-stationary and non-linear. This means that some of the basic ML techniques will not work due to the IID assumption in the input data (which isn't explicitly stated within the sample problems). I don't think the Uber tool will have the flexibility to stabilize some problems.

But again, it might develop over time and I haven't gone through the technical documentation to check that statement. But proceed with caution, use this to learn about ML. Most of the top Deep Learning libraries are heading to this "No coding" type of structure (although you are coding through the config file so don't kid yourself). Tensorflow has Keras now as a preferred front end starting with TensorFlow 2.0. It is done with a simple Python script much like demoed in the youtube above.

Nil per os
-NJAMC [Generic Programmer]

LOM WIKI: NT-Local-Order-Manager-LOM-Guide
Artificial Bee Colony Optimization
Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #9 (permalink)
 
NJAMC's Avatar
 NJAMC 
Atkinson, NH USA
Market Wizard
 
Experience: Intermediate
Platform: NinjaTrader 8/TensorFlow
Broker: NinjaTrader Brokerage
Trading: Futures, CL, ES, ZB
Posts: 1,970 since Dec 2010
Thanks Given: 3,037
Thanks Received: 2,394


SMCJB View Post
I think having a dedicated "Machine Learning and Artificial Intelligence" sub forum would be a good idea. I would also personally be willing to go through and identify old threads that should be moved into the new sub forum. Question is should it be Elite only or not? I would lean towards no but a lot of the ML threads here already are actually in Elite only sections. Could have both that would probably be overkill. Right now the ML threads are spread between "Traders Hideout", "Matlab, R project and Python", "Elite Circle" and "Elite Automated Trading".

@NJAMC @Mabi @rleplae @srgtroy what do you think?
@xplorer is this something you could do (if it has support) or would this need the big guy?

Hi @SMCJB,

I don't know that we have critical mass yet for another sub-forum as I don't see a lot of activity under that topic. Might be me, but seems like there is only a hand-full of us with this interest. Would a sub-forum bring more interest and help organize the information, maybe!

If one is formed, my preference would be to keep it Elite as there is potentially very powerful threads that will be formed. It is best not to have that become a product by non-Elite users by taking this communities thoughts. It seems like that should be an Elite topic. Just my 2 cents..

Nil per os
-NJAMC [Generic Programmer]

LOM WIKI: NT-Local-Order-Manager-LOM-Guide
Artificial Bee Colony Optimization
Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #10 (permalink)
 
rleplae's Avatar
 rleplae 
Gits (Hooglede) Belgium
Legendary Market Wizard
 
Experience: Master
Platform: NinjaTrader, Proprietary,
Broker: Ninjabrokerage/IQfeed + Synthetic datafeed
Trading: 6A, 6B, 6C, 6E, 6J, 6S, ES, NQ, YM, AEX, CL, NG, ZB, ZN, ZC, ZS, GC
Posts: 3,003 since Sep 2013
Thanks Given: 2,442
Thanks Received: 5,863


I think it makes sense, it would help the community looking for information on this particular topic to find things easier and grouped.


SMCJB View Post
I think having a dedicated "Machine Learning and Artificial Intelligence" sub forum would be a good idea. I would also personally be willing to go through and identify old threads that should be moved into the new sub forum. Question is should it be Elite only or not? I would lean towards no but a lot of the ML threads here already are actually in Elite only sections. Could have both that would probably be overkill. Right now the ML threads are spread between "Traders Hideout", "Matlab, R project and Python", "Elite Circle" and "Elite Automated Trading".

@NJAMC @Mabi @rleplae @srgtroy what do you think?
@xplorer is this something you could do (if it has support) or would this need the big guy?


Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
Thanked by:




Last Updated on August 11, 2019


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts