NexusFi: Find Your Edge


Home Menu

 





Noise: A source of your errors?


Discussion in Traders Hideout

Updated
      Top Posters
    1. looks_one Sandpaddict with 12 posts (4 thanks)
    2. looks_two Cutloss with 7 posts (4 thanks)
    3. looks_3 SodyTexas with 4 posts (5 thanks)
    4. looks_4 SBtrader82 with 2 posts (1 thanks)
      Best Posters
    1. looks_one kiwi with 4 thanks per post
    2. looks_two SodyTexas with 1.3 thanks per post
    3. looks_3 Cutloss with 0.6 thanks per post
    4. looks_4 Sandpaddict with 0.3 thanks per post
    1. trending_up 3,799 views
    2. thumb_up 19 thanks given
    3. group 7 followers
    1. forum 27 posts
    2. attach_file 6 attachments




 
Search this Thread

Noise: A source of your errors?

  #1 (permalink)
 kiwi 
Gold Coast
 
Experience: Advanced
Platform: Sierra Chart
Trading: Futures and Forex
Posts: 49 since Aug 2010
Thanks Given: 23
Thanks Received: 96

Lots of us have enjoyed Daniel Kahneman's work with "Thinking, Fast and Slow" being very popular. It certainly affected my thinking about the processes I should use in trading.

There's a new one, just released, "Noise" subtitiled a flaw in human judgement that might be similarly influential for discretionary and systems traders. So, search Noise Kahneman at your favourite bookseller if you're interested.

There's also a video discussion with Daniel and the other two authors that seems to suggest some value to traders.

( I didn't post it under psychology because I think it will be more relevant to your day to day trading processes than your emotional happiness but that might be the wrong choice )

Started this thread Reply With Quote

Can you help answer these questions
from other members on NexusFi?
How to apply profiles
Traders Hideout
NexusFi Journal Challenge - May 2024
Feedback and Announcements
Better Renko Gaps
The Elite Circle
Pivot Indicator like the old SwingTemp by Big Mike
NinjaTrader
REcommedations for programming help
Sierra Chart
 
Best Threads (Most Thanked)
in the last 7 days on NexusFi
Spoo-nalysis ES e-mini futures S&P 500
38 thanks
Just another trading journal: PA, Wyckoff & Trends
30 thanks
Tao te Trade: way of the WLD
24 thanks
Bigger Wins or Fewer Losses?
23 thanks
GFIs1 1 DAX trade per day journal
21 thanks
  #2 (permalink)
 
Sandpaddict's Avatar
 Sandpaddict 
Vancouver, Canada
 
Experience: Advanced
Platform: Ninjatrader, MT4
Broker: IB, Global Prime
Trading: Futures CFDs
Posts: 684 since Mar 2020
Thanks Given: 975
Thanks Received: 637


kiwi View Post
Lots of us have enjoyed Daniel Kahneman's work with "Thinking, Fast and Slow" being very popular. It certainly affected my thinking about the processes I should use in trading.

There's a new one, just released, "Noise" subtitiled a flaw in human judgement that might be similarly influential for discretionary and systems traders. So, search Noise Kahneman at your favourite bookseller if you're interested.

There's also a video discussion with Daniel and the other two authors that seems to suggest some value to traders.

( I didn't post it under psychology because I think it will be more relevant to your day to day trading processes than your emotional happiness but that might be the wrong choice )

Oh wow. Im a huge fan of Kahneman. Ty!

***I just went into google books and I already have it on preorder! Lol

Sent using the NexusFi mobile app

Visit my NexusFi Trade Journal Reply With Quote
  #3 (permalink)
 
SodyTexas's Avatar
 SodyTexas 
Austin TX
 
Experience: Advanced
Platform: Ninjatrader, Python, & R
Broker: RJO
Trading: Futures, Spreads
Posts: 421 since Sep 2013
Thanks Given: 117
Thanks Received: 1,085



kiwi View Post
Lots of us have enjoyed Daniel Kahneman's work with "Thinking, Fast and Slow" being very popular. It certainly affected my thinking about the processes I should use in trading.

There's a new one, just released, "Noise" subtitiled a flaw in human judgement that might be similarly influential for discretionary and systems traders. So, search Noise Kahneman at your favourite bookseller if you're interested.

There's also a video discussion with Daniel and the other two authors that seems to suggest some value to traders.

( I didn't post it under psychology because I think it will be more relevant to your day to day trading processes than your emotional happiness but that might be the wrong choice )

Good video thanks,

There are a number of indicators to measure "noise" and I find them very useful in trend following. Noise is a sideways movement within a trend.

Here is an example showing the recent noise in the Russell 2k using a spread in the efficiency ratios. The spread is simple, the efficiency ratio of Russell less the efficiency ratio of a benchmark, in this case, the Wilshire 5k.

Cheers,
Sody

EDIT: just finished the video, I guess my definition of noise is different from the video's definition. I will leave this post up just in case, but it does not really apply to the conversation, sorry.

"The great Traders have always been humbled by the market early on in their careers creating a deep respect for the market. Until one has this respect indelibly engraved in their makeup, the concept of money management and discipline will never be treated seriously."
Attached Thumbnails
Click image for larger version

Name:	noise1.png
Views:	157
Size:	52.2 KB
ID:	312996   Click image for larger version

Name:	noise2.png
Views:	137
Size:	55.7 KB
ID:	312997  
Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #4 (permalink)
 
SBtrader82's Avatar
 SBtrader82   is a Vendor
 
Posts: 587 since Feb 2018
Thanks Given: 222
Thanks Received: 1,333


kiwi View Post
Lots of us have enjoyed Daniel Kahneman's work with "Thinking, Fast and Slow" being very popular. It certainly affected my thinking about the processes I should use in trading.

There's a new one, just released, "Noise" subtitiled a flaw in human judgement that might be similarly influential for discretionary and systems traders. So, search Noise Kahneman at your favourite bookseller if you're interested.

There's also a video discussion with Daniel and the other two authors that seems to suggest some value to traders.

( I didn't post it under psychology because I think it will be more relevant to your day to day trading processes than your emotional happiness but that might be the wrong choice )

I think Kahneman is highly overrate, but so are most of Nobel prize winners.
I read "thinking fast and slow" and I found that there was very little added value, but I am math major and an electronic engineer so I have a slightly different concept of what science is.

I think that if you want to understand noise you should apply science. Make an experiment, take a "noisy" enviroment and trade it with a risk reward ratio and see the results.
Why are you so worried about noise?
Take a noisy enviroment, model noise as gaussian and trade it.... in theory you would become millionaire in a couple of month. In a couple of years you will be richer than Bill Gates.

"Noise" is an empty word, what does this word mean? why something is considered noise and something no?

My conclusion is that there is no noise.

Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #5 (permalink)
 
Sandpaddict's Avatar
 Sandpaddict 
Vancouver, Canada
 
Experience: Advanced
Platform: Ninjatrader, MT4
Broker: IB, Global Prime
Trading: Futures CFDs
Posts: 684 since Mar 2020
Thanks Given: 975
Thanks Received: 637


SBtrader82 View Post
I think Kahneman is highly overrate, but so are most of Nobel prize winners.
I read "thinking fast and slow" and I found that there was very little added value, but I am math major and an electronic engineer so I have a slightly different concept of what science is.

Overhyped, yes. Overrated, I don't think so. Also that book is a decade old so it's been metabolizing sort of speak into the collective understanding now. At the time it was pretty ground breaking.


SBtrader82 View Post
I think that if you want to understand noise you should apply science. Make an experiment, take a "noisy" enviroment and trade it with a risk reward ratio and see the results.

I'm not even sure what that means?

Like a gaussian model that has been proven and over and over doesn't fit how real markets work due to the fat tails?

Otherwise the market AREADY does that?


SBtrader82 View Post
Why are you so worried about noise?
Take a noisy enviroment, model noise as gaussian and trade it.... in theory you would become millionaire in a couple of month. In a couple of years you will be richer than Bill Gates.

Again. I don't understand what you are saying. Sure, but the markets not gaussian? I guess that's what your saying?


SBtrader82 View Post
"Noise" is an empty word, what does this word mean? why something is considered noise and something no?

It depends on what your measuring.

This always bugged about Al Brooks. He always used to say that theres no such thing as noise. I noticed he doesn't say that anymore. Hmmmn

One the other hand Nassim Taleb completely ignores it in "The Black Swan" stating if you can't know it... it doesn't exits. That always bothered me too. He has since clarified as well.

What does this have to do with "noise"? Everything!

Both men denied the the existence of the other and both were wrong.

So WHAT is noise? It's a ratio of the SIGNAL to NOISE right?

So what's the signal? If theres no noise in the signal theres no problem.

If there is... then thats "noise".


SBtrader82 View Post
My conclusion is that there is no noise.

My conclusion is there is ABSOLUTELY noise! And it's irrefutable. It's part of the equation.

Sent using the NexusFi mobile app

Visit my NexusFi Trade Journal Reply With Quote
  #6 (permalink)
 
SodyTexas's Avatar
 SodyTexas 
Austin TX
 
Experience: Advanced
Platform: Ninjatrader, Python, & R
Broker: RJO
Trading: Futures, Spreads
Posts: 421 since Sep 2013
Thanks Given: 117
Thanks Received: 1,085


Sandpaddict View Post
Overhyped, yes. Overrated, I don't think so. Also that book is a decade old so it's been metabolizing sort of speak into the collective understanding now. At the time it was pretty ground breaking.

I'm not even sure what that means?

Like a gaussian model that has been proven and over and over doesn't fit how real markets work due to the fat tails?

Otherwise the market AREADY does that?

Again. I don't understand what you are saying. Sure, but the markets not gaussian? I guess that's what your saying?

It depends on what your measuring.

This always bugged about Al Brooks. He always used to say that theres no such thing as noise. I noticed he doesn't say that anymore. Hmmmn

One the other hand Nassim Taleb completely ignores it in "The Black Swan" stating if you can't know it... it doesn't exits. That always bothered me too. He has since clarified as well.

What does this have to do with "noise"? Everything!

Both men denied the the existence of the other and both were wrong.

So WHAT is noise? It's a ratio of the SIGNAL to NOISE right?

So what's the signal? If theres no noise in the signal theres no problem.

If there is... then thats "noise".

My conclusion is there is ABSOLUTELY noise! And it's irrefutable. It's part of the equation.

Sent using the NexusFi mobile app

Noise is VERY measurable,

Noise is sideways movement; markets move up, down, or sideways. After all, sideways are often classified with patterns in the form of market indecision. As far as methods to measure noise.. ADR, price density, fractal dimension, or my favorite efficiency ratio. Try combining a trend system and oscillating system without those and I can almost always guarantee the results to be curve fitted.

Sody

"The great Traders have always been humbled by the market early on in their careers creating a deep respect for the market. Until one has this respect indelibly engraved in their makeup, the concept of money management and discipline will never be treated seriously."
Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #7 (permalink)
 
Sandpaddict's Avatar
 Sandpaddict 
Vancouver, Canada
 
Experience: Advanced
Platform: Ninjatrader, MT4
Broker: IB, Global Prime
Trading: Futures CFDs
Posts: 684 since Mar 2020
Thanks Given: 975
Thanks Received: 637


SodyTexas View Post
Noise is VERY measurable,

Noise is sideways movement; markets move up, down, or sideways. After all, sideways are often classified with patterns in the form of market indecision. As far as methods to measure noise.. ADR, price density, fractal dimension, or my favorite efficiency ratio. Try combining a trend system and oscillating system without those and I can almost always guarantee the results to be curve fitted.

Sody

Yes I agree noise is VERY measurable.

I would say though just because it has a trend up or down doesn't mean as much as measurements.

Standard Deviation, linear regression, and the least squares concept are better measurements of what we are measuring I think.

This paper...
https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3243130

...although slightly off topic, but I dont think so, highlights the issues with standard measurements. Such as the sharpe ratio and it's cousin the SQN.

Again although not directly related to noise it's so profound you can see the glaring measuring errors within the existing tools.

Profitably and Quality Measurement.

PQM: See formula below. It's just beautiful! And far more accurate than anything before it as far as I'm concerned.

Sent using the NexusFi mobile app

Visit my NexusFi Trade Journal Reply With Quote
  #8 (permalink)
 
SBtrader82's Avatar
 SBtrader82   is a Vendor
 
Posts: 587 since Feb 2018
Thanks Given: 222
Thanks Received: 1,333


Sandpaddict View Post
Overhyped, yes. Overrated, I don't think so. Also that book is a decade old so it's been metabolizing sort of speak into the collective understanding now. At the time it was pretty ground breaking.

I'm not even sure what that means?

Like a gaussian model that has been proven and over and over doesn't fit how real markets work due to the fat tails?

Otherwise the market AREADY does that?

Again. I don't understand what you are saying. Sure, but the markets not gaussian? I guess that's what your saying?

It depends on what your measuring.

This always bugged about Al Brooks. He always used to say that theres no such thing as noise. I noticed he doesn't say that anymore. Hmmmn

One the other hand Nassim Taleb completely ignores it in "The Black Swan" stating if you can't know it... it doesn't exits. That always bothered me too. He has since clarified as well.

What does this have to do with "noise"? Everything!

Both men denied the the existence of the other and both were wrong.

So WHAT is noise? It's a ratio of the SIGNAL to NOISE right?

So what's the signal? If theres no noise in the signal theres no problem.

If there is... then thats "noise".

My conclusion is there is ABSOLUTELY noise! And it's irrefutable. It's part of the equation.

Sent using the NexusFi mobile app

I can't understand you either, I am not saying that the market is gaussian, but normally when you talk about noise in terms of Signal to noise ratio, you normally assume that there is some level of noise that is gaussian and above it there is the signal. This is how we engineers model that. The theory is easy, and also non engineers and non mathematicians understand it.... and that's part of the problem.
The reason behind the gaussian noise comes from how the electronic components generate noise. It's a model that has some reason to exist.... in the market it has no reason to exist. I think that at some point someone trying to be cool started to use the term noise and to apply scientific concepts to an endeavor which has nothing to do with electronics.

I will make you an example of why I don't think in terms of noise. Many traders, including big institutions, use the ladder. They see the orders on the DOM and they decide what to do to the tick level. If they see a big order resting on the ladder they will either get scared or try to gauge if the rest of the market partecipants are so strong that they hit it.
If you look at candles you will see choppiness, but the smalll movements that you see in the 1 min or 5 min charts they all have a reson to exist. There is somebody who is trading.... and it's not me and you, it's someone who's trading 100 or more contracts per trade. Do you think that if noise existed he would be so naive to trade on such a small timeframe? NO.
He trades because he is pushing the market to hit the big order, he pushes and then let the market retrieve and then pushes again and some other big trader is doing the opposite.

I watch it happen everyday.... I can explain every single 5 min, bar of the day, I can even explain the 1 min bar.... and I think every trader who's been trading long enough can. This doesn't mean that I would take part in every trade, but the market is not random, because people don't take random choices with real money.
Retailers are negligible, so big money know what they are doing.

Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
  #9 (permalink)
 
MNSTrading's Avatar
 MNSTrading 
Grand Rapids, Michigan
 
Experience: None
Trading: Commodities and Russell
Posts: 158 since Nov 2015
Thanks Given: 59
Thanks Received: 336

What SodyTexas said is correct. There are 2 components to a "rough" system, we can call it noise and structure. You can see it in this mandlebrot set


dKjJKKl


you have the structure (the buddha looking thing) and all the stuff coming out of it. In the stuff new structures arise, to infinity. So neither the noise nor structure is the source of error. Not seeing the whole picture is the error. Who can see it? A small boy with a wooden spade.

Coming, they can't be denied. Going, they can't be detained.
Visit my NexusFi Trade Journal Reply With Quote
  #10 (permalink)
 
Sandpaddict's Avatar
 Sandpaddict 
Vancouver, Canada
 
Experience: Advanced
Platform: Ninjatrader, MT4
Broker: IB, Global Prime
Trading: Futures CFDs
Posts: 684 since Mar 2020
Thanks Given: 975
Thanks Received: 637



SBtrader82 View Post
I can't understand you either, I am not saying that the market is gaussian, but normally when you talk about noise in terms of Signal to noise ratio, you normally assume that there is some level of noise that is gaussian and above it there is the signal. This is how we engineers model that. The theory is easy, and also non engineers and non mathematicians understand it.... and that's part of the problem.
The reason behind the gaussian noise comes from how the electronic components generate noise. It's a model that has some reason to exist.... in the market it has no reason to exist. I think that at some point someone trying to be cool started to use the term noise and to apply scientific concepts to an endeavor which has nothing to do with electronics.

Well sure they did and that's the problem. Noise AS DEFINED by traders is either smaller timeframe moves that don't generally affect them and on the other hand the UNKNOWABLE noise that seems larger than the signal causing confusion. The latter is the one that keeps us up at night.
SBtrader82 View Post
I will make you an example of why I don't think in terms of noise. Many traders, including big institutions, use the ladder. They see the orders on the DOM and they decide what to do to the tick level. If they see a big order resting on the ladder they will either get scared or try to gauge if the rest of the market partecipants are so strong that they hit it.

I think this is backwards. If they have enough size sure they may be able to move the market and if that's part of their strategy that makes sense but I doubt that's the norm. If this firm existed wouldn't they have already taken over the world?
SBtrader82 View Post
If you look at candles you will see choppiness, but the smalll movements that you see in the 1 min or 5 min charts they all have a reson to exist. There is somebody who is trading.... and it's not me and you, it's someone who's trading 100 or more contracts per trade. Do you think that if noise existed he would be so naive to trade on such a small timeframe? NO.

Ya this WAS Al Brooks stance for years too. Never understood that.

To answer your question yes IT IS NOISE. If I trade off monthly charts... daily's are noise. If I trade weekly charts, hourly charts ARE noise. If I trade hourly charts why would I stare at ticks?

But again, it's the fact that there is as much noise (as in you don't know what's going to happen vs what your sure of) or I'd say MORE in the markets than signal and HOW do you measure THAT?

Right now it's generally a version of P/L divided by the Std Dev of the Profit and loss. Which is flawed anyway.
SBtrader82 View Post
He trades because he is pushing the market to hit the big order, he pushes and then let the market retrieve and then pushes again and some other big trader is doing the opposite.

Ya sure maybe market makers in thin markets but generally in the index futures I believe it's far less possible.
#############
SBtrader82 View Post
I watch it happen everyday.... I can explain every single 5 min, bar of the day, I can even explain the 1 min bar.... and I think every trader who's been trading long enough can. This doesn't mean that I would take part in every trade, but the market is not random, because people don't take random choices with real money.

##############
OK ya lost me on that one. Sounds a little hyperbolistic.

Sure. I can tell ya what happened with 20/20 vision too? Does absolutely nothing for you in the future.

People do NOTHING but take random choices with REAL money! Including "BIG MONEY". They just think it's logical. If we were truly honest with ourselves and logical we'd probably realize we shouldn't trade at all. Just invest for the long term in an index. What is it %35/%65 now?

SBtrader82 View Post
Retailers are negligible, so big money know what they are doing.

That couldn't be farther from the truth. Big money as a group are for sure trained better, have access to huge... absolutely HUGE amounts of capital, and scores of resources retailer could only dream of. (Maybe they could throw us a few PhDs?). And more computing power you could ever even use. So what?

They are either using leverage or balancing a risk model to achieve a certain level of return for a given risk level.

The goal is to NOT lose money (that's unsaid) and secondly it's usually to beat the benchmark S&P plus the risk free rate of bonds ect... ect... whatever.

Also if retailers are negligible which they ARE but we are gaining a tiny share more and more as time marches on. Look at what happened with Game Stop. Lol

So who moves the market if all the smart money knows what's going to happen?

And WHO are these "BIG MONEY" movers? Institutions like pension funds? Large investment banks? Hedge funds which can be as large as a larger fund, although not usually... down to a one man operation. Or how about HFT firms? (Which probably makes up a somewhat large part of the daily volume in the index's)

What about hedgers and arbitrators?

I think I am still misunderstanding something here?

Good discussion. Gets the brain fluid flowing.

Sent using the NexusFi mobile app

Visit my NexusFi Trade Journal Reply With Quote
Thanked by:




Last Updated on May 25, 2021


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts