The news is a maniacal scramble to make sense of the current financial situation around the world.
Predictions, ____ expert from _____ investment research firm, advice, soothsaying, modeling, bear vs. bull, Fed should do this, Fed shouldn’t do this…. and so on.
A truth I got comfortable with a long time ago but had reinforced over the last three weeks in my life.
Your model can only be as predictive as the thing you are modeling.
– Jason Cawley, Wolfram Research (and probably others…)
That’s a stupid statement, right? Duh. I know that.
Really think about it though. and then consider these things and your interpretation of them
- weather forecasts
- endless dow jones index reports
- Political polls
- compatibility tests in online dating
- SAT scores
- TSA profiling at airports
- Annual budgeting for businesses
- Or go through the latest in the news
All of these “indicators” attempt to predict complex systems/situations. Those systems have to show some stability, some simplicity to ever give way to useful prediction (useful = do you get info you can use elsewhere and with enough time/energy to use it).
There is potential to get some local or short term prediction due to local or short term stability. However, to effectively use that over time you need to be able to predict when that stability yields to a new pattern. That is where it gets difficult.
Yes, you can aggregate a lot of these indicators to produce some sort of statistical sample. Usually though, you’re simply hiding the intesting stuff in the errors in your statistical model. Washing out the outliers as “noise”. The problem is, especially in the indicators above, it’s the outliers that matter! But I digress…
Point for financial pundits: national and global economics itself is complex. no simple model, simple statement, simple index can accurately model it. not even poorly.
Agree or Disagree? Let’s have a discussion.
Russ, it’s very weird you posted this. Because I was also posting something about predictability today (rather, finding specific complex structures) — http://thenksblog.wordpress.com/2008/07/16/featured-nks-forum-post-the-mozart-problem/
Jason talks about this kind of thing. I thought it was an interesting post. I even bring up the idea that “sitting back” and letting things play out is, at bottom, a problem that involves the idea of free will. Check it!