Blogging the Bookshelf

Blogging my bookshelf – one book at a time

Blogging the Bookshelf header image 4

Entries Tagged as 'Modelling'

Where Objective and Subjective Reality Intersect – “The Signal and the Noise: The Art and Science of Prediction” – Nate Silver

November 25th, 2012 · Comments Off on Where Objective and Subjective Reality Intersect – “The Signal and the Noise: The Art and Science of Prediction” – Nate Silver · Prediction, Statistics

Prediction is difficult for us for the same reason that it is so important: it is where objective and subjective reality intersect. Distinguishing the signal from the noise requires both scientific knowledge and self-knowledge: the serenity to accept the things we cannot predict, the courage to predict the things we can, and the wisdom to […]

[Read more →]

Tags:··

The Accuracy of Climate Models – “The Signal and the Noise: The Art and Science of Prediction” – Nate Silver

November 24th, 2012 · Comments Off on The Accuracy of Climate Models – “The Signal and the Noise: The Art and Science of Prediction” – Nate Silver · Environmental Policy, Policy, Politics, Prediction, Statistics

Emanuel’s concerns are actually quite common among the scientific community: climate scientists are in much broader agreement about some parts of the debate than others. A survey of climate scientists conducted in 2008 found that almost all (94 percent) were agreed that climate change is occurring now, and 84 percent were persuaded that it was […]

[Read more →]

Tags:·····

The Limitations of Statistical Significance – “The Signal and the Noise: The Art and Science of Prediction”, Nate Silver

November 22nd, 2012 · Comments Off on The Limitations of Statistical Significance – “The Signal and the Noise: The Art and Science of Prediction”, Nate Silver · Data, Statistical Inference, Statistics

The bigger problem, however, is that the frequentist methods—in striving for immaculate statistical procedures that can’t be contaminated by the researcher’s bias—keep him hermetically sealed off from the real world. These methods discourage the researcher from considering the underlying context or plausibility of his hypothesis, something that the Bayesian method demands in the form of […]

[Read more →]

Tags:·····

More Data Means More Noise – “The Signal and the Noise: The Art and Science of Prediction”, Nate Silver

November 21st, 2012 · Comments Off on More Data Means More Noise – “The Signal and the Noise: The Art and Science of Prediction”, Nate Silver · Data, Prediction, Statistical Inference, Statistics

As there is an exponential increase in the amount of available information, there is likewise an exponential increase in the number of hypotheses to investigate. For instance, the U.S. government now publishes data on about 45,000 economic statistics. If you want to test for relationships between all combinations of two pairs of these statistics—is there […]

[Read more →]

Tags:····

In Medicine, Stupid Models Kill People – “The Signal and the Noise: The Art and Science of Prediction”, Nate Silver

November 20th, 2012 · Comments Off on In Medicine, Stupid Models Kill People – “The Signal and the Noise: The Art and Science of Prediction”, Nate Silver · Data, Prediction, Statistical Inference, Statistics

Much of the most thoughtful work on the use and abuse of statistical models and the proper role of prediction comes from people in the medical profession. That is not to say there is nothing on the line when an economist makes a prediction, or a seismologist does. But because of medicine’s intimate connection with […]

[Read more →]

Tags:····

Overfit Models – “The Signal and the Noise: The Art and Science of Prediction”, Nate Silver

November 19th, 2012 · Comments Off on Overfit Models – “The Signal and the Noise: The Art and Science of Prediction”, Nate Silver · Modelling, Quotes, Statistics

But the overfit model scores those extra points in essence by cheating—by fitting noise rather than signal. It actually does a much worse job of explaining the real world. As obvious as this might seem when explained in this way, many forecasters completely ignore this problem. The wide array of statistical methods available to researchers […]

[Read more →]

Tags:····

Risk and Uncertainty – “The Signal and the Noise: The Art and Science of Prediction”, Nate Silver

November 16th, 2012 · Comments Off on Risk and Uncertainty – “The Signal and the Noise: The Art and Science of Prediction”, Nate Silver · Data, Prediction

Risk, as first articulated by the economist Frank H. Knight in 1921, is something that you can put a price on. Say that you’ll win a poker hand unless your opponent draws to an inside straight: the chances of that happening are exactly 1 chance in 11. This is risk. It is not pleasant when […]

[Read more →]

Tags:····