on
Expert Predictions
This is blog post #4 in a series of analytical posts about the 2022 midterms. This post is affiliated with Gov 1347: Election Analytics, a course at Harvard University in the Government department.
The Plan This Week
Last week, I took a close look at The Economist’s and FiveThirtyEight’s House forecast models and their methodology, and compared them. With these models in mind, I updated my own 2022 midterm forecast and model to include national economic conditions (Gross Domestic Product, Real Disposable Income, and unemployment), generic ballot polls (partisan preference), and the midterm-president’s-party effect.
One of the most interesting differences between the two models was that FiveThirtyEight explicitly mentions their use of expert forecasts (Cook Political Report, Inside Elections, and Sabato’s Crystal Ball) to predict future elections. Expert forecasts are intuitively a strong predictor of the race outcomes, as they are the best predictions elections experts have given all they data they gathered. This week, I wanted to investigate how accurate these expert predictions really are, specifically for the 2018 midterms.
How Accurate Are Expert Predictions?
To conduct this week’s investigation, I compare the actual results of the 2018 midterm elections to the average election ratings of experts. The 2018 results shown below are Democrat vote shares in each district. The 2018 expert election ratings come from Ballotpedia, with the election ratings taking on integer values 1 through 7 – 1 represents a Solid/Safe Democrat prediction and 7 represents a Solid/Safe Republican average expert prediction for each district.
Evaluation
For the most part, the predictions are pretty accurate via visual investigation. Most of the areas that actually had majority-Republican vote shares in the 2018 elections were predicted to be likely or solidly Republican by the experts on average. The blue districts of the 2018 midterms, like the ones along the west coast of Washington, Oregon, and California, in Arizona and New Mexico, in southern Texas, and scattered throughout the Rust Belt, were impressively predicted by the experts and their ratings, reflected in the standout blue coloring in the plot above. The experts were also able to pin down the close races, like the ones in southern New Mexico and in Maine. Overall, I think the average expert ratings predicted the congressional races at the district level very well, despite being just one predictor (that is a culmination of many predictors considered by the experts) in my model.
My 2022 Model and Forecast, Updated
My New Model
My national model remains the same as it was last week, and I cannot fully extend my national model to the district level because it uses national variables like GDP change, as well as national responses to the generic ballot polls. That said, I can incorporate this week’s investigation into a district-level model that predicts the House races by district using the most recent expert ratings data I have access to. These district-level models are of course imperfect because they only use expert ratings, but across all of them, they have an average R-squared of 0.78.
My New Forecast
Below are my models’ predictions for the major vote share taken by Democrats for the 94 congressional districts where the expert ratings were available.
state | district | pred |
---|---|---|
Alaska | AL | 48.03 |
Arizona | 1 | 51.30 |
Arizona | 2 | 49.10 |
Arizona | 6 | 48.19 |
California | 21 | 48.30 |
California | 22 | 60.08 |
California | 25 | 58.31 |
California | 26 | 54.77 |
California | 3 | 49.02 |
California | 45 | 51.94 |
California | 47 | 58.68 |
California | 49 | 50.06 |
California | 9 | 56.05 |
Colorado | 3 | 48.72 |
Colorado | 7 | 55.14 |
Connecticut | 4 | 49.58 |
Connecticut | 5 | 51.77 |
Florida | 13 | 49.10 |
Florida | 15 | 48.92 |
Florida | 16 | 42.36 |
Florida | 2 | 52.57 |
Florida | 22 | 47.55 |
Florida | 27 | 48.87 |
Florida | 7 | 51.79 |
Georgia | 12 | 53.79 |
Georgia | 6 | 52.09 |
Illinois | 11 | 50.91 |
Illinois | 13 | 49.98 |
Illinois | 14 | 49.43 |
Illinois | 17 | 49.32 |
Illinois | 6 | 53.55 |
Illinois | 8 | 51.17 |
Iowa | 1 | 47.23 |
Iowa | 2 | 48.58 |
Iowa | 3 | 47.41 |
Kansas | 3 | 48.34 |
Maine | 2 | 47.16 |
Maryland | 6 | 70.30 |
Michigan | 11 | 49.35 |
Michigan | 3 | 47.56 |
Michigan | 7 | 45.56 |
Michigan | 8 | 48.92 |
Minnesota | 1 | 49.60 |
Minnesota | 2 | 49.52 |
Minnesota | 3 | 49.31 |
Minnesota | 8 | 50.25 |
Missouri | 2 | 46.53 |
Nebraska | 2 | 50.03 |
Nevada | 3 | 50.07 |
Nevada | 4 | 52.93 |
New Hampshire | 1 | 49.69 |
New Hampshire | 2 | 51.32 |
New Jersey | 11 | 60.44 |
New Jersey | 2 | 46.43 |
New Jersey | 3 | 49.77 |
New Jersey | 5 | 50.37 |
New Jersey | 7 | 49.27 |
New Mexico | 1 | 50.81 |
New Mexico | 2 | 48.27 |
New York | 1 | 48.92 |
New York | 11 | 45.26 |
New York | 18 | 51.87 |
New York | 19 | 48.23 |
New York | 2 | 46.52 |
New York | 22 | 48.60 |
New York | 25 | 49.11 |
New York | 3 | 46.90 |
New York | 4 | 53.23 |
North Carolina | 13 | 48.93 |
North Carolina | 6 | 53.43 |
North Carolina | 7 | 51.02 |
North Carolina | 9 | 49.77 |
Ohio | 1 | 46.03 |
Ohio | 10 | 20.01 |
Ohio | 13 | 58.82 |
Ohio | 15 | 47.43 |
Ohio | 7 | 62.47 |
Oregon | 5 | 52.66 |
Pennsylvania | 1 | 50.84 |
Pennsylvania | 10 | 46.13 |
Pennsylvania | 12 | 48.24 |
Pennsylvania | 17 | 41.72 |
Pennsylvania | 6 | 51.10 |
Pennsylvania | 7 | 48.00 |
Pennsylvania | 8 | 47.94 |
South Carolina | 1 | 49.78 |
Texas | 23 | 49.28 |
Virginia | 10 | 48.25 |
Virginia | 2 | 50.30 |
Virginia | 5 | 48.37 |
Virginia | 7 | 50.98 |
Washington | 3 | 50.43 |
Washington | 8 | 50.44 |
Wisconsin | 3 | 44.73 |
References
[1] Ballotpedia. (2022). https://ballotpedia.org/Main_Page
[2] Cook Political Report. (2002). House Race Ratings. https://www.cookpolitical.com/ratings/house-race-ratings
[3] Inside Elections. (2022). House Ratings. https://insideelections.com/ratings/house
[4] Sabato’s Crystal Ball. (2022). House Race Ratings. https://centerforpolitics.org/crystalball/2022-house/
[5] The New York Times. (2018, November 6). U.S. House election results 2018. The New York Times. https://www.nytimes.com/interactive/2018/11/06/us/elections/results-house-elections.html