Current navigation level
Previous navigation level
Next navigation level
Current navigation level

Soccer Analytics - Forecast Quality

On this page we check the quality of previous forecasts. To this end, we compare our forecasts to forecasts from other external sources.

The main objective of the model is to forecast the final table. It is not expected that the final table can be predicted exactly. Every season has its own surprises and disappointments. To check how good our forecast was last season, we compare our forecast with the tips from many other forecasts collected on the BStat homepage. All of these predict the ranks of the final table. We calculate the rank correlation coefficient with the real final table and the respective forecasts. The closer a forecast was to the truth, the higher this value. Our forecast method reached the fourth position in the 2018/19 season. Guessing the exact position is often a matter of luck, especially in a narrow league like the Bundesliga. Therefore, we additionally look at the forecast quality for expected points using the root mean squared error. This quality measure is smaller the closer the forecast is to the actual points. In this category, our forecast again performs very good.
In the table "Coach dismissals 2017/18" all released coaches of the Bundesliga season 2017/18 are listed with the standardized deviation of the points to our forecast at the time of their dismissal. All coaches were dismissed with negative deviations. We regard this as evidence that the managers of the Bundesliga teams apply similar standards as our model.

SEASON 2018/19
           Rank correlation coefficient Root Mean Squared Error
 SEW  0.72  11.3 
 Soccer-Rating.com  0.80*  -
 Spiegel Online  0.80*  -
 Transfermarkt.de  0.73  -
 Sportwetten.com  0.72  -
 Ran  0.73  -
 Euro Club Index  0.69  -
 Comunio.de  0.74  -
 Hessische/Niedersächsische Allgemeine   0.65  -
 Fupro.de  0.70  -
 Bundesliga-Tipp-Prognose  0.70  12.0
 @BettingIsCool  0.71  11.1*
 FiveThirtyEight  0.65  11.7
 Youpriboo.com  0.64  -
 DRatings  0.67  11.3
 Sport1.de  0.61  -
 KickForm.de  0.64  12.4
 Club ELO  0.61  -
 T-Online  0.57  -
 General-Anzeiger Bonn  0.55   - 
 Goalimpact  0.60  12.9
 FootballDatabase  0.51  -
 Liga-Statistik.de  0.42  17.9
 Bundesliga-Prognose.de  0.42  17.7
 * indicates best prediction performance
  Rank correlation
coefficient
Root mean
squared error
Season 2017/18
SEW new
0.64 8.9*
SEW old
0.47 10.8
Transfermark.de 0.60 -
Goalimpact 0.71 9.0
Fupro 0.63 11.5
bundesliga-prognose.de
0.43 16.8
Kick-Forum 0.61 9.4
Spiegel Online
0.75* -
FiveThirtyEight 0.63 9.9
 Euro Club Index
0.61 9.0
fussballmathe.de 0.63 12.1
General-Anzeiger 0.74  -
Fussball-Manager.com 0.58 16.4
Club Elo
0.62 -
 * indicates best prediction performance.
Coach Dismissals 2017/18
After match day Team  Coach Deviation / matches in office
 4 VfL Wolfsburg  Andries Jonker  -0.27 
 6 Bayern Munich  Carlo Ancelotti  -0.08 
 10 Werder Bremen  Alexander Nouri  -0.56 
 14 FC Koln  Peter Stoeger  -0.84 
 15 Borussia Dortmund  Peter Bosz  -0.25 
 19 Hamburg  Markus Gisdol  -0.32 
 20 Stuttgart  Hannes Wolf  -0.07 
 23 VfL Wolfsburg  Martin Schmidt
-0.23 
 26 Hamburg  Bernd Hollerbach  -0.38

In the 2016/17 season, our forecast was only beaten by Spiegel Online in predicting the rankings.

Season 2016/17
Quality measure SEW Soccer Analytics
goalimpact.com F.A.Z. Spiegel Online
538
Rank correlation coefficient
 0.47 0.44 0.29 0.50* 0.42
RMSE 10.14* 10.87 - - 10.83
 * indicates best prediction performance.
 

In season 2015/16 our predictions were at least as good as all considered competitors.

Season 2015/16
Quality measure SEW Soccer Analytics
goalimpact.com F.A.Z. Spiegel Online
Rank correlation coefficient
 0.64* 0.64* 0.57 0.60
RMSE 8.57* 8.76 - -
 * indicates best prediction performance.