library(elo)Now that we’ve explored the Elo setup, we turn our attention to other methodologies implemented in the elo package.
The first model computes teams’ win percentages, and feeds the differences of percentages into a regression. Including an adjustment using adjust() in the formula also includes that in the model. You could also adjust the intercept for games played on neutral fields by using the neutral() function.
e.winpct <- elo.winpct(score(points.Home, points.Visitor) ~ team.Home + team.Visitor + group(week), data = tournament,
subset = points.Home != points.Visitor) # to get rid of ties for now
summary(e.winpct)##
## An object of class 'elo.winpct', containing information on 8 teams and 51 matches.
##
## Mean Square Error: 0.1566
## AUC: 0.8339
## Favored Teams vs. Actual Wins:
## Actual
## Favored 0 1
## TRUE 7 32
## (tie) 0 0
## FALSE 9 3rank.teams(e.winpct)## Athletic Armadillos Blundering Baboons Cunning Cats
## 1 7 4
## Defense-less Dogs Elegant Emus Fabulous Frogs
## 8 5 2
## Gallivanting Gorillas Helpless Hyenas
## 3 6predict(e.winpct, newdata = data.frame(team.Home = "Athletic Armadillos", team.Visitor = "Blundering Baboons", stringsAsFactors = FALSE))## 1
## 0.9690678tournament$neutral <- replace(rep(0, nrow(tournament)), 30:35, 1)
summary(elo.winpct(score(points.Home, points.Visitor) ~ team.Home + team.Visitor + neutral(neutral) + group(week),
data = tournament, subset = points.Home != points.Visitor))##
## An object of class 'elo.winpct', containing information on 8 teams and 51 matches.
##
## Mean Square Error: 0.1565
## AUC: 0.825
## Favored Teams vs. Actual Wins:
## Actual
## Favored 0 1
## TRUE 6 32
## (tie) 0 0
## FALSE 10 3The models can be built “running”, where predictions for the next group of games are made based on past data. Consider using the skip= argument to skip the first few groups (otherwise the model might have trouble converging).
Note that predictions from this object use a model fit on all the data.
e.winpct <- elo.winpct(score(points.Home, points.Visitor) ~ team.Home + team.Visitor + group(week), data = tournament,
subset = points.Home != points.Visitor, running = TRUE, skip = 5)
summary(e.winpct)##
## An object of class 'elo.winpct', containing information on 8 teams and 51 matches.
##
## Mean Square Error: 0.2141
## AUC: 0.8339
## Favored Teams vs. Actual Wins:
## Actual
## Favored 0 1
## TRUE 5 19
## (tie) 6 13
## FALSE 5 3predict(e.winpct, newdata = data.frame(team.Home = "Athletic Armadillos", team.Visitor = "Blundering Baboons", stringsAsFactors = FALSE)) # the same thing## 1
## 0.9690678It’s also possible to compare teams’ skills using logistic regression. This is essentially the Bradley-Terry model. A matrix of dummy variables is constructed, one for each team, where a value of 1 indicates a home team and -1 indicates a visiting team. The intercept then indicates a home-field advantage. To denote games played in a neutral setting (that is, without home-field advantage), use the neutral() function. In short, the intercept will then be set to 1 - neutral(). Including an adjustment using adjust() in the formula also includes that in the model.
results <- elo.glm(score(points.Home, points.Visitor) ~ team.Home + team.Visitor + group(week), data = tournament,
subset = points.Home != points.Visitor) # to get rid of ties for now
summary(results)##
## Call:
## stats::glm(formula = wins.A ~ . - 1, family = family, data = dat.qr,
## weights = wts, subset = NULL, na.action = stats::na.pass)
##
## Deviance Residuals:
## Min 1Q Median 3Q Max
## -2.0108 -0.8255 0.4050 0.6560 2.1217
##
## Coefficients:
## Estimate Std. Error z value Pr(>|z|)
## home.field 1.0307 0.3871 2.663 0.00775 **
## `Athletic Armadillos` 1.4289 0.9546 1.497 0.13442
## `Blundering Baboons` -0.9637 0.9043 -1.066 0.28659
## `Cunning Cats` 0.5377 0.9483 0.567 0.57074
## `Defense-less Dogs` -1.7413 1.0356 -1.681 0.09268 .
## `Elegant Emus` 0.3931 0.8818 0.446 0.65576
## `Fabulous Frogs` 0.8489 0.8807 0.964 0.33509
## `Gallivanting Gorillas` 0.3994 0.9500 0.420 0.67417
## ---
## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
##
## (Dispersion parameter for binomial family taken to be 1)
##
## Null deviance: 70.701 on 51 degrees of freedom
## Residual deviance: 48.037 on 43 degrees of freedom
## AIC: 64.037
##
## Number of Fisher Scoring iterations: 5
##
## Mean Square Error: 0.1566
## AUC: 0.8375
## Favored Teams vs. Actual Wins:
## Actual
## Favored 0 1
## TRUE 7 32
## (tie) 0 0
## FALSE 9 3rank.teams(results)## Athletic Armadillos Blundering Baboons Cunning Cats
## 1 7 3
## Defense-less Dogs Elegant Emus Fabulous Frogs
## 8 5 2
## Gallivanting Gorillas Helpless Hyenas
## 4 6predict(results, newdata = data.frame(team.Home = "Athletic Armadillos", team.Visitor = "Blundering Baboons", stringsAsFactors = FALSE))## 1
## 0.9684256summary(elo.glm(score(points.Home, points.Visitor) ~ team.Home + team.Visitor + neutral(neutral) + group(week),
data = tournament, subset = points.Home != points.Visitor))##
## Call:
## stats::glm(formula = wins.A ~ . - 1, family = family, data = dat.qr,
## weights = wts, subset = NULL, na.action = stats::na.pass)
##
## Deviance Residuals:
## Min 1Q Median 3Q Max
## -2.0349 -0.7789 0.3933 0.7618 2.2148
##
## Coefficients:
## Estimate Std. Error z value Pr(>|z|)
## home.field 1.0886 0.4229 2.574 0.0101 *
## `Athletic Armadillos` 1.6006 0.9750 1.642 0.1007
## `Blundering Baboons` -0.8541 0.8930 -0.956 0.3389
## `Cunning Cats` 0.5801 0.9446 0.614 0.5391
## `Defense-less Dogs` -1.8507 1.0449 -1.771 0.0765 .
## `Elegant Emus` 0.5762 0.8994 0.641 0.5218
## `Fabulous Frogs` 0.8470 0.8804 0.962 0.3360
## `Gallivanting Gorillas` 0.5777 0.9279 0.623 0.5335
## ---
## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
##
## (Dispersion parameter for binomial family taken to be 1)
##
## Null deviance: 70.701 on 51 degrees of freedom
## Residual deviance: 48.405 on 43 degrees of freedom
## AIC: 64.405
##
## Number of Fisher Scoring iterations: 5
##
## Mean Square Error: 0.1556
## AUC: 0.8375
## Favored Teams vs. Actual Wins:
## Actual
## Favored 0 1
## TRUE 7 32
## (tie) 0 0
## FALSE 9 3The models can be built “running”, where predictions for the next group of games are made based on past data. Consider using the skip= argument to skip the first few groups (otherwise the model might have trouble converging).
Note that predictions from this object use a model fit on all the data.
results <- elo.glm(score(points.Home, points.Visitor) ~ team.Home + team.Visitor + group(week), data = tournament,
subset = points.Home != points.Visitor, running = TRUE, skip = 5)
summary(results)##
## Call:
## stats::glm(formula = wins.A ~ . - 1, family = family, data = dat.qr,
## weights = wts, subset = NULL, na.action = stats::na.pass)
##
## Deviance Residuals:
## Min 1Q Median 3Q Max
## -2.0108 -0.8255 0.4050 0.6560 2.1217
##
## Coefficients:
## Estimate Std. Error z value Pr(>|z|)
## home.field 1.0307 0.3871 2.663 0.00775 **
## `Athletic Armadillos` 1.4289 0.9546 1.497 0.13442
## `Blundering Baboons` -0.9637 0.9043 -1.066 0.28659
## `Cunning Cats` 0.5377 0.9483 0.567 0.57074
## `Defense-less Dogs` -1.7413 1.0356 -1.681 0.09268 .
## `Elegant Emus` 0.3931 0.8818 0.446 0.65576
## `Fabulous Frogs` 0.8489 0.8807 0.964 0.33509
## `Gallivanting Gorillas` 0.3994 0.9500 0.420 0.67417
## ---
## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
##
## (Dispersion parameter for binomial family taken to be 1)
##
## Null deviance: 70.701 on 51 degrees of freedom
## Residual deviance: 48.037 on 43 degrees of freedom
## AIC: 64.037
##
## Number of Fisher Scoring iterations: 5
##
## Mean Square Error: 0.2098
## AUC: 0.8375
## Favored Teams vs. Actual Wins:
## Actual
## Favored 0 1
## TRUE 6 19
## (tie) 6 13
## FALSE 4 3predict(results, newdata = data.frame(team.Home = "Athletic Armadillos", team.Visitor = "Blundering Baboons", stringsAsFactors = FALSE)) # the same thing## 1
## 0.9684256It’s also possible to compare teams’ skills using a Markov-chain-based model, as outlined in Kvam and Sokol (2006). In short, imagine a judge who randomly picks one of two teams in a matchup, where the winner gets chosen with probability p (here, for convenience, ‘k’) and the loser with probability 1-p (1-k). In other words, we assume that the probability that the winning team is better than the losing team given that it won is k, and the probability that the losing team is better than the winning team given that it lost is (1-k). This forms a transition matrix, whose stationary distribution gives a ranking of teams. The differences in ranking are then fed into a logistic regession model to predict win status. Any adjustments made using adjust() are also included in this logistic regression. You could also adjust the intercept for games played on neutral fields by using the neutral() function.
mc <- elo.markovchain(score(points.Home, points.Visitor) ~ team.Home + team.Visitor, data = tournament,
subset = points.Home != points.Visitor, k = 0.7)
summary(mc)##
## An object of class 'elo.markovchain', containing information on 8 teams and 51 matches.
##
## Mean Square Error: 0.1688
## AUC: 0.8
## Favored Teams vs. Actual Wins:
## Actual
## Favored 0 1
## TRUE 10 29
## (tie) 0 0
## FALSE 6 6rank.teams(mc)## Athletic Armadillos Blundering Baboons Cunning Cats
## 1 7 3
## Defense-less Dogs Elegant Emus Fabulous Frogs
## 8 4 2
## Gallivanting Gorillas Helpless Hyenas
## 6 5predict(mc, newdata = data.frame(team.Home = "Athletic Armadillos", team.Visitor = "Blundering Baboons", stringsAsFactors = FALSE))## 1
## 0.9594476summary(elo.markovchain(score(points.Home, points.Visitor) ~ team.Home + team.Visitor + neutral(neutral),
data = tournament, subset = points.Home != points.Visitor, k = 0.7))##
## An object of class 'elo.markovchain', containing information on 8 teams and 51 matches.
##
## Mean Square Error: 0.1732
## AUC: 0.7857
## Favored Teams vs. Actual Wins:
## Actual
## Favored 0 1
## TRUE 10 28
## (tie) 0 0
## FALSE 6 7These models can also be built “running”, where predictions for the next group of games are made based on past data. Consider using the skip= argument to skip the first few groups (otherwise the model might have trouble converging).
Note that predictions from this object use a model fit on all the data.
mc <- elo.markovchain(score(points.Home, points.Visitor) ~ team.Home + team.Visitor + group(week), data = tournament,
subset = points.Home != points.Visitor, k = 0.7, running = TRUE, skip = 5)
summary(mc)##
## An object of class 'elo.markovchain', containing information on 8 teams and 51 matches.
##
## Mean Square Error: 0.229
## AUC: 0.8
## Favored Teams vs. Actual Wins:
## Actual
## Favored 0 1
## TRUE 6 19
## (tie) 6 13
## FALSE 4 3predict(mc, newdata = data.frame(team.Home = "Athletic Armadillos", team.Visitor = "Blundering Baboons", stringsAsFactors = FALSE)) # the same thing## 1
## 0.9594476Note that by assigning probabilities in the right way, this function emits the Logistic Regression Markov Chain model (LRMC). Use the in-formula function k() for this. IMPORTANT: note that k() denotes the probability assigned to the winning team, not the home team (for instance). If rH(x) denotes the probability that the home team is better given that they scored x points more than the visiting team (allowing for x to be negative), then an LRMC model might look something like this:
elo.markovchain(floor(wins.home) ~ team.home + team.visitor + k(ifelse(x > 0, rH(x), 1 - rH(x))))Why do we use floor() here? This takes care of the odd case where teams tie. In this case, rH(x) < 0.5 because we expected the home team to win by virtue of being home. By default, elo.markovchain() will split any ties down the middle (i.e., 0.5 and 0.5 instead of p and 1-p), which isn’t what we want; we want the visiting team to get a larger share than the home team. Telling elo.markovchain() that the visiting team “won” gives the visiting team its whole share of p.
Alternatively, if h denotes a home-field advantage (in terms of score), the model becomes:
elo.markovchain(ifelse(home.points - visitor.points > h, 1, 0) ~ team.home + team.visitor + k(pmax(rH(x), 1 - rH(x))))In this case, the home team “won” if it scored more than h points more than the visiting team. Since rH(x) > 0.5 if x > h, then pmax() will assign the proper probability to the pseudo-winning team.
Finally, do note that using neutral() isn’t sufficient for adjusting for games played on neutral ground, because the adjustment is only taken into account in the logistic regression to produce probabilities, not the building of the transition matrix. Therefore, you’ll want to also account for neutral wins/losses in k() as well.
It’s also possible to compare teams’ skills using the Colley Matrix method, as outlined in Colley (2002). The coefficients to the Colley matrix formulation gives a ranking of teams. The differences in ranking are then fed into a logistic regession model to predict win status. Here ‘k’ denotes how convincing a win is; it represents the fraction of the win assigned to the winning team and the fraction of the loss assigned to the losing team. Setting ‘k’ = 1 emits the bias-free method presented by Colley. Any adjustments made using adjust() are also included in this logistic regression. You could also adjust the intercept for games played on neutral fields by using the neutral() function.
co <- elo.colley(score(points.Home, points.Visitor) ~ team.Home + team.Visitor, data = tournament,
subset = points.Home != points.Visitor)
summary(co)##
## An object of class 'elo.colley', containing information on 8 teams and 51 matches.
##
## Mean Square Error: 0.1565
## AUC: 0.8339
## Favored Teams vs. Actual Wins:
## Actual
## Favored 0 1
## TRUE 7 32
## (tie) 0 0
## FALSE 9 3rank.teams(co)## Athletic Armadillos Blundering Baboons Cunning Cats
## 1 7 4
## Defense-less Dogs Elegant Emus Fabulous Frogs
## 8 5 2
## Gallivanting Gorillas Helpless Hyenas
## 3 6predict(co, newdata = data.frame(team.Home = "Athletic Armadillos", team.Visitor = "Blundering Baboons", stringsAsFactors = FALSE))## 1
## 0.9687583summary(elo.colley(score(points.Home, points.Visitor) ~ team.Home + team.Visitor + neutral(neutral),
data = tournament, subset = points.Home != points.Visitor))##
## An object of class 'elo.colley', containing information on 8 teams and 51 matches.
##
## Mean Square Error: 0.1565
## AUC: 0.8268
## Favored Teams vs. Actual Wins:
## Actual
## Favored 0 1
## TRUE 6 32
## (tie) 0 0
## FALSE 10 3These models can also be built “running”, where predictions for the next group of games are made based on past data. Consider using the skip= argument to skip the first few groups (otherwise the model might have trouble converging).
Note that predictions from this object use a model fit on all the data.
co <- elo.colley(score(points.Home, points.Visitor) ~ team.Home + team.Visitor + group(week), data = tournament,
subset = points.Home != points.Visitor, running = TRUE, skip = 5)
summary(co)##
## An object of class 'elo.colley', containing information on 8 teams and 51 matches.
##
## Mean Square Error: 0.2173
## AUC: 0.8339
## Favored Teams vs. Actual Wins:
## Actual
## Favored 0 1
## TRUE 4 19
## (tie) 6 13
## FALSE 6 3predict(co, newdata = data.frame(team.Home = "Athletic Armadillos", team.Visitor = "Blundering Baboons", stringsAsFactors = FALSE)) # the same thing## 1
## 0.9687583elo.glm(), elo.markovchain(), and elo.winpct() all allow for modeling of margins of victory instead of simple win/loss using the mov() function. Note that one must set the family="gaussian" argument to get linear regression instead of logistic regression.
summary(elo.glm(mov(points.Home, points.Visitor) ~ team.Home + team.Visitor, data = tournament,
family = "gaussian"))##
## Call:
## stats::glm(formula = wins.A ~ . - 1, family = family, data = dat.qr,
## weights = wts, subset = NULL, na.action = stats::na.pass)
##
## Deviance Residuals:
## Min 1Q Median 3Q Max
## -10.6339 -2.8996 -0.0402 2.7879 12.9286
##
## Coefficients:
## Estimate Std. Error t value Pr(>|t|)
## home.field 2.6964 0.6941 3.885 0.000313 ***
## `Athletic Armadillos` 3.1250 1.8363 1.702 0.095263 .
## `Blundering Baboons` -2.4375 1.8363 -1.327 0.190655
## `Cunning Cats` 0.3125 1.8363 0.170 0.865584
## `Defense-less Dogs` -3.5000 1.8363 -1.906 0.062646 .
## `Elegant Emus` -0.9375 1.8363 -0.511 0.612014
## `Fabulous Frogs` 0.6875 1.8363 0.374 0.709759
## `Gallivanting Gorillas` 0.2500 1.8363 0.136 0.892277
## ---
## Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
##
## (Dispersion parameter for gaussian family taken to be 26.97582)
##
## Null deviance: 2161.0 on 56 degrees of freedom
## Residual deviance: 1294.8 on 48 degrees of freedom
## AIC: 352.81
##
## Number of Fisher Scoring iterations: 2
##
## Mean Square Error: 23.1221
## AUC: NA
## Favored Teams vs. Actual Wins:
## Actual
## Favored TRUE (tie) FALSE
## TRUE 31 3 10
## (tie) 0 0 0
## FALSE 4 2 6