Some fascinating figures from Spain where gay marriage has been legal since 2005, from the latest Affinity bulletin.
The table shows the number of same-sex and other sex marriages from 2000 onwards. 2005 was the year that gay marriage was introduced (mid-year).
|Year||Same-Sex Marriages||Other-Sex Marriages|
Now, just looking at the figures it’s very clear that the number of other-sex marriages drops dramatically after 2005, but we know enough about stats here to realise that what we need to do is to qualify whether that is a significant drop or not. The way we do that is to build two quick models – one for the figures from 2000 to 2004 and one for 2006 to 2011. Using those two models we can see if there is a significant difference between the two rates in the two periods being compared. Remember, “significant” means that we are at least 95% certain that the trends we are looking at are real and not just random.
So, the two models. Firstly the 2000 to 2004 model.
|Upper 95% Bound||6918|
|Lower 95% Bound||3245|
Let’s explain that. A simple regression shows that the line of best fit has a coefficient of 5,082. This means that during the period 2000 to 2004, on average the number of other-sex marriages increased by 5,082 per year. We are 95% certain that the true value of the long term trend is somewhere between 3,245 and 6,918 which tells us that we are pretty well certain that there was an upward annual trend in other-sex marriages during those years.
It’s worth pointing out that we can assess the 95% certainty from the P-value. If this is less than or equal to 0.05 (i.e. 95%) then we say that the coefficient is significant. If the p-value had been 0.05 the lower 95% bound would have been 0.
Right, now the 2006 to 2011 model (we leave 2005 out because it is the year of transition with same-sex marriages from July onwards).
|Upper 95% Bound||-7682|
|Lower 95% Bound||-12910|
You can probably work out what’s going on. Our coefficient is now -10,296 telling us that on average the number of other-sex marriages dropped by that amount every year. The upper and lower values of the 95% significance bounds indicate that this is a certain downward trend. Other-sex marriages have definitely been dropping year on year since the introduction of same-sex marriage.
What we can be certain of is that since the introduction of same-sex marriage the rate of other-sex marriage in Spain changed from a clear growth rate to a clear declining rate. Although the golden rule is that correlation does not equal causation, it’s pretty clear that there is a direct link between the two events. Let’s see if we can prove it statistically.
I thought first that it might be interesting to see if there was a direct link to the number of same-sex marriages and the number of other-sex marriages. I ran another regression on the 2006 to 2011 dataset, bringing in Year and same-sex marriage numbers as predictors of other-sex marriages.
|Same-Sex Marriage Coefficient||-1.026|
|Same-Sex Marriage P-Value||0.832|
Once again Year gives us a significant coefficient. Same-Sex Marriage numbers give us a negative coefficient of -1.026 (indicating that for every same-sex marriage there is a reduction of one in the number of other-sex marriages) but the P-Value is 0.832, way way higher than 0.05. Because of this we reject the idea that the number of same-sex marriages in a particular year affects the number of other-sex marriages. For the record I also ran this regression as a step-wise to see if the numbers of same-sex marriages added any significant information once the year coefficient was calculated – the result was negative.
What about demonstrating a straightforward link between the introduction of same-sex marriage and the annual change in other-sex marriages? I looked at regressing the Year and the presence or otherwise (as a dummy) of same-sex marriage against the annual change in other-sex marriages. The table of that data is below.
|Year||Same-Sex Marriage?||Change in Other-Sex Marriages|
The results of a step-wise regression are very interesting. The first variable that comes in is the Same-Sex marriage dummy.
This tells us that the presence of same-sex marriage in any year, regardless of the year, reduces the change in other-sex marriages by over -15,000. That’s easily enough to move from growth to decline. We are 99.7% confident this is a real effect. When we then try to enter in the year itself we don’t get a significant p-value. This means that we reject the hypothesis that there is a change in the number of other-sex marriages that is a general trend over time. Put simply, this means that the annual change is connected to the introduction of same-sex marriage and NOT a general long-term trend (as some have argued elsewhere).
So, what can we say from this? We are pretty certain that there are two different patterns in other-sex marriages registered in Spain pre and post the introduction of same-sex marriage. Those patterns seem to be directly linked to the introduction of same-sex marriage and are not part of a general trend in the time period we have data for. Whether one causes the other is of course a matter for further research.
A word of caution – it would be interesting to add pre-2001 marriage data into the mix to see if the final analysis (regressing against year and a dummy for same-sex marriage) holds up in a longer time period. Furthermore, given that Spain is a very religious county (Roman Catholic), one cannot automatically assume that such a phenomenon would repeat itself here in the UK. Indeed, if someone could supply me with the data from some of the other countries in Europe that have already introduced same-sex marriage, we could test that hypothesis.