politicalbetting.com » Blog Archive » Estimating the “house effect” for each pollster. How much do they differ from the overall average for each party.
All of us who follow the polls closely know that some firms will be particularly beneficial to one party or another and generally produce some of the worst figures for another party.
Over what period of time have these figures been measured? I suspect that the sample size is too small to be confident of the results given to anything like a meaningful level of confidence. Would you get a completely different set of figures for the same organisations after a second period of time of the same length? The voters keep changing their minds anyway, so it doesn't matter.
Conservative Party (Margaret Thatcher) Labour Party (Margaret Beckett) Green Party (Caroline Lucas, Natalie Bennett) Progressive Unionist Party (Dawn Purvis) SDLP (Margaret Ritchie) Plaid Cymru (Leanne Wood) Communist Party of Great Britain (Nina Temple) Peace and Progress Party (Vanessa Redgrave) Respect (Salma Yaqoob)
and some other woman leaders of parliamentary groups (e.g. SNP) and/or joint leaders or spokespersons (e.g. Jenny Jones, Sarah Parkin, Shirley Williams)
I wonder whether UKPR's averaging of the polls (on which Stephen Fisher's GE projections are based) will be modified in a similar fashion to Manchester University's revised methodology.
My guess is that the best firm for the SNP might be Populus.
The worst is crystal clear: YouGov. Their weighting are just barmy, which was on display yet again in their last Scottish Euro poll, just a day before polling stations opened, which had SLAB in the lead. Oops!
That makes it all the more interesting that since the Euros YouGov have been showing some excellent SNP performances in the sub-samples, which pre-Euros almost invariably had huge SLAB leads.
My guess is that the best firm for the SNP might be Populus.
The worst is crystal clear: YouGov. Their weighting are just barmy, which was on display yet again in their last Scottish Euro poll, just a day before polling stations opened, which had SLAB in the lead. Oops!
That makes it all the more interesting that since the Euros YouGov have been showing some excellent SNP performances in the sub-samples, which pre-Euros almost invariably had huge SLAB leads.
It would be interesting to see the bias in Scottish/Welsh/NI polls. How often are ~1000 sample polls taken in Scotland? Perhaps part of the problem is the chronic lack of data.
One of the biggest spreads for UKIP is Comres: On line:... Plus 1.8 By phone: Minus 2.5 A spread of 4.3 in the one company. Strange that, unless they ask very different questions,
Because of sheer quantity, YouGov polls tend to set the debate much more than other pollsters. Yet as this table shows, YouGov are considerably more favourable to both Labour and the Conservatives than most pollsters. Something to bear in mind when thinking about the state of play.
One of the biggest spreads for UKIP is Comres: On line:... Plus 1.8 By phone: Minus 2.5 A spread of 4.3 in the one company. Strange that, unless they ask very different questions,
I think people who are into politics and get their info online instead of from the telly will be better informed on average so that is likely to distort things.
This is indeed an excellent piece of analysis but its utility is at least partly based on the notion that the average is meaningful or even right.
What we know in practice is that ICM is right. Even on the Euros, which was not the polling companies' finest hour for understandable reasons, they were closest on the graphic the OGH put up.
This is interesting because their Labour score is 0.9% below the average. If the base line is ICM them Yougov overstate Labour by a full 3%. Puts crossover into perspective doesn't it?
Of course when we start adding in the takings of prostitutes and drug dealers in September we will find that we actually did this at the back end of last year.
The UK has been one of the slowest to achieve this for 2 main reasons. Firstly, a financial recession hit us harder than any of the other big boys given the importance of that sector in our economy so we had further to come back.
Secondly, the UK is fighting against a fairly strong headwind in falling north sea output. The contrast with the US where shale output has been ramped up over the same period is stark and has underlain the apparent difference in performance to a very large extent.
Still, no point in being cry babies about it. Even Salmond cannot wish north sea oil back into the ground (although he had a go claiming huge coal and gas reserves in Scotland this week without any reference to whether they are economically recoverable). We need to adapt to a post north sea world and get on with our own fracking soonest.
It would be better if you could add in a maximum deviation both ways in all the graphs so that the bars on each were representative of the absolute value of difference rather than a comparison with the largest variation on each graph.
What would be more useful is how much each of the pollsters varies from actual results. What is the point of telling us a pollster varies 3% from the average if the average is already 2-3% above or below what the party scores in actual results. We saw that with ComedyResolution and their 13% variation from reality with the Euro polls. It would be useful being reminded how close each pollster was to the 2010 results.
His attack was echoed by a prominent nationalist website and other separatists on social media, one of whom described her as: “A liar now and forever whatever the outcome of the vote, a known Quisling and collaborator.”
The mother of a disabled child has accused the First Minister of spearheading a “disgusting” smear campaign against her after she hosted the launch of the Unionists’ campaign for the final 100 days of the independence referendum contest.
Clare Lally said she felt sickened after one of Mr Salmond’s spin doctors contacted the Telegraph questioning her claim at Monday’s Better Together event that she was a “normal” mother.
What would be more useful is how much each of the pollsters varies from actual results. What is the point of telling us a pollster varies 3% from the average if the average is already 2-3% above or below what the party scores in actual results. We saw that with ComedyResolution and their 13% variation from reality with the Euro polls. It would be useful being reminded how close each pollster was to the 2010 results.
They used to do it that way.
"There were three concerns about the general election anchoring method. Firstly, it was harsh on the Liberal Democrats, who were over-estimated by pollsters ahead of 2010 but have been scoring very low in the polls ever since they lost over half their general election support after joining the Coalition. The negative public views of the Liberal Democrats, and their very different political position as a party of government, make it less likely that the current polls are over-estimating their underlying support.
Secondly, a general election anchor provides little guidance on UKIP, who scored only 3% in the general election but poll in the mid-teens now, but with large disagreements in estimated support between pollsters (see discussion of house effects below).
Thirdly, the polling ecosystem itself has changed dramatically since 2010, with several new pollsters starting operations, and several other established pollsters making such significant changes to their methodology that they were equivalent to new pollsters as well.
We have decided that these concerns are sufficiently serious to warrant an adjustment to our methodology. Rather than basing our statistical adjustment on the last general election, we now make adjustments relative to the “average pollster”. This assumes that the polling industry as a whole will not be biased. "
It is interesting to look at the Labour and Conservative offsets with each pollster. For example, with YouGov they are very similar, so the gap between the two parties is close to the average.
The 2010VI for the Cons showed that they lost less to UKIP and so their vote recovered. It is their best result since EU14.
Labour still have the largest share of LD2010 VI.
Also, for many YouGov polls, for the region Midlands/Wales, the Cons and Labour have been neck and neck (usual caveats in place). As in Wales Labour is very likely to outvote the Cons at the GE, what does that say about the Midlands?
You gov best for Kippers had them on just 12 yesterday - one to watch.
UKIP's poll numbers seem to have a wider range than the other parties, so their true support seems more likely to be closer one extreme, rather than an average of all.
Couple of questions for the serious psephologists here: 1. Is being different from average necessarily bad? Can one not look at polling performance over time to see who is the best? The average can be more wrong than any one pollster. 2. Is it possible to adjust polling outcomes with this to produce a more accurate prediction?
You gov best for Kippers had them on just 12 yesterday - one to watch.
UKIP's poll numbers seem to have a wider range than the other parties, so their true support seems more likely to be closer one extreme, rather than an average of all.
17% for UKIP I reckon. Everyone is understating them.
Why does it take so long for the penny to drop for Welsh Labour?
"Welsh youngsters need to show they have the skills they need to succeed anywhere in the world, the first minister will tell head teachers later.
Carwyn Jones will give a keynote address at a Cardiff conference on the Pisa international education tests.
Wales has been the worst performing UK nation in the three-yearly tests prompting a drive to improve standards.
The international organisation behind the tests has criticised Wales for a lack of long-term vision for education.
The concerns raised by the Organisation for Economic Co-operation and Development (OECD) in April were first highlighted in a report for the Welsh government more than six years ago, unpublished at the time but recently passed to the BBC...
Once again, Wales was ranked bottom of the four UK nations and fell further behind other countries, with east Asian cities and nations coming out on top.
Reforms including statutory reading and numeracy tests had already been introduced in Wales following previous disappointing Pisa results.....
The conference will also hear from OECD director for education and skills Andreas Schleicher, who runs the Pisa tests.
He has previously claimed that the impact of poverty on education has been overstated, pointing out that maths results for the poorest children in Shanghai matched those of the wealthiest UK pupils."
Got a potential bet or two in mind for Austria, but need the markets to get going before I can see if the odds are there.
1. Invaded by Germany in another Anschluss - 100/1 2. Return of the Hapsburg dynasty - 66/1 3. The waltz banned as anti social - 33/1 4. Austrian corporal becomes elected dictator - TSE - Evens 5. Conchita Wurst revealed as love child of Peter the Punter - 4/6 fav
Is it me, or is there lots of sport on, or coming?
As well as the excellence of F1, there's the rioting of the World Cup (with a side-order of Blatter lunacy), Wimbledon, the rugby tour in New Zealand and then the Commonwealth Games.
You gov best for Kippers had them on just 12 yesterday - one to watch.
UKIP's poll numbers seem to have a wider range than the other parties, so their true support seems more likely to be closer one extreme, rather than an average of all.
17% for UKIP I reckon. Everyone is understating them.
Yes: people get 'down-weighted' because of (a) false recall and (b) the fact they didn't vote before. I reckon 17% is the likely level of support for UKIP.
However, I reckon that - outside of four or five seats - they're going to accrue the most votes in places where it doesn't matter: that is, they'll get big second places in Labour heartlands, and they'll get a lot of angry Tories in the shires.
I also suspect that Farage will lose where he stands, simply because the seat he stands in will be opinion polled to death, and - unlike with Diane James, for example - there will be tactical voting against him.
Question: if UKIP gets four seats (which is a perfectly sensible guess), and Nigel Farage is not one of them, can he sensibly remain as leader?
Is it me, or is there lots of sport on, or coming?
As well as the excellence of F1, there's the rioting of the World Cup (with a side-order of Blatter lunacy), Wimbledon, the rugby tour in New Zealand and then the Commonwealth Games.
You gov best for Kippers had them on just 12 yesterday - one to watch.
UKIP's poll numbers seem to have a wider range than the other parties, so their true support seems more likely to be closer one extreme, rather than an average of all.
17% for UKIP I reckon. Everyone is understating them.
Yes: people get 'down-weighted' because of (a) false recall and (b) the fact they didn't vote before. I reckon 17% is the likely level of support for UKIP.
However, I reckon that - outside of four or five seats - they're going to accrue the most votes in places where it doesn't matter: that is, they'll get big second places in Labour heartlands, and they'll get a lot of angry Tories in the shires.
I also suspect that Farage will lose where he stands, simply because the seat he stands in will be opinion polled to death, and - unlike with Diane James, for example - there will be tactical voting against him.
Question: if UKIP gets four seats (which is a perfectly sensible guess), and Nigel Farage is not one of them, can he sensibly remain as leader?
How many people take part in tactical voting? I would guess it's a very small proportion of voters, so if Mr Farage chooses UKIP's strongest seat he should be able to weather a small shift to one opponent.
Electoral calculus estimated that tactical voting cost the Conservatives 26 seats in the 2005 election.
Over what period of time have these figures been measured? I suspect that the sample size is too small to be confident of the results given to anything like a meaningful level of confidence. Would you get a completely different set of figures for the same organisations after a second period of time of the same length?
The blog post does not specify a specific time period, but it seems to me you would want to choose one where the methodologies of the polling companies used were stable.
The recent introduction of the Ashcroft polls is a further complication, as they will modify the average used to calculate against.
Is this a sign of retrenchment or of increased competition from Ethiad?
Probably going to order 787 replacements. They seem to have fixedthe nniggles, it's cheaperand has a closer delivery date if they order today. RR would still be fine if this was the case. The whole A350 project has been bungled. Boeing got too large a start with the 787 while Airbus were fannying about making a double decker plane that few airlines needed beyond a bit of prestige.
The ‘house effect’ strikes me as a little odd as it appears to be anchored to an arbitrary reference point that in itself could be flawed. – I’ll stick with the gold standard ICM, thanks.
Mr. Fett, I thought you meant the tennis US Open at first.
I'm not into golf.
Mr. W, I believe that Mr. Eagles' claim that Caesar was a better general than Alexander disqualifies him from holding political office in Austria on grounds of insanity.
Mr. Fett, I thought you meant the tennis US Open at first.
I'm not into golf.
Mr. W, I believe that Mr. Eagles' claim that Caesar was a better general than Alexander disqualifies him from holding political office in Austria on grounds of insanity.
This is indeed an excellent piece of analysis but its utility is at least partly based on the notion that the average is meaningful or even right.
I don't know if anyone has tested it with opinion polls, but it is frequently the case that an average of model forecasts is better than the "best" single forecast, so without evidence to the contrary I would be wary of arguing otherwise in this particular case.
That said, the differences between ICM and the average are very interesting, and heartening for the Coalition parties.
Should it not be possible to judge the accuracy of pollsters' sample sets by looking at the other work they do compared to real life results? E.g. did they predict the X Factor winner or how succesful the new flavour of breakfast cereal would be?
You gov best for Kippers had them on just 12 yesterday - one to watch.
UKIP's poll numbers seem to have a wider range than the other parties, so their true support seems more likely to be closer one extreme, rather than an average of all.
17% for UKIP I reckon. Everyone is understating them.
Yes: people get 'down-weighted' because of (a) false recall and (b) the fact they didn't vote before. I reckon 17% is the likely level of support for UKIP.
However, I reckon that - outside of four or five seats - they're going to accrue the most votes in places where it doesn't matter: that is, they'll get big second places in Labour heartlands, and they'll get a lot of angry Tories in the shires.
I also suspect that Farage will lose where he stands, simply because the seat he stands in will be opinion polled to death, and - unlike with Diane James, for example - there will be tactical voting against him.
Question: if UKIP gets four seats (which is a perfectly sensible guess), and Nigel Farage is not one of them, can he sensibly remain as leader?
Survation's November 2013 poll of South Thanet showed a 3 way Con/Lab/UKIP marginal (Labour favourite).
Don't forget US Open, which starts today and the First Test tomorrow!
2.18 on England is a fine bet - I am bawdeep.
The one result that looks impossible is the draw. Looks fine and sunny throughout.
I would say that it's not so much the weather as doubts about the England batting - the last time we survived more than 200 overs in a Test was at Lords last July. The team has had a dreadful run of form since then.
You gov best for Kippers had them on just 12 yesterday - one to watch.
UKIP's poll numbers seem to have a wider range than the other parties, so their true support seems more likely to be closer one extreme, rather than an average of all.
17% for UKIP I reckon. Everyone is understating them.
Yes: people get 'down-weighted' because of (a) false recall and (b) the fact they didn't vote before. I reckon 17% is the likely level of support for UKIP.
However, I reckon that - outside of four or five seats - they're going to accrue the most votes in places where it doesn't matter: that is, they'll get big second places in Labour heartlands, and they'll get a lot of angry Tories in the shires.
I also suspect that Farage will lose where he stands, simply because the seat he stands in will be opinion polled to death, and - unlike with Diane James, for example - there will be tactical voting against him.
Question: if UKIP gets four seats (which is a perfectly sensible guess), and Nigel Farage is not one of them, can he sensibly remain as leader?
Survation's November 2013 poll of South Thanet showed a 3 way Con/Lab/UKIP marginal (Labour favourite).
Thanet South is one constituency I'm not betting on. I'll take Evens about the Lib Dems losing their deposit there though - they will be squeezed six ways till sunday.
Why does it take so long for the penny to drop for Welsh Labour?
"Welsh youngsters need to show they have the skills they need to succeed anywhere in the world, the first minister will tell head teachers later.
Carwyn Jones will give a keynote address at a Cardiff conference on the Pisa international education tests.
Wales has been the worst performing UK nation in the three-yearly tests prompting a drive to improve standards.
The international organisation behind the tests has criticised Wales for a lack of long-term vision for education.
The concerns raised by the Organisation for Economic Co-operation and Development (OECD) in April were first highlighted in a report for the Welsh government more than six years ago, unpublished at the time but recently passed to the BBC...
Once again, Wales was ranked bottom of the four UK nations and fell further behind other countries, with east Asian cities and nations coming out on top.
Reforms including statutory reading and numeracy tests had already been introduced in Wales following previous disappointing Pisa results.....
The conference will also hear from OECD director for education and skills Andreas Schleicher, who runs the Pisa tests.
He has previously claimed that the impact of poverty on education has been overstated, pointing out that maths results for the poorest children in Shanghai matched those of the wealthiest UK pupils."
So that destroys the argument loved by Labour that children's performance should be judged by those who get free school meals.
The standards in Welsh schools at the moment is terrible. My niece is 8. My sister makes sure to do her own little tests to see how she's progressing and gives her additional work in Maths and English because they are definitely not being taught to the same rigour of 30 years ago. A lot of it was rote learning in those days but by god, we could recall it when needed. And it's failing the kids. Luckily my niece enjoys having her head in books and learning new things so she's making progress but I feel sorry for the ones whose families aren't so diligent.
Summary: Employment: UP to 30.5 million Total Unemployment DOWN to 6.6% Youth Unemployment DOWN by 1.3% Economically Inactive DOWN to 8.8 million
Key Findings from ONS Bulletin • Comparing February to April 2014 with November 2013 to January 2014, there was a large increase in employment and a large fall in unemployment. There was a further fall in the number of economically inactive people aged from 16 to 64. These changes continue the general direction of movement over the past two years.
• There were 30.54 million people in work, 345,000 more than for November 2013 to January 2014 and 780,000 more than a year earlier.
• 72.9% of people aged from 16 to 64 were in work, up from 72.3% for November 2013 to January 2014 and up from 71.5% a year earlier. The latest figure of 72.9%, for February to April 2014, is 0.1 percentage point lower than before the downturn of 2008-09.
• There were 2.16 million unemployed people, 161,000 fewer than for November 2013 to January 2014 and 347,000 fewer than a year earlier.
• The unemployment rate was 6.6% of the economically active population (those in work plus those seeking and available to work), down from 7.2% for November 2013 to January 2014 and down from 7.8% a year earlier.
• There were 8.82 million economically inactive people (those out of work but not seeking or available to work) aged from 16 to 64. This was 80,000 fewer than for November 2013 to January 2014 and 178,000 fewer than a year earlier.
• 21.8% of people aged from 16 to 64 were economically inactive, down from 22.1% for November 2013 to January 2014 and down from 22.4% for a year earlier. The latest figure of 21.8%, for February to April 2014, is the lowest since 1990.
• Pay including bonuses for employees in Great Britain for February to April 2014 was 0.7% higher than a year earlier, with pay excluding bonuses 0.9% higher.
Isn't it time taxpayers took out "key individual insurance" on George Osborne?
Couple of questions for the serious psephologists here: 1. Is being different from average necessarily bad? Can one not look at polling performance over time to see who is the best? The average can be more wrong than any one pollster. 2. Is it possible to adjust polling outcomes with this to produce a more accurate prediction?
In principle, no to both. Clearly at any given moment one pollster is right and those showing different results are wrong. But the sample of actual GEs with current methods is derisory (roughly 1) so we don't have a statistically valid basis to assess them. We use proxies - by-elections, local elections, Euros - but all of those have different types of turnout peculiarities.
What we do know, roughly, is why the polls differ: sometimes they have similar raw data and then adjust them differently (compare YG and ICM, for instance). The assumptions which drive those differences may be valid sometimes and invalid at other times. For example, ICM assumes that half the uncertain 2010 LibDems will vote LibDem. That might have been right when in opposition. Does it still apply now? Perhaps it's more, or less? The other big difference is that pollsters vary wildly in weighting for stated certainty to vote - some only count those who say they're absolutely certain, some don't even ask, some weight on a sliding scale, some adjust by what voters did last time. Which assumption is right, in marginal seats in 2015? Only the brave would claim to know for sure.
IMO the only safe thing is to look at the trend within one pollster. Same assumptions, same sampling method. If anything is happening (and usually it isn't!) that's where it will show.
Mr Dancer, Tennis is good wherever it is played. Football is the modern equivalent of gladiatorial combat.
Yes but at least with Roman bread and circuses, participants were euthanased from time to time. Footballers on the other hand are just overpaid for what little they do, other than fill column inches in red top newspapers and the lower spectrum of gossip magazines.
The Cantor thing is hilarious. The American right continues to be completely insane. #Benghazi
Quite posibly, Oliver, but those of us that bet on US Elections have been busy recalibrating this morning.
The implications for 2016 are far reaching.
In what way Conchita ?
It's a massive Tea Party win.
Immigration reform is now off the agenda. Right wing economic policies are on. Ted Cruz is a live candidate again. It's a blow to a number of others; I should think Bush, Rubio, and Christie will be badly hampered.
Beyond that, it won't help the GOP in 'must-win' States like Florida, Virginia and N Carolina when the 2016 Presidentials roll round.
Apparently Nancy Pelosi could hardly contain her mirth when the result came in.
Weird pay growth figures though. Nice to see the revision up of last month's pay figures to 1.9% though.
Distortions due to the introduction of the 45% tax rate in April 2013 causing bonus payments to be moved forward from 2012-13 F/Y to April 2013.
This also caused a big fall (£0.8 bn) in NI and PAYE Income Tax receipts in April 2014 when compared to April 2013 in the last Public Finances Bulletin. The fall occured at the same time as all other economic growth linked receipts rose above OBR's forecasts.
We need a few more months of stats to see what the underlying trend on income related tax receipts and wage level really is.
• Pay including bonuses for employees in Great Britain for February to April 2014 was 0.7% higher than a year earlier, with pay excluding bonuses 0.9% higher.
Pay increases below inflation again - though the one year comparison appears to be complicated in this instance by the delay in bonus payments last year to take advantage of the cut in the additional rate of income tax to 45%.
• Pay including bonuses for employees in Great Britain for February to April 2014 was 0.7% higher than a year earlier, with pay excluding bonuses 0.9% higher.
Pay increases below inflation again - though the one year comparison appears to be complicated in this instance by the delay in bonus payments last year to take advantage of the cut in the additional rate of income tax to 45%.
See previous comment to JonathanD [sorry!]. You are right about the distorting effect caused by the introduction of the 45% tax rate.
Difficult to say what the true position is.
This confirmed (but not quantified) in main body of ONS bulletin:
The single month growth rate for total pay for April 2014 (minus 1.7%) was the lowest since March 2009. This reflects an unusually high growth rate for April 2013, due to some companies which usually paid bonuses in March paying them in April.
Mr Dancer, Tennis is good wherever it is played. Football is the modern equivalent of gladiatorial combat.
Yes but at least with Roman bread and circuses, participants were euthanased from time to time. Footballers on the other hand are just overpaid for what little they do, other than fill column inches in red top newspapers and the lower spectrum of gossip magazines.
There was plenty of gossip around gladiators or chariot racers. Indeed the highest paid sports person ever was the charioteer Diocles who won the equivalent of about $15bn. The highest paid modern sports stars rarely break a few hundred million.
I'm sure @Morris_Dancer will be pleased that paleo-F1 was so lucrative
• Pay including bonuses for employees in Great Britain for February to April 2014 was 0.7% higher than a year earlier, with pay excluding bonuses 0.9% higher.
Pay increases below inflation again - though the one year comparison appears to be complicated in this instance by the delay in bonus payments last year to take advantage of the cut in the additional rate of income tax to 45%.
Danger for Ed if he goes on this - this one off effect will have been flushed out of the stats shortly.
Still some short term headlines for Mr Which? magazine.
On the unemployment figures, unless the statistics work in a strange way isn't it possible that within the next few months we will get below the important thresholds of 2m unemployed and 1m on JSA?
Re Employment figures has anyone asked David Blanchflower when the the 5,000,000 unemployment figure will be reached. As this rate unemployment will be down to 1,500,000 by the election, look forward to Ed Balls telling everyone how right he is all the time.
• Pay including bonuses for employees in Great Britain for February to April 2014 was 0.7% higher than a year earlier, with pay excluding bonuses 0.9% higher.
Pay increases below inflation again - though the one year comparison appears to be complicated in this instance by the delay in bonus payments last year to take advantage of the cut in the additional rate of income tax to 45%.
See previous comment to RobD. You are right about the distorting effect caused by the introduction of the 45% tax rate.
Difficult to say what the true position is.
This confirmed (but not quantified) in main body of ONS bulletin:
The single month growth rate for total pay for April 2014 (minus 1.7%) was the lowest since March 2009. This reflects an unusually high growth rate for April 2013, due to some companies which usually paid bonuses in March paying them in April.
Also worth bearing in mind when the government argues that the figures demonstrate the effectiveness of reducing the 50 pence tax rate.
I think that the polls will converge as we get closer to the election and we will never know which is most accurate mid term. It is also hard to know if UNS is applicable as the geographical spread of swings may not be consistent with previous elections.
All the adjustments in the world can not make up for an inadequate sample in terms of size or randomness, and those of us in online panels are not typical of the wider public.
That said the trends over time probably have some meaning within any particular methodology, but surely we are an over polled society. Politicians should lift their noses to the horizon rather than obbsess over minutiae.
Couple of questions for the serious psephologists here: 1. Is being different from average necessarily bad? Can one not look at polling performance over time to see who is the best? The average can be more wrong than any one pollster. 2. Is it possible to adjust polling outcomes with this to produce a more accurate prediction?
In principle, no to both. Clearly at any given moment one pollster is right and those showing different results are wrong. But the sample of actual GEs with current methods is derisory (roughly 1) so we don't have a statistically valid basis to assess them. We use proxies - by-elections, local elections, Euros - but all of those have different types of turnout peculiarities.
What we do know, roughly, is why the polls differ: sometimes they have similar raw data and then adjust them differently (compare YG and ICM, for instance). The assumptions which drive those differences may be valid sometimes and invalid at other times. For example, ICM assumes that half the uncertain 2010 LibDems will vote LibDem. That might have been right when in opposition. Does it still apply now? Perhaps it's more, or less? The other big difference is that pollsters vary wildly in weighting for stated certainty to vote - some only count those who say they're absolutely certain, some don't even ask, some weight on a sliding scale, some adjust by what voters did last time. Which assumption is right, in marginal seats in 2015? Only the brave would claim to know for sure.
IMO the only safe thing is to look at the trend within one pollster. Same assumptions, same sampling method. If anything is happening (and usually it isn't!) that's where it will show.
Mr Dancer, Tennis is good wherever it is played. Football is the modern equivalent of gladiatorial combat.
Yes but at least with Roman bread and circuses, participants were euthanased from time to time. Footballers on the other hand are just overpaid for what little they do, other than fill column inches in red top newspapers and the lower spectrum of gossip magazines.
Footballers are paid a market price. It's capitalism in action. They are also subject to more reporting than any other sportsmen. If footballers had done what some international cricketers and rugby players have done over recent years they would have been hounded relentlessly and quite possibly driven from the sport.
Comments
Labour Party (Margaret Beckett)
Green Party (Caroline Lucas, Natalie Bennett)
Progressive Unionist Party (Dawn Purvis)
SDLP (Margaret Ritchie)
Plaid Cymru (Leanne Wood)
Communist Party of Great Britain (Nina Temple)
Peace and Progress Party (Vanessa Redgrave)
Respect (Salma Yaqoob)
and some other woman leaders of parliamentary groups (e.g. SNP) and/or joint leaders or spokespersons (e.g. Jenny Jones, Sarah Parkin, Shirley Williams)
and perhaps one or two in other countries as well
http://www.guide2womenleaders.com/woman_party_leaders.htm
My guess is that the best firm for the SNP might be Populus.
The worst is crystal clear: YouGov. Their weighting are just barmy, which was on display yet again in their last Scottish Euro poll, just a day before polling stations opened, which had SLAB in the lead. Oops!
That makes it all the more interesting that since the Euros YouGov have been showing some excellent SNP performances in the sub-samples, which pre-Euros almost invariably had huge SLAB leads.
"Hague said it would be a 'summit like no other' to end 'mass crime'"
London is the perfect place to discuss gang-rape.
http://www.theguardian.com/society/2013/nov/26/gangs-sexual-violence-warzones
"Sexual violence in parts of UK 'as bad as in warzones'"
On line:... Plus 1.8
By phone: Minus 2.5
A spread of 4.3 in the one company. Strange that, unless they ask very different questions,
What we know in practice is that ICM is right. Even on the Euros, which was not the polling companies' finest hour for understandable reasons, they were closest on the graphic the OGH put up.
This is interesting because their Labour score is 0.9% below the average. If the base line is ICM them Yougov overstate Labour by a full 3%. Puts crossover into perspective doesn't it?
Of course when we start adding in the takings of prostitutes and drug dealers in September we will find that we actually did this at the back end of last year.
The UK has been one of the slowest to achieve this for 2 main reasons. Firstly, a financial recession hit us harder than any of the other big boys given the importance of that sector in our economy so we had further to come back.
Secondly, the UK is fighting against a fairly strong headwind in falling north sea output. The contrast with the US where shale output has been ramped up over the same period is stark and has underlain the apparent difference in performance to a very large extent.
Still, no point in being cry babies about it. Even Salmond cannot wish north sea oil back into the ground (although he had a go claiming huge coal and gas reserves in Scotland this week without any reference to whether they are economically recoverable). We need to adapt to a post north sea world and get on with our own fracking soonest.
The mother of a disabled child has accused the First Minister of spearheading a “disgusting” smear campaign against her after she hosted the launch of the Unionists’ campaign for the final 100 days of the independence referendum contest.
Clare Lally said she felt sickened after one of Mr Salmond’s spin doctors contacted the Telegraph questioning her claim at Monday’s Better Together event that she was a “normal” mother.
http://www.telegraph.co.uk/news/politics/10891229/Alex-Salmonds-office-implicated-in-smear-attack-on-mother-who-spoke-up-for-the-Union.html
"There were three concerns about the general election anchoring method. Firstly, it was harsh on the Liberal Democrats, who were over-estimated by pollsters ahead of 2010 but have been scoring very low in the polls ever since they lost over half their general election support after joining the Coalition. The negative public views of the Liberal Democrats, and their very different political position as a party of government, make it less likely that the current polls are over-estimating their underlying support.
Secondly, a general election anchor provides little guidance on UKIP, who scored only 3% in the general election but poll in the mid-teens now, but with large disagreements in estimated support between pollsters (see discussion of house effects below).
Thirdly, the polling ecosystem itself has changed dramatically since 2010, with several new pollsters starting operations, and several other established pollsters making such significant changes to their methodology that they were equivalent to new pollsters as well.
We have decided that these concerns are sufficiently serious to warrant an adjustment to our methodology. Rather than basing our statistical adjustment on the last general election, we now make adjustments relative to the “average pollster”. This assumes that the polling industry as a whole will not be biased. "
http://blog.policy.manchester.ac.uk/featured/2014/06/polling-observatory-37-no-westminster-polling-aftershock-from-european-earthquake/
2010 General Election :
Con .. -0.1
Lab .. +1.0
LibDem .. +0.5
The 2010VI for the Cons showed that they lost less to UKIP and so their vote recovered. It is their best result since EU14.
Labour still have the largest share of LD2010 VI.
Also, for many YouGov polls, for the region Midlands/Wales, the Cons and Labour have been neck and neck (usual caveats in place). As in Wales Labour is very likely to outvote the Cons at the GE, what does that say about the Midlands?
Got a potential bet or two in mind for Austria, but need the markets to get going before I can see if the odds are there.
1. Is being different from average necessarily bad? Can one not look at polling performance over time to see who is the best? The average can be more wrong than any one pollster.
2. Is it possible to adjust polling outcomes with this to produce a more accurate prediction?
"Welsh youngsters need to show they have the skills they need to succeed anywhere in the world, the first minister will tell head teachers later.
Carwyn Jones will give a keynote address at a Cardiff conference on the Pisa international education tests.
Wales has been the worst performing UK nation in the three-yearly tests prompting a drive to improve standards.
The international organisation behind the tests has criticised Wales for a lack of long-term vision for education.
The concerns raised by the Organisation for Economic Co-operation and Development (OECD) in April were first highlighted in a report for the Welsh government more than six years ago, unpublished at the time but recently passed to the BBC...
Once again, Wales was ranked bottom of the four UK nations and fell further behind other countries, with east Asian cities and nations coming out on top.
Reforms including statutory reading and numeracy tests had already been introduced in Wales following previous disappointing Pisa results.....
The conference will also hear from OECD director for education and skills Andreas Schleicher, who runs the Pisa tests.
He has previously claimed that the impact of poverty on education has been overstated, pointing out that maths results for the poorest children in Shanghai matched those of the wealthiest UK pupils."
http://www.bbc.co.uk/news/uk-wales-27785129
So that destroys the argument loved by Labour that children's performance should be judged by those who get free school meals.
2. Return of the Hapsburg dynasty - 66/1
3. The waltz banned as anti social - 33/1
4. Austrian corporal becomes elected dictator - TSE - Evens
5. Conchita Wurst revealed as love child of Peter the Punter - 4/6 fav
Is it me, or is there lots of sport on, or coming?
As well as the excellence of F1, there's the rioting of the World Cup (with a side-order of Blatter lunacy), Wimbledon, the rugby tour in New Zealand and then the Commonwealth Games.
UKPR on Labour's uplift.
http://ukpollingreport.co.uk/blog/archives/8862#comments
However, I reckon that - outside of four or five seats - they're going to accrue the most votes in places where it doesn't matter: that is, they'll get big second places in Labour heartlands, and they'll get a lot of angry Tories in the shires.
I also suspect that Farage will lose where he stands, simply because the seat he stands in will be opinion polled to death, and - unlike with Diane James, for example - there will be tactical voting against him.
Question: if UKIP gets four seats (which is a perfectly sensible guess), and Nigel Farage is not one of them, can he sensibly remain as leader?
http://www.dailymail.co.uk/news/article-2654679/Miliband-A-political-freak-Prescott-He-touched-wife.html
Airbus said the cancellation had followed "ongoing discussions with the airline in light of their fleet requirement review".
In 2007, Emirates placed 50 orders for the A350-900 and 20 for the A350-1000, with deliveries due from 2019.
UK engine maker Rolls-Royce said the cancellation would lead to a £2.6bn hit to its order book.
http://www.bbc.co.uk/news/business-27791448
Is this a sign of retrenchment or of increased competition from Ethiad?
You are coming across as whiny.
Any comments on the narrowing of Labour's lead in the latest YG poll?
Mr. Jim, well, I think Wimbledon's rather good, but I'm not taken by the World Cup.
YES remain dead in the water, completely becalmed.
Tick tock ....
Electoral calculus estimated that tactical voting cost the Conservatives 26 seats in the 2005 election.
http://www.electoralcalculus.co.uk/conlabgap.html#tactical
Re: YouGov. You should know better Charles.
Just one poll.
Labour still in the high thirties.
Tories at the top of their range.
MOE.
Look at the trend.
Don't forget US Open, which starts today and the First Test tomorrow!
The recent introduction of the Ashcroft polls is a further complication, as they will modify the average used to calculate against.
The ‘house effect’ strikes me as a little odd as it appears to be anchored to an arbitrary reference point that in itself could be flawed. – I’ll stick with the gold standard ICM, thanks.
I would have thought it was the sort of thing you would do...
Edited extra bit: Mr. Fett, not into golf.
Mr. W, anyone who thinks Caesar was a better general than Alexander is too mad to hold political office.
I'm not into golf.
Mr. W, I believe that Mr. Eagles' claim that Caesar was a better general than Alexander disqualifies him from holding political office in Austria on grounds of insanity.
I'm not into golf.
Mr. W, I believe that Mr. Eagles' claim that Caesar was a better general than Alexander disqualifies him from holding political office in Austria on grounds of insanity.
That said, the differences between ICM and the average are very interesting, and heartening for the Coalition parties.
The implications for 2016 are far reaching.
http://survation.com/new-constituency-polling-in-south-thanet/
Doesn't tactical voting require a 2 horse race?
Weirdly, my earlier disappearing post not only appeared a bit late, it did so twice.
Let's hope Rod Crosby didn't see your post.
We'll be subject to misogynistic rants about witches.
Then things will move on to birther stuff about Obama.
And we'll segue naturally from there into holocaust denial.
A normal day on PB.
However "impossible" is a substantial stretch in betting terms.
Only 1 draw in last 10 (back to 2009) at Lords - that was vs Lanka but a day lost to rain.
7/1 from Stan James on Plunkett being top England wicket taker looks excellent also.
Let's go for "highly unlikely".
http://www.nationalreview.com/corner/380057/looking-back-tea-leaves-cantor-john-fund
http://www.nationalreview.com/corner
Today the Labour Market for June 2014.
Summary:
Employment: UP to 30.5 million
Total Unemployment DOWN to 6.6%
Youth Unemployment DOWN by 1.3%
Economically Inactive DOWN to 8.8 million
Key Findings from ONS Bulletin
• Comparing February to April 2014 with November 2013 to January 2014, there was a large increase in employment and a large fall in unemployment. There was a further fall in the number of economically inactive people aged from 16 to 64. These changes continue the general direction of movement over the past two years.
• There were 30.54 million people in work, 345,000 more than for November 2013 to January 2014 and 780,000 more than a year earlier.
• 72.9% of people aged from 16 to 64 were in work, up from 72.3% for November 2013 to January 2014 and up from 71.5% a year earlier. The latest figure of 72.9%, for February to April 2014, is 0.1 percentage point lower than before the downturn of 2008-09.
• There were 2.16 million unemployed people, 161,000 fewer than for November 2013 to January 2014 and 347,000 fewer than a year earlier.
• The unemployment rate was 6.6% of the economically active population (those in work plus those seeking and available to work), down from 7.2% for November 2013 to January 2014 and down from 7.8% a year earlier.
• There were 8.82 million economically inactive people (those out of work but not seeking or available to work) aged from 16 to 64. This was 80,000 fewer than for November 2013 to January 2014 and 178,000 fewer than a year earlier.
• 21.8% of people aged from 16 to 64 were economically inactive, down from 22.1% for November 2013 to January 2014 and down from 22.4% for a year earlier. The latest figure of 21.8%, for February to April 2014, is the lowest since 1990.
• Pay including bonuses for employees in Great Britain for February to April 2014 was 0.7% higher than a year earlier, with pay excluding bonuses 0.9% higher.
Isn't it time taxpayers took out "key individual insurance" on George Osborne?
Weird pay growth figures though. Nice to see the revision up of last month's pay figures to 1.9% though.
What we do know, roughly, is why the polls differ: sometimes they have similar raw data and then adjust them differently (compare YG and ICM, for instance). The assumptions which drive those differences may be valid sometimes and invalid at other times. For example, ICM assumes that half the uncertain 2010 LibDems will vote LibDem. That might have been right when in opposition. Does it still apply now? Perhaps it's more, or less? The other big difference is that pollsters vary wildly in weighting for stated certainty to vote - some only count those who say they're absolutely certain, some don't even ask, some weight on a sliding scale, some adjust by what voters did last time. Which assumption is right, in marginal seats in 2015? Only the brave would claim to know for sure.
IMO the only safe thing is to look at the trend within one pollster. Same assumptions, same sampling method. If anything is happening (and usually it isn't!) that's where it will show.
My betting antennae always twitch in a sporting contest when "impossible" is invoked. Even "highly unlikely" raises an eyebrow in modest interest.
Unfavoured would fit the bill suitably.
Immigration reform is now off the agenda. Right wing economic policies are on. Ted Cruz is a live candidate again. It's a blow to a number of others; I should think Bush, Rubio, and Christie will be badly hampered.
Beyond that, it won't help the GOP in 'must-win' States like Florida, Virginia and N Carolina when the 2016 Presidentials roll round.
Apparently Nancy Pelosi could hardly contain her mirth when the result came in.
This also caused a big fall (£0.8 bn) in NI and PAYE Income Tax receipts in April 2014 when compared to April 2013 in the last Public Finances Bulletin. The fall occured at the same time as all other economic growth linked receipts rose above OBR's forecasts.
We need a few more months of stats to see what the underlying trend on income related tax receipts and wage level really is.
"Is anyone still foolish enough to believe Rubio will be in the running?"
Well he's 11/2 favorite with the bookies and second fav on Betfair.
That adds up to a lot of fools.
Difficult to say what the true position is.
This confirmed (but not quantified) in main body of ONS bulletin:
The single month growth rate for total pay for April 2014 (minus 1.7%) was the lowest since March 2009. This reflects an unusually high growth rate for April 2013, due to some companies which usually paid bonuses in March paying them in April.
I'm sure @Morris_Dancer will be pleased that paleo-F1 was so lucrative
Still some short term headlines for Mr Which? magazine.
All the adjustments in the world can not make up for an inadequate sample in terms of size or randomness, and those of us in online panels are not typical of the wider public.
That said the trends over time probably have some meaning within any particular methodology, but surely we are an over polled society. Politicians should lift their noses to the horizon rather than obbsess over minutiae.