99% Flash Player Penetration – Too Good to be True?

Adobe makes much of the fact that its Flash player has become” the world’s most pervasive software platform” bridging the worlds of PC, Mac and Linux. Nowadays this claim is generally taken as read but ultimately it depends on the ubiquity of the Flash player as advertised on the Adobe site.

But should the claims be taken at face value?

Well let’s look at it in a bit more detail. At the time of writing there is a major headline:

“Flash content reaches 99.0% of Internet viewers”

followed by:  

“Adobe Flash Player is the world’s most pervasive software platform, used by over 2 million professionals and reaching 99.0% of Internet-enabled desktops in mature markets as well as a wide range of devices.”

“Over 2 million professionals!” Eat your heart out Dr Evil. Presumably they meant to say the Flash authoring tool is used by that number. Amusing, but hardly reassuring.

Sure enough look at the PC Penetration page and you’ll see that the latest estimate (December 2008) for Flash player penetration is 947 million users out of a total 956 million internet-connected devices. No doubt with the next quarterly update the 1 billion figure will have been smashed.

However things aren’t quite as straightforward as they look – as Adobe shows with its notes. 

The first of these reveals that the total number of PCs is based on a forecast made two years ago – an age in internet time. Already then the margin of error on numbers at least is enormous.

The second reveals that the figure is based on devices capable of reading Flash player 7 content. To be fair to Adobe they do give the penetration stats for different player releases and thanks to auto-updating the figure for the latest Flash player 10 is already around 55%. That’s pretty stunning in the timeframe but it’s not 99% (ie remember to target your SWFs at the lowest player capable of rendering your project).

The third note is the most significant:

“Total Player penetration is a calculation of the total number of PCs connected to the internet, multiplied by the weighted percentage of worldwide penetration from the Millward Brown study. This is an assumption made by Adobe.”

So what is the Millward Brown study? Well to begin with it’s not the fully independent survey you might assume as it was commissioned by Adobe.

Having said this, Adobe looks admirably open and helpful giving full details on the methodology page. You can even take the survey yourself – though I trust that the data from surveys originated from Adobe’s Flash Home page aren’t included!

I’m sure they’re not, but of course any internet-based research is automatically self-selecting – users who find and sign up to become members of the Lightspeed panel for rewards including music downloads will naturally tend to be home-based heavy internet users who have picked up more plug-ins than average as they go.

Moreover the survey works by showing animations and asking if you can see them. You are instructed not to download the plug-in when the dialog appears (why weren’t these disabled?), but I think it’s human nature to want to see what you’re missing and to hit OK rather than Cancel and especially on the first page where this is likely to happen which just so happens to be the Flash 10 page.

On top of which the underlying numbers on which such a major claim are built seem tiny with an apparent total survey sample size of 4,600 ie around 0.0005% of the suggested 956,000,000 total (and then weighted according to the CIA World Factbook!).  Adobe then seems to “assume” that these figures scale up neatly, but presumably Millward Brown doesn’t endorse that assumption. Moreover it’s only when you dig down that you discover that the figures give a signficant margin of error of around +/- 5% with 95% confidence.

So where does this all leave us?

As regular readers will know I’m a big fan of the power and potential of the Flash platform (though not of the majority of current Flash-based sites) and would like to see it spread as widely as possible. 

Moreover I’m sure that Flash is the most pervasive cross-platform web platform and if you throw in Flash Lite-enabled mobile devices, arguably the most pervasive software-lite platform. I’m certainly not disputing that it’s more popular than all other rival web platforms such as Java and so the best choice for most scenarios.

However in that Adobe headline both the seeming precision – “99.0%”- and the poorly-defined wooliness – “Internet viewers” – are clearly deceptive. 

More to the point is it really possible that 99% penetration could have been reached? Including Linux users? Including users at work? Including brand-new systems? Including my granny?

I guess the big test is whether the next set of figures from Adobe will finally break through the even more psychologically-significant 100% barrier.