Sunday 5 May 2013

Camera megapixels: Why more isn't always better

A 16-megapixel smartphone camera sounds great, but an 8-megapixel shooter could still produce better pics.





In a matter of months, the high-end smartphone camera spec rocketed from a respectable 8 megapixels to an altitudinous 13.
The Samsung Galaxy S4 and LG Optimus G Pro are the freshest examples of this megapixel push, but even last January's Pantech Discover (12.6 megapixels), last October's LG Optimus G for Sprint (13 megapixels), and especially mid-2012's Nokia 808 PureView, a 41-megapixel stunner that's worth the hype for photography fans.
Yet even though the technology exists, quality can be just as uneven from phone to phone as it was when an 8-megapixel shooter was the "best" that money could buy.

Championing that perception head on is HTC, the same company that not too long ago boasted about the 16-megapixel camera in its Titan II. Now, in its HTC One flagship, the smartphone-maker dials down the megapixel count to 4 megapixels, which HTC fancifully terms "ultrapixels," arguing that the lager pixel size throws back the blinds to let in much more light.

In this lies the reminder (that photography nuts will tell you), that it's quite possible for an excellent 5-megapixel camera to produce photos you prefer over a shoddy 12-megapixel camera. The megapixel number alone is no guarantee of heightened photographic performance.
Instead, the formula for fantastic photos comes down to the entire camera module that includes the size and material of the main camera lens, the light sensor, the image processing hardware, and the software that ties it all together. So let's dive in.

Key ingredient No. 1: The sensor


Most budding and professional photographers will tell you that the most important ingredient in the optical system is the sensor, because that's the part that captures the light. The sensor is essentially the "film" material of a digital camera. No light, no photo.
Light enters through the camera lens, then passes to the camera sensor, which receives the information and translates it into an electronic signal. From there, the image processor creates the image and fine-tunes it to correct for a typical set of photographic flaws, like noise.
The size of the image sensor is extremely important. In general, the larger the sensor, the larger your pixels, and the larger the pixels, the more light you can collect. The more light you can catch, the better you image can be.



The experts I spoke with for this story had colorful ways of describing the relationship between pixels and sensors, but "buckets of water" or "wells" were a favorite (intentionally oversimplified) analogy.
Imagine you have buckets (pixels) laid out on a blacktop (sensor). You want to collect the most water in those buckets as possible. To extend the water-and-bucket analogy, the larger the sensor you have (blacktop), the larger the pixels (buckets) you can put onto it, and the more water (light) you can collect.
Larger sensors are the reason that 8 megapixels from a digital SLR camera (or 5 or 13) best those 8 megapixels from a smartphone camera. You get roughly the same number of pixels, but those pixels on the DSLR get to be larger, and therefore let in more light. More light (generally) equals less-noisy images and greater dynamic range.  


The fallacy of megapixels


You can start to see that cramming more pixels onto a sensor may not be the best way to increase pixel resolution. That hasn't stopped the cell phone industry from doing just that.
Jon Erensen, a Gartner analyst who has covered camera sensors, remembers when we collectively made the leap from 1-megapixel to 2-megapixel sensors.
"They would make the pixel sizes smaller [to fit in more pixels]," Erensen told me over the phone, "but keep the image sensor the same."


"What ended up happening is that the light would go into the well [the "bucket"] and hit the photo-sensitive part of the image sensor, capturing the light. So if you make the wells smaller, the light has a harder time getting to the photo-sensitive part of the sensor. In the end, increased resolution wasn't worth very much. Noise increased."
The relationship between the number of pixels and the physical size of the sensor is why some 8-megapixel cameras can outperform some 12-, 13-, or even 16-megapixel smartphone cameras.
There's more involved, too. A slim smartphone limits the sensor size for one, and moving up the megapixel ladder without increasing the sensor size can degrade the photo quality by letting in less light than you could get with slightly fewer megapixels.
Then again, drastically shrunken pixel sizes aren't always the case when you increase your megapixels. HTC's Bjorn Kilburn, vice president of portfolio strategy, shared that the pixel size on the 16-megapixel Titan II measures 1.12 microns, whereas each of the HTC One X's 8 pixels measures a slightly larger 1.4 microns.
As a result, the photo quality on both these HTC smartphones should be comparable at a pixel-by-pixel level.





Unfortunately, most smartphone-makers don't share granular detail about their camera components and sensor size, so until we test them, the quality is largely up in the air. Even if smartphone makers did release the details, I'm not sure how scrutable those specs would be to the majority of smartphone shoppers.


What about Nokia's 41-megapixel PureView?


Nokia's story behind its 808 PureView smartphone is really interesting. CNET Senior Editor Josh Goldman has written one of the best explanations of the Nokia 808 Pureview's 41-megapixel camera that I've seen. I strongly suggest you read it.
In the meantime, here's a short summary of what's going on.
Juha Alakarhu (pronounce it YOO-hah), is head of camera technologies at Nokia, where he works within the Smart Devices team. Alakarhu explained to me that although Nokia has engineered the 808 to capture up to 41 megapixels, most users will view photos as the 5-megapixels default.
Usually, when you use the digital zoom on your phone, you're blowing up and cropping in on an image to see each pixel up close. You all know what that can look like: grainy, blocky, and not always as sharply focused or as colorful as you'd like.




In the 808 PureView, Nokia uses a process called "oversampling," which -- for the 808's 5-megapixel default resolution -- condenses the information captured in seven pixels into one (they call it a "superpixel.") If you zoom in on an object, you're simply seeing part of the image that's already there, rather than scaling up. This method should translate to higher-resolution digital print-outs and zoom-ins than you'd normally see.
It's taken over five years to create the technology within the 808 PureView, Nokia's Alakarhu said. Not only does the 808 lean on the physical size of the sensor (specifically 1/1.2-inch), there are also custom algorithms on top of the sensor to adjust the image to reduce imperfections like noise. It's this set of instructions is what Nokia terms PureView, not the sensor size alone.
As CNET's Goldman has pointed out, this is an unusually large sensor for a smartphone, and it's also larger than sensors found on the vast majority of point-and-shoot cameras.

Key ingredient No. 2: Image processing



In addition to the size and quality of the lens and sensor, there's also the image processor. Most modern high-end smartphone CPUs have dedicated graphics processors built into their chip, which, being hardware-accelerated and not just software-dependent, can quickly render images like photos, videos, and games without overtaxing the main application processor.

HTC and Samsung have been pushing continuous burst mode hard, averaging one shot in a tenth of a second or less, thanks to separate hardware-accelerated image processors that can capture shots like nobody's business. However, since burst mode doesn't give you time to focus, expect to see some blur
I promised that there was software bridging the hardware and the final image, and there is. Algorithms and other logic are what create the final image output on the phone's screen. This where the most subjective element of photography comes in -- how your eye interprets the quality of color, the photo's sharpness, and so on.
The image processor is also what helps achieve zero shutter lag, when the camera captures the photo when you press the capture button, not a beat or two after.


Wait, there's more


There's much more to know about the competing technology that goes into sensors, but backside-illuminated sensors are starting to be used much more in smartphones.
This type of sensor is often synonymous with better low-light performance because it increases photosensitivity. However, if you shoot in bright light, it can also blow out your image. Here are more details on how backside illumination works.

Low-light performance, by the way, is turning into a serious battleground for bragging rights. Nokia's Lumia 920 and Apple's iPhone 5 currently rule this shadowy realm, with HTC's One vastly outperforming the Samsung Galaxy S4, which has no automatic low-light adjustments to speak of (though there are several shooting modes.)
Backing out of the low light rabbit hole, it's important to note that the camera's sensor size and image processor may be the most crucial elements for creating quality smartphone photos, but other considerations come into play. Higher quality components, for example, can help tease out better photos, but they could also cost more, which could lead to a marginally pricier camera.
While the total cost of a camera module is only one part of the total cost, Gartner analyst Jon Erensen said that high-end parts could double the price of a basic camera set, and thought that parts could cost $15 per phone. The smartphone makers I contacted for this article, like Samsung and Nokia, wouldn't share sourcing or pricing information.

Usability is king



Gartner analyst Jon Erensen agrees. "What do you actually gain from going higher than you need, in a practical sense?," he said, adding that most people upload smartphone photos to online albums, or e-mail them to family and friends, formats that require many fewer than 8 megapixels, or even 5.
A trip to Indonesia illustrates what Nokia's Alakarhu and the others mean by the whole experience taking precedent over the specs. While trekking with 22 pounds of gear on his back -- including a high-quality DSLR -- Alakarhu repeatedly reached for the Nokia 808 PureView he kept in his pocket.
Although he considers himself an amateur photographer who will put in the time to frame a great shot, Alakarhu said he found himself using the PureView more because of its easy availability and quick start time when he didn't want to take the time to set up a more involved shot on his digital camera.
I have my share of similar stories, and I suspect that you do, too.
We definitely shouldn't scrap pixel count when weighing smartphone camera specs against others, but when it comes to all the hardware and software that create a great photo, the megapixel count alone just isn't enough. It's time we shift the focus somewhere else -- like maybe to that undersung sensor.