The Google Pixel 3 Review: The Ultimate Camera Test
by Andrei Frumusanu on November 2, 2018 11:00 AM EST- Posted in
- Smartphones
- camera
- Mobile
- Pixel
- Snapdragon 845
- Pixel 3
Display Measurement
The Pixel 3’s screen is an extremely important aspect of the phone, not just because it’s the centre-piece of a device, but also because Google’s choice of panel manufacturer. Last year’s Pixel 2 XL suffered from a compromising display made by LG, which in particular had very large issues regarding gamma as well as black clipping at low brightness levels.
This year, Google opted to swap display suppliers around, with the small Pixel 3 now featuring an LG panel while the bigger Pixel 3 XL uses a Samsung unit. Again unfortunately we don’t have the 3 XL at hand, but we can investigate the Pixel 3’s LG panel and make comparisons on the issue points that plagued last year’s 2 XL.
One thing of note that is a first for Google is the introduction of different display colour modes. This was introduced in Android P / 9 and was backported to last year’s Pixel 2. Google now offers a “Natural” mode which represents accurate sRGB and Display P3 D65 targets, a “Boosted” mode which increases the colour saturations, as well as an “Adaptive” mode which is a bit of a mess but shouldn’t be of any concern to people who don’t care too much about colour accuracy.
As always, we thank X-Rite and SpecraCal, as measurements are performed with an X-Rite i1Pro 2 spectrophotometer, with the exception of black levels which are measured with an i1Display Pro colorimeter. Data is collected and examined using SpectraCal's CalMAN software.
Starting off with the greyscale measurements, I decided to switch over to full scale 256 level measurements to better showcase some of the characteristics of the panels, we’ll get back to this at the end of this page.
In “Natural mode”, the Pixel 3 is very accurate and manages to showcase a DeltaE2000 of 1.36, along with an average colour temperature of 6576K, which is very near the target D65 illuminant.
The phone has a maximum brightness of 407 nits – which is average of an OLED, as recent generation Apple and Samsung devices reach levels above 600nits. Google isn’t employing any auto-brightness boost mode, so sunlight legibility might be less than that of other devices, however I wasn’t able to test this directly in the cloudy weather.
Gamma came in at 2.18 – however looking at the curve it’s notable that for most levels it’s at around 2.3, and the average is brought down by being too bright in the last 5% of levels.
SpectraCal CalMAN
sRGB in "Natural" and in "Boosted" (Against Display P3 Gamut)
When in “Natural” mode, all non-colour managed content targets the sRGB colour-space. Here the Pixel 3’s screen is very accurate with a dE2000 of 1.1, among the best in terms of colour accuracy.
Selecting the “Boosted” mode linearly increases the saturations within the sRGB space – the resulting gamut doesn’t adhere to any standard. The adaptive mode is a complete mess in terms of colour gamut as well as targeting a high gamma of 2.5 – we’ll get back to that into a bit.
Google introduced OS level colour management support in Android 8, however the implementation on the Pixel 2 wasn’t finalised and there wasn’t any application support as of last year. With the Pixel 3 I had hoped that Google would progress on this, however to my great disappointment I didn’t find a single out-of-the box application which would support wide-gamut content.
To demonstrate the issue, you see the Pixel 2, Pixel 3 and an iPhone XS showcasing sRGB and Display P3 images alongside each other in the above photo. By default on Chrome, both sRGB and P3 images are equal, while the XS correctly showcases the higher saturation of the full-level red of the P3 image.
There is one way to bypass this issue, and that is to explicitly tell Chrome to override the default provided system colour profile and just tell it the display is Display P3. This enables colour management in the app, and short of writing a custom application, is the only way to get wide colour gamut content to work on the Pixel 3.
SpectraCal CalMAN
Display P3 in "Natural" and in "Boosted"
Now one of the big questions I’ve had this year is how the CMS would interact with the actual display colour profiles in the settings. Fortunately, it’s pretty straightforward: The “Natural” mode isn’t per se a colour gamut selection, is just an actual category which has both accurate sRGB and P3 display modes via the CMS.
Testing out the Display P3 targets, the Pixel 3 showcases a good dE2000 result of 1.6. The display didn’t score better because seemingly the blue spectrum isn’t fully hitting the target saturations, something that also happened in the sRGB targets. Testing the P3 targets in the “Boosted” mode, we see again what is happening is that this mode just linearly increases the saturations. The blues are nearer to the P3 targets but all other colours overshoot the P3 target now.
SpectraCal CalMAN
sRGB and Display P3 Targets in "Adaptive"
Now the fun thing is testing what happens with the sRGB and Display P3 images when you’re in “Adaptive” mode. sRGB obviously is quite a disaster – I didn’t manage to match this resulting gamut to any existing standard so there’s no real point in measuring an error rate. Now what is really interesting is to see the CMS expand the resulting visible gamut with the P3 images – here we’re seeing something that is far wider than Display P3, especially in the blues. Again this doesn’t really match any standard gamut, so there’s no point in making direct comparisons.
SpectraCal CalMAN
GretagMacBeth in "Natural"
The GretagMacBeth colour test in natural mode results in accurate colours with a dE2000 of 1.28.
Gamma curves under magnifying glass
One of the reasons I want to switch to full 256 level greyscale testing is to better show case the luminance behaviour, specifically highlighting the issue of “black clipping”.
The Pixel 2 XL, along with the LG V30, suffered very badly from black clipping at low brightness levels. I generally attribute this to the fact that those generation panels just used the DDIC’s ADC bit-depth for both colour representation as well as brightness control. Samsung OLEDs use PWM on top to control brightness by just adjusting the duty level – with voltage of the pixels determining the colour intensity. The Pixel 2 XL and V30 seemed to lack sufficient range to cover the level-spectrum at the low-end, and this resulted in notorious black clipping.
SpectraCal CalMAN
Pixel 2 XL
SpectraCal CalMAN
Pixel 3
At minimum brightness, the Pixel 3 improves over the Pixel 2 XL in this regard, but it’s still pretty terrible as it’s clipping 15% of levels to black, as opposed to 25% of the Pixel 2 XL.
The higher the brightness, the less pronounced the issue is. At 200 nits compared across the Pixel 3, Pixel 2 XL, S9+ and an iPhone XS, we see that all of the Android phones are clipping the first few greyscale levels to black, with Apple being the only manufacturer able to perform excellently in this regard.
Also one thing that becomes evident when doing full-scale 256 level measurements is the fact that the Pixel 3 colour balance across levels is very haphazard, and we see quite a zig-zagging behaviour between the intensities at different levels, also represented by the dE2000 results. In absolute terms, this shouldn’t be an issue as overall the error rate is acceptable, however it’s a stark behavioural contrast to any other phone I’ve measured before.
Overall, the Pixel 3’s screen is an improvement over the Pixel 2 XL, however it doesn’t fully solve the low-brightness issues that are plaguing LG’s OLED panels, and Samsung panels such as on the Pixel 2 are still better this this regard.
In terms of colour accuracy, the Pixel 3 performs well. Here I would have hoped that Google would have gotten wide colour gamut support fully working within its applications – currently the only way to get this to work is to change a Chrome settings flag, and this only solves the problem for Chrome, and no other app.
Lastly, the display brightness is good, however again it’s just adequate at up to 400 nits, and fails to compete with super bright displays from competing flagships.
135 Comments
View All Comments
saleri6251 - Friday, November 2, 2018 - link
Hello Andrei,Thanks for the review as always. Just curious do you have any thoughts on the Titan M Security Chip?
Andrei Frumusanu - Friday, November 2, 2018 - link
I didn't have much time to get into it, we covered Google Hot Chips presentation: https://www.anandtech.com/show/13248/hot-chips-201...cha0z_ - Monday, November 5, 2018 - link
Hey, as we speak about chips - can you include/test the note 9 exynos? It's bigger body compared to the s9 and also has a lot better coolling. We all read your articles about the exynos 9810 + a lot about in @ xda, but it will be really nice to see where the more popular note 9 exynos stands with it's bigger coolling and body compared to the competition and s9/s9+.If you have the time and the desire, otherwise it's also cool - you do a lot of great reviews about phones/mobile SOCs. Keep it up and cheers!
cha0z_ - Monday, November 5, 2018 - link
No edit here: I am aiming primary at the sustained performance of the system/GPU tests. I am sure you already guessed it, but for the other members of the community.jordanclock - Friday, November 2, 2018 - link
As a P3XL owner, I can say this review completely matches my experiences.Also, that camera comparison is insane and Andrei is a mad-man for taking that many pictures AND THEN REVIEWING THEM ALL.
Andrei Frumusanu - Friday, November 2, 2018 - link
Thanks! The camera was a lot of work.This should also serve as a good comparison between all important phones over the last year or two. It's something I hope I won't have to do again till the S10.
jordanclock - Friday, November 2, 2018 - link
That last night shot is pretty similar to a comparison I showed my friends when they thought that it was just a gimmick.Have you also found that using the night shot for every shot seems to be a good default? I found that in general the night shot results are "good enough" compared to HDR+, but obviously has the benefit of better low-light results.
Andrei Frumusanu - Friday, November 2, 2018 - link
I've posted night mode pictures in daylight scenes as well, just to answer this question.There's no obvious difference and you can stay in night mode all the time, the only negative is that it'll be slower in terms of capture.
melgross - Sunday, November 4, 2018 - link
I’ve read that night mode is done after capture, not during, as Google, and other manufactures do their auto modes. So likely that’s why it’s slower.s.yu - Sunday, November 11, 2018 - link
Thank you for again the best set of samples on the net!This night mode just doesn't cease to amaze me, it preserves DR and enough(I'd say over 80%) resolution while accurately suppressing noise that it surpasses auto often enough even in daytime!
This is two notches above Huawei's night mode implementation, while Pixel's auto was better in the first place.