Measuring Perceptual Color Differences of Smartphone Photography

05/26/2022
by   Zhihua Wang, et al.
City University of Hong Kong
Nanyang Technological University
Hangzhou Dianzi University
0

Measuring perceptual color differences (CDs) is of great importance in modern smartphone photography. Despite the long history, most CD measures have been constrained by psychophysical data of homogeneous color patches or a limited number of simplistic natural images. It is thus questionable whether existing CD measures generalize in the age of smartphone photography characterized by greater content complexities and learning-based image signal processors. In this paper, we put together so far the largest image dataset for perceptual CD assessment, in which the natural images are 1) captured by six flagship smartphones, 2) altered by Photoshop, 3) post-processed by built-in filters of the smartphones, and 4) reproduced with incorrect color profiles. We then conduct a large-scale psychophysical experiment to gather perceptual CDs of 30,000 image pairs in a carefully controlled laboratory environment. Based on the newly established dataset, we make one of the first attempts to construct an end-to-end learnable CD formula based on a lightweight neural network, as a generalization of several previous metrics. Extensive experiments demonstrate that the optimized formula outperforms 28 existing CD measures by a large margin, offers reasonable local CD maps without the use of dense supervision, generalizes well to color patch data, and empirically behaves as a proper metric in the mathematical sense.

READ FULL TEXT

page 1

page 4

page 5

page 10

page 12

03/27/2023

Learning a Deep Color Difference Metric for Photographic Images

Most well-established and widely used color difference (CD) metrics are ...
04/08/2017

DSLR-Quality Photos on Mobile Devices with Deep Convolutional Networks

Despite a rapid rise in the quality of built-in smartphone cameras, thei...
11/22/2018

Image Quality Assessment and Color Difference

An average healthy person does not perceive the world in just black and ...
06/15/2023

DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Data

Current perceptual similarity metrics operate at the level of pixels and...
06/18/2023

GAN-based Image Compression with Improved RDO Process

GAN-based image compression schemes have shown remarkable progress latel...
06/09/2022

Swan: A Neural Engine for Efficient DNN Training on Smartphone SoCs

The need to train DNN models on end-user devices (e.g., smartphones) is ...
08/31/2020

DropLeaf: a precision farming smartphone application for measuring pesticide spraying methods

Pesticide application has been heavily used in the cultivation of major ...

Please sign up or login with your details

Forgot password? Click here to reset