Annotating shadows, highlights and faces: the contribution of a 'human in the loop' for digital art history

09/10/2018
by   Maarten W. A. Wijntjes, et al.
0

While automatic computational techniques appear to reveal novel insights in digital art history, a complementary approach seems to get less attention: that of human annotation. We argue and exemplify that a 'human in the loop' can reveal insights that may be difficult to detect automatically. Specifically, we focussed on perceptual aspects within pictorial art. Using rather simple annotation tasks (e.g. delineate human lengths, indicate highlights and classify gaze direction) we could both replicate earlier findings and reveal novel insights into pictorial conventions. We found that Canaletto depicted human figures in rather accurate perspective, varied viewpoint elevation between approximately 3 and 9 meters and highly preferred light directions parallel to the projection plane. Furthermore, we found that taking the averaged images of leftward looking faces reveals a woman, and for rightward looking faces showed a male, confirming earlier accounts on lateral gender bias in pictorial art. Lastly, we confirmed and refined the well-known light-from-the-left bias. Together, the annotations, analyses and results exemplify how human annotation can contribute and complement to technical and digital art history.

READ FULL TEXT

page 2

page 4

page 5

page 6

research
02/16/2020

Face Recognition: Too Bias, or Not Too Bias?

We reveal critical insights into problems of bias in state-of-the-art fa...
research
05/31/2023

ActiveAED: A Human in the Loop Improves Annotation Error Detection

Manually annotated datasets are crucial for training and evaluating Natu...
research
09/24/2020

Exposing GAN-generated Faces Using Inconsistent Corneal Specular Highlights

Sophisticated generative adversary network (GAN) models are now able to ...
research
05/26/2023

Are Fairy Tales Fair? Analyzing Gender Bias in Temporal Narrative Event Chains of Children's Fairy Tales

Social biases and stereotypes are embedded in our culture in part throug...
research
07/07/2020

Modeling and Mitigating Human Annotation Errors to Design Efficient Stream Processing Systems with Human-in-the-loop Machine Learning

High-quality human annotations are necessary for creating effective mach...
research
05/15/2018

On Learning Associations of Faces and Voices

In this paper, we study the associations between human faces and voices....
research
08/14/2023

There Is a Digital Art History

In this paper, we revisit Johanna Drucker's question, "Is there a digita...

Please sign up or login with your details

Forgot password? Click here to reset