Field Studies with Multimedia Big Data: Opportunities and Challenges (Extended Version)

by   Mario Michael Krell, et al.

Social multimedia users are increasingly sharing all kinds of data about the world. They do this for their own reasons, not to provide data for field studies-but the trend presents a great opportunity for scientists. The Yahoo Flickr Creative Commons 100 Million (YFCC100M) dataset comprises 99 million images and nearly 800 thousand videos from Flickr, all shared under Creative Commons licenses. To enable scientists to leverage these media records for field studies, we propose a new framework that extracts targeted subcorpora from the YFCC100M, in a format usable by researchers who are not experts in big data retrieval and processing. This paper discusses a number of examples from the literature-as well as some entirely new ideas-of natural and social science field studies that could be piloted, supplemented, replicated, or conducted using YFCC100M data. These examples illustrate the need for a general new open-source framework for Multimedia Big Data Field Studies. There is currently a gap between the separate aspects of what multimedia researchers have shown to be possible with consumer-produced big data and the follow-through of creating a comprehensive field study framework that supports scientists across other disciplines. To bridge this gap, we must meet several challenges. For example, the framework must handle unlabeled and noisily labeled data to produce a filtered dataset for a scientist-who naturally wants it to be both as large and as clean as possible. This requires an iterative approach that provides access to statistical summaries and refines the search by constructing new classifiers. The first phase of our framework is available as Multimedia Commons Search, an intuitive interface that enables complex search queries at a large scale...


page 4

page 7


Challenges of Big Data Analysis

Big Data bring new opportunities to modern society and challenges to dat...

Big Data and Social/Medical Sciences: State of the Art and Future Trends

The explosion of data on the internet is a direct corollary of the socia...

Big data and the SP theory of intelligence

This article is about how the "SP theory of intelligence" and its realis...

D2D Big Data: Content Deliveries over Wireless Device-to-Device Sharing in Large Scale Mobile Networks

Recently the topic of how to effectively offload cellular traffic onto d...

Digital Archives as Big Data

Digital archives contribute to Big data. Combining social network analys...

Efficient Computation of the Well-Founded Semantics over Big Data

Data originating from the Web, sensor readings and social media result i...

The future of statistical disclosure control

Statistical disclosure control (SDC) was not created in a single seminal...

Please sign up or login with your details

Forgot password? Click here to reset