Overview of Tasks and Investigation of Subjective Evaluation Methods in Environmental Sound Synthesis and Conversion

08/27/2019
by   Yuki Okamoto, et al.
0

Synthesizing and converting environmental sounds have the potential for many applications such as supporting movie and game production, data augmentation for sound event detection and scene classification. Conventional works on synthesizing and converting environmental sounds are based on a physical modeling or concatenative approach. However, there are a limited number of works that have addressed environmental sound synthesis and conversion with statistical generative models; thus, this research area is not yet well organized. In this paper, we review problem definitions, applications, and evaluation methods of environmental sound synthesis and conversion. We then report on environmental sound synthesis using sound event labels, in which we focus on the current performance of statistical environmental sound synthesis and investigate how we should conduct subjective experiments on environmental sound synthesis.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

research
04/29/2023

Environmental sound conversion from vocal imitations and sound event labels

One way of expressing an environmental sound is using vocal imitations, ...
research
08/16/2022

How Should We Evaluate Synthesized Environmental Sounds

Although several methods of environmental sound synthesis have been prop...
research
03/22/2023

Dual-Quaternions: Theory and Applications in Sound

Sound is a fundamental and rich source of information; playing a key rol...
research
04/25/2023

Foley Sound Synthesis at the DCASE 2023 Challenge

The addition of Foley sound effects during post-production is a common t...
research
07/21/2022

A Proposal for Foley Sound Synthesis Challenge

"Foley" refers to sound effects that are added to multimedia during post...
research
10/17/2022

Visual onoma-to-wave: environmental sound synthesis from visual onomatopoeias and sound-source images

We propose a method for synthesizing environmental sounds from visually ...
research
05/28/2023

CAPTDURE: Captioned Sound Dataset of Single Sources

In conventional studies on environmental sound separation and synthesis ...

Please sign up or login with your details

Forgot password? Click here to reset