Head-Related Transfer Function Interpolation with a Spherical CNN

09/15/2023
by   Xingyu Chen, et al.
0

Head-related transfer functions (HRTFs) are crucial for spatial soundfield reproduction in virtual reality applications. However, obtaining personalized, high-resolution HRTFs is a time-consuming and costly task. Recently, deep learning-based methods showed promise in interpolating high-resolution HRTFs from sparse measurements. Some of these methods treat HRTF interpolation as an image super-resolution task, which neglects spatial acoustic features. This paper proposes a spherical convolutional neural network method for HRTF interpolation. The proposed method realizes the convolution process by decomposing and reconstructing HRTF through the Spherical Harmonics (SHs). The SHs, an orthogonal function set defined on a sphere, allow the convolution layers to effectively capture the spatial features of HRTFs, which are sampled on a sphere. Simulation results demonstrate the effectiveness of the proposed method in achieving accurate interpolation from sparse measurements, outperforming the SH method and learning-based methods.

READ FULL TEXT
research
12/18/2017

Super-Resolution with Deep Adaptive Image Resampling

Deep learning based methods have recently pushed the state-of-the-art on...
research
07/28/2022

Predicting Global Head-Related Transfer Functions From Scanned Head Geometry Using Deep Learning and Compact Representations

In the growing field of virtual auditory display, personalized head-rela...
research
07/22/2022

Head-Related Transfer Function Interpolation from Spatially Sparse Measurements Using Autoencoder with Source Position Conditioning

We propose a method of head-related transfer function (HRTF) interpolati...
research
10/01/2019

Spherical k-Nearest Neighbors Interpolation

Geospatial interpolation is a challenging task due to real world data of...
research
12/05/2022

Spherical Essentially Non-Oscillatory (SENO) Interpolation

We develop two new ideas for interpolation on 𝕊^2. In this first part, w...
research
03/21/2022

Individualizing Head-Related Transfer Functions for Binaural Acoustic Applications

A Head Related Transfer Function (HRTF) characterizes how a human ear re...
research
01/29/2022

Spherical Convolution empowered FoV Prediction in 360-degree Video Multicast with Limited FoV Feedback

Field of view (FoV) prediction is critical in 360-degree video multicast...

Please sign up or login with your details

Forgot password? Click here to reset