SpeechMirror: A Multimodal Visual Analytics System for Personalized Reflection of Online Public Speaking Effectiveness

by   Zeyuan Huang, et al.

As communications are increasingly taking place virtually, the ability to present well online is becoming an indispensable skill. Online speakers are facing unique challenges in engaging with remote audiences. However, there has been a lack of evidence-based analytical systems for people to comprehensively evaluate online speeches and further discover possibilities for improvement. This paper introduces SpeechMirror, a visual analytics system facilitating reflection on a speech based on insights from a collection of online speeches. The system estimates the impact of different speech techniques on effectiveness and applies them to a speech to give users awareness of the performance of speech techniques. A similarity recommendation approach based on speech factors or script content supports guided exploration to expand knowledge of presentation evidence and accelerate the discovery of speech delivery possibilities. SpeechMirror provides intuitive visualizations and interactions for users to understand speech factors. Among them, SpeechTwin, a novel multimodal visual summary of speech, supports rapid understanding of critical speech factors and comparison of different speech samples, and SpeechPlayer augments the speech video by integrating visualization of the speaker's body language with interaction, for focused analysis. The system utilizes visualizations suited to the distinct nature of different speech factors for user comprehension. The proposed system and visualization techniques were evaluated with domain experts and amateurs, demonstrating usability for users with low visualization literacy and its efficacy in assisting users to develop insights for potential improvement.


page 2

page 8

page 15

page 16

page 22


E-ffective: A Visual Analytic System for Exploring the Emotion and Effectiveness of Inspirational Speeches

What makes speeches effective has long been a subject for debate, and un...

Talking to Data Visualizations: Opportunities and Challenges

Speech is one of the interaction modalities that we increasingly come ac...

InChorus: Designing Consistent Multimodal Interactions for Data Visualization on Tablet Devices

While tablet devices are a promising platform for data visualization, su...

DeHumor: Visual Analytics for Decomposing Humor

Despite being a critical communication skill, grasping humor is challeng...

SilkViser:A Visual Explorer of Blockchain-based Cryptocurrency Transaction Data

Many blockchain-based cryptocurrencies provide users with online blockch...

Deep generative factorization for speech signal

Various information factors are blended in speech signals, which forms t...

Temporal effects of Unmoderated Hate speech in Gab

With the online proliferation of hate speech, organizations and governme...

Please sign up or login with your details

Forgot password? Click here to reset