Social Simulacra: Creating Populated Prototypes for Social Computing Systems

08/08/2022
by   Joon Sung Park, et al.
0

Social computing prototypes probe the social behaviors that may arise in an envisioned system design. This prototyping practice is currently limited to recruiting small groups of people. Unfortunately, many challenges do not arise until a system is populated at a larger scale. Can a designer understand how a social system might behave when populated, and make adjustments to the design before the system falls prey to such challenges? We introduce social simulacra, a prototyping technique that generates a breadth of realistic social interactions that may emerge when a social computing system is populated. Social simulacra take as input the designer's description of a community's design – goal, rules, and member personas – and produce as output an instance of that design with simulated behavior, including posts, replies, and anti-social behaviors. We demonstrate that social simulacra shift the behaviors that they generate appropriately in response to design changes, and that they enable exploration of "what if?" scenarios where community members or moderators intervene. To power social simulacra, we contribute techniques for prompting a large language model to generate thousands of distinct community members and their social interactions with each other; these techniques are enabled by the observation that large language models' training data already includes a wide variety of positive and negative behavior on social media platforms. In evaluations, we show that participants are often unable to distinguish social simulacra from actual community behavior and that social computing designers successfully refine their social computing designs when using social simulacra.

READ FULL TEXT

page 5

page 6

page 7

research
08/26/2023

Cura: Curation at Social Media Scale

How can online communities execute a focused vision for their space? Cur...
research
06/26/2023

WinoQueer: A Community-in-the-Loop Benchmark for Anti-LGBTQ+ Bias in Large Language Models

We present WinoQueer: a benchmark specifically designed to measure wheth...
research
07/02/2020

Evolving Methods for Evaluating and Disseminating Computing Research

Social and technical trends have significantly changed methods for evalu...
research
09/20/2023

Fictional Worlds, Real Connections: Developing Community Storytelling Social Chatbots through LLMs

We address the integration of storytelling and Large Language Models (LL...
research
04/02/2019

Out of Site: Empowering a New Approach to Online Boycotts

GrabYourWallet, #boycottNRA and other online boycott campaigns have attr...
research
07/26/2022

Bodily Behaviors in Social Interaction: Novel Annotations and State-of-the-Art Evaluation

Body language is an eye-catching social signal and its automatic analysi...
research
07/26/2023

Embedding Democratic Values into Social Media AIs via Societal Objective Functions

Can we design artificial intelligence (AI) systems that rank our social ...

Please sign up or login with your details

Forgot password? Click here to reset