Spellburst: A Node-based Interface for Exploratory Creative Coding with Natural Language Prompts

08/07/2023
by   Tyler Angert, et al.
0

Creative coding tasks are often exploratory in nature. When producing digital artwork, artists usually begin with a high-level semantic construct such as a "stained glass filter" and programmatically implement it by varying code parameters such as shape, color, lines, and opacity to produce visually appealing results. Based on interviews with artists, it can be effortful to translate semantic constructs to program syntax, and current programming tools don't lend well to rapid creative exploration. To address these challenges, we introduce Spellburst, a large language model (LLM) powered creative-coding environment. Spellburst provides (1) a node-based interface that allows artists to create generative art and explore variations through branching and merging operations, (2) expressive prompt-based interactions to engage in semantic programming, and (3) dynamic prompt-driven interfaces and direct code editing to seamlessly switch between semantic and syntactic exploration. Our evaluation with artists demonstrates Spellburst's potential to enhance creative coding practices and inform the design of computational creativity tools that bridge semantic and syntactic spaces.

READ FULL TEXT

page 1

page 5

page 6

page 7

page 17

page 18

page 21

research
01/26/2023

On the Design of AI-powered Code Assistants for Notebooks

AI-powered code assistants, such as Copilot, are quickly becoming a ubiq...
research
05/23/2023

ChatGPT, Can You Generate Solutions for my Coding Exercises? An Evaluation on its Effectiveness in an undergraduate Java Programming Course

In this study, we assess the efficacy of employing the ChatGPT language ...
research
03/27/2023

LMCanvas: Object-Oriented Interaction to Personalize Large Language Model-Powered Writing Environments

Large language models (LLMs) can enhance writing by automating or suppor...
research
05/31/2023

AI for Low-Code for AI

Low-code programming allows citizen developers to create programs with m...
research
06/15/2023

Live Exploration of AI-Generated Programs

AI-powered programming assistants are increasingly gaining popularity, w...
research
01/15/2020

Scout: Rapid Exploration of Interface Layout Alternatives through High-Level Design Constraints

Although exploring alternatives is fundamental to creating better interf...
research
06/06/2023

GarmentCode: Programming Parametric Sewing Patterns

Garment modeling is an essential task of the global apparel industry and...

Please sign up or login with your details

Forgot password? Click here to reset