ObSynth: An Interactive Synthesis System for Generating Object Models from Natural Language Specifications

10/20/2022
by   Alex Gu, et al.
0

We introduce ObSynth, an interactive system leveraging the domain knowledge embedded in large language models (LLMs) to help users design object models from high level natural language prompts. This is an example of specification reification, the process of taking a high-level, potentially vague specification and reifying it into a more concrete form. We evaluate ObSynth via a user study, leading to three key findings: first, object models designed using ObSynth are more detailed, showing that it often synthesizes fields users might have otherwise omitted. Second, a majority of objects, methods, and fields generated by ObSynth are kept by the user in the final object model, highlighting the quality of generated components. Third, ObSynth altered the workflow of participants: they focus on checking that synthesized components were correct rather than generating them from scratch, though ObSynth did not reduce the time participants took to generate object models.

READ FULL TEXT

page 22

page 23

research
03/06/2018

Precise but Natural Specification for Robot Tasks

We present Flipper, a natural language interface for describing high lev...
research
04/08/2019

Sketchforme: Composing Sketched Scenes from Text Descriptions for Interactive Applications

Sketching and natural languages are effective communication media for in...
research
05/11/2023

Image-to-Text Translation for Interactive Image Recognition: A Comparative User Study with Non-Expert Users

Interactive machine learning (IML) allows users to build their custom ma...
research
11/03/2018

SimplerVoice: A Key Message & Visual Description Generator System for Illiteracy

We introduce SimplerVoice: a key message and visual description generato...
research
07/07/2023

Exploring and Characterizing Large Language Models For Embedded System Development and Debugging

Large language models (LLMs) have shown remarkable abilities to generate...
research
03/08/2023

nl2spec: Interactively Translating Unstructured Natural Language to Temporal Logics with Large Language Models

A rigorous formalization of desired system requirements is indispensable...
research
08/09/2019

Multi-Modal Synthesis of Regular Expressions

Despite their usefulness across a wide range of application domains, reg...

Please sign up or login with your details

Forgot password? Click here to reset