Cupid: Leveraging ChatGPT for More Accurate Duplicate Bug Report Detection

by   Ting Zhang, et al.

Duplicate bug report detection (DBRD) is a long-standing challenge in both academia and industry. Over the past decades, researchers have proposed various approaches to detect duplicate bug reports more accurately. With the recent advancement of deep learning, researchers have also proposed several approaches that leverage deep learning models to detect duplicate bug reports. A recent benchmarking study on DBRD also reveals that the performance of deep learning-based approaches is not always better than the traditional approaches. However, traditional approaches have limitations, e.g., they are usually based on the bag-of-words model, which cannot capture the semantics of bug reports. To address these aforementioned challenges, we seek to leverage state-of-the-art large language model to improve the performance of the traditional DBRD approach. In this paper, we propose an approach called Cupid, which combines the best-performing traditional DBRD approach REP with the state-of-the-art large language model ChatGPT. Specifically, we first leverage ChatGPT under the zero-shot setting to get essential information on bug reports. We then use the essential information as the input of REP to detect duplicate bug reports. We conducted an evaluation on comparing Cupid with three existing approaches on three datasets. The experimental results show that Cupid achieves new state-of-the-art results, reaching Recall Rate@10 scores ranging from 0.59 to 0.67 across all the datasets analyzed. Our work highlights the potential of combining large language models to improve the performance of software engineering tasks.


page 1

page 8


Towards Understanding the Impacts of Textual Dissimilarity on Duplicate Bug Report Detection

About 40 major overhead during software maintenance. Traditional techniq...

CLeBPI: Contrastive Learning for Bug Priority Inference

Automated bug priority inference can reduce the time overhead of bug tri...

Too Few Bug Reports? Exploring Data Augmentation for Improved Changeset-based Bug Localization

Modern Deep Learning (DL) architectures based on transformers (e.g., BER...

Early Detection of Security-Relevant Bug Reports using Machine Learning: How Far Are We?

Bug reports are common artefacts in software development. They serve as ...

Prompting Is All Your Need: Automated Android Bug Replay with Large Language Models

Bug reports are vital for software maintenance that allow users to infor...

Fast Changeset-based Bug Localization with BERT

Automatically localizing software bugs to the changesets that induced th...

Locating Faulty Methods with a Mixed RNN and Attention Model

IR-based fault localization approaches achieves promising results when l...

Please sign up or login with your details

Forgot password? Click here to reset