SAINE: Scientific Annotation and Inference Engine of Scientific Research

02/28/2023
by   Susie Xi Rao, et al.
0

We present SAINE, an Scientific Annotation and Inference ENgine based on a set of standard open-source software, such as Label Studio and MLflow. We show that our annotation engine can benefit the further development of a more accurate classification. Based on our previous work on hierarchical discipline classifications, we demonstrate its application using SAINE in understanding the space for scholarly publications. The user study of our annotation results shows that user input collected with the help of our system can help us better understand the classification process. We believe that our work will help to foster greater transparency and better understand scientific research. Our annotation and inference engine can further support the downstream meta-science projects. We welcome collaboration and feedback from the scientific community on these projects. The demonstration video can be accessed from https://youtu.be/yToO-G9YQK4. A live demo website is available at https://app.heartex.com/user/signup/?token=e2435a2f97449fa1 upon free registration.

READ FULL TEXT
research
03/23/2020

Characterizing the Roles of Contributors in Open-source Scientific Software Projects

The development of scientific software is, more than ever, critical to t...
research
01/31/2022

"How trustworthy is this research?" Designing a Tool to Help Readers Understand Evidence and Uncertainty in Science Journalism

This article reports on a Research through Design study exploring how to...
research
03/27/2021

Community-based Cyberreading for Information Understanding

Although the content in scientific publications is increasingly challeng...
research
01/01/2023

FEVA: Fast Event Video Annotation Tool

Video Annotation is a crucial process in computer science and social sci...
research
12/16/2019

PolSF: PolSAR image dataset on San Francisco

Polarimetric SAR data has the characteristics of all-weather, all-time a...
research
03/13/2018

A Survey on Deep Learning Toolkits and Libraries for Intelligent User Interfaces

This paper provides an overview of prominent deep learning toolkits and,...
research
06/30/2022

Neural Annotation Refinement: Development of a New 3D Dataset for Adrenal Gland Analysis

The human annotations are imperfect, especially when produced by junior ...

Please sign up or login with your details

Forgot password? Click here to reset