SAINE: Scientific Annotation and Inference Engine of Scientific Research

02/28/2023
by   Susie Xi Rao, et al.
0

We present SAINE, an Scientific Annotation and Inference ENgine based on a set of standard open-source software, such as Label Studio and MLflow. We show that our annotation engine can benefit the further development of a more accurate classification. Based on our previous work on hierarchical discipline classifications, we demonstrate its application using SAINE in understanding the space for scholarly publications. The user study of our annotation results shows that user input collected with the help of our system can help us better understand the classification process. We believe that our work will help to foster greater transparency and better understand scientific research. Our annotation and inference engine can further support the downstream meta-science projects. We welcome collaboration and feedback from the scientific community on these projects. The demonstration video can be accessed from https://youtu.be/yToO-G9YQK4. A live demo website is available at https://app.heartex.com/user/signup/?token=e2435a2f97449fa1 upon free registration.

READ FULL TEXT
03/23/2020

Characterizing the Roles of Contributors in Open-source Scientific Software Projects

The development of scientific software is, more than ever, critical to t...
03/27/2021

Community-based Cyberreading for Information Understanding

Although the content in scientific publications is increasingly challeng...
01/01/2023

FEVA: Fast Event Video Annotation Tool

Video Annotation is a crucial process in computer science and social sci...
12/16/2019

PolSF: PolSAR image dataset on San Francisco

Polarimetric SAR data has the characteristics of all-weather, all-time a...
03/13/2018

A Survey on Deep Learning Toolkits and Libraries for Intelligent User Interfaces

This paper provides an overview of prominent deep learning toolkits and,...
06/30/2022

Neural Annotation Refinement: Development of a New 3D Dataset for Adrenal Gland Analysis

The human annotations are imperfect, especially when produced by junior ...

Please sign up or login with your details

Forgot password? Click here to reset