A Novel Methodology For Crowdsourcing AI Models in an Enterprise

The evolution of AI is advancing rapidly, creating both challenges and opportunities for industry-community collaboration. In this work, we present a novel methodology aiming to facilitate this collaboration through crowdsourcing of AI models. Concretely, we have implemented a system and a process that any organization can easily adopt to host AI competitions. The system allows them to automatically harvest and evaluate the submitted models against in-house proprietary data and also to incorporate them as reusable services in a product.

READ FULL TEXT

page 1

page 2

page 3

research
06/24/2020

A Methodology for Creating AI FactSheets

As AI models and services are used in a growing number of highstakes are...
research
06/10/2023

Investigating Practices and Opportunities for Cross-functional Collaboration around AI Fairness in Industry Practice

An emerging body of research indicates that ineffective cross-functional...
research
08/31/2023

A Task-Interdependency Model of Complex Collaboration Towards Human-Centered Crowd Work

Models of crowdsourcing and human computation often assume that individu...
research
02/09/2018

Crowdsourcing: a new tool for policy-making?

Crowdsourcing is rapidly evolving and applied in situations where ideas,...
research
07/18/2023

Anticipating Technical Expertise and Capability Evolution in Research Communities using Dynamic Graph Transformers

The ability to anticipate technical expertise and capability evolution t...
research
03/05/2020

Towards Effective Human-AI Collaboration in GUI-Based Interactive Task Learning Agents

We argue that a key challenge in enabling usable and useful interactive ...
research
02/09/2018

The Fundamentals of Policy Crowdsourcing

What is the state of the research on crowdsourcing for policy making? Th...

Please sign up or login with your details

Forgot password? Click here to reset