Looper: An end-to-end ML platform for product decisions

10/14/2021
by   Igor L. Markov, et al.
0

Modern software systems and products increasingly rely on machine learning models to make data-driven decisions based on interactions with users and systems, e.g., compute infrastructure. For broader adoption, this practice must (i) accommodate software engineers without ML backgrounds, and (ii) provide mechanisms to optimize for product goals. In this work, we describe general principles and a specific end-to-end ML platform, Looper, which offers easy-to-use APIs for decision-making and feedback collection. Looper supports the full end-to-end ML lifecycle from online data collection to model training, deployment, inference, and extends support to evaluation and tuning against product goals. We outline the platform architecture and overall impact of production deployment – Looper currently hosts 700 ML models and makes 6 million decisions per second. We also describe the learning curve and summarize experiences of platform adopters.

READ FULL TEXT

page 2

page 6

research
08/31/2021

Towards Observability for Machine Learning Pipelines

Software organizations are increasingly incorporating machine learning (...
research
03/21/2023

Efficient Multi-stage Inference on Tabular Data

Many ML applications and products train on medium amounts of input data ...
research
02/27/2023

Scalable End-to-End ML Platforms: from AutoML to Self-serve

ML platforms help enable intelligent data-driven applications and mainta...
research
09/16/2022

Operationalizing Machine Learning: An Interview Study

Organizations rely on machine learning engineers (MLEs) to operationaliz...
research
05/05/2022

GreenDB: Toward a Product-by-Product Sustainability Database

The production, shipping, usage, and disposal of consumer goods have a s...
research
05/30/2022

Walle: An End-to-End, General-Purpose, and Large-Scale Production System for Device-Cloud Collaborative Machine Learning

To break the bottlenecks of mainstream cloud-based machine learning (ML)...
research
07/21/2022

GreenDB – A Dataset and Benchmark for Extraction of Sustainability Information of Consumer Goods

The production, shipping, usage, and disposal of consumer goods have a s...

Please sign up or login with your details

Forgot password? Click here to reset