A Tree-Structured Multi-Task Model Recommender

03/10/2022
by   Moshe Y. Vardi, et al.
0

Tree-structured multi-task architectures have been employed to jointly tackle multiple vision tasks in the context of multi-task learning (MTL). The major challenge is to determine where to branch out for each task given a backbone model to optimize for both task accuracy and computation efficiency. To address the challenge, this paper proposes a recommender that, given a set of tasks and a convolutional neural network-based backbone model, automatically suggests tree-structured multi-task architectures that could achieve a high task performance while meeting a user-specified computation budget without performing model training. Extensive evaluations on popular MTL benchmarks show that the recommended architectures could achieve competitive task accuracy and computation efficiency compared with state-of-the-art MTL methods.

READ FULL TEXT

page 5

page 8

page 10

page 11

page 14

page 15

page 17

page 18

research
10/25/2021

AutoMTL: A Programming Framework for Automated Multi-Task Learning

Multi-task learning (MTL) jointly learns a set of tasks. It is a promisi...
research
07/07/2023

TBGC: Task-level Backbone-Oriented Gradient Clip for Multi-Task Foundation Model Learning

The AllInOne training paradigm squeezes a wide range of tasks into a uni...
research
12/07/2022

Tree DNN: A Deep Container Network

Multi-Task Learning (MTL) has shown its importance at user products for ...
research
09/11/2019

Deep Elastic Networks with Model Selection for Multi-Task Learning

In this work, we consider the problem of instance-wise dynamic network m...
research
08/23/2023

Less is More – Towards parsimonious multi-task models using structured sparsity

Group sparsity in Machine Learning (ML) encourages simpler, more interpr...
research
11/30/2022

Optical multi-task learning using multi-wavelength diffractive deep neural networks

Photonic neural networks are brain-inspired information processing techn...
research
04/01/2022

Nowruz at SemEval-2022 Task 7: Tackling Cloze Tests with Transformers and Ordinal Regression

This paper outlines the system using which team Nowruz participated in S...

Please sign up or login with your details

Forgot password? Click here to reset