SODEN: A Scalable Continuous-Time Survival Model through Ordinary Differential Equation Networks

08/19/2020
by   Weijing Tang, et al.
5

In this paper, we propose a flexible model for survival analysis using neural networks along with scalable optimization algorithms. One key technical challenge for directly applying maximum likelihood estimation (MLE) to censored data is that evaluating the objective function and its gradients with respect to model parameters requires the calculation of integrals. To address this challenge, we recognize that the MLE for censored data can be viewed as a differential-equation constrained optimization problem, a novel perspective. Following this connection, we model the distribution of event time through an ordinary differential equation and utilize efficient ODE solvers and adjoint sensitivity analysis to numerically evaluate the likelihood and the gradients. Using this approach, we are able to 1) provide a broad family of continuous-time survival distributions without strong structural assumptions, 2) obtain powerful feature representations using neural networks, and 3) allow efficient estimation of the model in large-scale applications using stochastic gradient descent. Through both simulation studies and real-world data examples, we demonstrate the effectiveness of the proposed method in comparison to existing state-of-the-art deep learning survival analysis models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/17/2016

Stochastic Gradient Descent in Continuous Time

Stochastic gradient descent in continuous time (SGDCT) provides a comput...
research
11/13/2019

Asymptotics of Reinforcement Learning with Neural Networks

We prove that a single-layer neural network trained with the Q-learning ...
research
05/27/2022

Hazard Gradient Penalty for Survival Analysis

Survival analysis appears in various fields such as medicine, economics,...
research
09/07/2020

Survival Analysis via Ordinary Differential Equations

This paper introduces a general framework for survival analysis based on...
research
08/23/2022

Survival Mixture Density Networks

Survival analysis, the art of time-to-event modeling, plays an important...
research
11/12/2019

Shadowing Properties of Optimization Algorithms

Ordinary differential equation (ODE) models of gradient-based optimizati...
research
12/09/2019

InfoCNF: An Efficient Conditional Continuous Normalizing Flow with Adaptive Solvers

Continuous Normalizing Flows (CNFs) have emerged as promising deep gener...

Please sign up or login with your details

Forgot password? Click here to reset