Starting with Google's base BigBird model, we fine-tuned on binary mortality prediction in MIMIC admission notes. This
model seeks to predict whether a certain patient will expire within a given ICU stay, based on the text available upon
admission. Data prepared for this task as described in
this project,
using the simulated admission notes (taken from discharge summaries). This model will be used in an upcoming submission for
IMLH at ICML 2021.