NutriIngredientNet v5
Single-RGB-photo food nutrition estimator trained on Nutrition5k (overhead RGB).
No depth sensor required at inference — depth is predicted from the RGB image
(Depth Anything V2) and fused as a 4th channel, following DPF-Nutrition (Han et al., 2023).
Test results (official RGB test split; T3 real full-dish, comparable to the paper)
- Reconciled calorie MAE: 79.7 kcal (31.5%)
- Blend / Direct / Soft / Hard: 77.6 / 77.6 / 107.4 / 121.5 kcal
- Mass MAE 69.1 g | macro MAE: fat 6.2 g, carb 6.9 g, protein 5.7 g
- Detection F1 0.634 (vs frequency-prior 0.110)
- Grams MAE 20.7 g (vs oracle-presence mean-gram 23.5 g)
- Atwater residual: 26.14 kcal (direct) -> 0.0000 kcal (reconciled, exact)
- Conformal: CRC lambda 0.730 (empirical recall 0.820); gram interval ±41.6 g
(empirical coverage 87.0%)
Comparison
- Nutrition5k RGB-only baseline (Thames et al., CVPR 2021): 70.6 kcal / 26.1% (mean 254.94 kcal)
- DPF-Nutrition predicted-depth (Han et al., 2023): 14.7% calorie PMAE
- Prior versions: v2 = 117.8 kcal (46.6%), v3 = 76.5 kcal (30.2%)
Limitations (read before use)
- Fixed overhead camera geometry. Trained on the Nutrition5k rig; other angles degrade accuracy.
- Vocabulary / OOV ceiling. Only ingredients seen >= 10 times in train are
modeled; novel foods are missed.
- Extreme-dish under-prediction. Calorie-dense low-volume foods (e.g. 119 g almonds in
dish_1558373159, true 1013 kcal) are systematically under-predicted — beyond current published SOTA.
- Conformal caveat. Guarantees assume exchangeability; real-user photos are off-distribution.
- Not a medical device; for behavioral/trend feedback only (Atwater factors are ±5% at best).
