Animal Social Behavior Models
Two video classification models for animal behavior analysis.
Models
flyvsfly_model
- Species: Drosophila (fruit fly)
- Backbone: TimeSformer (ViT-Base, Kinetics-400 pretrained)
- Head: MLP (768→512→4)
- Classes: wing_extension, circle, copulation, others
- Input: 8 frames, 224×224
mice_lab_model
- Species: Mouse
- Backbone: Video Swin Transformer 3D-T (Kinetics-400 pretrained)
- Head: MLP with temporal mean pooling (768→512→5)
- Classes: Aggression, Investigation, Allo-groom, Standing, Other
- Input: 8 frames, 224×224
Usage
Each subfolder contains:
config.json — architecture parameters (backbone type, head config, class names)model.pth — trained weights
Load by reading config.json to determine which backbone class to instantiate.
