Behavior & Pose Analytics
IntegraPose
A unified desktop application for pose estimation, behavior classification, and downstream analytics - built for real lab workflows.
IntegraPose unifies pose estimation and behavior classification into a single end-to-end pipeline. Train or import a model, run inference on new recordings, score bouts with ROI-aware analytics, and explore sub-behaviors inside known classes - without stitching together separate tools.
What the app covers
- Project setup and annotation
- Pose & detection model training
- File and webcam inference
- Bout analytics and ROI metrics
- Sub-behavior discovery
- Custom YOLO architectures
Where IntegraPose Fits¶
Computational ethology has matured into a rich ecosystem of specialized tools. Pose estimation has strong open-source options like DeepLabCut and SLEAP. Unsupervised behavior discovery has B-SOiD, VAME, and Keypoint-MoSeq. Manual event coding is well served by BORIS, and end-to-end commercial suites cover the regulated end of the market. Each is excellent at what it does - and most labs end up assembling several of them, with custom scripts in between, to get from raw video to a publication-ready behavior count.
IntegraPose addresses the seams in that workflow rather than the building blocks. It brings pose estimation, multi-animal tracking, ROI- and bout-level analytics, and optional sub-behavior discovery into a single desktop application, backed by a curated plugin ecosystem for the cases the core workflow doesn't cover. The aim is not to replace the upstream tools but to give labs without dedicated engineering support a unified, reproducible path from raw video to defensible analytics - in one place, with a single time-locked stream of pose and behavior data underneath.
What You Can Build with IntegraPose¶
IntegraPose is a flexible platform: the same workflow pattern adapts across very different research and applied contexts.
Gait & Kinematic Analysis
Quantify stride length, speed, paw angle, and other locomotion features to study movement in health and disease.
Real-time Behavior Apps
Drive closed-loop experiments, biofeedback, and live monitoring with low-latency pose + behavior streams.
Rodent Assay Workflows
Score bouts, ROI occupancy, and inter-animal interactions across standard rodent paradigms.
Sports & Movement Analytics
Apply the same pose + behavior pipeline to athletic performance, technique review, or rehabilitation.
Start With The Right Path¶
| If you want to... | Start here | Best fit |
|---|---|---|
| Learn the layout and run a first project | Quick Start | New users |
| Use an existing detection model and skip pose training | Detection-Only Model Workflow | Detection-first workflows |
| Train and use a pose model inside IntegraPose | Pose Model Workflow | Full pose workflows |
| Process many recordings at once | Batch Processing Wizard | High-throughput labs |
| Design a custom YOLO architecture for your assay | Customizing the YOLO Model | Power users |
| Explore optional tools and plugins | Plugin Catalog | Extended workflows |
Workflow At A Glance¶
| Stage | Main result |
|---|---|
| Data Preprocessing | Extracted frames, cropped videos, organized source folders |
| Setup and Annotation | Project scaffold, classes or keypoints, dataset.yaml |
| Model Training | YOLO pose checkpoints and training artifacts |
| Inference | Detection or pose labels, videos, optional motion summaries |
| Bout Analytics | Bouts, ROI metrics, object interaction outputs, run manifest |
| Batch Processing Wizard | Repeated analytics runs across many videos |
| Behavior Clustering | Per-class sub-behaviors, candidate scores, named clip folders for downstream classifier training (pose workflows) |
Raw videos
-> Data Preprocessing
-> Setup and Annotation
-> Model Training (or imported model, or custom architecture)
-> Inference or Batch Processing Wizard
-> Bout Analytics
-> Behavior Clustering (optional)
Going Further¶
When the standard tabs aren't quite enough:
- Customize the YOLO architecture - edit the model
.yamlto swap backbones, fuse modules differently, add attention or transformer blocks, or tune for edge deployment. CLI training instructions included. - Behavior Clustering - split a known YOLO class into the sub-behaviors actually present in your data, score them, name them, and export classifier-ready clip folders.
The Plugin Ecosystem¶
IntegraPose ships with a curated plugin ecosystem that extends the
core 7-tab workflow without bloating it. Each plugin is opt-in - turn
them on from Plugins -> Manage Plugins..., launch them from the
Plugins menu, and the rest of the app continues to work
exactly as before.
Plugin status - research in progress
The plugin ecosystem evolves with active research. Some plugins are stable, others are works in progress, and the set may change as research priorities shift. See the Plugin Catalog for the current status note and per-plugin guides.
Dataset creation
Assisted Pose Curation -
review-first pose labeling with model-assisted suggestions.
AutoLabel Forge -
GroundingDINO + SAM-assisted auto-labeling for detection datasets.
Dataset Augmentor Lab -
GUI-driven augmentation for YOLO datasets.
Behavior & sequence modeling
TandemYTC - Tandem YOLO + Temporal Classifier - full-video annotation, YOLO-pose review overlays, temporal-model training, and bounded-latency inference.
Domain-specific analytics
Gait & Kinematic Dashboard -
stride length, speed, paw angle, and locomotion comparisons.
Zone Counter -
live polygon-based zone counts during inference.
Exploration & review
EDA Tool - interactive PCA / KMeans on pose embeddings with video sync.
Compatibility Notes¶
Inferencesupports bothdetectandposefile-based workflows.Model Trainingis pose-oriented in the GUI; custom detection architectures train via the CLI flow in Customizing the YOLO Model.Bout Analyticsworks with both detection-only and pose label outputs.Behavior Clustering (Tab 7)is pose-only; it accepts pose data, Bout Analytics output, or batch manifests as input.Batch Processing Wizardis available fromFile -> Batch Processing Wizard....- Optional plugins can be enabled from
Plugins -> Manage Plugins....
Open Source Foundations¶
IntegraPose builds on open-source projects that make modern vision and analytics workflows practical for research labs.
| Project | Role in IntegraPose |
|---|---|
| PyTorch | Deep-learning runtime used by model workflows and GPU-backed inference stacks |
| Ultralytics YOLO | Core training and inference backbone for pose and detection workflows |
| OpenCV | Video IO, image processing, overlays, and supporting CV utilities |
| NumPy and SciPy | Numerical processing across training, analytics, and feature computation |
| Pandas | Tables, bout summaries, and export-friendly data handling |
| Matplotlib | Plotting and reporting visuals |
| Pillow | Image loading, export, and GUI-friendly image utilities |
| Supervision | Overlay and workflow helpers for modern computer-vision pipelines |