Skip to content

Behavior & Pose Analytics

IntegraPose

A unified desktop application for pose estimation, behavior classification, and downstream analytics - built for real lab workflows.

IntegraPose unifies pose estimation and behavior classification into a single end-to-end pipeline. Train or import a model, run inference on new recordings, score bouts with ROI-aware analytics, and explore sub-behaviors inside known classes - without stitching together separate tools.

Detection Pose Behavior classification Batch analytics ROI metrics Sub-behavior discovery Custom architectures Plugin-ready

What the app covers

  • Project setup and annotation
  • Pose & detection model training
  • File and webcam inference
  • Bout analytics and ROI metrics
  • Sub-behavior discovery
  • Custom YOLO architectures

Where IntegraPose Fits

Computational ethology has matured into a rich ecosystem of specialized tools. Pose estimation has strong open-source options like DeepLabCut and SLEAP. Unsupervised behavior discovery has B-SOiD, VAME, and Keypoint-MoSeq. Manual event coding is well served by BORIS, and end-to-end commercial suites cover the regulated end of the market. Each is excellent at what it does - and most labs end up assembling several of them, with custom scripts in between, to get from raw video to a publication-ready behavior count.

IntegraPose addresses the seams in that workflow rather than the building blocks. It brings pose estimation, multi-animal tracking, ROI- and bout-level analytics, and optional sub-behavior discovery into a single desktop application, backed by a curated plugin ecosystem for the cases the core workflow doesn't cover. The aim is not to replace the upstream tools but to give labs without dedicated engineering support a unified, reproducible path from raw video to defensible analytics - in one place, with a single time-locked stream of pose and behavior data underneath.

What You Can Build with IntegraPose

IntegraPose is a flexible platform: the same workflow pattern adapts across very different research and applied contexts.

Gait analysis dashboard sample

Gait & Kinematic Analysis

Quantify stride length, speed, paw angle, and other locomotion features to study movement in health and disease.

Real-time behavior demo

Real-time Behavior Apps

Drive closed-loop experiments, biofeedback, and live monitoring with low-latency pose + behavior streams.

Rodent behavior workflow demo

Rodent Assay Workflows

Score bouts, ROI occupancy, and inter-animal interactions across standard rodent paradigms.

Multi-context tracking demo

Sports & Movement Analytics

Apply the same pose + behavior pipeline to athletic performance, technique review, or rehabilitation.

Browse more example outputs

Start With The Right Path

If you want to... Start here Best fit
Learn the layout and run a first project Quick Start New users
Use an existing detection model and skip pose training Detection-Only Model Workflow Detection-first workflows
Train and use a pose model inside IntegraPose Pose Model Workflow Full pose workflows
Process many recordings at once Batch Processing Wizard High-throughput labs
Design a custom YOLO architecture for your assay Customizing the YOLO Model Power users
Explore optional tools and plugins Plugin Catalog Extended workflows

Workflow At A Glance

Stage Main result
Data Preprocessing Extracted frames, cropped videos, organized source folders
Setup and Annotation Project scaffold, classes or keypoints, dataset.yaml
Model Training YOLO pose checkpoints and training artifacts
Inference Detection or pose labels, videos, optional motion summaries
Bout Analytics Bouts, ROI metrics, object interaction outputs, run manifest
Batch Processing Wizard Repeated analytics runs across many videos
Behavior Clustering Per-class sub-behaviors, candidate scores, named clip folders for downstream classifier training (pose workflows)
Raw videos
  -> Data Preprocessing
  -> Setup and Annotation
  -> Model Training (or imported model, or custom architecture)
  -> Inference or Batch Processing Wizard
  -> Bout Analytics
  -> Behavior Clustering (optional)

Going Further

When the standard tabs aren't quite enough:

  • Customize the YOLO architecture - edit the model .yaml to swap backbones, fuse modules differently, add attention or transformer blocks, or tune for edge deployment. CLI training instructions included.
  • Behavior Clustering - split a known YOLO class into the sub-behaviors actually present in your data, score them, name them, and export classifier-ready clip folders.

The Plugin Ecosystem

IntegraPose ships with a curated plugin ecosystem that extends the core 7-tab workflow without bloating it. Each plugin is opt-in - turn them on from Plugins -> Manage Plugins..., launch them from the Plugins menu, and the rest of the app continues to work exactly as before.

Plugin status - research in progress

The plugin ecosystem evolves with active research. Some plugins are stable, others are works in progress, and the set may change as research priorities shift. See the Plugin Catalog for the current status note and per-plugin guides.

Dataset creation

Assisted Pose Curation - review-first pose labeling with model-assisted suggestions.
AutoLabel Forge - GroundingDINO + SAM-assisted auto-labeling for detection datasets.
Dataset Augmentor Lab - GUI-driven augmentation for YOLO datasets.

Behavior & sequence modeling

TandemYTC - Tandem YOLO + Temporal Classifier - full-video annotation, YOLO-pose review overlays, temporal-model training, and bounded-latency inference.

Domain-specific analytics

Gait & Kinematic Dashboard - stride length, speed, paw angle, and locomotion comparisons.
Zone Counter - live polygon-based zone counts during inference.

Exploration & review

EDA Tool - interactive PCA / KMeans on pose embeddings with video sync.

See the full Plugin Catalog →

Compatibility Notes

  • Inference supports both detect and pose file-based workflows.
  • Model Training is pose-oriented in the GUI; custom detection architectures train via the CLI flow in Customizing the YOLO Model.
  • Bout Analytics works with both detection-only and pose label outputs.
  • Behavior Clustering (Tab 7) is pose-only; it accepts pose data, Bout Analytics output, or batch manifests as input.
  • Batch Processing Wizard is available from File -> Batch Processing Wizard....
  • Optional plugins can be enabled from Plugins -> Manage Plugins....

Open Source Foundations

IntegraPose builds on open-source projects that make modern vision and analytics workflows practical for research labs.

Project Role in IntegraPose
PyTorch Deep-learning runtime used by model workflows and GPU-backed inference stacks
Ultralytics YOLO Core training and inference backbone for pose and detection workflows
OpenCV Video IO, image processing, overlays, and supporting CV utilities
NumPy and SciPy Numerical processing across training, analytics, and feature computation
Pandas Tables, bout summaries, and export-friendly data handling
Matplotlib Plotting and reporting visuals
Pillow Image loading, export, and GUI-friendly image utilities
Supervision Overlay and workflow helpers for modern computer-vision pipelines

Read citations and acknowledgements