BehaviorAtlas · Autism Module

Autism Model Automated Behavior Assessment System

Fine action features from body-point tracking, 3D reconstruction, behavior decomposition, and clustering — combined with prediction models trained on autism modeling data for single-sample classification and multi-modal visual reports. Load project → predict → view report in three steps.

AUTISM PHENOTYPE PREDICTION
Load · predict · report
LOAD
PRED
VIEW

// prediction stream

[load] Explorer.ba3e · 24 samples · 40 action classes

40

Action classes

3 steps

Workflow

10+

Report modules

Research Background

Autism model phenotypes are complex and traditional scales miss nuance — high-dimensional spontaneous behavior plus predictive models are needed.

Autism spectrum disorder (ASD) animal models often show social deficits, repetitive stereotypy, and abnormal activity patterns — yet conventional tests (open field, three-chamber social, etc.) cover only limited dimensions and miss subtle spontaneous phenotypes. High-dimensional 3D skeleton tracking and unsupervised action clustering decompose continuous behavior into dozens of fine actions for richer cross-model and cross-group profiles.

The Autism Model Automated Behavior Assessment System builds on the BehaviorAtlas pipeline with prediction models trained on autism modeling cohorts: import a pre-processed project (Explorer.ba3e), predict per sample in one click, and the report panel shows multi-view video, 3D skeleton, action spectra, low-dimensional clustering, KNN classification, transition chord diagrams, kinematics, and 10+ visualization modules — for Shank3, Scn2a, and pharmacological intervention phenotyping.

01

40 Action Classes

Unsupervised clustering splits spontaneous behavior into 40 fine action segments — non-locomotor and locomotor features.

02

Prediction Models

Trained on autism modeling data — per-sample class prediction with confidence scores.

03

Multi-modal Reports

10+ linked charts: action spectra, UMAP clustering, transition matrices, word clouds, and kinematics distributions.

Core Software

Capture multi-channel dual-tier multi-view acquisition · Explorer project prediction and multi-modal reports — full capture-to-analysis pipeline.

BehaviorAtlas Capture Mouse
Capture

BehaviorAtlas Capture Mouse

Multi-channel · dual-tier multi-view sync capture

Multi-channel capture software for autism model mouse spontaneous behavior. Multi-view cameras on upper and lower cage tiers — synchronized multi-stream recording with millisecond alignment; sample ID, group metadata, and long-duration unattended acquisition for high-quality raw data for 3D tracking and action clustering.

2 tiersUpper/lowerMulti-viewPer-tier syncMulti-chSync capture
BehaviorAtlas Explorer
Analyze

BehaviorAtlas Explorer

Project import · single-sample prediction · multi-modal reports

Built for autism model behavioral big-data analysis. Load projects via Explorer.ba3e config with completed 3D tracking and action clustering; sample list shows predictions, model panel runs inference, and the report area covers multi-view video, 3D skeleton, action heatmaps, low-dimensional clustering, KNN classification, action transitions, and kinematics.

40Action classes3 stepsWorkflow.ba3eProject

Software Functions

Capture multi-channel dual-tier acquisition and Explorer project prediction and reporting — full pipeline from data capture to visual analysis.

Project Directory Structure
01

Project Directory Structure

3Dskeleton (3D skeleton csv/c3d), BeAOutputs (h5 skeleton/kinematics/action labels), Figures (clustering & skeleton plots), VideoSeg (40 action-class clips), and Explorer.ba3e config.

Load Project
02

Load Project

Menu File → Import Data, select Explorer.ba3e config — auto-loads sample list and pre-processed results.

Single-sample Prediction
03

Single-sample Prediction

Select sample and model, click Predict — sample list updates with predicted class instantly.

Multi-modal Data Report
04

Multi-modal Data Report

Main report panel: multi-view video & 3D skeleton, action density & spectra, UMAP clustering, KNN classification, and group-level dimensionality reduction.

3D Skeleton & Trajectories
05

3D Skeleton & Trajectories

Multi-view raw video with 3D skeleton overlay — selectable body points and motion trajectories synced to playback.

Data Export
06

Data Export

Export analysis charts, action-segment videos, and structured parameter tables for group statistics, publication figures, and downstream analysis.

Three-step Workflow

Load project → single-sample prediction → view report

  1. Import Explorer.ba3e

    Load Project

    After launch, click File in the menu bar → Import Data, navigate to the project folder, and open Explorer.ba3e config.

  2. Select · model · predict

    Single-sample Prediction

    Select a sample in the list, choose a model in the prediction panel, and click Predict — success when results appear in the sample list.

  3. Multi-modal visualization

    View Report

    Select a sample with prediction results — the report panel loads the full analysis with 10+ chart and video-linked modules.

Report Charts

After tracking, reconstruction, decomposition, and clustering — prediction models drive multi-dimensional visual reports.

40Action classesKNNClassificationUMAPClustering10+Report modules
01

Project Overview

Project metadata, sample grouping, and prediction model configuration.

ProjectMetadataGroups
02

Multi-view Video & 3D Skeleton

Multi-view raw video with synchronized 3D skeleton — selectable body-point motion trajectories.

3DMulti-viewTrajectory
03

Action Density & Spectrum

Representative autism action density and sample action spectrum — scrubber linked to video for current action name.

SpectrumDensityLinked
04

Low-dimensional Clustering

UMAP1/UMAP2 for non-locomotor features; Norm-velocity axis for locomotion — all sample actions in low-dimensional space.

UMAPClustering40 classes
05

KNN Classification & Group DR

KNN on combined kinematics and action data; 3D group-level dimensionality reduction of action fractions and kinematics.

KNNDRGroups
06

Transition Chord & Frequency Matrix

Transition chord diagrams (arc width = frequency) and action-name transition frequency heatmaps for sample and F/S/W groups.

TransitionChordHeatmap
07

Action Word Cloud

Action fraction word clouds per sample and group — larger text = higher action proportion.

Word cloudFractionGroups
08

Kinematics & Heatmaps

Velocity trajectory, position distribution, and body overlay heatmaps; speed/intensity/body-size distributions and body-angle polar histograms.

KinematicsHeatmapAngle

Applications

Autism gene model phenotyping, pharmacological intervention assessment, and psychiatric translational research.

01

Gene Knockout/Mutation Models

High-dimensional spontaneous behavior phenotyping and predictive classification for Shank3, Scn2a, and other ASD gene models.

02

Pharmacological Intervention

Pre/post intervention action spectra, transition patterns, and kinematics for objective efficacy assessment.

03

Sex Difference Analysis

Group-level action distribution and kinematics comparison — sex-difference phenotypes in ASD models.

04

Translational Psychiatry

Bridge from animal spontaneous behavior to human symptom dimensions — objective metrics under the RDoC framework.

Learn More

Contact us to learn more about high-dimensional autism model phenotyping and predictive behavioral analysis.