AutoSapiens Dashboard

Results Overview

Idea ID ↕ Design ID ↕ Epoch ↕ Train Body ↕ Train Pelvis ↕ Train Weighted ↕ Val Body ↕ Val Pelvis ↕ Val Weighted ↕
idea001 design001 Baseline 20 99.37 64.87 87.98 125.92 176.10 142.48
idea001 design002 20 98.23 63.98 86.93 130.36 158.33 139.59
idea001 design003 20 91.33 62.85 81.93 121.06 186.82 142.76
idea002 design001 Baseline 20 99.37 64.87 87.98 125.92 176.10 142.48
idea002 design002 20 101.65 74.88 92.82 128.48 177.07 144.52
idea002 design003 20 102.08 71.87 92.11 126.63 165.62 139.50
idea003 design001 20 148.29 70.00 122.45 155.48 178.12 162.95
idea003 design002 20 98.76 68.33 88.71 125.27 179.69 143.23
idea004 design001 20 81.79 40.00 68.00 112.96 170.46 131.94
idea004 design002 20 83.68 43.48 70.42 112.32 168.08 130.72
idea004 design003 20 86.00 47.72 73.37 113.93 167.65 131.66
idea004 design004 20 84.00 43.20 70.54 112.84 171.75 132.28
idea004 design005 20 85.27 46.13 72.36 112.53 170.18 131.56
idea004 design006 20 87.25 49.72 74.87 114.13 167.98 131.90
idea005 design001 20 99.33 59.11 86.06 123.82 116.50 121.40
idea005 design002 20 98.68 65.97 87.89 125.62 175.52 142.09
idea005 design003 20 99.39 71.38 90.15 127.32 184.14 146.07
idea006 design001 20 110.36 169.62 129.92 128.90 270.10 175.49
idea006 design002 20 102.51 76.62 93.97 126.03 176.85 142.80
idea006 design003 20 105.68 81.65 97.75 126.16 170.97 140.95
idea006 design004 20 101.59 72.46 91.98 127.40 174.91 143.07
idea006 design005 20 112.40 175.79 133.32 128.01 274.73 176.43
idea006 design006 20 111.68 173.35 132.03 124.24 265.31 170.79
idea007 design001 20 104.64 72.60 94.07 129.69 138.57 132.62
idea007 design002 20 106.71 75.07 96.27 132.68 139.69 134.99
idea007 design003 20 107.75 77.27 97.69 132.79 139.24 134.91
idea008 design001 20 98.98 55.64 84.68 122.60 103.72 116.37
idea008 design002 20 99.32 56.87 85.31 122.45 111.30 118.77
idea008 design003 20 98.34 52.64 83.26 121.02 93.68 112.00
idea008 design004 20 98.64 53.68 83.81 120.80 94.43 112.10
idea009 design001 20 84.83 43.29 71.12 112.99 168.68 131.37
idea009 design002 20 81.23 42.89 68.58 112.34 166.95 130.36
idea009 design003 20 82.11 38.59 67.75 113.07 171.19 132.25
idea009 design004 20 83.95 44.11 70.80 113.38 168.45 131.55
idea009 design005 20 82.94 38.60 68.31 113.41 172.84 133.02
idea010 design001 20 82.29 44.82 69.93 112.15 162.86 128.88
idea010 design002 20 84.60 43.57 71.06 114.95 167.42 132.27
idea010 design003 20 83.01 42.74 69.72 112.36 165.67 129.95
idea010 design004 20 83.88 44.25 70.80 111.45 167.62 129.98
idea010 design005 20 89.55 44.98 74.84 121.55 173.04 138.54
idea011 design001 20 83.28 38.44 68.48 109.93 94.19 104.74
idea011 design002 20 85.04 41.17 70.56 110.64 99.52 106.97
idea011 design003 20 84.95 41.48 70.60 111.26 105.81 109.46
idea011 design004 20 82.58 38.83 68.14 110.06 110.79 110.30
idea012 design001 20 92.84 51.29 79.13 115.23 168.40 132.78
idea012 design002 20 82.00 42.34 68.91 112.48 169.56 131.32
idea012 design003 20 91.95 56.36 80.21 117.86 174.85 136.67
idea012 design004 20 84.19 43.95 70.91 113.75 170.60 132.51
idea012 design005 20 100.07 62.08 87.53 120.95 171.55 137.65
idea013 design001 20 83.37 45.18 70.76 112.85 166.58 130.58
idea013 design002 20 88.07 44.75 73.77 116.61 169.16 133.95
idea013 design003 20 83.03 43.63 70.03 112.99 167.29 130.91
idea013 design004 20 82.41 44.92 70.04 112.63 168.18 130.96
idea014 design001 20 94.50 54.53 81.31 125.05 114.15 121.45
idea014 design002 20 79.62 36.96 65.54 108.04 97.07 104.42
idea014 design003 20 76.82 35.35 63.13 106.85 96.73 103.51
idea015 design001 20 79.46 37.31 65.55 107.85 89.95 101.94
idea015 design002 6 129.78 121.00 126.88 130.43 170.78 143.74
idea015 design003 5 223.40 346.92 264.16 184.63 320.77 229.55
idea015 design004 20 71.75 35.73 59.86 102.51 91.62 98.92
idea016 design001 20 111.25 46.59 89.91 211.37 116.61 180.10
idea016 design002 20 109.00 44.53 87.72 209.73 115.56 178.65
idea016 design003 6 365.69 149.59 294.38 415.61 173.53 335.72
idea016 design004 20 111.44 46.09 89.88 210.25 116.77 179.40
idea017 design002 5 134.91 136.34 135.38 133.80 196.90 154.62
idea017 design003 5 143.35 152.74 146.45 150.79 200.25 167.11
idea017 design004 5 145.32 159.17 149.89 149.53 204.51 167.67
idea018 design001 5 143.12 153.27 146.47 198.05 242.18 212.62
idea018 design002 5 143.12 153.27 146.47 133.24 179.53 148.52
idea018 design003 5 143.12 153.27 146.47 144.91 219.98 169.68
idea018 design004 5 143.12 153.27 146.47 198.05 242.18 212.62
idea019 design001 20 76.56 36.94 63.49 106.26 96.61 103.07
idea019 design002 20 77.49 37.97 64.45 105.77 96.93 102.85
idea019 design003 20 77.66 37.51 64.41 106.81 96.77 103.49
idea019 design004 20 78.48 37.43 64.94 106.29 93.94 102.22
idea019 design005 20 78.83 38.60 65.55 107.62 104.37 106.55
idea020 design001 20 73.05 36.41 60.96 103.98 97.68 101.90
idea020 design002 20 75.91 35.11 62.44 105.78 91.92 101.21
idea020 design003 20 71.87 35.93 60.01 102.90 92.37 99.42
idea020 design004 20 69.27 35.60 58.16 103.58 92.72 99.99
idea020 design005 5 159.09 177.99 165.33 149.22 207.17 168.34
idea021 design001 20 71.30 35.76 59.57 102.05 91.72 98.64
idea021 design002 20 70.35 35.99 59.01 104.35 93.43 100.75
idea021 design003 20 73.31 36.39 61.13 103.68 96.71 101.38
idea021 design004 20 69.76 35.57 58.48 103.07 92.25 99.50

Ideas & Designs

idea001: RGB-D Modality Fusion Strategy
Status: Done
# RGB-D Modality Fusion Strategy

**Expected Designs:** 3

**Concept:** 
The Sapiens baseline uses 'early fusion' by modifying the first patch embedding layer for 4-channel input. This potentially dis...
View Full Idea & Designs
idea002: Kinematic Attention Masking
Status: Done
# Kinematic Attention Masking

**Expected Designs:** 3

**Concept:** 
Human pose estimation models often predict physically impossible poses because the attention mechanism lacks explicit structural c...
View Full Idea & Designs
idea003: Curriculum-Based Loss Weighting
Status: Done
# Curriculum-Based Loss Weighting

**Expected Designs:** 2

**Concept:** 
Absolute depth is hard and creates noisy gradients early on. It needs a learned or structured loss weighting over epochs to st...
View Full Idea & Designs
idea004: Layer-Wise Learning Rate Decay & Progressive Unfreezing
Status: Done
# Layer-Wise Learning Rate Decay & Progressive Unfreezing

**Expected Designs:** 6

**Concept:** 
Use structure in how the backbone learns to prevent catastrophic forgetting of the ViT's rich pre-trai...
View Full Idea & Designs
idea005: Depth-Aware Positional Embeddings
Status: Done
# Depth-Aware Positional Embeddings

**Expected Designs:** 3

**Concept:** 
Provide explicit geometric awareness to the Transformer, which currently only uses standard 2D positional encodings. Inject ...
View Full Idea & Designs
idea006: Training Data Augmentation for Generalization
Status: Done
# idea006 — Training Data Augmentation for Generalization

**Expected Designs:** 6

**Baseline starting point:** `baseline.py` (equivalently `baseline/train.py`, `baseline/model.py`, `baseline/transfo...
View Full Idea & Designs
idea007: Depth-Bucket Positional Embeddings with Layer-Wise Fine-Tuning
Status: Done
# Depth-Bucket Positional Embeddings with Layer-Wise Fine-Tuning

**Expected Designs:** 3

## Starting Point

The baseline starting point for this idea is:

`runs/idea005/design001/code/`

That design...
View Full Idea & Designs
idea008: Continuous Depth Positional Encoding
Status: Done
# Continuous Depth Positional Encoding

**Expected Designs:** 4

## Starting Point

The baseline starting point for this idea is:

`runs/idea005/design001/code/`

That design delivered the best comple...
View Full Idea & Designs
idea009: Head Architecture Refinement
Status: Done
# Head Architecture Refinement: Query Initialization, Depth of Decoder, and Output Normalization

**Expected Designs:** 5

## Starting Point

The baseline starting point for this idea is:

`runs/idea0...
View Full Idea & Designs
idea010: Multi-Scale Backbone Feature Aggregation
Status: Done
# idea010 — Multi-Scale Backbone Feature Aggregation

**Expected Designs:** 5

## Starting Point

The baseline starting point for this idea is:

`runs/idea004/design002/train.py`

That design produced...
View Full Idea & Designs
idea011: LLRD with Continuous Depth PE
Status: Done
# idea011 — LLRD Schedule Combined with Continuous Depth PE

**Expected Designs:** 4

## Starting Point

The baseline starting point for this idea is:

`runs/idea008/design003/code/`

That design prod...
View Full Idea & Designs
idea012: Regularization for Generalization
Status: Done
# idea012 — Regularization for Generalization

**Expected Designs:** 5

## Starting Point

The baseline starting point for this idea is:

`runs/idea004/design002/train.py`

That design produced the be...
View Full Idea & Designs
idea013: Joint Prediction Loss Reformulation
Status: Done
# idea013 — Joint Prediction Loss Reformulation

**Expected Designs:** 4

## Starting Point

The baseline starting point for this idea is:

`runs/idea004/design002/train.py`

That design produced the ...
View Full Idea & Designs
idea014: Best-of-Breed Combination: LLRD + Depth PE + Wide Head
Status: Done
# idea014 -- Best-of-Breed Combination: LLRD + Depth PE + Wide Head

**Expected Designs:** 3

## Starting Point

The baseline starting point for this idea is:

`runs/idea008/design003/code/`

That des...
View Full Idea & Designs
idea015: Iterative Refinement Decoder
Status: Done
# idea015 -- Iterative Refinement Decoder on SOTA Triple Combo

**Expected Designs:** 4

## Starting Point

The baseline starting point for this idea is:

`runs/idea014/design003/code/`

That design i...
View Full Idea & Designs
idea016: 2.5D Heatmap Soft-Argmax
Status: Done
# idea016 -- 2.5D Heatmap Representation with Soft-Argmax Decoding

**Expected Designs:** 4

## Starting Point

The baseline starting point for this idea is:

`runs/idea014/design003/code/`

Current S...
View Full Idea & Designs
idea017: Temporal Adjacent-Frame Fusion
Status: Done
# idea017 -- Temporal Context via Adjacent-Frame Fusion

**Expected Designs:** 4

## Starting Point

The baseline starting point for this idea is:

`runs/idea014/design003/code/`

Current SOTA: val_mp...
View Full Idea & Designs
idea018: Weight Averaging: EMA and SWA on SOTA Triple-Combo
Status: Done
# idea018 — Weight Averaging: EMA and SWA on the SOTA Triple-Combo

**Expected Designs:** 4

## Baseline starting point
`runs/idea014/design003/code/` (current SOTA: 106.85 mm val_mpjpe_body, 96.73 mm...
View Full Idea & Designs
idea019: Anatomical Structure Priors for Iterative Refinement
Status: Done
# idea019 -- Anatomical Structure Priors for Iterative Refinement

**Expected Designs:** 5

## Starting Point

The baseline starting point for this idea is:

`runs/idea015/design001/code/`

That desig...
View Full Idea & Designs
idea020: Refinement-Specific Loss and Gradient Strategy
Status: Training
# idea020 -- Refinement-Specific Loss and Gradient Strategy

**Expected Designs:** 5

## Starting Point

The baseline starting point for this idea is:

`runs/idea015/design004/code/`

That design is t...
View Full Idea & Designs
idea021: Anatomical Priors on Two-Decoder SOTA
Status: Done
# idea021 -- Anatomical Priors on the Two-Decoder SOTA

**Expected Designs:** 4

## Starting Point

The baseline starting point for this idea is:

`runs/idea015/design004/code/`

That design is the cu...
View Full Idea & Designs