b0.1 norm + twr1 Deep-Dive Results
b0.1 norm + twr1 Deep-Dive Results
This note isolates the within-setting analysis for beta0p1_norm_pv0_twr1, selected under the Apr1 deep-dive rule: keep settings with mean final-answer accuracy at least 0.95, then rank by mean final router-sampled probe accuracy. The current note covers all 18 runs (6 tasks x 3 adaptation modes).
Snapshot
- included runs:
18 - mean final test final-answer accuracy:
0.9891 - mean final test router-sampled probe accuracy:
0.7700 - mean final test posterior-mu probe accuracy:
0.9695 - mean final baseline-normalized reconstruction loss:
0.08884 - mean final validation KL:
1.577 - mean first-eval validation router probe accuracy:
0.5982
Latent-Space Structure Over Training
The fixed-PCA router-sampled latent trajectories are organized by adaptation mode and task rather than pooled across the collection. The animated grid shows how separation develops over the shared training timeline, while the three static frame sheets hold the same view at approximately 2%, 10%, 20%, 50%, and 100% training progress for full, lora, and reinit.
Caption: Fixed-PCA projection of router-sampled latent vectors over training for beta0p1_norm_pv0_twr1. Rows are adaptation modes, columns are tasks, and each panel keeps a run-specific projection basis and axis limits across the full trajectory.
Caption: Selected latent-geometry checkpoints for the full rows.
Caption: Selected latent-geometry checkpoints for the lora rows.
Caption: Selected latent-geometry checkpoints for the reinit rows.
Probe, Reconstruction, And KL Dynamics
The task-wise dynamics plot overlays the three adaptation modes for each task. This makes it easier to see whether the later latent separation comes from router-side probe gains alone or from a broader shift in posterior probe quality, reconstruction, and KL.
Caption: Validation router-probe accuracy, posterior-probe accuracy, baseline-normalized reconstruction loss, and KL over training for beta0p1_norm_pv0_twr1, with one line per adaptation mode inside each task row.
Artifact Availability
Analogical-steering summaries are not present for the live Apr1 runs of this setting, so the deep dive is limited to latent-trajectory and probe/reconstruction dynamics. The matched no-TWR setting beta0p1_norm_pv0_twr0 does have analogical-summary coverage.
