Qwen25 Multi-Task Dynamics: Qwen2.5 1.5B

Back to hub · results · analysis

Note

This is an observational dynamics deep-dive for qwen25_15b. This page uses final-test metrics for ranking because final metrics are available.

Selection

Rows are ranked by within-task matched router score, computed as within-task router probe times strategy-match rate. The selected row is dist_plus_tokcc_a0p25_w0p05_tokcc0p95_b0p01_lin100 with score 0.9167 from final_test.

selectedcollection_labelcontinuous_latent_dimloss_settinganalysis_statusmetric_sourcematched_router_scorefinal_answer_accuracywithin_task_router_probeall_task_router_probestrategy_match_rateposterior_probereconstruction_losskl_prior_losslatest_global_step
selected1.5B paper grid z6464dist_plus_tokcc_a0p25_w0p05_tokcc0p95_b0p01_lin100complete_finalfinal_test0.91670.99410.93230.21130.98320.99010.00072.09671563
1.5B paper grid z6464tokcc_a0p25_b0p1_lin100complete_finalfinal_test0.88450.99250.90840.21250.97370.97650.62431.46811563
ratio/tokinv follow-up z6464dist_plus_tokcc_a0p25_w0p75_tokcc0p25_b0p01_lin100complete_finalfinal_test0.88230.99510.8910.21280.99020.97770.00611.76111563
1.5B paper grid z6464dist_norm_b0p01_lin100complete_finalfinal_test0.80860.99580.81440.21380.99290.96410.00391.82631563
ratio/tokinv follow-up z6464dist_plus_tokcc_a0p25_w0p5_tokcc0p5_b0p01_lin100complete_finalfinal_test0.80490.99560.81010.20690.99360.97320.01361.24041563
ratio/tokinv follow-up z6464dist0p25_tokcc0p75_a0p25_b0p01_lin100complete_finalfinal_test0.69580.99870.69750.16470.99760.94740.01482.07361563
raw beta baseline z6464raw_b0p01_constcomplete_finalfinal_test0.69070.99930.69120.13410.99930.72740.0320.01241563
1.5B paper grid z6464dist_plus_tokcc_a0p25_w0p05_tokcc0p95_b0p1_lin100complete_finalfinal_test0.68720.99910.68790.13490.99890.76920.0320.00681563
raw beta baseline z6464raw_b1_constcomplete_finalfinal_test0.68610.99930.68660.12940.99930.68090.0320.01211563
1.5B paper grid z6464tokcc_a0p25_b0p01_lin100complete_finalfinal_test0.68510.99850.68680.13670.99740.80010.63860.01791563
raw beta baseline z6464raw_b1_lin100complete_finalfinal_test0.68350.99940.68390.1360.99940.67930.0320.03081563
raw beta baseline z6464raw_b0p1_constcomplete_finalfinal_test0.67370.99940.67410.13090.99940.69890.0320.02231563
ratio/tokinv follow-up z6464tokinv_a1_eps1em8_b0p01_lin100complete_finalfinal_test0.62840.99370.63410.13570.9910.79930.57231.63281563
1.5B paper grid z6464dist_norm_b0p1_lin100complete_finalfinal_test0.58440.99940.58470.13330.99940.85430.0320.00661563
1.5B paper grid z6464raw_b0p1_lin100complete_finalfinal_test0.56890.99950.56920.12830.99950.67940.0320.01221563
1.5B paper grid z6464raw_b0p01_lin100complete_finalfinal_test0.55660.99940.55690.12390.99940.74180.0320.00681563

Validation Dynamics

The validation dynamics panel plots final-answer accuracy, matched router score, within-task router probe, all-task router probe, strategy-match rate, posterior-mu probe, reconstruction loss, and KL prior by epoch progress for each available run directory.

Validation dynamics for Qwen2.5 1.5B

Router-Sampled Z-Space

Router-sampled z-space PCA animation for Qwen2.5 1.5B Selected Router-sampled z-space PCA animation frames for Qwen2.5 1.5B

Task-separated view: GIF columns are effective tasks; frame rows are effective tasks.

Task-separated Router-sampled z-space PCA animation for Qwen2.5 1.5B Task-separated Router-sampled z-space PCA animation frames for Qwen2.5 1.5B

Source frame stream: path:.runs/synthetic_sequences/disentangled/synthetic-pretrained-disentangled-from-entangled-v2-paper-method-grid-multi-task-z64-qwen25-15b/task-multi_task_src-ent-qwen25-1-5b_adapt-lora_lt-continuous_loss-recon-dist-0p05-tokcc-0p95_beta-0p01_h5b23e54d90e0b933_s314159/continuous_val_router_sampled_z_frames.jsonl

Posterior-Mu Z-Space

Posterior-mu z-space PCA animation for Qwen2.5 1.5B Smoothed Posterior-mu z-space PCA animation for Qwen2.5 1.5B Selected Posterior-mu z-space PCA animation frames for Qwen2.5 1.5B

Task-separated view: GIF columns are effective tasks; frame rows are effective tasks.

Task-separated Posterior-mu z-space PCA animation for Qwen2.5 1.5B Smoothed task-separated Posterior-mu z-space PCA animation for Qwen2.5 1.5B Task-separated Posterior-mu z-space PCA animation frames for Qwen2.5 1.5B

Source frame stream: path:.runs/synthetic_sequences/disentangled/synthetic-pretrained-disentangled-from-entangled-v2-paper-method-grid-multi-task-z64-qwen25-15b/task-multi_task_src-ent-qwen25-1-5b_adapt-lora_lt-continuous_loss-recon-dist-0p05-tokcc-0p95_beta-0p01_h5b23e54d90e0b933_s314159/continuous_val_posterior_mu_frames.jsonl

Run-Level Notes

The selected run directory is path:.runs/synthetic_sequences/disentangled/synthetic-pretrained-disentangled-from-entangled-v2-paper-method-grid-multi-task-z64-qwen25-15b/task-multi_task_src-ent-qwen25-1-5b_adapt-lora_lt-continuous_loss-recon-dist-0p05-tokcc-0p95_beta-0p01_h5b23e54d90e0b933_s314159. The data backing this page are in path:experiments/synthetic_sequences/disentangled/analysis/aggregates/synthetic-pretrained-disentangled-from-entangled-v2-paper-method-grid-multi-task-z64-qwen25_20260501/data/dynamics_qwen25_15b_metrics.csv and path:experiments/synthetic_sequences/disentangled/analysis/aggregates/synthetic-pretrained-disentangled-from-entangled-v2-paper-method-grid-multi-task-z64-qwen25_20260501/data/dynamics_qwen25_15b_eval_history.csv. The generation script is path:experiments/synthetic_sequences/disentangled/analysis/run_qwen25_paper_method_grid_multi_task_z64_20260501.py.

Built with LogoFlowershow