tokcc-hparam-followup-multi-task-z64-qwen25_20260503

Status: running. The collection contains 26 expected training cells split across two slurmkit collections: 13 lafferty H100 reservation jobs and 13 general-cluster jobs.

This report tracks the targeted Qwen2.5 0.5B/1.5B multi-task z64 TOK-CC hyperparameter follow-up. The collection tests whether the weak 1.5B pure tokcc_a0p25_b0p01_lin100 recovery in the paper-method grid is seed noise, beta sensitivity, alpha sensitivity, or evidence that a small distribution-normalized component stabilizes TOK-CC recovery.

Links

• design
• results
• analysis

Artifacts

• Lafferty H100 slurmkit collection: path:.slurmkit/collections/synthetic-pretrained/disentanglement/from-entangled-v2/tokcc-hparam-followup-multi-task-z64-qwen25-lafferty-h100.yaml
• General-cluster slurmkit collection: path:.slurmkit/collections/synthetic-pretrained/disentanglement/from-entangled-v2/tokcc-hparam-followup-multi-task-z64-qwen25-general.yaml
• Lafferty H100 spec: path:experiments/synthetic_sequences/slurm/families/disentangled_from_entangled/specs/continuous_from_entangled_v2_tokcc_hparam_followup_multi_task_z64_qwen25_lafferty_h100.yaml
• General-cluster spec: path:experiments/synthetic_sequences/slurm/families/disentangled_from_entangled/specs/continuous_from_entangled_v2_tokcc_hparam_followup_multi_task_z64_qwen25_general.yaml
• Parse hook: path:experiments/synthetic_sequences/slurm/families/disentangled_from_entangled/params_from_entangled_v2_tokcc_hparam_followup.py

Context

• Parent Qwen2.5 multi-task paper-method report: paper-method grid results
• TOK-CC/dist-weight follow-up note inside the parent report: TOK-CC/dist-weight sweep
• Method note for the TOK-CC objective family: normalized concentration-corrected token-weighted reconstruction

Runs

• Slurmkit collections: synthetic-pretrained/disentanglement/from-entangled-v2/tokcc-hparam-followup-multi-task-z64-qwen25-lafferty-h100; synthetic-pretrained/disentanglement/from-entangled-v2/tokcc-hparam-followup-multi-task-z64-qwen25-general
• Shared run artifact collection: synthetic-pretrained-disentangled-from-entangled-v2-tokcc-hparam-followup-multi-task-z64-qwen25
• Submitted: 2026-05-03
• Planned cells: 26 total; 12 Qwen2.5 0.5B and 14 Qwen2.5 1.5B.