Murtadha hamid's picture

Murtadha hamid PRO

murtadha9
1 4

AI & ML interests

Building applied AI systems: models, data pipelines, and monitoring & analysis tooling across text, speech, and vision โ€” with a focus on Arabic and the Iraqi dialect

Recent Activity

reacted to savoji's post with ๐Ÿ”ฅ 2 days ago
One Qwen3-VL-8B checkpoint improves all three streaming spatial benchmarks at once: OST-Bench 50.52 to 63.93 (+13.41), UCS-Bench +7.44, OVO-S-Bench +4.91. The change is in the supervision, with no new memory module or annotation. The ChronoReplay paper calls the failure mode interface lock-in: post-train on one answer format and that readout improves while others stall. A categorical-only control hits 58.03 on OVO-S but drops OST from 50.52 to 47.48. ๐Ÿ” The recipe โ€ข Keep targets in native formats (option, metric value with units, timestamp) โ€ข Replay episodes in source order, each target attached to its causal prefix โ€ข Loss mass: 2/3 on 33,180 single-turn examples, 1/3 on 6,381 episodes (alpha = 0.5) ๐Ÿ“Š The numbers โ€ข Three-benchmark mean 56.86, against 50.74 (categorical-only) and 50.76 (trajectory-only) โ€ข Chronological order beats a shifted-order control by about 2.41 OST points on two seeds; the 13.41 belongs to the whole recipe โ€ข Adaptive frame selection adds +4.09 on OVO-S (57.98) with 80.50 frames instead of 128 โš ๏ธ Caveats โ€ข One backbone, indoor scenes only; the single-family comparison is confounded by data coverage โ€ข The repo has a CPU smoke test and a --dry-run training command, but no license and no fine-tuned weights https://huggingface.co/papers/2610.34283 https://arxiv.org/abs/2610.34283 https://github.com/yihaohu0118/ChronoReplay If you fine-tune VLMs for embodied work, do you score categorical, metric and temporal readouts together? ๐Ÿ“š Read it elsewhere โ€ข The deep dive on Medium: https://medium.com/p/8d2fb1bf832d โ€ข The long read on Substack: https://sajjadpakdamansavoji.substack.com/p/chronoreplay-lifts-qwen3-vl-8b-by โ€ข The thread on X: https://x.com/saavoji/status/2116229682844877156 โ€ข Every version on sajjadpsavoji.github.io: https://sajjadpsavoji.github.io/blog#chronoreplay
View all activity

Organizations

None yet