LLM Post-Training as Brownfield Maintenance: An Industrial Perspective on Dataware Engineering
Gopi Krishnan Rajbahadur, Amir M. Ebrahimi, Boyuan Chen, Ahmed E. Hassan · Read the paper
Hook: The paper argues that improving a deployed LLM may depend as much on engineering its training data mixture as on selecting a post-training recipe.
Summary: The paper presents industrial LLM post-training as brownfield maintenance: teams update a deployed checkpoint through bounded changes to a curated training mixture rather than retraining from scratch. It identifies zero-sum mixture design, yield as a binding metric, and end-to-end integration under uncertainty as recurring challenges in code-generation improvement.
Industry impact: In the paper's case study, improving the conversion of teacher distillation into usable training data increased accepted supervision by 2.84 times while keeping the same solution teacher and four solution attempts per candidate problem. The reported patch improved CodeForces pass@1 by 2.59 points and pass@3 by 3.11 points, while held-out LiveCodeBench v6 pass@1 rose by 6.11 points and pass@3 by 8.05 points.
Potential implications: The results suggest that teams maintaining deployed checkpoints may benefit from treating post-training mixtures as dataware artifacts that require disciplined, bounded updates. The paper reports that these gains were statistically significant across 16 stochastic evaluations per benchmark and that internal AIME and MATH regression suites remained within tolerance, but its conclusions are based on one fixed checkpoint per condition.
One note in three: a verified census of three deployed AI scribes, and the instrument that counted it
Sebastian Fox, Luke Markham, Ryan Lail, Michael Karotsieris · Read the paper
Hook: The paper argues that measuring AI-scribe failures depends substantially on how the review instrument defines and verifies an error.
Summary: The paper reports an audit of three commercial ambient AI scribes using 565 notes from 142 UK primary-care and US ambulatory consultations, along with authored scenarios. It found that 31.3% of notes carried a verified failure, with errors concentrated in allergy and medication information, invented patient identity, and histories recorded as examinations during telephone consultations.
Industry impact: The reported findings indicate that clinical AI-scribe evaluations can produce substantially different failure rates depending on review instructions, reviewing models, and standards, with sampled rates ranging from 28% to 97%. The authors also report that no product was given a patient record and that, after excluding two error classes a record might have prefilled, the failure rate was 24.8%.
Potential implications: For organizations assessing or deploying AI scribes, the paper highlights the importance of specifying review criteria, documenting model and prompt versions, and examining evidence for each reported failure. The authors release 618 findings with transcript-side evidence and a rerunnable pipeline, enabling others to inspect and reproduce the reported audit.
Learning-Assisted Congestion-Aware Route Scheduling for Semiconductor Fab Material Control Systems
Hao Yin, Meiqi Tu, Anbang Liu, Shaochong Lin, Max Z. J. Shen · Read the paper
Hook: The paper treats route planning as both a delivery-time prediction problem and a congestion-risk management problem.
Summary: Semiconductor-fab material control systems must choose relay routes online, where queueing at heterogeneous and partly observable equipment can dominate delivery time. The paper proposes a transport-network-aware congestion representation that supports separate time predictions and calibrated congestion-risk estimates, then uses them in a risk-constrained route-scheduling rule.
Industry impact: In a controlled closed-loop evaluation, the authors report a 16.4% reduction in mean delivery time and a 22.6% reduction in internal resource waiting time. Throughput remained essentially unchanged in that evaluation, suggesting that the reported gains came from improved routing and congestion management rather than increased production flow.
Potential implications: The method emphasizes using only information available before each prediction moment, which is important for avoiding look-ahead in online scheduling. Its decision model also shows how learned predictions can be combined with an operations-research constraint on extreme-congestion probability.
DASC: Decay-Aware State Compression for Hybrid Linear-Attention Serving
Yanqi Yu, Pingwei Sun, Jianchao Tan, Tao Zhang, Yuchen Xie, Xunliang Cai, Yao Liu · Read the paper
Hook: DASC treats recurrent-state checkpoints as information with different retention horizons rather than uniformly valuable cache contents.
Summary: The paper introduces Decay-Aware State Compression (DASC), a method for compressing persistent recurrent-state checkpoints in hybrid linear-attention serving by selecting state units with longer retention horizons and packing them into a ragged layout. On Kimi-Linear, the authors report that conservative configurations compress KDA state checkpoints by 2.63× while staying close to full caching, and under fixed memory budgets reduce mean TTFT by 42.6% and increase input throughput by 68.4%.
Industry impact: For inference systems using hybrid linear attention, the approach targets the memory pressure caused by storing state checkpoints alongside full-attention KV caches, which can otherwise increase evictions and repeated prefill. The paper reports that balancing compressed checkpoints across tensor-parallel ranks enables higher cache capacity, lower mean TTFT, and higher input throughput on the evaluated Kimi-Linear workloads.
Potential implications: The results suggest that checkpoint compression can trade memory savings against either omitted-state accuracy effects or additional replay computation through bounded-suffix refresh. The paper also reports a similar quality-efficiency trend for Qwen with Gated DeltaNet, indicating that the method is not limited to channel-wise Kimi Delta Attention state compression.
The Differential Reasoning Router: Operationalizing Cost-Aware LLM Annotation in E-commerce
Cheng Lyu, Jingyue Zhang, Vinny DeGenova, Mengwei Li, Yuanli Pei · Read the paper
Hook: Instead of using a reasoning model as a default fallback, the framework treats reasoning and human review as selectively allocated resources.
Summary: The paper introduces the Differential Reasoning Router, a cost-aware framework for routing e-commerce annotation tasks among direct models, reasoning models, and human reviewers. It estimates success probabilities at both the item and business-rule levels to reserve expensive reasoning and human review for cases where they are most useful.
Industry impact: The approach targets cold-start workflows in which structured product data must satisfy multiple business rules but only limited pre-launch labels are available. In a production e-commerce workflow, the paper reports accuracy parity with the strongest confidence-based router while reducing reasoning-token costs by more than 60%.
Potential implications: The resulting labels can support prompt engineering, supervised fine-tuning, calibration, and refinement of business rules during gradual automation. Teams adopting similar workflows would still need to manage ambiguous rule boundaries, model errors, and cases that require human escalation.
