← Nathan Bosch
← latest·

2026-08-24

Daily Digest

AI & LLMs

Today’s research solidifies a shift from monolithic model advancement toward a production-centric discipline: the focus is on building reliable, distributed, and resource-efficient systems at the inference layer. We see distillation and architecture design must now account for origin relationships and hardware constraints, while advancements in distributed inference, dynamic safety routing, and multi-agent graph engineering treat the LLM as a component within a larger, engineered pipeline—a direct parallel to industrial AI in domains like drug discovery.

Every Coin Has Two Sides: On the Dual Nature of Generalization in On-Policy Distillation of Large Language Models

Zhaoyi Li, Deyang Kong, Yuan Wei, Evan Yang · hf_daily_papers

On-policy distillation transfers a teacher's reasoning behavior, not its correct answers — even unsolved problems are useful. The critical factor is the origin relationship between teacher and student: same-origin pairs generalize across languages, reasoning horizons, and domains, while cross-origin pairs mostly just fit the training distribution. This makes multi-teacher OPD tricky — routing to domain experts doesn't contain each teacher's influence, causing a seesaw among their capabilities. For anyone training student models via distillation, this means careful selection of teacher origin matters more than the teacher's raw performance.

Daedalus-150M: A Convolution-Attention Hybrid Designed for CPU Inference

Christos Koutsiaris · hf_daily_papers

Daedalus-150M flips the typical approach: rather than designing a large model and compressing it for CPU, they fixed CPU inference as the target and optimized the architecture from scratch. Only 6 of 18 blocks use attention; the rest rely on short convolutions that don't grow with sequence length, so memory and compute scale linearly. Trained on just 59.9B tokens, it outperforms GPT-2 124M, Pythia-160M, and OPT-125M — all trained on 3-6x more data — and scores higher than MobileLLM-125M (trained on 1T tokens). On CPU at 2048-token context, it decodes 1.76x faster than a standard all-attention model of the same size, and the speed advantage grows with longer contexts as predicted. The paper also candidly reports what didn't work: naive 4-bit quantization degrades quality, roughly half the convolution channels become inert, and the vocabulary is oversized for the model. The key takeaway is that co-designing architecture with deployment constraints (CPU, latency, quantization) can yield Pareto improvements over generic designs, even with far less training data. That's directly relevant to anyone building production ML systems where inference cost or CPU fallback matters.

28 TPS on Qwen2.5-7B across two separate cloud regions over public WAN using speculative decoding + CUDA Graphs [P]

reddit_ml

ShardFlow demonstrates a critical advance for distributed LLM inference: by pairing speculative decoding with CUDA Graphs, draft generation latency dropped from 112ms to 25ms, enabling 28 TPS on Qwen2.5-7B across two GCP regions with ~86ms RTT. The key insight is that speculative decoding transforms WAN latency from a per-token bottleneck into a per-round cost, and CUDA Graphs eliminate Python kernel launch overhead (which had GPU idle 65% of the time). This approach makes multi-region inference practical without specialized hardware — directly applicable to any scenario needing low-latency LLM serving across geographies, including drug discovery workflows that might run models across distributed compute.

Llama-Mobile: Efficient 2.7-Bit Quantization of VLMs

Luka Ribar, Jeevan Bhoot, Douglas Orr · hf_daily_papers

Quantizing VLMs to sub-3-bit precision typically requires access to training data and produces models that fall apart on multimodal tasks. This work shows you can get to 2.7-bit without any training data — the model itself generates the calibration set — and still run on Arm CPUs with 8-bit activations. The Llama 3.2 11B Vision model drops to 3.7 GB while holding up on standard VQA benchmarks. The practical implication: mobile/edge deployment of vision-language models is no longer bottlenecked by memory or proprietary training data access. For anyone building on-device multimodal agents or needing compressed models for constrained environments, this removes a major blocker. Worth watching whether the data-free calibration trick transfers to other modalities and model families.

CLEAR: Continuous Latent Adapter Routing for Utility-Preserving LLM Safety Alignment

Chengxiao Wang, Enyi Jiang, Xiaojing Liao, Sanmi Koyejo · hf_daily_papers

CLEAR introduces a conditional gating mechanism that dynamically activates a safety LoRA adapter only when needed, preserving the base model’s utility on benign inputs while drastically reducing harmful outputs. On Llama-3-8B-Instruct, it cut HarmBench attack success rate from 32.3% to 0.5% and actually improved GSM8K accuracy by up to 7.1 points over standard safety tuning. This is a practical alignment technique that avoids the common utility-safety trade-off — relevant if you're deploying LLMs in regulated domains like drug discovery where you need both robust safety guardrails and maximal model capability on legitimate scientific queries.

Let's Scale Step by Step: Compute-Efficient Hyperparameter Transfer for Large-Scale Mixture-of-Experts

Nayeon Kim, Hojin Lee, Yunju Bak, Jaesun Park · hf_daily_papers

A new two-step framework enables compute-efficient hyperparameter transfer for large-scale Mixture-of-Experts (MoE) models. By adapting Maximal Update Parameterization (μP) for MoE with Multi-head Latent Attention and Muon optimizer, optimal learning rates transfer consistently across model width. The method then extrapolates to trillion-token horizons using a predictive scaling law (R²=0.95). This means you can determine the optimal learning rate for a 155B-parameter MoE model trained on 10 trillion tokens by running cheap proxy experiments on small models, eliminating the need for expensive full-scale hyperparameter sweeps. For anyone training large MoEs—like those in frontier AI or drug discovery models—this directly reduces pretraining costs and speeds up experimentation.

EviRank: Structured Relevance Evidence for Multimodal Image Re-ranking

Enjun Du, Siyi Liu, Zirong Chen, Xinyu Zuo · hf_daily_papers

EviRank introduces a training-free, evidence-driven approach to multimodal image re-ranking that could meaningfully improve how AI handles compositional queries in geospatial or drug discovery contexts. Instead of compressing query constraints into a black-box embedding or relying on error-prone chain-of-thought, it decomposes any query—text, image, or composed—into six typed semantic slots (entities, attributes, relations, each marked required/forbidden/ignorable) and uses rubric scoring plus listwise comparison for re-ranking. For someone building production ML systems, the key takeaway is: this provides a structured, interpretable way to enforce fine-grained constraints at inference time without retraining, and the distilled student retains 90%+ performance at lower cost. If you ever need to re-rank molecular images by structural features or geospatial scenes by compositional attributes, this framework could slot directly into your inference pipeline.

Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence

Yuyuan Feng, Zhishang Xiang, Chaobin Yang, Qichao Ma · hf_daily_papers

LLM agent systems are hitting a fundamental ceiling: individual intelligence can't scale to tasks requiring heterogeneous expertise, parallel execution, or persistent state. The emerging solution is Graph Engineering — constructing explicit, dynamic graph structures that organize tasks, agents, and system state into a coherent whole. This shifts the focus from optimizing one agent's capabilities to designing system-level coordination, effectively turning agent collections into engineered distributed systems. For anyone building multi-agent architectures or platform-level ML infrastructure, this is a framing that maps directly onto real engineering challenges.

Beyond Correctness: Benchmarking and Aligning Response Behaviors in Hybrid-Thinking MLLMs

Xinming Wang, Weinong Wang, Hongming Yang, Yansong Lin · hf_daily_papers

Hybrid-thinking MLLMs (switching between deliberative reasoning and fast non-thinking inference) suffer from systematic misalignment: non-thinking mode shows significantly higher failure rates in chain-of-thought leakage, repetition, logical contradictions, and performative reasoning, even when task accuracy is similar. The authors introduce PatternEval (a 2,415-prompt diagnostic benchmark) and PatternRL (response-level reward model with pattern-specific penalties) that reduces cross-mode misalignment on Qwen3-VL models with minimal accuracy trade-off. For ML engineers working on inference efficiency or alignment, this highlights that correctness alone masks brittle response behaviors in production—and provides a concrete training framework to enforce consistent user-facing behavior across latency tiers.

AgentMercury: Your Agent Can Synthesize Verifiable Environments for Business Scenarios at scale

Minbyul Jeong, Chanwoong Yoon · hf_daily_papers

AgentMercury introduces a scalable method to automatically generate executable environments from business scenarios, producing nearly 5,000 environments across diverse industries. Training agents via RL on these synthetic worlds leads to substantial performance gains not just on enterprise benchmarks but also on out-of-domain evaluations like AIME26 (a math reasoning test) — Qwen3.5-4B improved from 45.9 to 56.0. This suggests that rich, scenario-grounded simulation environments can serve as a powerful, generalizable training substrate, potentially reducing the need for hand-crafted benchmarks. For anyone building AI systems that must interact with complex, real-world workflows (including drug discovery pipelines), this approach could enable more robust agent behavior without task-specific reward engineering.

Pharma & Drug Discovery

Today’s developments underscore a trend toward using novel data sources and computational methods to uncover previously invisible biological vulnerabilities, from cell state dynamics to viral dark matter. The common thread is the increasing reliance on scalable, unbiased analysis—de novo peptide sequencing, methylation arrays, microbial classification—to generate the biological insights that can feed target identification pipelines. For AI-driven discovery, the value lies in translating these emergent datasets into predictive models for patient stratification, therapeutic mechanisms, or entirely new target classes.

Microtubule regulation in cancer cells

Alex Matov · openalex

Drug-resistant tumors exhibit specific changes in microtubule dynamics regulation that create exploitable cell state vulnerabilities. Measuring and modeling these dynamics can reveal susceptibility to particular drug regimens and offer a strategy to overcome resistance. This connects directly to AI-driven drug discovery: ML models that characterize microtubule regulation from patient cells could identify which vulnerabilities are targetable, potentially improving therapy success rates.

Discovery and Validation of Non-canonical Antigens for Hepatocellular Carcinoma Immunotherapy

Stephen Li, Yujuan Dong, Jiaxun Liu, Shanglin Li · openalex

A study on hepatocellular carcinoma identified twelve non-canonical peptides from cryptic translation of non-canonical open reading frames, with four showing tumor-enriched expression and one (p2) demonstrating strong predicted MHC and TCR binding affinity. The work links ribosome recruitment and m6A modifications to translation initiation of these antigens, opening new immunotherapy targets. For Isomorphic Labs, this underscores the value of integrating long-read RNA-seq, mass spectrometry, and binding predictions to discover novel, druggable epitopes—a pipeline where ML models for peptide-MHC affinity and translation dynamics could be directly applied or refined.

Journal of Urological Surgery

openalex

A society-backed, quarterly open-access urology journal now publishes without author fees and uses double-blind peer review — lowering barriers for clinical groups to share surgical, uro-oncology and diagnostic work. For someone building ML models or platforms, that matters because it’s a potential, low-friction source of clinical studies, imaging and outcome data, and a credible venue for publishing applied ML/clinical collaborations. The no-fee model reduces pay-to-publish risk but also warrants a quick quality check (editorial board, indexing) before treating it as a primary data source. Monitor it as an early signal pipeline for translational urology work and possible collaboration opportunities with clinicians who may have datasets or validation cohorts useful for AI-driven biomarker or diagnostic efforts.

MARLOWE: taxonomic characterization of unknown samples for forensics using de novo peptide identification

Sarah Jenson, Fanny Chu, Gelio Alves, Aleksey Y. Ogurtsov · openalex

A new open-source tool, MARLOWE, applies de novo peptide sequencing to identify source organisms from forensic biological samples with 91.4% specificity at 5% FDR — comparable to the leading tool MiCId, but with a Bayesian probabilistic approach that requires no a priori knowledge of the organism. This matters because it demonstrates that de novo proteomics, which sidesteps traditional database searches, can achieve forensic-grade specificity. For Nathan: while this is forensics, not drug discovery, the methodological core — leveraging de novo peptide identification for unbiased taxonomic assignment — directly parallels challenges in mass spectrometry-based proteomics used in AI drug discovery, where sample-to-organism mapping without reference libraries is often needed. It also validates that probabilistic scoring over broad sequence databases can work at scale, which may inform how Isomorphic Labs evaluates proteomics data for target identification or off-target effects.

Characterization of microbial dark matter at scale with MetaSBT and taxonomy-aware Sequence Bloom Trees

Fabio Cumbo, Daniel Blankenberg · openalex

MetaSBT hits the sweet spot of scaling microbial 'dark matter' classification using Bloom filters — indexing 190K viral genomes and finding that ~80% of species clusters have no match in existing reference databases. By integrating into Galaxy Platform, it makes novel taxonomic discovery accessible without requiring deep infra. The important insight for drug discovery: viral dark matter is a massive, untapped chemical space for potential therapeutic targets and viral vector engineering. If this approach can be adapted to functional metagenomic screening (e.g., identifying novel biosynthetic gene clusters, phage-host interactions), it could accelerate target discovery pipelines that Isomorphic Labs might care about — especially in areas like microbiome modulation or phage therapy. Direct competitor relevance: Recursion's phenomics platform depends on high-quality cellular models; better viral classification could improve model system fidelity.

Prediction of biological age and blood biomarkers from DNA methylation profiles measured by the methylation screening array: development and validation of models on Japanese data

Tatsuma Shoji, Yui Tomo, Ryo Nakaki · openalex

A Japanese cohort study validates that Methylation Screening Arrays (MSA), a cheaper alternative to standard EPIC arrays, can reliably predict biological age and several blood biomarkers from DNA methylation data. This matters because MSA cost-efficiency could enable larger-scale, population-level epigenetic aging studies, potentially accelerating biomarker discovery for drug response and aging interventions. For Isomorphic Labs, this suggests a scalable, lower-cost method for generating epigenetic data that could inform target identification or patient stratification in age-related diseases, though direct drug discovery relevance is indirect given the focus on Japanese populations and biomarker prediction rather than therapeutic mechanisms.

Evidence for the acquisition of a proteorhodopsin-like rhodopsin by a chrysophyte-infecting giant virus

Petra K Byl, Christopher R. Schvarcz, Julie Thomy, Qian Li · openalex

A newly isolated giant virus infecting chrysophyte algae carries a proteorhodopsin gene—the first ever seen in a viral genome—along with ribosomal proteins and genes resembling marine cyanobacteria. The implication: phago-mixotrophic hosts that both photosynthesize and ingest bacteria may serve as an intracellular melting pot for horizontal gene transfer between unrelated viruses and bacteria, enabling viral genomes to hijack host metabolic genes. The viral rhodopsin likely lacks a functional retinal-binding site, suggesting a light-independent role and broadening the functional catalogue of rhodopsins. For Nathan, this is a compelling basic-science advance in virus evolution and genetic exchange, not a direct pharma play, but relevant as a reminder of how untapped microbial diversity can yield unexpected mechanisms that might eventually inspire novel biotech or antimicrobial strategies.

Americans bought 12% less soda under new SNAP restrictions, study says

stat_news

A new NBER study (pre-peer review) found that SNAP soda bans in 10 states cut purchases by ~12%, or ~34 fewer 12-oz cans per person per year. This is rare causal evidence that restricting benefits for unhealthy items meaningfully changes consumption, despite skepticism it would just shift spending. For you, the significance is twofold: it’s a concrete data point in the ongoing MAHA policy experiment that could affect consumer staples (big soda, big food) in your portfolio, and it demonstrates a real-world model of behavioral nudge through financial constraints — relevant to incentives in health/pharma policy discussions.

World News

Protectionism and political instability are amplifying global volatility, as seen in the US-Canada trade collapse and internal Ukrainian fractures, directly impacting currency and aid-dependent markets. Meanwhile, economic pressures are manifesting in both labor markets, with a UK graduate hiring slump reflecting a pivot to automation, and in consumer sectors, where aggressive Chinese EV regulation signals heightened operational risk for tech-driven industries.

Canadian dollar dips after US-Canada talks collapse into trade war; oil prices fall ahead of US sanctions on Iran – business live

Julia Kollewe · guardian

US-Canada trade talks collapsed, triggering a full-blown trade war with 50% US tariffs on $20bn of Canadian goods and dollar-for-dollar Canadian retaliation. The Canadian dollar fell 0.2% as markets repriced the breakdown. This signals that negotiating with the current US administration may be futile, adding volatility to global markets and directly affecting currency exposure in any diversified portfolio.

UK graduate job vacancies plunge to lowest in a decade

Alex Daniel · guardian

UK graduate job vacancies fell 45% year-on-year in July to the lowest since tracking began in 2016, reversing a spring recovery. This reflects broader economic headwinds from rising employer costs and firms prioritizing AI investment over hiring. The trend signals persistent labor market weakness that could weigh on UK consumer spending and growth, with implications for your portfolio's macro exposure and the local tech hiring environment.

Zelensky should be asked what he knew about government corruption, sacked minister tells BBC

bbc_world

A sacked Ukrainian minister is publicly demanding that President Zelensky be questioned about his knowledge of government corruption, and is pushing for wartime elections—a move that could destabilize Ukraine's political unity during the war. For Nathan, this is a signal that internal political fractures in Ukraine may intensify, potentially affecting Western aid flows, investor sentiment toward Eastern European markets, and the broader geopolitical risk premium that influences global indices and his portfolio.

Nearly three million Teslas recalled in China over hidden door handles

bbc_world

China mandated a recall of nearly 3 million EVs from Tesla, XPeng, Xiaomi, and Geely over hidden door handle safety risks. This signals a regulatory tightening that could raise compliance costs for all EV makers operating in China and alter consumer trust in the market.

Finance & FIRE

A structurally higher-rate regime is forcing a reassessment of portfolio carry, making the contrarian signal in 'hated' bonds worthy of a long-term, tax-efficient position. Meanwhile, the broadening bull market into sectors like healthcare validates diversification and the continued primacy of passive indexing as active management grapples with shifting risk premia.

Top clicks this week on Abnormal Returns

abnormal_returns

This week's most-clicked links on Abnormal Returns cluster around three themes: the enduring shift to higher rates (which challenges the carry trade and bond-heavy portfolios), a broadening bull market that is now pulling in healthcare after a rough patch, and renewed affirmation that passive index investing continues to outperform active stock-picking. For a passive index investor, the key signal is that the bull market is becoming more inclusive beyond tech/AI mega-caps — healthcare's breakout could add diversification tailwinds to a globally diversified portfolio. Meanwhile, rising rates may compress growth stocks' multiples, but historically this doesn't derail long-term compounding for disciplined buy-and-hold strategies.

The Most Hated Asset Class in the World

wealth_common_sense

Bonds are now the most hated asset class, mirroring the sentiment extreme that preceded international stocks' rally in early 2025. Negative sentiment is a contrarian signal; current yields may offer a compelling entry for long-term, indexed investors. For your portfolio, this suggests reconsidering fixed-income allocation—whether to overweight bonds or hold duration—especially given the tax efficiency of bonds in ISAs and SIPPs.

Startup Ecosystem

The startup ecosystem is being reshaped by a central tension: massive capital flows into AI infrastructure (like Alibaba's $10bn placement) meet a growing realization that the previous "replace, not augment" narrative was premature, as evidenced by layoff reversals. This is forcing a strategic pivot towards resilience and efficiency—seen in the venture focus on pragmatic AI optimization startups—which aligns with the broader engineering principle that complex systems, like distributed ML platforms, fail predictably and must be designed for graceful degradation, not perfection.

How Complex Systems Fail

hacker_news

Complex systems — like distributed ML infrastructure or drug discovery pipelines — fail in predictable but unavoidable ways, not from single catastrophic errors but from the accumulation of latent conditions that erode safety margins. The core insight: every production system already operates in a degraded state, and failures are just the normal consequence of earlier design decisions that seemed rational at the time. For someone building and maintaining ML platforms, this reframes incident post-mortems — instead of hunting for root cause, you should expect failure as a feature of complexity and invest in resilience testing, graceful degradation, and rapid recovery rather than trying to prevent all failures. Directly applicable to thinking about Lyft-era infrastructure lessons and current reliability concerns at Isomorphic.

I gave Qwen 3.8 27B a reverse-engineering job and it finished in 30 minutes

hacker_news

Qwen 3.8, a 27B parameter model, completed a reverse-engineering task in 30 minutes that would typically require a team of human engineers. This demonstrates that open-weight, smaller models can now perform complex, multi-step reasoning tasks previously reserved for much larger, proprietary systems or human experts. For Nathan, this underscores the rapid commoditization of high-level AI capabilities—smaller, efficient models are closing the gap with frontier systems. This trend has implications for startup strategy (cheaper, more accessible AI) and ML infrastructure (inference optimization, model distillation). It also suggests that AI-driven drug discovery tools might become more capable and affordable, potentially shifting competitive dynamics in the space.

Enterprise AI agents are only as reliable as the messiest documents behind them

venturebeat

The prevailing approach to enterprise AI — building per-application context pipelines — is already breaking down as teams proliferate. Different agents end up with inconsistent views of the same business knowledge, changes propagate unevenly, and duplicative embedding/index work wastes engineering resources. This is fundamentally a knowledge management problem, not a context engineering one. The solution is a shared enterprise knowledge platform that manages knowledge once and publishes reusable representations for all AI applications, analogous to how enterprise data platforms handled structured data.

Employers are quietly rehiring the people AI replaced, and paying them less to come back

the_next_web

A Forrester report reveals that 55% of employers regret replacing workers with AI, and half of those layoffs are being quietly reversed—but rehired staff are often paid less or moved offshore. In Europe, a new directive will force companies to consult workers before such decisions, backed by financial penalties. This signals that the initial wave of AI-driven headcount reduction was premature; many tasks still require human judgment, and the cost savings from replacing people with AI don't always materialize. For you, this is a reminder that the hype cycle around AI replacing knowledge workers is hitting reality—important context for how you think about AI's role in drug discovery and whether similar overcorrections could happen in biotech. It also directly affects the startup landscape: expect more regulation around AI-related layoffs, and watch for startups that offer AI solutions that augment rather than replace, as they may face less backlash.

VCs pick out 19 startups to watch making AI more efficient

sifted

Sifted asked a handful of VCs to each name one startup working on AI efficiency, yielding 19 picks across compute optimization, model compression, inference acceleration, and specialized hardware. A few themes stand out: European firms are disproportionately represented, and several startups target pragmatic niches — reducing GPU burn for fine-tuning or making LLMs run on edge devices — rather than chasing general-purpose AGI. For someone building ML infrastructure at an AI-native company, this is a useful signal of where VC money is flowing in the efficiency layer. Worth scanning the full list for potential tools or acquisition targets that might intersect with Isomorphic's compute-intensive workflows, though the drug discovery angle is indirect. Compared to other similar roundups, this one has higher signal because the VCs were asked to pick one each (less noise) and the respondents are credible (e.g., LocalGlobe, Hoxton).

Alibaba is raising $10.2bn and spending all of it on AI

the_next_web

Alibaba is raising $10.2bn through a Hong Kong share placement, directing all net proceeds to AI infrastructure and capabilities. This follows a 75% drop in quarterly net profit, driven by the same spending. The move signals a strategic bet on AI compute scale, prioritizing long-term positioning over short-term profitability. For Nathan, this is another data point on the massive capital flows into AI infrastructure — affecting compute availability and pricing for everyone, including drug discovery labs. It also highlights the competitive intensity in China's AI race, distinct from US hyperscalers, which could shape global supply chains and geopolitical dynamics around AI resources.