Q Labs reports that Dust can pretrain transformer language models without backpropagation, but its results rely on larger populations and more compute.
Dust: Pretraining Transformers Without Backpropagation
Browsing Category
Advanced Topics
47 posts
LensVLM: Compressing Long Context As Images, Expanding Only Relevant Pages
LensVLM introduces a novel method to compress long contexts into images, expanding only relevant pages, marking a potential shift in AI processing.
Distributed Systems Classics (2017)
Search interest in ‘Distributed Systems Classics (2017)’ has spiked recently, driven by growing academic and industry focus on foundational texts, though the exact trigger remains unconfirmed.
Factoring RSA 260
Researchers have successfully factored RSA-260, marking a significant milestone in cryptography and computational number theory.
Stop Anthropomorphizing Intermediate Tokens As Reasoning/Thinking Traces (2025)
Researchers warn against interpreting intermediate tokens in AI models as reasoning traces, emphasizing the importance of proper interpretation in 2025.
Tail-call Optimization In C Is Relatively Recent (2025)
C language officially added tail-call optimization in 2025, marking a significant update after decades without this feature. Here’s what it means.
Goodhart’s Law Comes For Every Benchmark You Trust
Experts warn that Goodhart’s Law is undermining the trustworthiness of widely used benchmarks in AI and finance, raising concerns about their validity.
Rust Project Goals: Immobile Types And Guaranteed Destructors
Rust developers announce new goals to enhance safety with immobile types and guaranteed destructors, aiming for more predictable memory management.
Ten Advances In Mathematics And Theoretical Computer Science
A review of ten recent significant advances in mathematics and theoretical computer science, highlighting confirmed developments and their implications.
Demystifying DRAM Read Disturbance: RowHammer And RowPress Phenomena
An in-depth analysis of DRAM read disturbance phenomena, including RowHammer and RowPress, their confirmed impacts, and future implications for memory security.
![Competitive Programmer's Handbook (2018) [Pdf]](https://geometr.info/wp-content/uploads/2026/10/competitive-programmer-s-handbook-2018-pdf-featured-260x140.jpg)