22yo Reverse-Engineers and Open-Sources Mythos
A 22-year-old developer reverse-engineered Claude's Mythos architecture and open-sourced it. The implementation draws MoE and attention from DeepSeek, combining public research and common speculations.
Search
Tag: #architecture10 results
AMOR: Entropy-Gated SSM-Attention Hybrid
AMOR is a hybrid model inspired by dual-process cognition theories, dynamically activating sparse attention only when SSM predictions show high entropy uncertainty. It projects Ghost KV from SSM states for O(n) efficiency, outperforming SSM-only and Transformer baselines on retrieval tasks with perfect accuracy using just 22% attention positions. Prediction entropy reliably detects retrieval needs with a 1.09 nats gap.
Huawei updates Tao Law research paper
Huawei has released an updated version of its 'Tao Law' research paper. The update provides further clarification on the technical routes the company decided to abandon during its development process.
Understanding Inner and Outer Loops in AI Coding
This article explains the distinction between inner loops handled by AI agents and outer loops managed by harnesses. It explores the challenges of memory management in automated coding workflows.
💼
Lessons Learned from Shutting Down an LLM Startup
A developer shares insights from shutting down a production LLM service for medical appointments. Key takeaways include the difficulty of guaranteeing reliability for third-party clients and the technical challenges of integrating async-first tools like PydanticAI into sync architectures.
Maket launches AI-powered floor plan digitization tool
Maket has introduced a new feature that allows users to upload existing floor plans in PDF, JPG, or PNG formats. The tool uses AI to convert these static images into fully editable residential design layouts within minutes.
Oracle's Survival Strategy: AI-Native SaaS Architecture
Oracle Japan explains its strategy for 'core AI' integration, emphasizing the need for flexible architectures to avoid technical stagnation in the SaaS market. Industry partners like WingArc1st and NSW shared insights on leveraging AI to ensure SaaS longevity.
SATFormer for Efficient Transformers
New SATFormer paper introduces per-token, per-head gates for selective first-layer value access in Transformers. Outperforms baselines on loss and retrieval benchmarks with near-baseline throughput. ArXiv and GitHub links provided.
Synaps Raises $3.6M for AI Architect Canvas
Austrian-Albanian startup Synaps raised $3.6M to develop an AI design canvas for architects, positioning it as a potential AutoCAD challenger. Five months post-beta launch in Tirana, it has 60,000 users and hundreds of paying customers. Investor Plug and Play is on its cap table.
Five critical cloud security mistakes at the architecture level
Cloud Architect Nodir Safarov outlines common architectural failures that lead to security gaps in multi-cloud environments. The analysis highlights how rapid enterprise cloud adoption often outpaces security implementation.