Retrieval-augmented generation is how enterprises actually deploy LLMs on their own data. Techniques, tools and production lessons.
142 articles
TurboQuant Pro is an open-source toolkit compressing high-dimensional vectors by 5-42x while retaining 0.95+ cosine similarity. It benchmarks 6 methods on 2.4M real BGE-M3 embeddings and integrates with pgvector/FAISS.
Reddit r/MachineLearning · 163d ago
Open-source prototype implements Unix philosophy in ML retrieval pipelines with swappable, typed-contract stages like PII redaction and chunking. Enables isolating changes for precise eval comparisons.
Reddit r/MachineLearning · 173d ago
Developer shares hard-learned lessons from deploying RAG bots in Australian compliance sectors like construction and mining. Key insights include query expansion over chunk size, source boosting, layered prompts, local embeddings, and isolated VMs per client.
Reddit r/LocalLLaMA · 174d ago
Researchers propose combining fine-tuning and retrieval for LLM agents to achieve better generalization on unseen tasks. They develop a superior LoRA-based SFT recipe and analyze optimal retrieval strategies for storage, querying, and selection.
ArXiv AI · 183d ago
NVIDIA introduces NeMo Retriever, a generalizable agentic retrieval pipeline that surpasses traditional semantic similarity methods. Hosted on Hugging Face, it enables more advanced and adaptable retrieval for AI systems.
Hugging Face Blog · 190d ago
Databricks launched KARL, a RAG agent trained via reinforcement learning across six enterprise search behaviors using synthetic data. It matches Claude Opus performance on KARLBench at 33% lower cost and 47% lower latency.
VentureBeat · 198d ago
YuanLab.ai released the open-source Yuan3.0 Ultra multimodal foundation model. It integrates MoE architecture optimizations for training efficiency and targets enterprise tasks.
36氪 · 198d ago
This AWS blog demonstrates deploying a production-ready event assistant using Amazon Bedrock AgentCore components. It handles memory for context and preferences, secure authentication, serverless scaling, and RAG via Knowledge Bases for personalized attendee experiences.
AWS Machine Learning Blog · 206d ago
SurrealDB releases version 3.0, a multi-model database that stores agent memory, vectors, graphs, and structured data in one Rust-native engine for transactional consistency. It eliminates sync issues across tools like Postgres, Pinecone, and Neo4j in RAG systems.
VentureBeat · 214d ago
embedflow proposes migrating between embedding models by reranking a small set of documents retrieved from an existing index, avoiding a full vector backfill. In tests covering 63 migrations and up to one million documents, a Qwen 4B-to-8B upgrade matched native retrieval quality with 50 reranked documents.
Reddit r/MachineLearning · 11d ago
AWS explains how to customize an Amazon Bedrock knowledge base for large and complex PDFs and images by using Amazon Textract for high-accuracy extraction. The workflow preprocesses and ingests documents, then supports large-scale querying of utility bills for more accurate customer interactions.
AWS Machine Learning Blog · 15d ago
Coworker.ai has launched OM2, an organizational memory layer designed to give enterprise AI agents persistent access to relevant company knowledge. The product aims to reduce repetitive context loading and claims it can cut enterprise AI token consumption by up to 9x.
The Next Web (TNW) · 16d ago
John Deere has launched JD, an AI assistant that lets farmers ask plain-language questions about their own machine and field data. The launch also includes a ten-point voluntary Farmer Data Commitment, while EU users are covered by many related obligations under the Data Act.
The Next Web (TNW) · 18d ago
aimake is an incremental build system for AI and ML pipelines that tracks dependencies and fingerprints inputs by content instead of timestamps. It reuses unchanged stages such as datasets, embeddings, and indexes, while rebuilding only stale steps after prompt or configuration changes.
Reddit r/MachineLearning · 18d ago
Weaviate presents a late-interaction multi-vector retrieval approach for extracting meaning from charts and tables in PDFs. The method searches documents based on page appearance, avoiding traditional OCR, chunking, and text extraction steps.
Weaviate Blog · 18d ago
Qdrant and LangChain highlight production-ready RAG performance for LLM applications. The update focuses on asynchronous support, efficient resource usage, and scalable vector search.
LangChain Blog · 24d ago
LangChain introduces flexible retrieval methods for building AI applications tailored to a user’s data. Developers can use semantic or hybrid retrievers to create personalized ChatGPT-style experiences.
LangChain Blog · 24d ago
LangChain presents an implementation guide for using a Multi-Vector Retriever with tables, text, and images in RAG systems. The accompanying cookbooks cover retrieval over semi-structured and multimodal data.
LangChain Blog · 25d ago
Amazon DynamoDB is reportedly beginning to support AI search natively, potentially reducing the need for a separate vector database in some architectures. The update could simplify AI application data stacks by bringing search capabilities closer to the primary database.
InfoQ中国 · 27d ago
AWS presents its portfolio of vector search capabilities embedded in existing databases and storage services, eliminating the need for a standalone vector database or data migration. The post compares six purpose-built services and provides a framework for selecting the right vector engine.
AWS Machine Learning Blog · 30d ago
The Hugging Face Blog introduces multi-vector, or late-interaction, embedding models using Sentence Transformers. The approach represents inputs with multiple vectors rather than a single embedding, enabling more fine-grained similarity matching.
Hugging Face Blog · 32d ago
OneAdvanced built a UK-sovereign AI platform by self-hosting Llama 4 Maverick and Llama Guard 4 on Amazon SageMaker AI. Its RAG pipeline uses pgvector, while more than 50 agents run with Strands Agents SDK on Amazon ECS.
AWS Machine Learning Blog · 38d ago
The author proposes a 'local-first' architecture where a local process acts as a gatekeeper, redacting sensitive data before sending requests to cloud models. This approach aims to prevent LLMs from leaking private memory during inference by treating cloud models as untrusted labor.
Reddit r/MachineLearning · 61d ago
This article explores whether current AI memory systems are limited by focusing on static fact retrieval rather than dynamic pattern inference. It proposes that future architectures should evolve to model a user's reasoning style and explanatory frameworks.
Reddit r/MachineLearning · 65d ago
The article explores how human memory structures can inform AI architecture, specifically challenging the notion of how memory is stored and retrieved. It suggests that memory can function as an independent layer rather than being deeply integrated into model weights.
量子位 · 65d ago
The author shares lessons learned from building incremental indexing pipelines, highlighting critical failures in handling document deletions and partial updates. The post emphasizes that maintaining consistency between source data and vector stores is a complex distributed systems challenge.
Reddit r/MachineLearning · 66d ago
VectorizationLLM is a specialized model based on Google open-weight LLMs, designed to assist engineering students with complex mathematical and computational analysis. It utilizes a RAG architecture to provide conceptual explanations and examples without revealing direct answers.
ArXiv AI · 71d ago
SoftBank successfully deployed an enterprise-wide RAG platform for 19,000 employees, balancing user convenience with corporate security. The project achieved significant operational efficiency, saving an estimated tens of thousands of hours in manual work.
ITmedia AI+ (日本) · 72d ago
This article explores the integration of Graph-based Retrieval Augmented Generation (GraphRAG) with knowledge graphs to enhance pharmaceutical research. It demonstrates how combining structured data with generative AI improves discovery speed and scientific accuracy.
AWS Machine Learning Blog · 73d ago
TripAdvisor's AI-generated review summaries are inaccurately labeling unsafe hotels as 'spotless' and 'friendly'. This raises concerns about the reliability of LLM-based summarization in high-stakes consumer decision-making.
Digital Trends · 79d ago