Three Kinds of RAG Corpus, and What It Costs to Build for the Wrong One
Enterprise Document Intelligence [Vol.1 #14A] – Three questions tell you which shape a document collection has, and each shape wants…
Category: General
How to Fine-Tune an LLM: An End-to-End Guide
A hands-on guide to fine-tuning LLMs for the real world The post How to Fine-Tune an LLM: An End-to-End Guide…
Making the Knowledge Layer a Graph You Actually Traverse
Why retrieval quality should be a property of the system, not of the question’s wording? Rebuilding knowledge layer with graph…
How to Scale an Integration Pipeline Without Breaking Correctness
A production account of scaling an enterprise integration pipeline from 500 to 8,000 events per second, and the two correctness…
Kimi K3’s 1M Token Context Window vs. RAG: Cost, Latency and Answer Quality
A controlled comparison of a top-5 RAG pipeline and a full 127,000 token prompt on the same 12 questions, same…
Understanding Anti-AI Public Opinion
People can accept tradeoffs when they see value — but if they don’t, what happens? The post Understanding Anti-AI Public…
Jigsaw Jeeves: Building a Puzzle Assistant using Computer Vision
Conceptual overview and walkthrough of a solution approach in Python The post Jigsaw Jeeves: Building a Puzzle Assistant using Computer…
From Prototype to Production: The Architecture Behind Secure & Governed AI Agents
Building the Responsible AI, security, and governance layers required for enterprise-ready agents The post From Prototype to Production: The Architecture…
When AI art has no author: Study finds generated images often can’t be traced to training data
When an artificial intelligence image generator produces a portrait, whose work went into it? The question sits at the center…
Building Enterprise Agent Systems that People can Trust, Verify and Improve
5 principles that determine whether an agent system succeeds in production, explained through one I built for a $100M+ company. The…
Q&A: Rethinking how innovation happens
Innovation is a concept that has become mythologized in the modern era: what it is, how to manage it, how…
Ten Is Not a Hundred
The number that fooled every hallucination detector The post Ten Is Not a Hundred appeared first on Towards Data Science.
Q&A: Rethinking how innovation happens
Innovation is a concept that has become mythologized in the modern era: what it is, how to manage it, how…
Webwright: Why AI Web Agents Should Write Code, Not Click
For years, web agents have worked one click at a time—and often fallen apart on long tasks. Microsoft Research’s Webwright…
How to Perform Effective Project Management with AI
Become a more productive software engineer with LLMs The post How to Perform Effective Project Management with AI appeared first…
Loop Engineering for RAG: The Small Loops Inside Each Step, the Big Loops Across the Pipeline
Enterprise Document Intelligence [Vol.1 #13bis] – The four bricks return useful results most of the time. Loop engineering is what…
Designing a Persistent Knowledge Layer That Refuses to Guess
RAG Retrieves, It Never Remembers. A vendor-neutral blueprint for applications that accumulate understanding. Includes a complete Azure-native implementation (Microsoft Foundry,…
Running SQL Concurrently Across Three Remote DuckDB Servers with Quack
A small experiment in remote SQL execution The post Running SQL Concurrently Across Three Remote DuckDB Servers with Quack appeared first…
Mathematical Experiments Are Becoming Abundant Through Human-Machine Teaming
Two open problems, exact-arithmetic checking and a proof assistant, over a single weekend. The post Mathematical Experiments Are Becoming Abundant Through Human-Machine…
How to Shine as a Data Scientist in the Vibe Coding Era
Here’s how to be the Data Scientist who thrives in a world where coding is a commodity. The post How…
A Day in the Life of a Data Scientist in 2026
How AI has massively changed my day-to-day workflow The post A Day in the Life of a Data Scientist in…
RAG Workflow and Loop Engineering: The Dispatcher That Decides When to Loop and When to Stop
Enterprise Document Intelligence [Vol.1 #13] – Putting the patterns together, and why this is what “agentic RAG” should look like…
Found Friday S5I6: Privacy and Practical AI
FOUND FRIDAY · SEASON 5 · ISSUE 6 Privacy is the control layer for practical AI. This issue starts with…
My Model Was Cheating on Its Own Test
A preprocessing pipeline let my car price model peek at the test set before the exam, and the twelve points…
I Made an LLM Lay Siege to My Minecraft House
Can a language model do live adversarial level design? Yes, emphasis on the adversarial part The post I Made an…
How to Utilize OKF Efficiently to Enable Knowledge Exchange Among LLMs
Google’s Open Knowledge Format (OKF) is a Markdown+YAML skeleton for sharing knowledge between humans and AI agents. This post reuses…
Before Full Agentic RAG: Know How You Decide, and the Parsing Methods You Pick From
Enterprise Document Intelligence [Vol.1 #5nonies] – Nature, plan, execute, synthesize: closing brick 1 with a dispatcher that reads each PDF’s…
Backpropagation Explained for Beginners (Part 3): How Backpropagation Really Works
From one gradient to every gradient The post Backpropagation Explained for Beginners (Part 3): How Backpropagation Really Works appeared first…
Putting sign language AI into users’ hands
Introducing sign-language-to-text (SL2T), our breakthrough model powering new sign language features for Deaf and hard of hearing users.
Building Multimodal Workflows with a Local LLM
Image inputs and structured outputs with Gemma 4 and Ollama The post Building Multimodal Workflows with a Local LLM appeared…
How to Place Vertiport Locations in Any City Using Geospatial Machine Learning
A reproducible Lagos case study with population data, transport access, and airspace constraints The post How to Place Vertiport Locations…
Stop Calling the First Significant Day a Win
Checking an A/B test until it crosses p < 0.05 can turn a nominal 5 percent false-positive rate into almost…
Should AI Developers Make the Switch from Polars to Pandas?
Not all Python data libraries are created equal! The post Should AI Developers Make the Switch from Polars to Pandas?…
The Budget Split That Explains Itself
How to diversify a budget without losing the shadow prices that explain the result The post The Budget Split That…
Can a Local LLM Run My AI Assistant?
I replayed the same 27 real production tasks through two local models, one hardware upgrade apart, to find out what…
With a feel for physics, AI models simulate a wider range of real-world scenarios
Artificial intelligence models are jacks of many trades, including writing, generating images, and creating 3D models. But they aren’t as…
How to Effectively Deploy Code With Claude Code
Learn how to optimize your CI/CD pipeline for coding agents The post How to Effectively Deploy Code With Claude Code…
Building an Agent-Ready Data Warehouse: What Traditional Architectures Do Wrong
Giving an AI agent access to a data warehouse doesn’t automatically make it agent-ready. The real challenge lies in teaching…
Variational Autoencoders (VAEs) Explained: From Theory to ELBO and the Reparameterization Trick
A clear, math-first walkthrough of how VAEs learn to generate new data The post Variational Autoencoders (VAEs) Explained: From Theory…
SPP-Net Paper Walkthrough: Breaking the Fixed-Size Constraint
Learn how Spatial Pyramid Pooling enables CNNs to handle any image size, with a from-scratch PyTorch implementation The post SPP-Net…
I Thought Loading Data Was the Finish Line. It Was the Starting Point.
Building my first dbt models and learning what “analysis-ready” data actually means The post I Thought Loading Data Was the…
How to Implement Structured Output with Local LLMs
Why use it? How to implement it? What can we do when it fails? The post How to Implement Structured…
Before Q, K, and V: Reconstructing the Transformer
Many Transformer explainers start with the finished architecture. We ask why it looks the way it does. The post Before…
Building a Streamlit UI for My LangGraph AI Agent
Building a production-ready web interface for a stateful LangGraph agent The post Building a Streamlit UI for My LangGraph AI…
Matplotlib vs Plotly: Which Python Chart Tool Should You Choose?
From Static Plots to Interactive Data Exploration The post Matplotlib vs Plotly: Which Python Chart Tool Should You Choose? appeared first…
Loop Engineering for Listing Questions: When the Answer Is Every Passage, Not the Top One
Enterprise Document Intelligence [Vol.1 #12] – The category of question most RAG pipelines silently fail on, and the pipeline shape…
My Fall-Detection Model Scored 94%, and It Was Lying to Me
How a single evaluation choice inflated my results by 25 points, and what rebuilding honestly taught me about ML systems…
I Built an AI Data Agent Which Can Query Data and Answer Business Questions. Here’s How.
A step-by-step guide to building a data agent and conversational interface that let business users to explore data in natural…
Last Month’s Machine Learning Lessons Learned
The downside of conference travel The post Last Month’s Machine Learning Lessons Learned appeared first on Towards Data Science.