Matt George
Home
Services
Apps
BlogInsightsAPIsBook Call
← Back to All Posts

Llm Articles

0 posts about llm

Loading...
Matt George

Fractional CTO and full-stack engineer. I build AI platforms, large-scale data scrapers, and production systems for early-stage startups.

Explore

  • Home
  • Services
  • Apps
  • Blog
  • Insights

Build

  • APIs
  • API Docs

Connect

  • Contact
  • Book a call
  • LinkedIn
  • GitHub

Services

All services →

Leadership & Strategy

  • Technology Strategy
  • Fractional CTO
  • Interim CTO
  • Startup CTO

Product & Engineering

  • Product Roadmap
  • Architecture Review
  • AI & Digital Transformation
  • Engineering Team Building

Risk & Compliance

  • Security & Compliance
  • Technical Due Diligence
  • AI Strategy
  • Payments & Fintech
  • Code Review
  • Security Review
  • Software & Data Engineering
  • Developer & Vendor Management
© 2026 Full Stack Development, LLC. All rights reserved.
Terms of ServicePrivacy Policy
Showing 19 of 226 posts in Llm ·
Matt GeorgeMatt George•November 17, 2026•13 min read

How to Build an AI Agent: The Loop, Memory, and Tools

A technical guide for engineers and leaders on the architecture of AI agents, covering the core reasoning loop, memory systems, tool integration, and critical production trade-offs.

Matt GeorgeMatt George•November 14, 2026•12 min read

The History of the Chatbot: From ELIZA to ChatGPT

A comprehensive reference history of conversational AI, tracing its evolution from the simple pattern-matching programs of the 1960s to the large language models of the present day.

Matt GeorgeMatt George•November 9, 2026•11 min read

Semantic Caching: A Technical Guide for LLM Applications

Semantic caching reduces LLM application costs and latency by storing and reusing responses to conceptually similar queries, using vector embeddings and similarity search instead of exact-text matching.

Matt GeorgeMatt George•November 3, 2026•12 min read

Speculative Decoding: How LLMs Generate Faster

Speculative decoding accelerates large language model inference by using a smaller, faster model to draft text that a larger, more powerful model then verifies in parallel, significantly reducing generation latency without compromising output quality.

Matt GeorgeMatt George•November 2, 2026•11 min read

LLM Observability: Tracing, Logging, and Cost Tracking

A comprehensive guide to LLM observability, explaining the technical mechanisms of tracing, logging, evaluation, and cost analysis for production AI systems.

Matt GeorgeMatt George•November 1, 2026•12 min read

Structured Data Extraction With LLMs: When It Beats Hand-Written Parsers

Large Language Models can extract structured data like JSON from unstructured text with surprising reliability, but the mechanism and tradeoffs determine when this approach is superior to traditional parsers.

Matt GeorgeMatt George•October 29, 2026•13 min read

Quantization: Running LLMs Cheaper and Faster

Quantization reduces the memory footprint and computational cost of large language models by converting their weights from high-precision floating-point numbers to low-precision integers, enabling faster inference on less expensive hardware.

Matt GeorgeMatt George•October 5, 2026•13 min read

Context Windows: What They Cost and How to Use Them Well

A context window is the measure of text an AI model can consider at once to process a request and generate a response. Understanding its technical mechanisms, costs, and failure modes is critical for making sound engineering decisions about when to use large contexts versus alternative architectures like RAG.

Matt GeorgeMatt George•October 3, 2026•13 min read

How Attention Works in Large Language Models

A technical explanation of the attention mechanism in LLMs, from its conceptual origins to the mathematical details of Scaled Dot-Product Attention and its practical implications for engineering leaders.

Matt GeorgeMatt George•September 12, 2026•7 min read

Can I Just Use ChatGPT to Scrape a Website?

Can ChatGPT scrape a website? For one page maybe, but here is why it breaks at real scale and where AI genuinely earns its keep in a data pipeline.

Matt GeorgeMatt George•August 23, 2026•14 min read

Function Calling and Tool Use in LLMs

A comprehensive guide to how LLMs use functions and tools to interact with external systems, covering the underlying mechanism, history, practical examples, and critical decision-making tradeoffs for technical leaders.

Matt GeorgeMatt George•August 7, 2026•11 min read

Building LLM-Powered ETL Pipelines: Beyond Simple Text Processing

How we built an AI-powered data extraction system that transforms unstructured documents into structured data with 95% accuracy, and the architectural decisions that made it scalable.

Matt GeorgeMatt George•August 1, 2026•11 min read

LoRA and Parameter-Efficient Fine-Tuning, Explained

A comprehensive technical guide to LoRA (Low-Rank Adaptation), explaining its mechanism, use cases, and tradeoffs compared to full model fine-tuning.

Matt GeorgeMatt George•July 31, 2026•12 min read

How to Evaluate a RAG Pipeline

A comprehensive guide for technical leaders on evaluating Retrieval-Augmented Generation (RAG) systems, covering component-wise metrics, end-to-end testing, failure modes, and the strategic tradeoffs involved.

Matt GeorgeMatt George•July 26, 2026•12 min read

Fine-Tuning vs RAG vs Prompting: Choosing the Right Approach

A comprehensive guide for technical leaders on the mechanisms, tradeoffs, and decision criteria for customizing LLMs using Prompting, Retrieval-Augmented Generation (RAG), and Fine-Tuning.

Matt GeorgeMatt George•July 15, 2026•13 min read

Evaluating LLMs: How to Measure Output Quality

A comprehensive guide for technical leaders on measuring LLM performance, covering human evaluation, automated metrics like BLEU and BERTScore, and the modern LLM-as-a-Judge approach.

Matt GeorgeMatt George•July 8, 2026•14 min read

Managing LLM Cost and Latency in Production

A comprehensive technical guide for engineers and leaders on the mechanisms behind LLM cost and latency, with concrete strategies for optimization in production systems.

Matt GeorgeMatt George•June 8, 2026•19 min read

The History of Natural Language Processing

From rule-based parsing to statistical methods, word embeddings, and transformers, and the leap from grammar to scale.

Matt GeorgeMatt George•April 23, 2026•12 min read

Why LLMs Hallucinate, and How to Reduce It

A technical explanation of why Large Language Models produce incorrect or fabricated information, and a guide to practical mitigation strategies like Retrieval-Augmented Generation (RAG) for software engineers and technical leaders.