Understanding Tokens in LLMs

Tokens in LLMs explained - the word unbelievable split into three tokens: un, believ and able

The hidden currency behind every AI conversation — explained from scratch A beginner-friendly deep dive, with real examples from Ollama. A token is the small chunk of text an LLM actually reads and writes — usually part of a word, not a whole word. As a rough rule, 1 token ≈ 4 characters ≈ three-quarters … Read more

Deep Dive: How Machines “Understand” Text Without Exact Matching (Learning Exercise)

I recently completed a Proof of Concept (PoC) to understand the internal mechanics of how machines process language. The goal was to learn how data transforms from human words into mathematical numbers and back. This method is the foundation for modern search, allowing a system to find answers based on meaning rather than just matching … Read more

10 steps to Architecting an Application

Step 1: Define what architecture means by identifying the hard-to-change decisions the system must get right. Step 2: Understand the problem space, actors, and system boundaries to avoid solving the wrong problem or allowing scope creep. Step 3: Define core system capabilities in business terms, independent of features or technology. Step 4: Identify core domain … Read more

Incremental Prompting using GenAI : CRUD Script example

In previous blog I have emphasized that even with the rise of AI tools in software development, a strong foundational understanding of programming concepts is crucial. I have highlighted key elements like syntax, data types, loops, and data structures as essential to master before leveraging AI for tasks like scaffolding or code snippets. AI should … Read more