Understanding Tokens in LLMs

The hidden currency behind every AI conversation — explained from scratch A beginner-friendly deep dive, with real examples from Ollama. If you have ever wondered why an AI charges you “per token,” why the same message can suddenly cost more tokens on the second try, or why a Word document costs more than plain text … Read more

Deep Dive: How Machines “Understand” Text Without Exact Matching (Learning Exercise)

I recently completed a Proof of Concept (PoC) to understand the internal mechanics of how machines process language. The goal was to learn how data transforms from human words into mathematical numbers and back. This method is the foundation for modern search, allowing a system to find answers based on meaning rather than just matching … Read more

Incremental Prompting using GenAI : CRUD Script example

In previous blog I have emphasized that even with the rise of AI tools in software development, a strong foundational understanding of programming concepts is crucial. I have highlighted key elements like syntax, data types, loops, and data structures as essential to master before leveraging AI for tasks like scaffolding or code snippets. AI should … Read more