What I thought was ordinary least squares turned into Vandermonde conditioning, Forsythe's orthogonal polynomials and Chebyshev. The monomials aren't really orthogonal.
Posts
Polynomial fit: a rabbit hole
You understand by forgetting, while your agent can't
Why your coding agent compresses against the average of every codebase instead of yours and why forgetting is part of intelligence. Built on Kolmogorov complexity.
Information theory for programmers
Information, entropy, and cross-entropy from a programmer's intuition. Ends at the loss function your LLM is trained on.
Fixpoints for clarity
Fixpoints as a tool to understand and make sense of algorithms like Page rank, Nash Equilibrium, Bellman Optimality and Expectation Maximization.
Programming Bitcoin: Handwaved Field
Reading Programming Bitcoin carefully, and digging into the finite-field math the book hand-waves.
Implementing functional programming language (Part 1) - Untyped Lambda Calculus
Exploring lambda calculus without any typing. Building notions of numbers, booleans etc... just from lambda expressions.
What can't a regular expression do?
We have a general understanding of what regular expressions can do. But this one explores what it can't. Formally putting a pin on when we are asking too much from it.
Old Posts
I used to host a blog in github pages before. I am slowly migrating them to new setup on my machine (Raspberry pi). I will probably write a blog post on it. Until I migrate them, I am going to drop links to them here.