Experimenting with Artificial Intelligence and Machine Learning

Here is my new series where I will embark on an interesting journey: building a Large Language Model (LLM) from scratch using a reverse engineering approach.

Usually to learn and figure out how to build an LLM, you will start with the mathematical foundations and then work your way upward to a functional model. For this I would do the opposite. I will start from a ready made working LLM and systematically deconstruct it. This allows me (and you) to immediately see the end goal and how each of the different component contributes to the final system.