Skip to content

Tag: llm

What I Learned Building an AI Software Factory

Disclaimer: this article was written by an organic sentient being, me, and not by an AI. All typos, mistakes, and repetitions are mine, and I am proud of them.

I tend not to trust my own understanding of a topic if I have just read a description of it, or watched a video. My level of understanding is several orders of magnitude better when I’ve been learning a topic by actively engaging with the topic for example by trying to build something, because a lot of the deep understanding of something only happens when you interact with it, and when you observe it collide with the real world.

For example, I’ve written compilers to understand how programming languages work, I’ve written a persisted key-value store to understand large-scale data storage systems, and more recently, I wrote a crypto payment system to understand the Ethereal blockchain and its ecosystem.

Everyone nowadays is selling us their AI skills, AI best practices, and God’s truth on how we are supposed to use AI. I’ve myself drank the kool-aid only to wake up to the reality that all these people are only using persuasion and marketing tricks but not proving anything, and if I wanted to understand the impact of AI on software engineering, then I would have to develop my own system and workflow, and see it run in wild.

So my idea was simple: build an AI workflow, apply it to a few projects, and observe myself interact with it to see what new habits I’m adopting, what I’m learning, what works and doesn’t. After a few weeks, I would extract the guiding principles behind my decisions, as a way to gain a deeper understanding of how those systems work under the hood, and equip myself with some mental models of how one should interact with such systems in the future.

Nine weeks and 421 commits later, I’ve built a workflow which I’ve named Backlog Loop and released on GitHub, and in this article I am sharing what I’ve learned. I don’t recommend that you should use this tool, but rather, read about the issues and limitations with AI that it helped me uncover.

What I worry about with AI

Disclaimer: this article has been written 100% by me, a human being, using mechanical finger typing. All typos and lack of stylistic taste are entirely mine.

I haven’t taken to this blog for a year now. I changed jobs. I was busy with family matters. I got into a rabbit hole of tokenmaxxing building a coding harness for writing code I can trust with LLMs. And I took notes about things I wanted to write about, but I thought to myself that won’t be of any interest to anyone, so I didn’t write them. But in the end here we are, It thought maybe I would write something that would add some value to someone somewhere, and that would be worth reading instead of reading it from ChatGPT, Claude, or any of their derivatives.

So here we go. I’m worried. I’m worried for us.

I don’t want this to be yet another AI doomer article. I do believe AI can and will automate software engineering once we manage to solve the problem of ensuring code correctness with 5-nine reliability at scale. We will get there, it’s not about if but when.

I’m not worried about AI taking over as the paperclip maximizer. I’m worried about us humans losing our ways. Losing the simplicity of appreciating another human’s presence, giving a smile to someone without expecting anything in return, feeling someone’s skin and looking into his or her eyes as you shake hands. I’m worried that through addictive apps and AI interactions we are going to atrophy our ability to empatize with other living beings to the point of becoming a society of lonely self-absorbed narcissists with culturally ingrained sociopathic tendencies.