I am motivated to start a homelab for several reasons that all circulate around the growth of AI in the last couple years. I believe our ways of working as engineers is changing rapidly. Technology has always moved fast and the race to stay ahead or the fear of missing out is not a new dilemma for software engineers. Yet, the ai platform wave is just around the corner and I believe engineering heads will roll across the globe.
To sum it up, we are going to build software, hardware, and infrastructure to support a development platform that is driven by AI. Additionally, I am going to add support for automation, observability, privacy, content management (RSS Feeds | Plex | Books), and support for ephemeral labs. This will be a series of different posts.
This is my tower of power. Sitting on top of the rack, is a mini PC that is connected to an eGPU for setting up the ai development platform. However, I will not only be using self hosted LLM's. In the rack, is all of my networking hardware, powering devices, and servers for virtualization.
Here is a detailed list of the hardware that is in the picture https://teaglebuilt.github.io/homelab/hardware/
to be continued...