PinnedThe Malaccan Adventures of Captain Tiger BellyNotes on a one year sabbatical sailing Southeast Asia.Jun 13Jun 13
The Exciting Race to Build a Secure OS Without CA revolution in operating systems is quietly taking shape in the open source community. The year is 1991. The dominating operating UNIX…Sep 19Sep 19
Monitoring your HPC/GPU Cluster Performance and ThermalsMost of my favorite Red Hat consulting engagements involved performance tuning. In the good old days before solid state storage most…Sep 11Sep 11
Quantize Karaoke is the Whisper AI Game You’re MissingOne of the projects I’ve been presented during this Asian sabbatical was custom use cases for Whisper.cpp. This is the open source C++…Jun 9Jun 9
The Spectacular Failure of Apple Vision ProYet another generation of virtual reality equipment has launched and failed, as Apple discontinues its much hyped Apple Vision Pro headset…Dec 13, 2024A response icon1Dec 13, 2024A response icon1
Published inTeraSkyUltimate AV1 Security CameraAs a big advocate for the open source AV1 video codec, I once presented a few use cases to the Cloud Native Media group in London. I…Aug 27, 2024Aug 27, 2024
Published inTeraSkyThe Misleading Costs of Private vs Public InferenceI crunched some numbers of private vs public LLM costs. The results blew my mind.Jul 30, 2024A response icon1Jul 30, 2024A response icon1
Published inTeraSkyThe Glorious Return of Bytecode: WebAssemblyEvery time compute architecture dominance shifts the question of portability comes up. With developer machines using one architecture and…Jul 1, 2024Jul 1, 2024
Published inTeraSkyLlama 3’s Rust Skills are ImpressiveA lot of the public scoring on open models today are based on general knowledge. Many of these models are impressive for general use but…Apr 29, 2024Apr 29, 2024
Published inTeraSkyAutoscaling Llama Server in the Cloud from $0.08/hrOnce you’ve trained a base model on your customer support content and database, how do you deploy that model autoscaled out enough to…Apr 19, 2024A response icon1Apr 19, 2024A response icon1
