Posts tagged GPU

DictatorFlow is a voice-to-text platform that ships as a single 23MB native binary for Linux, Windows, and macOS. It evolved from VoiceType, a Go-based Linux-only CLI tool, into a full cross-platform application rewritten in Zig with local GPU inference, multi-provider cloud fallback, and a web…

Production ML inference is bottlenecked by memory bandwidth, not compute. Every PyTorch operation launches a separate GPU kernel, allocates intermediate tensors, and round-trips through global memory. CuteDSL fixes this by fusing multiple operations into single Triton/CUDA kernels – delivering up…