Software developer building web products and open-source tools. Currently focused on local AI inference, native macOS software and AMD GPU acceleration through Metal.
I have been developing software since 2012, mostly across TypeScript, JavaScript, Python and PHP. My recent systems work uses Swift, C++, Metal and llama.cpp.
A native macOS app that runs language and image models locally on Intel Macs with AMD GPUs.
ToshLLM combines a SwiftUI interface with a patched llama.cpp engine built around the limitations of discrete AMD GPUs on Metal. It includes native chat, model management, vision, image generation, benchmarks, an OpenAI-compatible API and multi-GPU support.
If ToshLLM is useful to you, you can support its continued development.
My work spans product development, APIs, automation, e-commerce and infrastructure. I am comfortable moving from user-facing interfaces to backend services and lower-level performance work when a project requires it.
Primary tools: Swift, SwiftUI, Metal, C++, TypeScript, React, Next.js, Node.js, Python, PHP, WordPress, MongoDB and MySQL.
For professional inquiries or open-source collaboration, reach me through LinkedIn.