local-llm Guide: Build a High-Performance LLM Server

Introduction Running state-of-the-art Large Language Models (LLMs) locally is the goal for many developers seeking privacy, performance, and freedom from API costs. However, moving beyond simple single-GPU setups into the world of high-performance, multi-GPU servers...

Apple’s Foundation Models Utilities: A Guide for Swift Devs

Introduction As Apple pushes further into on-device and private cloud AI with Apple Intelligence, developers are gaining powerful new native tools. The core of this is the Foundation Models framework, a Swift API for working with large language models. Recognizing the...

rizzo-pii: A Local-First AI Privacy Guard for LLMs

Introduction The convenience of using powerful cloud-based LLMs like ChatGPT or Claude for summarizing contracts or legal documents comes with a significant risk: data privacy. Every time a user pastes sensitive text, they are sending personally identifiable...

mlx-dspark: Efficient LLM Alignment on Apple Silicon

Introduction Aligning Large Language Models (LLMs) with human preferences is a critical step in making them safe and useful, but traditional methods can be inefficient. The popular Direct Preference Optimization (DPO) technique, while an improvement over older...

Audar-ASR-V1: A Speech-to-Text Model for Indian Languages

Introduction Developers working with Automatic Speech Recognition (ASR) often face a trade-off between using general-purpose models that work reasonably well for many languages and specialized models that offer high accuracy for a specific dialect. For the rich...