Local first voice dictation app using Apple MLX and OpenAI Whisper

Introduction

We recently built a local first, private and secure voice dictation app. This app can automatically remove filler words, format and punctuate the text and switch between apps seamlessly. The best part is that it runs fully offline since the model runs on-device.

Note: This works only on Mac with Apple silicon as it leverage Apple's MLX library.

This is made possible by the incredible MLX library from Apple that lets you run powerful voice transcription models like OpenAI's whisper on Macs running on Apple silicon.

Reach out to me if you are looking to improve your team's efficiency by building AI agents.

Demo

Tech Stack

• Model: OpenAI Whisper

• Model platform: Apple ML Explore

• Model server: MLX Omni Server

• Python 3.11

Useful Resources

• Book a free consultation with Karthik

• Langtrace Website

• Langtrace Discord

• Langtrace Github

• Langtrace Twitter(X)

• Langtrace Linkedin