Rabbit Holes a commonplace book,kept in the open
Tag · 1 folios

Multimodal models

A pencil mark from the long tail. Browse the hand-chosen subjects for broader paths through the book.

450 Musing

Notes From Fucking Around With Vision, Text, and Audio Models

The bulk of my vibe-coding experiments over the last few months have involved audio and vision, so I’ve ended up trying an unreasonable number of multimodal models. This is a small guide based entirely on what I’ve actually used. If you have a project where you need vision capabilities for text extraction, models for…

keep reading — 14 min ↗
Multimodal modelsAudio modelsLarge language models 4 threads →