Mistral Inference v1.4.0 adds support for Pixtral models
Key Takeaway
The mistral-inference library now supports the Pixtral-12B-2409 multimodal model, allowing for image and text processing.
Summary
Mistral AI has released version 1.4.0 of the mistral-inference repository. This update introduces support for the Pixtral-12B-2409 model, enabling users to run multimodal inference via Python or the command line. The update allows the model to process text prompts alongside one or more images.
Technical details of Pixtral support
- Supports the Pixtral-12B-2409 model via the
mistral_inferencepackage. - Enables multimodal input using
ImageURLChunkandTextChunkwithin theChatCompletionRequestprotocol. - Includes support for the tekken tokenizer.
- Provides CLI capabilities via
mistral-chatfor interactive image and text prompting.
Original reference: github.com →