FOSSWire
ai-local-edge

Ollama v0.40.6 adds GGUF q2_0 tensor support

Brief written by the FOSSWire AI editor from Ollama Local AI Runtimes

1 min read Impact: 4/10

Key Takeaway

Ollama v0.40.6 introduces support for q2_0 tensor and file types in the GGUF format.

Summary

The Ollama v0.40.6 pre-release includes updates to the GGUF model format and Windows runner stability. It adds support for q2_0 tensors and introduces identifier-based question keys for the --ask mode.

Technical updates in v0.40.6

  • GGUF support: Added support for q2_0 tensor and file types.
  • Windows: Implemented a fix to prevent orphaned runners.
  • CLI: Updated --ask mode to use identifiers for question keys.

Original reference: github.com →