Ollama v0.31.2 Release: Agent Core Integration, CUDA Fallback, and More
Decision Brief
Key changes in v0.31.2: Agent core integration (#16963), fallback to standard CUDA when JetPack runner is missing (#16949), enable Flash Attention on CUDA CC 6.x GPUs (#16994), MLX rewrite (#16919) and update to de7b4ed9 (#17056), removal of OLLAMA_EXPERIMENT=client2 env var (#16962). Fixes include unbounded parallelism (#16966), CUDA toolkit lookup (#16613), UTF-8 safe file opening (#16999). Also cleaned up llama-server dead code (#17007) and unsupported ROCm devices (#17010). For developers deploying models locally with Ollama, the Agent core integration lays groundwork for advanced automation; CUDA fallback improves JetPack compatibility; Flash Attention enables better inference efficiency on older GPUs (CC 6.x). Overall, this is an important minor release toward greater stability and broader hardware support.
Sources
- Ollama(GitHub Releases)
Local-model runtime releases: new supported models and serving features.
- Ollama(GitHub Releases)
留言
登入後即可留言,和其他 builder 交換實測心得。
還沒有留言,搶頭香。