The Bonsai-demo repo enables running Bonsai language models locally across Mac Metal, Linux/Windows CUDA/Vulkan/ROCm, and CPU targets. The updated Bonsai 27B family introduces vision-language capabilities, native OpenAI-style tool calling, and MCP server support. It also features a reasoning model with configurable effort and context windows exceeding 256k tokens.
- Run Bonsai 1-bit and 27B models locally on diverse hardware including Mac Metal and GPU/CPU stacks.
- Leverage vision-language features to analyze photos, screenshots, and PDFs directly in the demo UI.
- Utilize native OpenAI-style tool_calls and MCP servers for agentic workflow integration.
- Configure reasoning effort per chat or budget tokens per request for the 256k+ context window model.