Sipeed MaixStation packs 256-TOPS Axera NPU, 128GB RAM in pocket Linux AI box

Sipeed has detailed the MaixStation, a compact Linux AI workstation built around the Axera AX8860P processor and a new Maix-V compute module. The system pairs 16 Arm Cortex-A55 cores with a 256 TOPS FP4 NPU, up to 128GB of LPDDR5X memory on a 256-bit bus, and 10G SFP+ networking in a 363cm³ enclosure. The company claims preliminary inference benchmarks for the 128GB model that exceed NVIDIA's DGX Spark on select Qwen3 models, though these figures are manufacturer-reported and unverified.

The MaixStation is designed for local AI development and deployment, with a USB/network mode switch allowing direct host connection or standalone inference serving. Software support includes Debian 13 with Linux 6.18, plus inference frameworks vLLM, SGLang, PyTorch, llama.cpp, and Ollama. Sipeed plans to open-source the AXDSL kernels used for hardware acceleration, and the system will ship with browser-based management and OpenAI- and Anthropic-compatible APIs.

AX8860P architecture and MaixStation platform details

• AX8860P SoC: 16 Arm Cortex-A55 cores paired with a dedicated NPU delivering 256 TOPS at dense FP4 precision, with integrated video processing hardware and PCIe 5.0 connectivity.
• Memory subsystem: 256-bit LPDDR5X-8533 interface supporting up to 128GB of unified memory with 273GB/s bandwidth, enabling on-device inference for models up to approximately 125 billion parameters in MoE configurations.
• Maix-V compute module: 78 × 78mm module using an LPCAMM2 connector, shared across MaixStation, MaixStation Pro, and MaixBlade product lines for platform scalability.
• Expansion and clustering: MCIO 8i interface with PCIe 5.0 ×8 allows dual-MaixStation linking for 256GB combined memory; MaixBlade PCIe card integrates four AX8860P processors for larger deployments.
• Open-source software commitments: AXDSL kernels and development tools planned for open-source release; vLLM and SGLang backends use AXDSL-based hardware acceleration with broader SDK availability in development.

Why it matters

The MaixStation represents a notable entry in the emerging market for compact, non-NVIDIA local AI inference hardware, with Sipeed's promised open-source AXDSL kernels potentially reducing dependency on proprietary acceleration stacks. For Linux developers and self-hosting enthusiasts, the combination of mainline-oriented Debian 13 support, familiar inference frameworks, and OpenAI-compatible APIs could provide a more transparent alternative to closed-edge AI platforms, though actual performance and software maturity will depend on delivery of the open-source commitments and community verification of the manufacturer's benchmark claims.