FOSSWire
Search/
Open Hardware & RISC-V

Arduino App Lab 0.11 adds production app releases, AI pose estimation, and phone sensor streaming

Brief written by the FOSSWire AI editor from Arduino How we write

2 min read

Key Takeaway

Arduino App Lab 0.11 introduces production-grade "App Releases" for deployment to third-party boards, a side-panel AI coding assistant, on-device pose estimation for VENTUNO Q, and expanded mobile sensor streaming.

Summary

Arduino released App Lab 0.11, expanding its project deployment and AI integration capabilities. The update adds immutable, pre-compiled app packages for the Works with Arduino program, a context-aware Agent Panel chat beside the code editor, and a new Pose Estimation Brick that runs locally on VENTUNO Q with both preconfigured skeleton tracking and custom pose training from photo folders. The Mobile Companion App now streams microphone and IMU data over WebSocket, and a new TPS brick enables Qualcomm's terrestrial positioning service on UNO Q.

What's new in App Lab 0.11

  • App Releases: Frozen, immutable packages with locked dependencies and pre-compiled sketches; remote dependencies like AI models download at install time. Deployable to Works with Arduino certified third-party hardware.
  • Agent Panel: Side-chat AI assistant using open workspace files as context, distinct from the full-window Agent Mode in 0.10. Updates files during plain-language chat and organizes history per-app.
  • Pose Estimation Brick: Runs locally on VENTUNO Q at up to 10 FPS with 17-point skeleton tracking. Standard poses (standing, sitting, arms up/down) work without training; custom poses require only positive and negative example photo folders.
  • LLM Brick expansion: Direct Hugging Face model import via ID or URL, with automatic compatibility checking and quantization selection.
  • Mobile Companion App: Now streams microphone and IMU data as JSON over WebSocket at high frequency, with password protection and encryption options. External devices can use the same WebSocket interface.
  • TPS brick: Qualcomm Terrestrial Positioning Service on UNO Q, using Wi-Fi, cellular, and Bluetooth LE signals for positioning with power management.

Why it matters

The App Release feature signals Arduino's push toward production deployment beyond hobbyist sharing, potentially making App Lab a more viable path for small-scale commercial IoT products. Local pose estimation and expanded phone sensor streaming also reduce reliance on cloud services for edge AI and sensing applications.

Original reference: blog.arduino.cc →