# Hugging Face publishes TorchNeuron profiling guide for AWS Trainium

> **Key takeaway:** Hugging Face released the first part of a tutorial series on profiling inference performance using TorchNeuron, the open source PyTorch backend for AWS Trainium AI accelerators.

**Published:** 2026-10-21T16:04:43+00:00 
**Source:** Hugging Face Blog & Announcements 
**Category:** ai-open-models 
**Canonical URL:** https://fosswire.org/news/hugging-face-publishes-torchneuron-profiling-guide-for-aws-t.html 

## Summary
The tutorial covers system-level profiling for machine learning workloads on AWS Trainium chips using TorchNeuron, which integrates with PyTorch through the PrivateUse1 extension mechanism. It demonstrates how to configure torch.profiler with the Neuron backend, interpret key_averages() tables comparing CPU and device time, and trace operations through Neuron Explorer. The walkthrough profiles three implementations of RMSNorm to compare performance characteristics.

## Profiling setup and tooling
- TorchNeuron registers as a PyTorch backend via the PrivateUse1 extension point, avoiding a dedicated dispatch key
- Profiling requires two objects: **NeuronConfig** (selects data streams and cores to capture) and **NeuronProfiler** (provides export_trace callback)
- **Neuron Explorer** is a browser-based viewer for system trace, device timeline, and per-engine breakdown; supports SSH tunnel or VS Code extension
- Device profiles produce matched **.neff** (compiled executable) and **.ntff** (hardware instruction trace) files identified by shared numeric hash
- The tutorial profiles three RMSNorm implementations: naive PyTorch ops, `torch.rms_norm()` fused kernel, and naive ops with `torch.compile`

## Why it matters
The tutorial lowers the barrier for ML practitioners to optimize inference on AWS Trainium, an increasingly relevant alternative to NVIDIA hardware in cloud AI deployments. Open source tooling for non-NVIDIA accelerators remains limited, making this documentation significant for diversifying AI hardware ecosystems.