FFmpeg adds native xHE-AAC decoder for majority of streams

FFmpeg has merged a native xHE-AAC audio decoder into its codebase. The decoder currently supports streams that do not use (e)SBR, USAC, or MPEG-H Surround extensions, which covers the majority of xHE-AAC content currently in circulation. Support for the remaining USAC and (e)SBR components is under active development. The implementation effort also uncovered several specification ambiguities, which the FFmpeg team has reported back to the standard authors for potential errata.

What the xHE-AAC decoder supports today

• Core xHE-AAC decoding: The native decoder handles standard xHE-AAC streams without extended spectral band replication or unified speech and audio coding layers.
• Unsupported extensions: (e)SBR, USAC, and MPEG-H Surround are explicitly not yet implemented; these require additional development work.
• Specification feedback loop: The FFmpeg team identified specification issues during implementation and submitted findings to the authors for future errata inclusion.
• Stability work ongoing: The decoder is functional for supported streams but remains under active refinement for broader compatibility and robustness.

Why it matters

Native xHE-AAC support removes a dependency on external or proprietary decoders for FFmpeg users, streamlining media processing pipelines on Linux and other platforms. As xHE-AAC gains adoption in streaming and broadcast for its volume normalization features, having first-class open-source support ensures Linux distributions and downstream applications like video editors, transcoders, and media servers can handle this format without licensing friction.