Opus
Opus audio codec (RFC 6716): API and operations manual
1.5
Typedefs | Functions
Opus Decoder

This page describes the process and functions used to decode Opus. More...

Typedefs

typedef struct OpusDecoder OpusDecoder
 Opus decoder state. More...
 
typedef struct OpusDREDDecoder OpusDREDDecoder
 Opus DRED decoder. More...
 
typedef struct OpusDRED OpusDRED
 Opus DRED state. More...
 

Functions

int opus_decoder_get_size (int channels)
 Gets the size of an OpusDecoder structure. More...
 
OpusDecoderopus_decoder_create (opus_int32 Fs, int channels, int *error)
 Allocates and initializes a decoder state. More...
 
int opus_decoder_init (OpusDecoder *st, opus_int32 Fs, int channels)
 Initializes a previously allocated decoder state. More...
 
int opus_decode (OpusDecoder *st, const unsigned char *data, opus_int32 len, opus_int16 *pcm, int frame_size, int decode_fec)
 Decode an Opus packet. More...
 
int opus_decode_float (OpusDecoder *st, const unsigned char *data, opus_int32 len, float *pcm, int frame_size, int decode_fec)
 Decode an Opus packet with floating point output. More...
 
int opus_decoder_ctl (OpusDecoder *st, int request,...)
 Perform a CTL function on an Opus decoder. More...
 
void opus_decoder_destroy (OpusDecoder *st)
 Frees an OpusDecoder allocated by opus_decoder_create(). More...
 
int opus_dred_decoder_get_size (void)
 Gets the size of an OpusDREDDecoder structure. More...
 
OpusDREDDecoderopus_dred_decoder_create (int *error)
 Allocates and initializes an OpusDREDDecoder state. More...
 
int opus_dred_decoder_init (OpusDREDDecoder *dec)
 Initializes an OpusDREDDecoder state. More...
 
void opus_dred_decoder_destroy (OpusDREDDecoder *dec)
 Frees an OpusDREDDecoder allocated by opus_dred_decoder_create(). More...
 
int opus_dred_decoder_ctl (OpusDREDDecoder *dred_dec, int request,...)
 Perform a CTL function on an Opus DRED decoder. More...
 
int opus_dred_get_size (void)
 Gets the size of an OpusDRED structure. More...
 
OpusDREDopus_dred_alloc (int *error)
 Allocates and initializes a DRED state. More...
 
void opus_dred_free (OpusDRED *dec)
 Frees an OpusDRED allocated by opus_dred_create(). More...
 
int opus_dred_parse (OpusDREDDecoder *dred_dec, OpusDRED *dred, const unsigned char *data, opus_int32 len, opus_int32 max_dred_samples, opus_int32 sampling_rate, int *dred_end, int defer_processing)
 Decode an Opus DRED packet. More...
 
int opus_dred_process (OpusDREDDecoder *dred_dec, const OpusDRED *src, OpusDRED *dst)
 Finish decoding an Opus DRED packet. More...
 
int opus_decoder_dred_decode (OpusDecoder *st, const OpusDRED *dred, opus_int32 dred_offset, opus_int16 *pcm, opus_int32 frame_size)
 Decode audio from an Opus DRED packet with floating point output. More...
 
int opus_decoder_dred_decode_float (OpusDecoder *st, const OpusDRED *dred, opus_int32 dred_offset, float *pcm, opus_int32 frame_size)
 Decode audio from an Opus DRED packet with floating point output. More...
 
int opus_packet_parse (const unsigned char *data, opus_int32 len, unsigned char *out_toc, const unsigned char *frames[48], opus_int16 size[48], int *payload_offset)
 Parse an opus packet into one or more frames. More...
 
int opus_packet_get_bandwidth (const unsigned char *data)
 Gets the bandwidth of an Opus packet. More...
 
int opus_packet_get_samples_per_frame (const unsigned char *data, opus_int32 Fs)
 Gets the number of samples per frame from an Opus packet. More...
 
int opus_packet_get_nb_channels (const unsigned char *data)
 Gets the number of channels from an Opus packet. More...
 
int opus_packet_get_nb_frames (const unsigned char packet[], opus_int32 len)
 Gets the number of frames in an Opus packet. More...
 
int opus_packet_get_nb_samples (const unsigned char packet[], opus_int32 len, opus_int32 Fs)
 Gets the number of samples of an Opus packet. More...
 
int opus_packet_has_lbrr (const unsigned char packet[], opus_int32 len)
 Checks whether an Opus packet has LBRR. More...
 
int opus_decoder_get_nb_samples (const OpusDecoder *dec, const unsigned char packet[], opus_int32 len)
 Gets the number of samples of an Opus packet. More...
 
void opus_pcm_soft_clip (float *pcm, int frame_size, int channels, float *softclip_mem)
 Applies soft-clipping to bring a float signal within the [-1,1] range. More...
 

Detailed Description

This page describes the process and functions used to decode Opus.

The decoding process also starts with creating a decoder state. This can be done with:

int error;
dec = opus_decoder_create(Fs, channels, &error);
struct OpusDecoder OpusDecoder
Opus decoder state.
Definition: opus.h:399
OpusDecoder * opus_decoder_create(opus_int32 Fs, int channels, int *error)
Allocates and initializes a decoder state.

where

While opus_decoder_create() allocates memory for the state, it's also possible to initialize pre-allocated memory:

int size;
int error;
size = opus_decoder_get_size(channels);
dec = malloc(size);
error = opus_decoder_init(dec, Fs, channels);
int opus_decoder_init(OpusDecoder *st, opus_int32 Fs, int channels)
Initializes a previously allocated decoder state.
int opus_decoder_get_size(int channels)
Gets the size of an OpusDecoder structure.

where opus_decoder_get_size() returns the required size for the decoder state. Note that future versions of this code may change the size, so no assumptions should be made about it.

The decoder state is always continuous in memory and only a shallow copy is sufficient to copy it (e.g. memcpy())

To decode a frame, opus_decode() or opus_decode_float() must be called with a packet of compressed audio data:

frame_size = opus_decode(dec, packet, len, decoded, max_size, 0);
int opus_decode(OpusDecoder *st, const unsigned char *data, opus_int32 len, opus_int16 *pcm, int frame_size, int decode_fec)
Decode an Opus packet.

where

opus_decode() and opus_decode_float() return the number of samples (per channel) decoded from the packet. If that value is negative, then an error has occurred. This can occur if the packet is corrupted or if the audio buffer is too small to hold the decoded audio.

Opus is a stateful codec with overlapping blocks and as a result Opus packets are not coded independently of each other. Packets must be passed into the decoder serially and in the correct order for a correct decode. Lost packets can be replaced with loss concealment by calling the decoder with a null pointer and zero length for the missing packet.

A single codec state may only be accessed from a single thread at a time and any required locking must be performed by the caller. Separate streams must be decoded with separate decoder states and can be decoded in parallel unless the library was compiled with NONTHREADSAFE_PSEUDOSTACK defined.

Typedef Documentation

◆ OpusDecoder

typedef struct OpusDecoder OpusDecoder

Opus decoder state.

This contains the complete state of an Opus decoder. It is position independent and can be freely copied.

See also
opus_decoder_create,opus_decoder_init

◆ OpusDRED

typedef struct OpusDRED OpusDRED

Opus DRED state.

This contains the complete state of an Opus DRED packet. It is position independent and can be freely copied.

See also
opus_dred_create,opus_dred_init

◆ OpusDREDDecoder

Opus DRED decoder.

This contains the complete state of an Opus DRED decoder. It is position independent and can be freely copied.

See also
opus_dred_decoder_create,opus_dred_decoder_init

Function Documentation

◆ opus_decode()

int opus_decode ( OpusDecoder st,
const unsigned char *  data,
opus_int32  len,
opus_int16 pcm,
int  frame_size,
int  decode_fec 
)

Decode an Opus packet.

Parameters
[in]stOpusDecoder*: Decoder state
[in]datachar*: Input payload. Use a NULL pointer to indicate packet loss
[in]lenopus_int32: Number of bytes in payload*
[out]pcmopus_int16*: Output signal (interleaved if 2 channels). length is frame_size*channels*sizeof(opus_int16)
[in]frame_sizeNumber of samples per channel of available space in pcm. If this is less than the maximum packet duration (120ms; 5760 for 48kHz), this function will not be capable of decoding some packets. In the case of PLC (data==NULL) or FEC (decode_fec=1), then frame_size needs to be exactly the duration of audio that is missing, otherwise the decoder will not be in the optimal state to decode the next incoming packet. For the PLC and FEC cases, frame_size must be a multiple of 2.5 ms.
[in]decode_fecint: Flag (0 or 1) to request that any in-band forward error correction data be decoded. If no such data is available, the frame is decoded as if it were lost.
Returns
Number of decoded samples or Error codes

◆ opus_decode_float()

int opus_decode_float ( OpusDecoder st,
const unsigned char *  data,
opus_int32  len,
float *  pcm,
int  frame_size,
int  decode_fec 
)

Decode an Opus packet with floating point output.

Parameters
[in]stOpusDecoder*: Decoder state
[in]datachar*: Input payload. Use a NULL pointer to indicate packet loss
[in]lenopus_int32: Number of bytes in payload
[out]pcmfloat*: Output signal (interleaved if 2 channels). length is frame_size*channels*sizeof(float)
[in]frame_sizeNumber of samples per channel of available space in pcm. If this is less than the maximum packet duration (120ms; 5760 for 48kHz), this function will not be capable of decoding some packets. In the case of PLC (data==NULL) or FEC (decode_fec=1), then frame_size needs to be exactly the duration of audio that is missing, otherwise the decoder will not be in the optimal state to decode the next incoming packet. For the PLC and FEC cases, frame_size must be a multiple of 2.5 ms.
[in]decode_fecint: Flag (0 or 1) to request that any in-band forward error correction data be decoded. If no such data is available the frame is decoded as if it were lost.
Returns
Number of decoded samples or Error codes

◆ opus_decoder_create()

OpusDecoder* opus_decoder_create ( opus_int32  Fs,
int  channels,
int *  error 
)

Allocates and initializes a decoder state.

Parameters
[in]Fsopus_int32: Sample rate to decode at (Hz). This must be one of 8000, 12000, 16000, 24000, or 48000.
[in]channelsint: Number of channels (1 or 2) to decode
[out]errorint*: OPUS_OK Success or Error codes

Internally Opus stores data at 48000 Hz, so that should be the default value for Fs. However, the decoder can efficiently decode to buffers at 8, 12, 16, and 24 kHz so if for some reason the caller cannot use data at the full sample rate, or knows the compressed data doesn't use the full frequency range, it can request decoding at a reduced rate. Likewise, the decoder is capable of filling in either mono or interleaved stereo pcm buffers, at the caller's request.

◆ opus_decoder_ctl()

int opus_decoder_ctl ( OpusDecoder st,
int  request,
  ... 
)

Perform a CTL function on an Opus decoder.

Generally the request and subsequent arguments are generated by a convenience macro.

Parameters
stOpusDecoder*: Decoder state.
requestThis and all remaining parameters should be replaced by one of the convenience macros in Generic CTLs or Decoder related CTLs.
See also
Generic CTLs
Decoder related CTLs

◆ opus_decoder_destroy()

void opus_decoder_destroy ( OpusDecoder st)

Frees an OpusDecoder allocated by opus_decoder_create().

Parameters
[in]stOpusDecoder*: State to be freed.

◆ opus_decoder_dred_decode()

int opus_decoder_dred_decode ( OpusDecoder st,
const OpusDRED dred,
opus_int32  dred_offset,
opus_int16 pcm,
opus_int32  frame_size 
)

Decode audio from an Opus DRED packet with floating point output.

Parameters
[in]stOpusDecoder*: Decoder state
[in]dredOpusDRED*: DRED state
[in]dred_offsetopus_int32: position of the redundancy to decode (in samples before the beginning of the real audio data in the packet).
[out]pcmopus_int16*: Output signal (interleaved if 2 channels). length is frame_size*channels*sizeof(opus_int16)
[in]frame_sizeNumber of samples per channel to decode in pcm. frame_size must be a multiple of 2.5 ms.
Returns
Number of decoded samples or Error codes

◆ opus_decoder_dred_decode_float()

int opus_decoder_dred_decode_float ( OpusDecoder st,
const OpusDRED dred,
opus_int32  dred_offset,
float *  pcm,
opus_int32  frame_size 
)

Decode audio from an Opus DRED packet with floating point output.

Parameters
[in]stOpusDecoder*: Decoder state
[in]dredOpusDRED*: DRED state
[in]dred_offsetopus_int32: position of the redundancy to decode (in samples before the beginning of the real audio data in the packet).
[out]pcmfloat*: Output signal (interleaved if 2 channels). length is frame_size*channels*sizeof(float)
[in]frame_sizeNumber of samples per channel to decode in pcm. frame_size must be a multiple of 2.5 ms.
Returns
Number of decoded samples or Error codes

◆ opus_decoder_get_nb_samples()

int opus_decoder_get_nb_samples ( const OpusDecoder dec,
const unsigned char  packet[],
opus_int32  len 
)

Gets the number of samples of an Opus packet.

Parameters
[in]decOpusDecoder*: Decoder state
[in]packetchar*: Opus packet
[in]lenopus_int32: Length of packet
Returns
Number of samples
Return values
OPUS_BAD_ARGInsufficient data was passed to the function
OPUS_INVALID_PACKETThe compressed data passed is corrupted or of an unsupported type

◆ opus_decoder_get_size()

int opus_decoder_get_size ( int  channels)

Gets the size of an OpusDecoder structure.

Parameters
[in]channelsint: Number of channels. This must be 1 or 2.
Returns
The size in bytes.

◆ opus_decoder_init()

int opus_decoder_init ( OpusDecoder st,
opus_int32  Fs,
int  channels 
)

Initializes a previously allocated decoder state.

The state must be at least the size returned by opus_decoder_get_size(). This is intended for applications which use their own allocator instead of malloc.

See also
opus_decoder_create,opus_decoder_get_size To reset a previously initialized state, use the OPUS_RESET_STATE CTL.
Parameters
[in]stOpusDecoder*: Decoder state.
[in]Fsopus_int32: Sampling rate to decode to (Hz). This must be one of 8000, 12000, 16000, 24000, or 48000.
[in]channelsint: Number of channels (1 or 2) to decode
Return values
OPUS_OKSuccess or Error codes

◆ opus_dred_alloc()

OpusDRED* opus_dred_alloc ( int *  error)

Allocates and initializes a DRED state.

Parameters
[out]errorint*: OPUS_OK Success or Error codes

◆ opus_dred_decoder_create()

OpusDREDDecoder* opus_dred_decoder_create ( int *  error)

Allocates and initializes an OpusDREDDecoder state.

Parameters
[out]errorint*: OPUS_OK Success or Error codes

◆ opus_dred_decoder_ctl()

int opus_dred_decoder_ctl ( OpusDREDDecoder dred_dec,
int  request,
  ... 
)

Perform a CTL function on an Opus DRED decoder.

Generally the request and subsequent arguments are generated by a convenience macro.

Parameters
dred_decOpusDREDDecoder*: DRED Decoder state.
requestThis and all remaining parameters should be replaced by one of the convenience macros in Generic CTLs or Decoder related CTLs.
See also
Generic CTLs
Decoder related CTLs

◆ opus_dred_decoder_destroy()

void opus_dred_decoder_destroy ( OpusDREDDecoder dec)

Frees an OpusDREDDecoder allocated by opus_dred_decoder_create().

Parameters
[in]decOpusDREDDecoder*: State to be freed.

◆ opus_dred_decoder_get_size()

int opus_dred_decoder_get_size ( void  )

Gets the size of an OpusDREDDecoder structure.

Returns
The size in bytes.

◆ opus_dred_decoder_init()

int opus_dred_decoder_init ( OpusDREDDecoder dec)

Initializes an OpusDREDDecoder state.

Parameters
[in]decOpusDREDDecoder*: State to be initialized.

◆ opus_dred_free()

void opus_dred_free ( OpusDRED dec)

Frees an OpusDRED allocated by opus_dred_create().

Parameters
[in]decOpusDRED*: State to be freed.

◆ opus_dred_get_size()

int opus_dred_get_size ( void  )

Gets the size of an OpusDRED structure.

Returns
The size in bytes.

◆ opus_dred_parse()

int opus_dred_parse ( OpusDREDDecoder dred_dec,
OpusDRED dred,
const unsigned char *  data,
opus_int32  len,
opus_int32  max_dred_samples,
opus_int32  sampling_rate,
int *  dred_end,
int  defer_processing 
)

Decode an Opus DRED packet.

Parameters
[in]dred_decOpusDRED*: DRED Decoder state
[in]dredOpusDRED*: DRED state
[in]datachar*: Input payload
[in]lenopus_int32: Number of bytes in payload
[in]max_dred_samplesopus_int32: Maximum number of DRED samples that may be needed (if available in the packet).
[in]sampling_rateopus_int32: Sampling rate used for max_dred_samples argument. Needs not match the actual sampling rate of the decoder.
[out]dred_endopus_int32*: Number of non-encoded (silence) samples between the DRED timestamp and the last DRED sample.
[in]defer_processingint: Flag (0 or 1). If set to one, the CPU-intensive part of the DRED decoding is deferred until opus_dred_process() is called.
Returns
Offset (positive) of the first decoded DRED samples, zero if no DRED is present, or Error codes

◆ opus_dred_process()

int opus_dred_process ( OpusDREDDecoder dred_dec,
const OpusDRED src,
OpusDRED dst 
)

Finish decoding an Opus DRED packet.

The function only needs to be called if opus_dred_parse() was called with defer_processing=1. The source and destination will often be the same DRED state.

Parameters
[in]dred_decOpusDRED*: DRED Decoder state
[in]srcOpusDRED*: Source DRED state to start the processing from.
[out]dstOpusDRED*: Destination DRED state to store the updated state after processing.
Returns
Error codes

◆ opus_packet_get_bandwidth()

int opus_packet_get_bandwidth ( const unsigned char *  data)

Gets the bandwidth of an Opus packet.

Parameters
[in]datachar*: Opus packet
Return values
OPUS_BANDWIDTH_NARROWBANDNarrowband (4kHz bandpass)
OPUS_BANDWIDTH_MEDIUMBANDMediumband (6kHz bandpass)
OPUS_BANDWIDTH_WIDEBANDWideband (8kHz bandpass)
OPUS_BANDWIDTH_SUPERWIDEBANDSuperwideband (12kHz bandpass)
OPUS_BANDWIDTH_FULLBANDFullband (20kHz bandpass)
OPUS_INVALID_PACKETThe compressed data passed is corrupted or of an unsupported type

◆ opus_packet_get_nb_channels()

int opus_packet_get_nb_channels ( const unsigned char *  data)

Gets the number of channels from an Opus packet.

Parameters
[in]datachar*: Opus packet
Returns
Number of channels
Return values
OPUS_INVALID_PACKETThe compressed data passed is corrupted or of an unsupported type

◆ opus_packet_get_nb_frames()

int opus_packet_get_nb_frames ( const unsigned char  packet[],
opus_int32  len 
)

Gets the number of frames in an Opus packet.

Parameters
[in]packetchar*: Opus packet
[in]lenopus_int32: Length of packet
Returns
Number of frames
Return values
OPUS_BAD_ARGInsufficient data was passed to the function
OPUS_INVALID_PACKETThe compressed data passed is corrupted or of an unsupported type

◆ opus_packet_get_nb_samples()

int opus_packet_get_nb_samples ( const unsigned char  packet[],
opus_int32  len,
opus_int32  Fs 
)

Gets the number of samples of an Opus packet.

Parameters
[in]packetchar*: Opus packet
[in]lenopus_int32: Length of packet
[in]Fsopus_int32: Sampling rate in Hz. This must be a multiple of 400, or inaccurate results will be returned.
Returns
Number of samples
Return values
OPUS_BAD_ARGInsufficient data was passed to the function
OPUS_INVALID_PACKETThe compressed data passed is corrupted or of an unsupported type

◆ opus_packet_get_samples_per_frame()

int opus_packet_get_samples_per_frame ( const unsigned char *  data,
opus_int32  Fs 
)

Gets the number of samples per frame from an Opus packet.

Parameters
[in]datachar*: Opus packet. This must contain at least one byte of data.
[in]Fsopus_int32: Sampling rate in Hz. This must be a multiple of 400, or inaccurate results will be returned.
Returns
Number of samples per frame.

◆ opus_packet_has_lbrr()

int opus_packet_has_lbrr ( const unsigned char  packet[],
opus_int32  len 
)

Checks whether an Opus packet has LBRR.

Parameters
[in]packetchar*: Opus packet
[in]lenopus_int32: Length of packet
Returns
1 is LBRR is present, 0 otherwise
Return values
OPUS_INVALID_PACKETThe compressed data passed is corrupted or of an unsupported type

◆ opus_packet_parse()

int opus_packet_parse ( const unsigned char *  data,
opus_int32  len,
unsigned char *  out_toc,
const unsigned char *  frames[48],
opus_int16  size[48],
int *  payload_offset 
)

Parse an opus packet into one or more frames.

Opus_decode will perform this operation internally so most applications do not need to use this function. This function does not copy the frames, the returned pointers are pointers into the input packet.

Parameters
[in]datachar*: Opus packet to be parsed
[in]lenopus_int32: size of data
[out]out_tocchar*: TOC pointer
[out]frameschar*[48] encapsulated frames
[out]sizeopus_int16[48] sizes of the encapsulated frames
[out]payload_offsetint*: returns the position of the payload within the packet (in bytes)
Returns
number of frames

◆ opus_pcm_soft_clip()

void opus_pcm_soft_clip ( float *  pcm,
int  frame_size,
int  channels,
float *  softclip_mem 
)

Applies soft-clipping to bring a float signal within the [-1,1] range.

If the signal is already in that range, nothing is done. If there are values outside of [-1,1], then the signal is clipped as smoothly as possible to both fit in the range and avoid creating excessive distortion in the process.

Parameters
[in,out]pcmfloat*: Input PCM and modified PCM
[in]frame_sizeint Number of samples per channel to process
[in]channelsint: Number of channels
[in,out]softclip_memfloat*: State memory for the soft clipping process (one float per channel, initialized to zero)
For more information visit the Opus Website.