# AAC encoder and M4A output

Video Capture SDK .Net Video Edit SDK .Net Media Blocks SDK .Net

The VisioForge SDK provides several AAC encoder implementations, each with unique characteristics and use cases.

M4A is a file format used for storing audio data encoded with the Advanced Audio Coding (AAC) codec. VisioForge .Net SDKs provide robust support for creating high-quality M4A audio files through their dedicated M4AOutput class. This format is widely used for digital audio distribution due to its excellent compression efficiency and sound quality.

VideoCaptureCoreX VideoEditCoreX MediaBlocksPipeline

The cross-platform capable SDKs (VideoCaptureCoreX, VideoEditCoreX, MediaBlocksPipeline) allow you to utilize several AAC encoder implementations via M4AOutput. This guide focuses on three main approaches using dedicated settings objects:

1. AVENC AAC Encoder - A feature-rich, cross-platform encoder.
2. VO-AAC Encoder - A streamlined, cross-platform encoder.
3. Media Foundation AAC Encoder - A Windows-specific system encoder, accessible on Windows platforms via MFAACEncoderSettings.

The AVENC AAC Encoder offers the most comprehensive configuration options for audio encoding. It provides advanced settings for stereo coding, prediction, and noise shaping.

• Multiple coder strategies
• Configurable stereo coding
• Advanced noise and prediction techniques

The AVENC AAC Encoder supports three coder strategies:

• ANMR: Advanced noise modeling and reduction method
• TwoLoop: Two-loop searching method for optimization
• Fast: Default fast search algorithm (recommended for most use cases)

var aacSettings = new AVENCAACEncoderSettings
{
    Coder = AVENCAACEncoderCoder.Fast,
    Bitrate = 192,
    IntensityStereo = true,
    ForceMS = true,
    TNS = true
};

• Bitrates: 0, 32, 64, 96, 128, 160, 192, 224, 256, 320 kbps
• Sample Rates: 7350 to 96000 Hz
• Channels: 1 to 6 channels

The VO-AAC Encoder is a more streamlined encoder with simpler configuration options.

• Simplified configuration
• Straightforward bitrate and sample rate controls
• Limited to stereo audio

var aacSettings = new VOAACEncoderSettings
{
    Bitrate = 128
};

• Bitrates: 32, 64, 96, 128, 160, 192, 224, 256, 320 kbps
• Sample Rates: 8000 to 96000 Hz
• Channels: 1-2 channels

This encoder is specific to Windows platforms and offers a limited but performance-optimized encoding solution.

• Windows-specific implementation
• Predefined bitrate options
• Limited sample rate support

• Bitrates: 0 (Auto), 96, 128, 160, 192, 576, 768, 960, 1152 kbps
• Sample Rates: 44100, 48000 Hz
• Channels: 1, 2, 6 channels

Each encoder provides a static IsAvailable() method to check if the encoder can be used in the current environment. This is useful for runtime compatibility checks.

if (AVENCAACEncoderSettings.IsAvailable())
{
    // Use AVENC AAC Encoder
}
else if (VOAACEncoderSettings.IsAvailable())
{
    // Fallback to VO-AAC Encoder
}

The cross-platform implementation uses the M4AOutput class as the foundation for M4A file creation. To begin using this feature, initialize the class with your desired output filename:

var output = new M4AOutput("output.m4a");

The default encoder selection is platform-dependent:

• Windows environments: MF AAC
• Other platforms: VO-AAC

You can override this default selection by explicitly setting the Audio property:

// For VO-AAC encoder
output.Audio = new VOAACEncoderSettings();

// For AVENC AAC encoder
output.Audio = new AVENCAACEncoderSettings();

// For MF AAC encoder (Windows only)
#if NET_WINDOWS
output.Audio = new MFAACEncoderSettings();
#endif

Since M4A files are based on the MP4 container format, you can adjust various output parameters through the Sink property:

// Change the output filename
output.Sink.Filename = "new_output.m4a";

For workflows requiring specialized audio processing, the M4AOutput class supports custom audio processors:

// Implement your custom audio processing logic
output.CustomAudioProcessor = new MyCustomAudioProcessor(); 

The M4AOutput class provides several methods for handling files and retrieving encoder information:

// Get current output filename
string currentFile = output.GetFilename();

// Update the output filename
output.SetFilename("updated_file.m4a");

// Retrieve available audio encoders
var audioEncoders = output.GetAudioEncoders();

Each VisioForge SDK has a slightly different approach to implementing M4A output:

var core = new VideoCaptureCoreX();
core.Outputs_Add(output, true);

var core = new VideoEditCoreX();
core.Output_Format = output;

var aac = new VOAACEncoderSettings();
var sinkSettings = new MP4SinkSettings("output.m4a");
var m4aOutput = new M4AOutputBlock(sinkSettings, aac);

1. AVENC AAC Encoder:

   • Most flexible rate control
   • Supports constant bitrate (CBR)
   • Multiple encoding strategies affect quality and performance

2. VO-AAC Encoder:

   • Simple constant bitrate control
   • Recommend for straightforward encoding needs
   • Limited advanced configuration

3. Media Foundation Encoder:

   • Limited to predefined bitrates
   • Good for quick Windows-based encoding
   • Auto bitrate option available

• For advanced audio encoding with maximum control, use AVENC AAC Encoder
• For simple, cross-platform encoding, use VO-AAC Encoder
• For Windows-specific, optimized encoding, use Media Foundation Encoder

• Bitrate vs. Quality vs. File Size: Higher bitrates generally result in better audio quality but also lead to larger file sizes. Experiment with different bitrates to find the optimal balance for your specific content and distribution needs.
• Sample Rate Matching: Always try to choose sample rates that match your source audio. This avoids unnecessary resampling, which can potentially degrade audio quality.
• Encoder Characteristics:
  • AVENC AAC Encoder: Offers the most extensive configuration options, allowing for fine-grained control over quality and performance. Ideal for advanced use cases.
  • VO-AAC Encoder: Provides a good balance of simplicity, cross-platform compatibility, and quality. A solid choice for many common scenarios.
  • Media Foundation AAC Encoder: Leverages built-in Windows audio processing capabilities. It can be efficient on Windows but offers less configuration flexibility than AVENC.
• Channel Configuration (Mono vs. Stereo):
  • For voice-only content, using mono encoding (1 channel) can significantly reduce file size without a noticeable loss in quality for speech. Check if your chosen encoder settings (e.g., AVENCAACEncoderSettings.Channels) allow explicit channel configuration.
  • For music and rich audio environments, stereo (2 channels) is generally preferred.
• Content-Specific Bitrate Ranges: While higher is often better, the "best" bitrate depends on the audio content:
  • Speech/Voice: 64-96 kbps can be adequate.
  • General Music: 128-192 kbps is a common target for good quality.
  • High-Fidelity Audio: 256-320 kbps or higher might be used when pristine quality is critical. These are guidelines; always test with your specific audio.
• Target Audience and Platform: Consider who will be listening and on what devices. For example, if the audio is primarily for web streaming to mobile devices, extremely high bitrates might lead to buffering issues or unnecessary data consumption. Tailor your encoder choice and settings accordingly.

• Check the MP4 output guide for sample code.
• Check the AAC encoder block for sample code.

VideoCaptureCore VideoEditCore

M4AOutput is the primary class for configuring M4A (AAC) output settings. It implements both IVideoEditBaseOutput and IVideoCaptureBaseOutput interfaces.

• Returns: VideoCaptureOutputFormat.M4A
• Purpose: Gets the internal output format for video capture

• Returns: VideoEditOutputFormat.M4A
• Purpose: Gets the internal output format for video editing

• Returns: JSON string representation of the M4AOutput object
• Purpose: Serializes the current configuration to JSON

• Parameters: JSON string containing M4AOutput configuration
• Returns: New M4AOutput instance
• Purpose: Creates a new M4AOutput instance from JSON configuration

Defines the version of AAC to be used:

Specifies the AAC encoder stream object type:

Determines the AAC encoder stream output type:

// Create new M4A output configuration
var core = new VideoCaptureCore();
core.Mode = VideoCaptureMode.VideoCapture;
core.Output_Filename = "output.m4a";

var output = new VisioForge.Core.Types.Output.M4AOutput
{
    Bitrate = 192,
    Version = AACVersion.MPEG4,
    Object = AACObject.Low,
    Output = AACOutput.ADTS
};

core.Output_Format = output; // core is an instance of VideoCaptureCore or VideoEditCore

The optimal bitrate depends on your content type and quality requirements:

• 64-96 kbps: Suitable for voice recordings and speech content
• 128-192 kbps: Recommended for general music and audio content
• 256-320 kbps: Ideal for high-fidelity music where quality is paramount

• Use AACObject.Low for most applications as it provides an excellent balance between quality and encoding efficiency
• Reserve AACObject.Main for specialized use cases requiring maximum quality
• Avoid AACObject.Undefined as it isn't a valid encoding option

• AACOutput.ADTS provides better compatibility with various players and devices
• AACOutput.RAW is preferable when the AAC stream will be embedded within another container format