Vl.audio breaks vl.mediafoundation

Hadasi · November 3, 2020, 12:42pm

I have a video player that uses VL.Mediafoundation and its been working fine. I’ve been asked to add a music player and some sound effect to the installation. By adding VL.Audio (which uses ASIO4All) VLMediaFoundation’s player node does not load any videos or even show the duration of the videos.

Ideally, I would play the audio files from VL.Mediafoundation to compensate, but that doesn’t seem possible. I’m not sure this is possible from VL.GStreamer instead either at the moment, or whether I should convert the audio files into video files for the purpose.

Any suggestions? (I have managed to get irrklang to work but the license is a bit expensive and it feels a bit daft just to play a bit of audio.)

Hadasi · November 3, 2020, 1:51pm

To add, there isn’t any error message.

To recreate:
with VL.Mediafoundation [006] and VL.Audio[0.2.4-alpha] installed, run the ‘How to play video’ help patch
reference VL.audio nuget. Add AudioEngine. The media foundation player should freeze.

Elias · November 4, 2020, 11:55am

Hm, just checked and works for me. Was using vvvv gamma preview (2020.3-0045 with Stride), VL.MediaFoundation (0.2.0-stride) and VL.Audio (0.2.4-alpha).
I get a short hickup when adding the AudioEngine node, but after that the ASIO4ALL (v2.14) window pops up in the bottom right corner and all is well from that moment on. Could also open the FFT help patch while the movie was still playing.

Hadasi · November 4, 2020, 3:41pm

The issue was in Gamma 2020.2.2, but indeed, it isn’t present in the preview version

bjoern · June 22, 2021, 9:50am

Unfortunately I still encouter this issue. Tested with:

2021.4.0-0119
VL.Video.MediaFoundation.0.0.10-alpha
VL.Audio.0.2.23-alpha
ASIO4ALL v.2.15 Beta 1

Here is a demo patch and some test files to demonstrate the issue. Not sure if it is a vvvv bug though because as soon as ASIO4ALL is running videos played in VLC also don’t output any sound, but at least the video part plays fine.

MediaFoundationAudioIssue.7z (591.4 KB)

Thought I had a workaround by using the fruity loops asio driver but it keeps crashing:

tonfilm · September 17, 2021, 10:37am

The solution could be to use FlexASIO in WASAPI shared mode:

EDIT: scratch that, there is one bug that needs to be fixed first:

github.com/dechamps/FlexASIO

getLatencies() before createBuffers() returns error in violation of ASIO spec (triggers failure in NAudio)

opened 10:26AM - 23 Jun 21 UTC

closed 08:36PM - 16 Oct 21 UTC

bj-rn

bug asiohost

Hey, I am trying to use FlexAsio together with an application called [vvvv](http…s://visualprogramming.net/), which in turn uses [NAudio](https://github.com/naudio/NAudio) for audio playback. It works fine with other drivers like [ASIO4All](https://www.asio4all.org/) and the ASIO drivers that come with [FL Studio](https://www.image-line.com/). According to the FlexAsio log the cause of the exception is the following: ``` 2021-06-23T11:55:00.8155006+02:00 9752 8212 --- ENTERING CONTEXT: getLatencies() 2021-06-23T11:55:00.8155629+02:00 9752 8212 --- EXITING CONTEXT: getLatencies() (-997 [ASE_InvalidMode] getLatencies() called before createBuffers()) ``` [FlexASIO.log](https://github.com/dechamps/FlexASIO/files/6701030/FlexASIO.log) I don't know if this is a driver issue or if NAudio does somehow not handle the ASIO spec correctly. Going through their source the following seems to take place: `this.AsioOut = new AsioOut(driverName);` ``` public AsioOut(string driverName) { this.syncContext = SynchronizationContext.Current; InitFromName(driverName); } ``` [->](https://github.com/naudio/NAudio/blob/63c7011a7559cb55719e306dd3ab716b25e26d6a/NAudio.Asio/AsioOut.cs#L60) ``` private void InitFromName(string driverName) { this.driverName = driverName; // Get the basic driver AsioDriver basicDriver = AsioDriver.GetAsioDriverByName(driverName); // Instantiate the extended driver driver = new AsioDriverExt(basicDriver); driver.ResetRequestCallback = OnDriverResetRequest; this.ChannelOffset = 0; } ``` [->](https://github.com/naudio/NAudio/blob/63c7011a7559cb55719e306dd3ab716b25e26d6a/NAudio.Asio/AsioOut.cs#L147) ``` public AsioDriverExt(AsioDriver driver) { this.driver = driver; if (!driver.Init(IntPtr.Zero)) { throw new InvalidOperationException(driver.GetErrorMessage()); } callbacks = new AsioCallbacks(); callbacks.pasioMessage = AsioMessageCallBack; callbacks.pbufferSwitch = BufferSwitchCallBack; callbacks.pbufferSwitchTimeInfo = BufferSwitchTimeInfoCallBack; callbacks.psampleRateDidChange = SampleRateDidChangeCallBack; BuildCapabilities(); } ``` [->](https://github.com/naudio/NAudio/blob/63c7011a7559cb55719e306dd3ab716b25e26d6a/NAudio.Asio/ASIODriverExt.cs#L41) ``` private void BuildCapabilities() { capability = new AsioDriverCapability(); capability.DriverName = driver.GetDriverName(); // Get nb Input/Output channels driver.GetChannels(out capability.NbInputChannels, out capability.NbOutputChannels); capability.InputChannelInfos = new AsioChannelInfo[capability.NbInputChannels]; capability.OutputChannelInfos = new AsioChannelInfo[capability.NbOutputChannels]; // Get ChannelInfo for Inputs for (int i = 0; i < capability.NbInputChannels; i++) { capability.InputChannelInfos[i] = driver.GetChannelInfo(i, true); } // Get ChannelInfo for Output for (int i = 0; i < capability.NbOutputChannels; i++) { capability.OutputChannelInfos[i] = driver.GetChannelInfo(i, false); } // Get the current SampleRate capability.SampleRate = driver.GetSampleRate(); var error = driver.GetLatencies(out capability.InputLatency, out capability.OutputLatency); // focusrite scarlett 2i4 returns ASE_NotPresent here if (error != AsioError.ASE_OK && error != AsioError.ASE_NotPresent) { var ex = new AsioException("ASIOgetLatencies"); ex.Error = error; throw ex; } // Get BufferSize driver.GetBufferSize(out capability.BufferMinSize, out capability.BufferMaxSize, out capability.BufferPreferredSize, out capability.BufferGranularity); } ``` [->](https://github.com/naudio/NAudio/blob/63c7011a7559cb55719e306dd3ab716b25e26d6a/NAudio.Asio/ASIODriverExt.cs#L246)

bjoern · October 19, 2021, 11:10am

For reference:

tonfilm · February 17, 2022, 8:19pm

the latest VL.Audio package has WASAPI driver support.

system · February 17, 2023, 8:20pm

This topic was automatically closed 365 days after the last reply. New replies are no longer allowed.