SkiaTexture does not work receiving a video via DrawImage from a video source

benju · June 4, 2024, 8:13pm

SkiaTexture seems to have a problem with Video (IVideoSource) Input via SKImage/Layer. Works with Image file via SKImage/Layer though.

See patch attached:
240604_skiatexture.zip (459.7 KB)

(of course it would be better to play the video in Stride, but it should work however)

Elias · June 5, 2024, 8:42am

Stride and Skia render pipelines use different graphics devices. When bridging from one world into the other (SkiaTexture) we might run into resources which have been created on the other device and therefor are not valid on the one we’re rendering on. In your case that’s the SkImage produced by the VideoSourceToSkImage node. However what you could try is to tell that node to produce images backed by CPU memory (instead of GPU) by setting the prefer GPU pin to false. These images should then be renderable in both worlds.

That there even are two devices at play is unfortunate and a known issue since quite a while. However there’s no proper fix yet due to incompatibilities with blend modes in the used APIs. Sorry for that.

benju · June 8, 2024, 11:03pm

Yep, setting VideoSourceToSkImage’s “Prefer Gpu”-Pin to fals does the trick. Thanks for the explanation, this makes sense.

However, ideally this would be somehow recognized and handled internally (in the SkiaTexture), or?
But I understand it seems more complex then I thought.

bjoern · June 9, 2024, 9:09am

Hey, are you refering to this?

Looks like the sRGB color type is available in the 3.0.0 previews:

github.com

mono/SkiaSharp/blob/v3.0.0-preview.3.1/binding/SkiaSharp/Definitions.cs#L60


      
          		RgbaF32 = 12,
          		Rg88 = 13,
          		AlphaF16 = 14,
          		RgF16 = 15,
          		Alpha16 = 16,
          		Rg1616 = 17,
          		Rgba16161616 = 18,
          		Bgra1010102 = 19,
          		Bgr101010x = 20,
          		Bgr101010xXR = 21,
          		Srgba8888 = 22,
          		R8Unorm = 23,
          	}
          
          	public static partial class SkiaExtensions
          	{
          		public static bool IsBgr (this SKPixelGeometry pg) =>
          			pg == SKPixelGeometry.BgrHorizontal || pg == SKPixelGeometry.BgrVertical;
          
          		public static bool IsRgb (this SKPixelGeometry pg) =>
          			pg == SKPixelGeometry.RgbHorizontal || pg == SKPixelGeometry.RgbVertical;

Couldn’t find any roadmap for the stable release though.

This also looks interesting:

github.com/mono/SkiaSharp

[FEATURE] Support Direct3D

opened 03:34AM - 01 Apr 24 UTC

Kation

type/feature-request

### Is your feature request related to a problem? 1. Some GPU or its driver doe…sn't support Vulkan. For example, Intel Xe Graphics currently driver will return null ptr when get procedure address for some name. Then `GRContext.CreateVulkan` will return null. 2. Some environment only support OpenGL 1.1. For example, Virtual Machine without GPU. Or remote control without RDP with Intel Xe Graphics. Then `GRContext.CreateGl` will return null. Without Vulkan and OpenGL, we can only use CPU to render images. ### Describe the solution you would like Add D3D support with Windows os. ### Describe alternatives you have considered Add define `SK_Direct3D` when compile native skia so that I can use it with pinvoke and reflection. ### Additional context _No response_ ### Code of Conduct - [X] I agree to follow this project's Code of Conduct

github.com/mono/SkiaSharp

Compile Skia with Direct3D on Windows platform

mono:main ← Kation:main

opened 03:33AM - 08 Apr 24 UTC

Kation

+618 -3

**Description of Change** Compile Skia with Direct3D on Windows platform *…*Bugs Fixed** https://github.com/mono/SkiaSharp/issues/2817 **API Changes** None. **Behavioral Changes** None. **Required skia PR** https://github.com/mono/skia/pull/121 **PR Checklist** - [ ] Has tests (if omitted, state reason in description) - [ ] Rebased on top of main at time of PR - [ ] Merged related skia PRs - [ ] Changes adhere to coding standard - [ ] Updated documentation

tonfilm · June 10, 2024, 11:02am

These are all super nice developments in the SkiaSharp repo!

Elias · March 19, 2025, 12:25pm

Adding to the answer I gave further up: In the latest preview (7.0-256), Skia will use the same graphics device as Stride does. Had a quick look at your patch and where we see black in your screenshot, it now outputs the video correctly.