After some exports of your posted patch plus some subsequent performance profiler runs we managed to tweak some nodes. In total the render time went down from ~9ms to ~7.8ms, memory allocation during a time span of 10sec went down from 410MB to 240MB thereby reducing time spent in garbage collection from 140ms to 90ms. Not sure it will solve your performance issues, but call it a step in the right direction.
Here is a flame graph comparison of the main Render call.
Before:
After:
You can test these changes yourself by using the latest 2022.5 preview (>= 481) plus most recent VL.Elementa (>= 5.1.2, which by the time of writing wasn’t release yet as package - should be soon though).