Parallel preprocessor processing

[Luna5ama]

It makes packs load faster (depending on how many preprocessors they spammed)

[douira]

It would be interesting to actually see a profile of shader pack loading before and after this patch. My past measurements (quite some time ago, so they might now be outdated) indicate the preprocessor's share of the total shader reloading time is very small.

[Luna5ama]

It would be interesting to actually see a profile of shader pack loading before and after this patch. My past measurements (quite some time ago, so they might now be outdated) indicate the preprocessor's share of the total shader reloading time is very small.

Like the description said. It depends on how many preprocessors they use. I saw good gains on Photon and Alpha Piscium. Also, there is #2629 that fixes transform cache.

[SpacEagle17]

Any updates on this? Would be interesting to see if it could be looked into if the claims are correct :)

[Luna5ama]

Ok so right now I am having loading performance issues with my pack then I remembered this exist. So on my pack's latest commit (d2d699ba). Preprocessing take a long time. This did make it faster.

I reload my pack 15 times while running a profiler and this is the result:
Before:


After:

As you can see from the second screenshot of each, there is some parallelism going on so it is working.
Reload time:
Before: ~750ms
After: ~250ms