This repository was archived by the owner on Nov 27, 2024. It is now read-only.

System.Numerics.TensorPrimitives for Cpu math #72

Merged

saddam213 merged 1 commit into master from CpuMath

Dec 21, 2023

Member

saddam213 commented Dec 21, 2023

Latest OnnxRuntime includes System.Numerics.TensorPrimitives which has some Span based Tensor math operations

This PR will aim to move all possible CPU tensor math to use these new functions, mainly TensorHelper, Scheduler and Diffuser classes


          Use System.Numerics.TensorPrimitives for Cpu math

6087b46

Member Author

saddam213 commented Dec 21, 2023 •

edited

Loading

After TensorHelper update gained about 5-10% performance

LCM 6 Steps: 1280ms -> 880ms avg 100 images

saddam213 merged commit 98e5264 into master

saddam213 deleted the CpuMath branch

December 21, 2023 06:33

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet