Skip to content

Re-evaluate Explicit SIMD Aggregations #5032

@tustvold

Description

@tustvold

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

We currently only have explicit SIMD kernels for min, max and sum. This is a non-trivial additional complexity, and relies on features not present in stable Rust.

Describe the solution you'd like

Historically LLVM has struggled with auto-vectorisation of horizontal operations like aggregates, and this has been why we've kept these kernels, however, it is possible this has since improved. We should assess whether it is possible to eliminate the need for explicit SIMD kernels, and potentially remove them

Describe alternatives you've considered

Additional context

#4560 contains some experiments for improving the auto-vectorisation of aggregates

Metadata

Metadata

Assignees

No one assigned

    Labels

    arrowChanges to the arrow crateenhancementAny new improvement worthy of a entry in the changeloghelp wanted

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions