Skip to content

Reduce memory use #3

Open
Open
@danieldk

Description

@danieldk

Currently, we are computing the distances between each instance and each cluster centroid using a matrix multiplication of both matrices. This requires n_instances x n_centroids memory. When more than one thread is used, we have multiple such matrices in flight, resulting in large memory use.

Alternatively, we could compute the centroid distances per instance. This requires far less memory, but is more CPU intensive.

The reductive API should offer both approaches.

Metadata

Metadata

Assignees

No one assigned

    Labels

    FeatureNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions