Search results

<code>OutOfBoundsError</code> when streaming parquet files with <code>low_memory=True</code>

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

waiting on authorWaiting for user input or feedback.Waiting for user input or feedback.

Status: Open.

Bug

#553 In Lightning-AI/litData;

· kyoungrok0517 opened on Apr 13, 2025

Local cache dir not fully clearing in DDP multi-node training.

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#512 In Lightning-AI/litData;

· JackUrb opened on Mar 12, 2025

CI error: <code>All chunks should've been deleted</code> keeps coming back

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#437 In Lightning-AI/litData;

· deependujha opened on Dec 20, 2024

incorrect dataloader length when <code>drop_last=False</code>

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#402 In Lightning-AI/litData;

· grez72 opened on Oct 28, 2024

The config isn't consistent between chunks

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

waiting on authorWaiting for user input or feedback.Waiting for user input or feedback.

won't fix

Status: Open.

#370 In Lightning-AI/litData;

· gluonfield opened on Sep 17, 2024

StreamingDataset causes NCCL timeout when using multiple nodes

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

won't fix

Status: Open.

#340 In Lightning-AI/litData;

· hubenjm opened on Aug 26, 2024

RuntimeError: Can't start new thread

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#280 In Lightning-AI/litData;

· cgebbe opened on Jul 31, 2024

If data samples contain a Python list with a variable number of elements, type inference will fail

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#260 In Lightning-AI/litData;

· senarvi opened on Jul 23, 2024

Profiler patches torch without reverting it

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#240 In Lightning-AI/litData;

· awaelchli opened on Jul 17, 2024

Using a streaming dataloader with an unbalanced dataset yields unexpected batch sizes.

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#199 In Lightning-AI/litData;

· esivonxay-cognitiv opened on Jun 29, 2024

Pytorch lighting Fabric + lit data + DDP hangs when finishing epoch

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#129 In Lightning-AI/litData;

· miguelalba96 opened on May 13, 2024