Skip to content

Source error with sync delete all dest files #695

Open
@adrienyhuel

Description

@adrienyhuel

Hello,

I'm trying to synchronize the content of an S3 to a local directory.

If there is an error on source (like a network timeout to reach the S3, or the bucket doesn't exist), the existing files in the directory can be all deleted.

I suspect there is a race condition between listing source and dest, and the first generating an error will fail the sync process.
I think about that because if the dest folder contain only few files, then the files are deleted.
But if the dest folder contains lots of files (like /tmp dir), no files are deleted, because src s3 lisiting fail before dest local dir listing finish.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    Status

    No status

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions