Is there an rsync like program with the ability to track changes in file location? - eviltoast

I’m looking for a linux program that can mirror a directory to another drive and move a subdirectory in the mirror.

  • IsoKiero@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    5
    ·
    1 year ago

    lsyncd does just this. It’s intended use is to sync directories between systems over slow(ish) uplink, but it can work locally as well. It takes some fiddling to set up, but once set up it just does it’s thing seamlessly at the background. However if you’re just looking for a backup solution I’d might look for something else, like a plain rsync script.

    • Nine@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      1 year ago

      This is the best answer. I use it regularly to keep hundreds of TB in sync across nodes. Works extremely well and is pretty much hands off once setup.

      • johntash
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        Do you use lsyncd for multidirectional sync or only to mirror one node to the others?

  • randomname01@feddit.nl
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 year ago

    Why not exclude the folder you want to move from the initial sync, and sync that folder separately to the final location?

  • johntash
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 year ago

    Restic, kopia, and Borg are all pretty good backup tools with deduplication built in, so they might be a good option if you’re doing this for backup purposes?

  • foggy@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    1 year ago

    I use RealTimeSync.

    It just… Works. I love it. It’s free.

    There are plenty of features that could effectively let you do what you want.

    Mine is set to sync my server with a backup whenever my main PC is idle for 20 mins. Once it determines how to sync, it lets me review before syncing.

    • SomeBoyo@feddit.deOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      I am trying to create a crontab to backup multiple directory in which files change their location, but I don’t know if links would solve it

      • SpaceNoodle@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        1 year ago

        You can also have rsync exclude specific files, so you could sync the main dir first, then the special subdir specifically

  • vynlwombat@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    1 year ago

    rclone sync might be a acceptable?

    It doesn’t move files from one dir to another but it would delete the old directory and recopy to the new directory.

    I think rsync has the same functionality but could be wrong

  • redcalcium@lemmy.institute
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    As long as the backup system performs deduplication, it should be able to store the backup data efficiently even if the source files are constantly moved around or renamed.

    ZFS snapshots can perform deduplication. There is also ZBackup, which also has deduplication support.