[HELP] Setting up a Jellyfin server with different (remote) storage servers - eviltoast

Hello, not so long ago I discovered Jellyfin, and by extension Radarr, Sonarr, Bazarr, Jackett, etc.

So I immediately installed Jellyfin on a Hetzner server that I already had, powerful enough to have several people consuming content at the same time on these kinds of services.

As the hard drives at home were full, and I didn’t want to sacrifice my bandwidth, I got a Hetzner Storage Box to store the video content on.

So I’ve got Radarr, Sonarr and qBitTorrent installed on my computer, where I manage the downloads, upload them to the Storage Box which is then mounted on the server where Jellyfin is installed to serve the content (see the diagram above, the orange part would be a hypothesis for integrating more storage in the future).

Problems :

  • Synchronisation between my local machine and the Hetzner Storage Box: as I was saying, I download everything locally and then upload everything with rclone sync to the storage. The exact command is: rclone sync /mnt/2TB/Jellyfin HetznerBox:/Jellyfin --exclude "*.!qB" --transfers 10 --fast-list --checkers 500 --progress --log-level DEBUG --log-file=/var/log/rclone/rclone-sync-jellyfin.log This has several problems, it’s slow, and I have a 1 GB/s fibre connection, and I doubt the problem is with Hetzner… Secondly, if I delete content on the storage server and run the command again, the content will be resynchronised. What’s more, it often happens that I run the command and nothing happens for a long time before the synchronisation starts. Thirdly, rclone sync forces me to keep a local copy of everything.
  • rclone mount does not seem to respect the --vfs-cache-max-size: here is the command I use to mount the storage server on the server where Jellyfin is installed rclone mount HetznerBox:/Jellyfin /somepath/Jellyfin/ --vfs-cache-mode full --vfs-cache-max-size 100G --allow-other. But if I run df -h I get /dev/md2 436G 148G 266G 36% / And if I run sudo du -sh Jellyfin/ I get 378G Jellyfin/ The server only has Jellyfin installed, and I don’t know how to look precisely how much the vfs cache is using.
  • since Radarr, Sonarr and everything are on my computer, if I install Jellyserr on the same server as Jellyfin (which would be perfect for managing everything when we have several users), it won’t be able to communicate with Radarr and Sonarr.

Possible solutions:

  • Don’t use my local machine. I’d like to use the Hetzner server for Radarr, Sonarr, qBitTorrent, etc. but the problem is that I don’t want to store the data on this server, but on the Storage Box. How can I download directly from one server to another?
  • Could I use Mullvad VPN only for qBitTorrent downloads (and Jackett) on a Hetzner server, or is that too complicated or foolish?

Edit:

Diagram updated to adapt more to my configuration:

image

  • the Hetzner servers are in Finland
  • tried again overnight, rclone mount works fine, just extremely slow
  • downloads of “finished” torrents and those “in progress” are already separated
  • Katzastrophe@feddit.deEnglish
    15·
    1 year ago

    Can’t help you, but I have to ask, why Hetzner?

    They are a german server hosting company, you know, the country with some of the strictest copyright laws? For example, a kid at an old school of mine was once fined 800€ for accidentally sharing a song on a school hosted messaging board.

    If you do anything with pirated torrenting on their servers, they will know, and will come after your ass. And even sharing pirated content can get you in incredibly hot water, they might not have found out yet, but when they do, good luck.

    • bier@lemmy.blahaj.zoneEnglish
      3·
      1 year ago

      I’ve been using a Hetzner server for a couple of years now and haven’t gotten any abuse reports or DMCA takedown request but I’m using a docker + vpn setup so maybe it’s that

    • retiolus@lemmy.catOPEnglish
      1·
      1 year ago

      Hetzner because that’s what I had and have always had a good experience with them, anything else to recommend at the same prices? And that is a reason why I don’t download the content directly on their servers but on my local machine.

      • Katzastrophe@feddit.deEnglish
        5·
        1 year ago

        The only one in a similar price range that comes to mind is ovhcloud.com, they are a france based company, still not ideal though, as they might require ID.

        If money is the biggest factor (which I guess it is), best thing for you to do, might be to move your storage box off of the german servers and onto the finnish servers.

          • taaz@biglemmowski.winEnglish
            11·
            1 year ago

            Even in the finish location, if any of the “law” fuckers scourging the open trackers, sends an abuse/dmca to Hetzner, you will have some explaining to do as they will raise it as a ticket and require an explanation as to what happened and what is your course of action to remedy it.

            Source: my own experience about two months ago (used chatgpt to send them a neutral bussiness respone, worked like a charm)

            Use vpn that allows port forwarding, or never touch public trackers at all, or both.

        • VonReposti@feddit.dkEnglish
          1·
          1 year ago

          I don’t think I’ve ever given my ID for my Kimsufi or SoYouStart servers. Both of them are OVH subsidiaries.

          • Katzastrophe@feddit.deEnglish
            1·
            1 year ago

            I’ve heard they do it sometimes for high risk customers. Though they might have stopped some years ago

      • Rescuer6394@feddit.nlEnglish
        21·
        1 year ago

        they can detect piracy regardless. generally they set up honeypots and if you download a torrent from them, they will know and fine you.