I am performing a migration that moves the images files from disk storage to object storage. During this migration the image back-end needs to be turned off, and so images will not be accessible.
It should still be possible to comment.
I am not sure how long this will take.
This is part of a few optimizations that I plan to do before I upgrade the instance to version 0.19.4.
I never knew there was a salamander that accompanied the mander nomenclature.
Yeah! Hello! 🦎
Thanks for all your work keeping the lights on, Sal!
Good luck!
Thanks!! I faced an unexpected problem, but now the files are being transferred _
The transfer is quite slow. I have timed it for a bit and if the “Used Space” data on the object storage dashboard is correct, files are being transferred at about 120 MB / minute… If that rate is the average, this will take about 40 hours :/ But hopefully the object storage dashboard is lagging. We will see.
Wow that’s depressingly slow! My previous file server would transfer at around 75MB/s (not minute) and I thought that was pretty bad. Hopefully you can figure out where the bottleneck is at.
I thought that worse case scenario this would be an overnight transfer, but only 40 GB have been transferred so far.
The server’s bandwidth use is well below the limit, so I think that the issue might be on the receiving end (Contabo’s S3-compatible object storage).
I had to decrease the number of parallel connections because otherwise I would get too many errors and the transfer would stop, so it might not be the transfer speed of a single file, but rather the amount of time the server has to wait between initiating transfers. I am not sure, but at ~50GB per 12 hours this will end up taking almost 4 days… I will ask in the Matrix chat to see if this was also the experience of others who migrated.
Fingers crossed 🤞
Late to the party, but I hope that the transfer goes well!
Thanks!
Almost a day and only about 50% transferred. I was expecting it to be much faster… I just hope once it finishes it all works smoothly 😄
🦎 🦎 🦎 🦎 🦎
On a lighter note, it would take far longer if you delayed it! Just imagine some years from now, the amount of data being transferred!
Exactly! It is something that I wanted to do over a year ago, but I was not sure how… Pretty much all my knowledge about servers comes from setting up and trying not to break a lemmy instance, so this was another lesson that I was a bit scared to learn 😂 It turns out that it was very simple as the pict-rs (Lemmy’s image backend) developer made a robust migration tool that automates this process. But since I don’t know that beforehand, I need to triple check backups and read the instructions several times in preparation so even if it is easy and the hard work has been done by others it still requires some focus.
