What kind of servers are you running? Why do you need 3? You could theoretically write one microservice to do the job of three "servers". If you are downloading
and uploading content it should not be too difficult. Off the top of the dome, without knowing what your running fully, you could cluster your stack with Kubernetes and use AWS/Google with elastic search maybe it would be faster than any home built stack and you would spend a lot less per any performance gain.
Sorry just interested never even thought of using stuff I work with every day to do something fun outside of work. It sounds like a fun little project with some financial gain on the back end.
Basically I'm just splitting the load between 3 servers to download and upload content faster.
I also assign one server to handle models who have equal or less than 200 videos and my other server handles the rest.
I use my local server to update the content.
I'd call myself a Datahoarder before I call myself a seller.
It started off as a fun project, but I wanted to download more content so I was like how am I going to sustain my hobby?; so I just started
selling content to pay for the servers.
I'm running 1 local server (aka my Windows PC) and 2 Windows VPS servers they both have 700GB HD that I utilize as a buffer for my uploads.
I need multiple servers because GDrive Filestream has a daily upload limit of 750GB.
At first, I couldn't max it out with just two servers; so I bought another and finally, it did hit the limit.
Since I kept maxing out the upload limit, I couldn't keep up with people's requests for content I didn't have.
The only way to increase the upload limit (without any tricks) is to pay for another GD account which grants you another 750GB and it resets every 12hrs instead of 24hrs. I'm able to upload 3TB per day with my 3 servers.
Somehow it's still not enough to handle people's request so I'm about to buy the 4th server. Never really thought it would get this big tbh.
The VPS' costs me $50 a month. I could probably save a lot more if I joined Google Cloud tbh so I'm going to look into what you said, but at the end of the day, the hobby pays for itself which is great and people get what they want lmao.
Hope I made sense; I'm hungry lmao.