Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?
-
@Dashrender said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
How much actual data do you have? 5 TB?
It seems odd that your backups would grow to 8.5 TB then drop to 5 TB, I assume this means your backups can't do daily pruning of your retention policy?
So you have 4 GB of changes a day - not a small amount, but not huge either.
If you're going to sync just once a week, what's your weekly change rate? that's a number you're going to need to give Google to figure out pricing, unless the QNAP is backing up all the incrementals from the week on that single weekly sync.
@JaredBusch said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
@Dashrender said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
How much actual data do you have? 5 TB?
It seems odd that your backups would grow to 8.5 TB then drop to 5 TB, I assume this means your backups can't do daily pruning of your retention policy?
How is this odd? Full backup = 5TB. Then add incremenatls, bring it up to 8.5TB.
Then a new full backup runs and then purges the old full and incrementals bringing it back to 5TB.
@Dashrender , @JaredBusch is right. The Actual data is around 5TB and incremental backup takes up to 60 days and purge 30 days backup and keeps 30 days anytime.
-
So backup data is going up to 8.5 TB now, and of course this 8.5 TB is not stable and will change as actual data changes.
So should I consider 8.5 TB ? or 10TB (for safer side) as my Cloud Storage need ?
-
@openit said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
So backup data is going up to 8.5 TB now, and of course this 8.5 TB is not stable and will change as actual data changes.
So should I consider 8.5 TB ? or 10TB (for safer side) as my Cloud Storage need ?
I'm pretty sure Google changes for what you actually use. But for presentation purposes, it might be best to just use 10 TB so you don't sell it short on possible cost.
-
@openit said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
Unlike for any local or onsite backup with NAS, cloud backup seems to be bit difficult to understand, estimate, propose to management and use in real-time.
That's because "cloud backup" isn't a thing. It's an amorphous concept, not even a single concept let alone a single thing.
-
@openit said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
I am not sure what is the cause. One option in my hand is allocating dedicated bandwidth to QNAP NAS on Firewall.
Never dedicate bandwidth, use QoS instead. Dedicated just cripples everything else.
-
@scottalanmiller said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
@openit said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
I am not sure what is the cause. One option in my hand is allocating dedicated bandwidth to QNAP NAS on Firewall.
Never dedicate bandwidth, use QoS instead. Dedicated just cripples everything else.
Sorry, I am no expert in Networks, actually I meant for QoS by saying Dedicated. I understand it could be different in technical meaning like, QoS will use bandwidth only when it needs something like that ?
-
@openit said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
@scottalanmiller said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
@openit said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
I am not sure what is the cause. One option in my hand is allocating dedicated bandwidth to QNAP NAS on Firewall.
Never dedicate bandwidth, use QoS instead. Dedicated just cripples everything else.
Sorry, I am no expert in Networks, actually I meant for QoS by saying Dedicated. I understand it could be different in technical meaning like, QoS will use bandwidth only when it needs something like that ?
Correct. A lot of people do reserved bandwidth instead of QoS and really mess up their networks, it's a common thing to get wrong so very important to use the right terms - especially since a lot of routers offer both.
-
So I am trying to estimate the Google Cloud Storage pricing with their calculator.
Requirements :
Region : (looking for cheapest one) - selected South Carolina as a test. which one is cheapest location ?
Storage Capacity : 10TB. And space could be increased without any interruption, right ?
Redundancy : I believe this multi-regional is for Redundancy, which means our data will be maintained in two or more locations. I am not going with Redundancy option.
Type of Storage : Because I don't want cold storage, I have chosen "Cloud Storage Nearline"
That's it ?
-
@scottalanmiller @Dashrender @JaredBusch @DustinB3403
I have just filled Location and Cloud Storage nearline, no idea about other options like operations etc.
-
How about restore options below storage ?
Should I include this estimate too ? For retrieving of data, we will require to retrieve only at the time of unsuccessful restoration from Onsite backup. And sometimes I want to retrieve to test.
One more thing I believe to be considered is, the backup we are going to take is Backup Files (Incremental Backup), so all files needs to downloaded at the time retrieval, so downloading 10TB will be horrible and may take ages
?
-
@scottalanmiller said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
@openit said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
@scottalanmiller said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
@openit said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
I am not sure what is the cause. One option in my hand is allocating dedicated bandwidth to QNAP NAS on Firewall.
Never dedicate bandwidth, use QoS instead. Dedicated just cripples everything else.
Sorry, I am no expert in Networks, actually I meant for QoS by saying Dedicated. I understand it could be different in technical meaning like, QoS will use bandwidth only when it needs something like that ?
Correct. A lot of people do reserved bandwidth instead of QoS and really mess up their networks, it's a common thing to get wrong so very important to use the right terms - especially since a lot of routers offer both.
Yup, same concept with phone systems. QoS is the best way to make sure they work even if everything else is congested.
-
Couple of things. Last time I've run bittorrent on a qnap it was way more slow then a pc. At the time no qos was there or I had missed it.
Google can apply limits. We have migrated our mails on google. Aprox the company had 90 gb mail uploaded. Google limited upload by no more than 3 mails per minute regardless of the size. Limit was on mail number.
Don't know if they apply similar restriction in storage. -
@matteo-nunziati said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
Couple of things. Last time I've run bittorrent on a qnap it was way more slow then a pc. At the time no qos was there or I had missed it.
Google can apply limits. We have migrated our mails on google. Aprox the company had 90 gb mail uploaded. Google limited upload by no more than 3 mails per minute regardless of the size. Limit was on mail number.
Don't know if they apply similar restriction in storage.3 emails a min?
-
@Dashrender said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
@matteo-nunziati said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
Couple of things. Last time I've run bittorrent on a qnap it was way more slow then a pc. At the time no qos was there or I had missed it.
Google can apply limits. We have migrated our mails on google. Aprox the company had 90 gb mail uploaded. Google limited upload by no more than 3 mails per minute regardless of the size. Limit was on mail number.
Don't know if they apply similar restriction in storage.3 emails a min?
sorry, messed up numbers: 1 mail every 3 seconds
-
@matteo-nunziati said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
@Dashrender said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
@matteo-nunziati said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
Couple of things. Last time I've run bittorrent on a qnap it was way more slow then a pc. At the time no qos was there or I had missed it.
Google can apply limits. We have migrated our mails on google. Aprox the company had 90 gb mail uploaded. Google limited upload by no more than 3 mails per minute regardless of the size. Limit was on mail number.
Don't know if they apply similar restriction in storage.3 emails a min?
sorry, messed up numbers: 1 mail every 3 seconds
That's still amazingly slow.
-
I have applied QoS for NAS box by 4MBps, not sure if it's enough ? and following is the status QNAP's Google Cloud backup software when I triggered full backup data (around 8TB) :
Expected finishing date is terrible : Around after two months
Transfer rate : 1.79MBps (before applying QoS, it was 606.29 KBps) and don't know why it's not boosting upto 4MBps ?
-
@openit said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
I have applied QoS for NAS box by 4MBps, not sure if it's enough ? and following is the status QNAP's Google Cloud backup software when I triggered full backup data (around 8TB) :
Expected finishing date is terrible : Around after two months
Transfer rate : 1.79MBps (before applying QoS, it was 606.29 KBps) and don't know why it's not boosting upto 4MBps ?
You could use that maybe for archival or escrow purposes. Something you really don't need to restore from. Time to restore is important, too.
-
@Tim_G said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
@openit said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
I have applied QoS for NAS box by 4MBps, not sure if it's enough ? and following is the status QNAP's Google Cloud backup software when I triggered full backup data (around 8TB) :
Expected finishing date is terrible : Around after two months
Transfer rate : 1.79MBps (before applying QoS, it was 606.29 KBps) and don't know why it's not boosting upto 4MBps ?
You could use that maybe for archival or escrow purposes. Something you really don't need to restore from. Time to restore is important, too.
Here I have chosen Nearline but not cold storage, because it's not Archive but Offsite Backup.
Are you saying to use for Archival because the performance doesn't seems to be practical ?
-
@openit said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
@Tim_G said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
@openit said in Google Cloud as offsite backup. How to check if it's suitable for us or no and pricing ?:
I have applied QoS for NAS box by 4MBps, not sure if it's enough ? and following is the status QNAP's Google Cloud backup software when I triggered full backup data (around 8TB) :
Expected finishing date is terrible : Around after two months
Transfer rate : 1.79MBps (before applying QoS, it was 606.29 KBps) and don't know why it's not boosting upto 4MBps ?
You could use that maybe for archival or escrow purposes. Something you really don't need to restore from. Time to restore is important, too.
Here I have chosen Nearline but not cold storage, because it's not Archive but Offsite Backup.
Are you saying to use for Archival because the performance doesn't seems to be practical ?
I'm saying that you normally use off-site backup for disaster recovery... if your onsite backup fails or a fire destroys everything. Then, you time for recovery from your "off-site" backup will be 2 months (unless they will ship you your data). Is that acceptable? But if you have other off-site backup, like tape in another facility, then you can use "cloud" backup as archival or escrow backup. Something you likely won't need to restore from, but it's there if the government wants something that's like 7 years old, or Iron Mountain blows up or something.
Edit: This is why if you do choose to do this, make sure they offer a way to send you your data in an acceptable timely manner. Many do, maybe they do too,.
-
My point is that you shouldn't use "cloud" backup as a replacement for onsite backup. And if you do use something like that, it's fine if it slowly archives backups in the background, as your main on-site backups do their thing like normal, and you can restore if needed like normal.
