Help me download my life plan!

[DataHoarder]

Hello all!  To start off with, my name is DataHoarder!  I (this should be very obvious), am a Data Hoarder.  I am at 69 Terabytes of stuff, and believe this would help me on the road.  My life's plan is to travel the world in either a van or a RV.

 

[user 423]

So how many 3.5 hour movies would 69T hold?

 

[highdesertranger]

Welcome DataHoarder to the CRVL forums! To help you learn the ins and outs of these forums, this "Tips & Tricks" post lists some helpful information to get you started. We look forward to hearing more from you. highdesertranger

 

[DataHoarder]

So how many 3.5 hour movies would 69T hold?

I do Remuxed blu ray, so at 40GB per movie (average), you would be looking at 1,725... if it was a standard 2 hour movie.  However with it your example being 3.5 hours per movie, it would be about 985 Movies you could fit on that... or porn... always porn...  


Those examples are for 1080p Bluray remuxes only.  If you were to go with 2160p, you would be looking at an average of 200GB per movie, which would drop down the movie total to 345 Movies.

If you were to do 4320p movies (8k), you would be looking at an average of 500GB per movie, which would bring the total number of movies you could store on 69TB to 138 Movies.  In just a few short years, this is what you would be looking at.  Although HDD/SSD sizes are going to be substantially different than what they are now.  By the time 4320p movies become mainstream, I would be looking at a cool half petabyte or more.

Now, (just one more) if you were to do 8640p movies (16k) movies, you would be looking at 2TB per movie, you would only be able to store 34 Movies on that 69TB drive you have.

 

[DLTooley]

A Terabyte day is a good day.

 

[rvpopeye]

With standard DVD formats , about 5GB per movie.
and ISO would be about 8GB.

 

[DataHoarder]

I dont get how anyone could possibly watch that quality.

 

[tav-2020]

It's called "grew up in the 70s with a b&w tiny tv and tin foil rabbit ears"   
everything looks great compared to that 

 

[DataHoarder]

I might not have grown up in the 70s, but I DID have a tiny (12 inches at most) b&w TV...  but i meant nowadays

 

[Bud Smiley]

So let's get to the question of how you're going to bring it with you? Assuming you aren't looking at cloud storage, you're going to need some sort of NAS. At 69TiB, you're looking at a decent collection of disks.

You could use 12 TiB disks. Ten of them would give you 80 TiB of usable storage in a ZFS RAIDZ-2 setup. Gives you two disks parity and a tiny bit of room for expansion.

End result is you'll be carting around some decent hardware. I'm not sure what the consumer market has for that capacity; you might be looking at enterprise-class hardware and the corresponding power requirements. That's just me talkin' though....

 

[KathyC]

I think you might want to ask yourself several questions to formulate the best solution for you:

1. Do you need a single storage device or could you split your data into logical buckets across several devices?
2. Do you really need/want all 69T? And, if so, are you going to be continuing to grow your data in the future?
3. How much space will you have to store/rack your device(s)?
4. Will you be able to keep your hardware in the recommended climate (temp/humidity) on the road?
5. How/will you backup your data?
6. What's your overall budget? You can find external 6TB drives for $150 or less (around 2+ lbs. each) or you can spend thousands on lots of equipment!

I keep things in lower resolution, backup all I can on free/cheap cloud services (with redundancies) and use inexpensive, bus-powered drives that take up very little space! I have a lot of data, but not as much as you!

Good luck; let us know how you tackle this!

 

[DataHoarder]

So let's get to the question of how you're going to bring it with you? Assuming you aren't looking at cloud storage, you're going to need some sort of NAS. At 69TiB, you're looking at a decent collection of disks.

You could use 12 TiB disks. Ten of them would give you 80 TiB of usable storage in a ZFS RAIDZ-2 setup. Gives you two disks parity and a tiny bit of room for expansion.

End result is you'll be carting around some decent hardware. I'm not sure what the consumer market has for that capacity; you might be looking at enterprise-class hardware and the corresponding power requirements. That's just me talkin' though....

I do externals.  I have no need for a NAS, as i mostly just access the drives once a month to unload data on to them, and move stuff around.  I have 70TB right now (not TiB(yes, i know there's a difference)).  That is across 17 drives.

 

[DataHoarder]

I think you might want to ask yourself several questions to formulate the best solution for you:

1.  Do you need a single storage device or could you split your data into logical buckets across several devices?  
2.  Do you really need/want all 69T?  And, if so, are you going to be continuing to grow your data in the future?
3.  How much space will you have to store/rack your device(s)?
4.  Will you be able to keep your hardware in the recommended climate (temp/humidity) on the road?
5.  How/will you backup your data?
6.  What's your overall budget?  You can find external 6TB drives for $150 or less (around 2+ lbs. each) or you can spend thousands on lots of equipment!

I keep things in lower resolution, backup all I can on free/cheap cloud services (with redundancies) and use inexpensive, bus-powered drives that take up very little space!  I have a lot of data, but not as much as you!

Good luck; let us know how you tackle this!

1: Split
2: Yes I do... more actually!  Also, yes, I have done the math, and I will hit 1PB in the next 3 years.
3: Not much actually... you would be surprised
4: Yup
5: Copy over.  Update once a week.
6: My budget?  Well, I buy 5TB drives at 90 bucks, and 6TB drives at 120 bucks.  Not a fan of NAS (since it decreases the total lifespan of all drives by spinning them all up at once).

 

[Bud Smiley]

If you don't want a NAS then I guess you're doing it right with the external drives. Sounds like it's going to be noncritical data that's infrequently accessed at least.

1PB of external drives sounds unwieldy.

Do you have any redundancy in your setup?

 

[KathyC]

1: Split
2: Yes I do... more actually!  Also, yes, I have done the math, and I will hit 1PB in the next 3 years.
3: Not much actually... you would be surprised
4: Yup
5: Copy over.  Update once a week.
6: My budget?  Well, I buy 5TB drives at 90 bucks, and 6TB drives at 120 bucks.  Not a fan of NAS (since it decreases the total lifespan of all drives by spinning them all up at once).

Great; sounds as if you have a system that works for you!

 

[DataHoarder]

If you don't want a NAS then I guess you're doing it right with the external drives. Sounds like it's going to be noncritical data that's infrequently accessed at least.

1PB of external drives sounds unwieldy.

Do you have any redundancy in your setup?

At the moment?  No.  As it is, today is my final day of my job, and all of that money will be going towards new drives.  I will be able to increase my storage size to 85TB of space that I can use.  However, i do have a plan for backups.  The next job I take I will be dedicating most (80 percent) of my earnings to getting backup drives, and who knows... Maybe I will get a NAS or a server from 45drives.com