Big data has a problem: it is being abused. One of the biggest misconceptions is that big data is about archiving everything forever, buying the biggest, cheapest storage pool, and building a giant proverbial barn of hay in order to try to find needles.
Vendor marketing has abused this. Consider marketing that advises that you use that same NAS for Exchange and big data! Big data people have different storage management problems than the normal humble enterprise storage administrators.
Your typical storage administrator may struggle to deal with detailed compliance and disaster recovery issues. A big data admin will struggle to decide if check-pointing 4PB of in memory data is worth the hassle or if it will be cheaper to recreate the data.
Big data requires we rethink how we store data, where we store data, and what we store.
We use cookies to ensure that we give you the best experience on our website. If you continue to use this site we will assume that you are happy with it.
We are a professional review site that has advertisement and can receive compensation from the companies whose products we review. We use affiliate links in the post so if you use them to buy products through those links we can get compensation at no additional cost to you.OkDecline
1 Comment
Tomi Engdahl says:
BIG DATA wizards: LEARN from CERN, not the F500
Silos are for mudbloods
http://www.theregister.co.uk/2015/03/23/cerns_atom_big_data_f500/
Big data has a problem: it is being abused. One of the biggest misconceptions is that big data is about archiving everything forever, buying the biggest, cheapest storage pool, and building a giant proverbial barn of hay in order to try to find needles.
Vendor marketing has abused this. Consider marketing that advises that you use that same NAS for Exchange and big data! Big data people have different storage management problems than the normal humble enterprise storage administrators.
Your typical storage administrator may struggle to deal with detailed compliance and disaster recovery issues. A big data admin will struggle to decide if check-pointing 4PB of in memory data is worth the hassle or if it will be cheaper to recreate the data.
Big data requires we rethink how we store data, where we store data, and what we store.