Dark Data to waste up to 5.8m tonnes of carbon dioxide in 2020
Digitization can be part of the solution to climate change but storing digital data that is never used can also consume an enormous amount of energy and, as a result, produce CO2 that need never have been wasted. Veritas estimates that 5.8 million tonnes of CO2 will be unnecessarily pumped into the atmosphere as a result of powering the storage of this kind of data this year alone. In order to protect the planet from this waste, businesses need to get on top of their data management strategies, use the right tools to identify which data is valuable, and rid their data centres of ‘dark data’.
On average, 52 percent of all data stored by organizations worldwide is ‘dark’ as those responsible for managing it don’t have any idea about its content or value. Here in the UAE, dark data stands at around 47%, according to the 2019 Veritas Middle East Databerg Report. Much has been said about the financial cost of dark data but the environmental cost has, so far, often been overlooked. Analysts predict that the amount of data that the world will be storing will grow from 33ZB in 2018 to 175ZB by 2025. This implies that, unless people change their habits, there will be 91ZB of dark data in five years’ time – over four times the volume we have today, with all the energy associated with powering the infrastructure in which it lives.
According to the third edition of “Veritas Middle East Databerg Report”, UAE businesses surveyed were failing to manage their dark and ROT data, with only 12% of the data stored by organizations reported to be clean – the rest being ROT (redundant, outdated, trivial information)and unclassified data. The good news is that the IT industry has a unique chance to get ahead of this challenge. By taking steps to understand our data better, implementing policies to filter dark data and deleting the information that’s simply not needed, we can help reduce spiraling emissions.
Veritas has defined best practices that will enable organizations worldwide not only to delete data waste with confidence but also help them to reduce cost and strengthen their compliance:
Identify all data stores and gain overview: Data Mapping and Data Discovery are the first steps in understanding how information flows through an organization. Gaining visibility and insight into where data and sensitive information is being stored, who has access to it and how long it is being retained is a critical first step in pursuit of dark data and the key foundation to build from.
Illuminate dark data: a proactive Data Management approach allows organizations to gain visibility into their data, storage and backup infrastructure, so they can take control of data associated risks and make well educated decisions which data can be deleted with confidence.
Automate the discovery and data insight routines: to keep pace with the data explosion, companies should automate the analytics, tracking, and reporting necessary to deliver organizational accountability for dark data, file use and security. Companies might need to handle petabytes of data and billions of files, so their Data Insight approach should integrate with archiving, backup and security solutions to prevent data loss and ensure policy-based data retention.
Minimise and place controls around Data: Data minimization and purpose limitation ensure organizations reduce the amount of data being stored and establish what is retained is directly related to the purpose in which it was collected. Classification, flexible retention and compliant policy engines allow confident deletion of non-relevant information providing a cornerstone of any dark data project and companywide compliance.
Monitor to ensure continual adherence to compliance standards: compliance rules like GDPR introduce a duty on all organizations to report certain types of data breaches to the relevant supervisory authority, and in some cases to the individuals affected. Organizations must evaluate their ability to monitor breach activity and quickly trigger reporting procedures to ensure compliance.
