2 November 2018

Rainer Käse, Senior Manager at Toshiba Electronics Europe explains how to ensure your HDD choice meets your surveillance storage needs. The selection of storage for surveillance systems has different requirements from other, large storage applications. With the demand primarily on the writing side, storage needs to be capable of simultaneously handling dozens of video channels. In addition, the storage medium needs to be ultra-reliable without ignoring typical mass-storage challenges, such as heat generation and power consumption. This article looks at some of the trends in the surveillance industry and how Toshiba’s HDD technology has been implemented to create a family of disk drives that target surveillance applications. Global challenges in surveillance In our ever more security conscious world, demand for professional-grade video surveillance is growing rapidly. Combining state-of-the-art camera systems with intelligent software means that anyone can have security that never sleeps, never misses a thing and does not demand a salary. According to research firm IHS Markit, less than 10 million cameras shipped globally in 2006. However, ten years later that had grown ten-fold to 100 million and is forecast to be 130 million in 2018. However, as sales volumes grow, so prices are coming under pressure. The 30% unit growth between 2016 and 2018 is only forecast to increase revenue by 6%, indicating a significant drop in per-unit revenue. The biggest consistent challenge being faced by manufacturers and operators of video surveillance systems is that of security. As systems become more open and interconnected into wider building management systems in smart buildings, so they become network connected, exposing them to malicious external attacks. While systems are inherently secure, as the number of cameras deployed per system increases, shortcuts such as assigning the same access credentials to every camera, or storing suites of passwords in insecure spreadsheets – both of which makes the hacker’s job easier. With the new European GDPR legislation coming into force imminently, the processes surrounding the collection, use and storage of video surveillance data become more rigorous with the prospect of significant fines for not following the rules. As systems become larger with more cameras attached then system bandwidth and data storage becomes an issue. The need to identify individuals and things such as vehicle licence plates from video is leading more operators to upgrade to 4K video systems, which will demand more powerful surveillance systems with greater bandwidth and storage. Key challenges in storage systems The data being generated by video surveillance systems is somewhat staggering. In 2014, around 566 petabytes of data was produced in a single day, according to estimates by IHS Markit. To put that in context, that is over 11 million Blu-ray movie discs, or twice the amount of user data stored by Facebook. In the following four years to 2018, that amount has almost quadrupled with over 2,000 petabytes being generated every day – all of which requires storage. As surveillance systems operate 24/7/365, so do the storage systems connected to them, which creates a particular set of challenges for the selection of storage media. As most systems these days are based on digital cameras, HDDs are most commonly used for storage. Innovations in speed, capacity and interfaces have all contributed to a continuously reducing cost-per-gigabyte. Any video surveillance system is only as good as the storage that it records to. Without reliable storage, some or all of the data recorded can be lost. While individual drive reliability is a key factor in selecting surveillance storage, data reliability and availability is further enhanced by the use of RAID arrays. As data is stored redundantly on several drives, one or more drives can fail with no loss of data and, in many systems, the failed drive can be ‘hot plugged’, meaning that it can be replaced without the need to power off the system. As video surveillance storage systems are operating 24/7/365 so power consumption is also a key challenge, not only for the power that is consumed but also for the heat generated in what are often densely packed arrays of drives. As elevated temperatures are often linked to reduced operating life, keeping the array cool is a key challenge for storage designers. A number of factors determine the size of the required storage. Firstly the number of cameras connected will determine the amount of data being delivered, this will also determine the write speed of the drives as they need to record data at the rate it is produced. The type of data being stored will also have an impact on the size of the storage – for example if there is legislation that stipulates that a particular type of data has to be stored for a certain time. Businesses may also choose to store data for longer periods as a way of evidencing that they have complied with legislation. As an example, the recently-legalised marijuana industry in the USA is increasingly using (and storing) video surveillance data to prove compliance with stringent legislation governing their activities. While the failure of a single camera in a system is relatively minor (and key areas may be covered by more than one camera as a backup), the failure of a storage system can be far more significant. There may be a direct cost (a fine from an authority or even the loss of a licence to operate) for lost data or an indirect cost as the loss of data hampers business activity. Is SSD an option for video surveillance storage? The way in which video surveillance data is written defines the type of media that is preferable for a given application. Modern SSDs are smaller and lighter than HDDs, and they consume less power. They are also generally faster than HDDs, especially at random access – so, to many, they would seem to be a natural choice. However, given that the nature of video surveillance data is sequential, with almost no need for random access (which contrasts with an enterprise database application) an array of HDDs can be even