{"id":6595,"date":"2021-04-13T14:21:23","date_gmt":"2021-04-13T12:21:23","guid":{"rendered":"https:\/\/tekmart.co.za\/t-blog\/?p=6595"},"modified":"2021-04-13T14:21:25","modified_gmt":"2021-04-13T12:21:25","slug":"the-storage-that-ip-surveillance-needson-premise-and-in-the-cloud","status":"publish","type":"post","link":"https:\/\/tekmart.co.za\/t-blog\/the-storage-that-ip-surveillance-needson-premise-and-in-the-cloud\/","title":{"rendered":"The storage that IP surveillance needs;on-premise and in the cloud"},"content":{"rendered":"Reading Time-approximately:<\/span> 4<\/span> minutes<\/span><\/span>\n

Surveillance is changing, with the evolution from simple streams of sequential images to the application of AI to video, as well as an increasing move to use of the cloud.<\/strong><\/h2>\n\n\n\n
\"Antony<\/figure>\n\n\n\n

By Antony Adshead<\/a><\/p>\n\n\n\n

Surveillance systems\u00a0demands huge amounts of storage media. With most surveillance based around image capture, that will always likely be the case.<\/p><\/blockquote><\/figure>\n\n\n\n

That also means that input\/output (I\/O) will generally be sequential \u2013 think one movie frame after another being written or read to a drive. But, that changes somewhat with\u00a0the use of artificial intelligence (AI) to add intelligence to surveillance.<\/p>\n\n\n\n

But what are the storage needs of surveillance systems, what type of storage media can be used for surveillance, and what kinds of storage products are aimed at surveillance?<\/p>\n\n\n\n

Surveillance is changing<\/strong><\/h3>\n\n\n\n

Monitoring and retention of video camera footage still forms a central core to the world of surveillance, and so a key requirement of storage in surveillance is the ability to handle sequential\u00a0I\/O\u00a0well. \u00a0<\/p>\n\n\n\n

Meanwhile, surveillance is increasingly being supplemented with AI\u00a0 \u2013 or so-called\u00a0vision intelligence\u00a0\u2013 to bring actionable insight to camera-captured imagery.<\/p>\n\n\n\n

So, where once security cameras would simply have been monitored by humans and retained as a record, movement of potential interest can be identified and alerts raised, for example. That\u2019s of obvious utility to physical security where systems can be primed to\u00a0recognise an intruder by size, shape, movement, and so on.<\/p><\/blockquote>\n\n\n\n

But AI has also been implemented in a wide range of other surveillance applications such as phasing traffic lights to improve vehicle flow, monitoring retail centre footfall to adjust product placement, and being able to recognise concerns over wellbeing \u2013 such as a fallen patient \u2013 in healthcare settings.<\/p>\n\n\n\n

But no matter what the application and level of AI applied to it, sequential I\/O will likely be the core storage performance characteristic required for surveillance systems.<\/p>\n\n\n\n

However, not all apparently sequential I\/O is as smooth as you think when it comes to video. Some video\u00a0codecs, for example, comprise different types of frames that represent full images and differential changes that contain only changes portions. A hardly changing image would see little in the way of change, until a person walked across the camera\u2019s view, which means I\/O flow would be quite wave-like.<\/p>\n\n\n\n

While the requirements of image capture are largely sequential, the application of analytical and machine learning functionality is likely to involve a whole load more randomness.<\/p>\n\n\n\n

That\u2019s because while ingest of an image is pretty sequential, reading and comparing patterns within images will make reference to potentially large amounts of existing patterns already saved. The AI side of things is potentially quite random in its I\/O needs.<\/p>\n\n\n\n

What storage media are suited to surveillance?<\/strong><\/h3>\n\n\n\n

Spinning disk HDD<\/strong><\/p>\n\n\n\n

With sequential I\/O forming the vast bulk of surveillance traffic, spinning disk\u00a0HDDs\u00a0are predominant in the field. Spinning disk is well-suited to sequential I\/O as the mechanical nature of the drives means time savings are made when read heads don\u2019t need to cycle in and out of different locations on disk platters.<\/p>\n\n\n\n

Drives can be\u00a0SATA<\/a>, or the more performant and more expensive serial-attached SCSI (SAS)<\/a>, in terms of back-end connectivity. Both will work well with the main job of video ingest.<\/p>\n\n\n\n

Solid state and NVMe<\/strong><\/p>\n\n\n\n

However, for the kind of heavy lifting that analytics requires, solid state storage where random access of storage cells is done electronically rather than mechanically doesn\u2019t incur time penalties.<\/p>\n\n\n\n

This kind of media means flash, or NVMe flash<\/a>, perhaps with enhanced processing power from a GPU card will possibly be required.<\/p>\n\n\n\n

That was the case with\u00a0Hong Kong-based cloud service provider Vivavo, where it leveraged NVMe-based storage for facial recognition on street cameras.<\/p>\n\n\n\n

Solid state is a lot more pricey than spinning disk, so it will often make sense to have a tier of flash where data being processed is held, while HDD is fine for bulk storage of video.<\/p>\n\n\n\n

Tape<\/strong><\/p>\n\n\n\n

Tape is also a potentially useable bulk storage medium, and when tapes are not in use they consume no power, unlike HDDs. But access to data held on tape is a lot slower than other media. Automating that via use of LTFS \u2013\u00a0a way of layering a NAS<\/a>-like file system on top of tape\u00a0\u2013 would be one option. Using tape as another tier for bulk storage is another way to incorporate it.<\/p>\n\n\n\n

Cloud storage<\/strong><\/p>\n\n\n\n

Finally, there is cloud storage, which in some senses may be an ideal medium for video surveillance footage and analytics, which can be leveraged in the form of as-a-service offerings in the cloud.<\/p>\n\n\n\n

But there are drawbacks too, such as the bandwidth required to upload video that could multiply as the number of cameras increases. There are also charges for the retention of data in the cloud to be considered. Compliance may also be an issue if images are stored outside particular jurisdictions.<\/p>\n\n\n\n

Surveillance and storage on-site<\/strong><\/h3>\n\n\n\n

The easiest way to get IP surveillance is by buying a network video recorder (NVR) that comes with everything you need \u2013 cameras, servers, connecting hardware. These may be well suited to many smaller businesses, but may also be limited in terms of expansion, customisation and integration possible.<\/p>\n\n\n\n

When it comes to HDDs for surveillance storage, any enterprise drive will work. But with retention of large amounts of imagery for long periods with potentially small amounts of access, higher capacities with less rigorous performance requirements fit the bill. That most probably means 7,200rpm SATA most of the time.<\/p>\n\n\n\n

Some hard drive vendors, such as Seagate with its Skyhawk AI products, sell HDDs which they claim to be optimised for surveillance workloads. These are SATA drives, with an emphasis placed on\u00a0MTBF (mean time between failures); 2 million hours in the case of the Seagate product.<\/p>\n\n\n\n

Surveillance moves to the cloud<\/strong><\/h3>\n\n\n\n

Increasingly, surveillance is moving to the cloud, in so-called video surveillance as a service, in which the customer just has cameras on-site plus the ability to connect to the internet.<\/p>\n\n\n\n

With so-called vSaaS one big trade-off is ongoing data storage costs against the one-time outlay for an NVR product. Having said that, cloud costs are likely to be more predictable than spend on on-site storage capacity or dealing with failed components.<\/p>\n\n\n\n

Issues could also arise if internet connectivity is broken and images are not captured. Hybrid systems have been developed that use some on-site storage to counter that eventuality.<\/p>\n\n\n\n

A big plus for cloud-based surveillance is that the added intelligence of AI can be added as a service to existing provision.<\/p>\n","protected":false},"excerpt":{"rendered":"

Reading Time-approximately:<\/span> 4<\/span> minutes<\/span><\/span>Surveillance is changing, with the evolution from simple streams of sequential images to the application of AI to video, as well as an increasing move to use of the cloud. By Antony Adshead Surveillance systems\u00a0demands huge amounts of storage media. With most surveillance based around image capture, that will always likely be the case. That also means that input\/output (I\/O)<\/p>\n

Read More<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[38,221,8,62,107,246],"tags":[],"class_list":["post-6595","post","type-post","status-publish","format-standard","hentry","category-best-practices-for-data-center-operations","category-computer-storage-hardware","category-data-center-hardware","category-data-storage-backup-tools","category-san-technology-and-arrays-2","category-software-as-a-service-saas"],"_links":{"self":[{"href":"https:\/\/tekmart.co.za\/t-blog\/wp-json\/wp\/v2\/posts\/6595","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/tekmart.co.za\/t-blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/tekmart.co.za\/t-blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/tekmart.co.za\/t-blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/tekmart.co.za\/t-blog\/wp-json\/wp\/v2\/comments?post=6595"}],"version-history":[{"count":1,"href":"https:\/\/tekmart.co.za\/t-blog\/wp-json\/wp\/v2\/posts\/6595\/revisions"}],"predecessor-version":[{"id":6596,"href":"https:\/\/tekmart.co.za\/t-blog\/wp-json\/wp\/v2\/posts\/6595\/revisions\/6596"}],"wp:attachment":[{"href":"https:\/\/tekmart.co.za\/t-blog\/wp-json\/wp\/v2\/media?parent=6595"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/tekmart.co.za\/t-blog\/wp-json\/wp\/v2\/categories?post=6595"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/tekmart.co.za\/t-blog\/wp-json\/wp\/v2\/tags?post=6595"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}