4K workflows present much higher demands, with much greater variability, than have the 2K and HD workflows now commonplace in the media and entertainment industry. Post-production facilities moving into 4K must deal not only with a dramatic jump in data, but also with a corresponding increase in the bandwidth and processing power needed to work effectively with higher-resolution content. While the sheer size and quantity of files can be challenging to storage infrastructure, the variety of formats — different types of HD, 2K, 4K and soon 8K — makes for vast variances in file sizes, as well.
Just how much data, capacity and performance are required can vary significantly, influenced by factors ranging from spiking demand for “anywhere, anytime” content to shrinking deadlines for deliverables, as well as the usual vagaries of a post project. By looking closely at key aspects of workflow storage, however, post-production facilities can reduce the number of unknowns and plan effectively for their 4K future. In addition to considering storage performance and scalability, they must evaluate the degree of content accessibility that is necessary, as well as the optimal approach to content archiving.
Storage system performance is largely dependent on three factors: drive management, network management and the capabilities of the file system. If these are well-understood, it becomes easier to identify the solution that will best address the post facility’s format (data rate), capacity and stream count (number of simultaneous users) requirements.
Within a 4K-ready storage infrastructure, the aggregate performance of underlying drives must be managed to provide the tremendous gigabyte-per-second speeds required for high-resolution workflows. What does this mean for drive choice? Well, consider that the bandwidth provided by individual spinning hard disk drives (HDDs) ranges from 75 MB/s to 150 MB/s, and also that solid-state drives (SSDs) can deliver up to 1900 MB/s each. Consider also the fact that one minute of uncompressed 4K requires about 50 GB, and the most costly enterprise SSDs can accommodate up to 2 TB, or about 40 minutes per drive.
Ultimately, while the speed of SSDs is quite compelling, the costs add up quickly in the face of 4K capacity requirements. Though prices for SSDs are falling, HDDs continue to be far less costly in per-gigabyte terms. HDDs with RAID 6 protection offer the best price-to-performance benefits, particularly when most disk operations are sequential reads and writes of individual frames and files. In other scenarios, such as animation and VFX work, SSDs or an SSD/HDD mix with intelligent data movement across storage media can provide the best combination of performance and cost.
The way in which network connections attach to storage infrastructure has a direct impact on performance. Rather than engaging in a debate over the superiority of network attached storage (NAS) and storage area network (SAN), the better course today is to determine a combination of the two that can best provide the workstation and client connectivity essential to support 4K workflow.
Providing fixed, predictable bandwidth between workstations and shared storage, Fibre Channel SAN connections address those elements of post-production that demand fast, reliable access. More affordable Ethernet-based NAS connections require time-consuming processing overhead but are appropriate for the many other operations largely unaffected by the small delay. This model offers the greatest benefits with both SAN and NAS connectivity extended across Linux, Windows and Mac operating systems.
A sophisticated file system can enable multiple Windows, Linux and Mac workstations to access shared storage over a Fibre Channel network, allowing them to read and write to the same storage volume at the same time without network delays. As a result, content creators working in the 4K realm can enjoy the immediate, shared access to media files that is key to effective collaboration. When storage extends across multiple tiers, sometimes including cloud storage, the file system can not only simplify the presentation of files to applications and users but also leverage policies to ensure that content is in the right place at the right time.
In any operation experiencing growth, continuous productivity demands the ability to add storage capacity without the need for file migration or complete downtime. The ability to tune performance to changing requirements, whether due to format type or volume of work, is likewise key to high productivity. When performance and capacity can be scaled independently of one another, the post facility can achieve the performance characteristics ideal for a given workflow, or even to suit the roles and requirements of different individuals within the workflow.
Keeping completed higher-resolution projects on speedy production storage is expensive — but also essential to rapid creation of multiplatform deliverables. Given their lengthy drive rebuild times, RAID-based NAS systems become an increasingly risky alternative as operating hours and capacity rise. Object storage, on the other hand, offers self-healing capabilities that ensure the integrity and availability of files and associate metadata stored as objects across many drives. With 4K content driving up capacity requirements, the uptime guaranteed by object storage makes it a compelling addition to storage infrastructure.
In fact, object storage is a popular choice for both private and public cloud storage, which serve as economical, space-saving offsite repositories for content. Some aspects of high-resolution work, such as full-resolution editorial and VFX, aren’t a natural fit for the cloud, but cloud-based services can simplify or reduce the cost of common tasks such as review and approval, transcoding, rendering and distribution.
Content Preservation and Archiving
Long-term storage of 4K project files and masters calls for a cost-effective and durable storage medium, and LTO tape fits the bill. Tape cartridges last longer than mechanical drives and use a fraction of the energy that spinning disks require. LTO-7 today provides 6TB of uncompressed data storage that can be written at 300 MB/sec at less than a penny per gigabyte, and LTO-8 promises impressive speed gains and even greater savings.
The continued performance improvements that are making tape a candidate for nearline storage are also giving post facilities much faster access to their archived content. This is a valuable improvement, particularly with increasing consumer demand for content making a readily accessible archive a more valuable archive.
Although public cloud-based archive services offer easy and affordable long-term storage, delayed access times and slower download speeds make them optimal for off-site storage within a larger backup strategy.
Establishing a 4K-ready storage infrastructure naturally involves some speculation with respect to the performance and capacity needed to support higher-resolution workflows of today and tomorrow, as well as the influence of an evolving and expanding media marketplace. With the right combination of drive, network and file management in a system that affords high reliability, continuous scalability, appropriate levels of availability and economical content preservation, post facilities will be prepared to accommodate the intense and often unpredictable requirements of work in the higher-resolution realm.