Turing Codec: Open-Source HEVC Video Compression
BBC R&D has released the first version of the Turing codec, an open source software HEVC video encoder that allows highly efficient compression of video content with low computational complexity.
A curation about new media technologies
BBC R&D has released the first version of the Turing codec, an open source software HEVC video encoder that allows highly efficient compression of video content with low computational complexity.
A significant step in the road to Ultra High Definition TV services has been taken with the approval of the DVB-UHDTV Phase 1 specification at the 77th meeting of the DVB Steering Board. The specification includes an HEVC Profile for DVB broadcasting services that draws, from the options available with HEVC, those that will match the requirements for delivery of UHDTV Phase 1 and other formats. The specification updates ETSI TS 101 154 (Specification for the use of Video and Audio Coding in Broadcasting Applications based on the MPEG-2 Transport Stream).
The new DVB-UHDTV Phase 1 will allow images with four times the static resolution of the 1080p HDTV format, at frame rates of up to 60 images per second. Contrast will be drastically improved by increasing the number of bits per pixel to 10 bit. From the wide range of options defined in the HEVC Main 10 profile, Level 5.1 is specified for UHD content for resolutions up to 2160p. For HD content, HEVC Main profile level 4.1 is specified for supporting resolutions up to 1080p.
The DVB-UHDTV Phase 1 specification takes into account the possibility that UHDTV Phase 2 may use higher frame rates in a compatible way, which will add further to the image quality of UHDTV Phase 1.
“HEVC is the most recently-developed compression technology and, among other uses, it is the key that will unlock UHDTV broadcasting,” said DVB Steering Board Chairman, Phil Laven. “This new DVB–UHDTV Phase 1 specification not only opens the door to the age of UHDTV delivery but also potentially sets the stage for Phase 2, the next level of UHDTV quality, which will be considered in upcoming DVB work,” he continued.
Also approved was the specification for Companion Screens and Streams, Part 2: Content Identification and Media Synchronization. Companion Devices (tablets, smart phones) enable new user experiences for broadcast service consumption. Many of these require synchronisation between the Broadcast Service at the TV Device and the Timed Content presented at the Companion Device. This specification focuses on the identification and synchronisation of a Broadcast Service on a TV Device (Connected TV or STB and screen) and Timed Content on a Companion Screen Application running on a Companion Device. Part 2 outlines the enabling factors for the identification of, and synchronisation with, broadcast content, timed content and trigger events on TV devices (for example a Connected TV or STB) and related content presented by an application running on a personal device.
Another specification to gain approval from the Steering Board was the MPEG-DASH Profile for Transport of ISO BMFF Based DVB Services over IP Based Networks. This specification defines the delivery of TV content via HTTP adaptive streaming. MPEG-DASH covers a wide range of use cases and options. Transmission of audiovisual content is based on the ISOBMFF file specification. Video and audio codecs from the DVB toolbox that are technically appropriate with MPEG-DASH have been selected. Conditional Access is based on MPEG Common Encryption and delivery of subtitles will be XML based. The DVB Profile of MPEG-DASH reduces the number of options and also the complexity for implementers. The new specification will facilitate implementation and usage of MPEG-DASH in a DVB environment.
The three new specifications will now be sent to ICT standards body ETSI for formal standardisation and the relevant BlueBooks will be published shortly.
Source: Advanced Television
As part of the 4Ever project, we have been releasing an HEVC and DASH ultra high definition dataset, ranging from 8bit 720p 30Hz up to 10bit 2160p 60 Hz. The dataset is released under CC BY-NC-ND.
The data set web page is here, and more information on the dataset can also be found in this article.
Source: GPAC
HEVC Version 1 demonstrates it has achieved more than 50% bitrate savings compared to MPEG 4 AVC/H.264, the MPEG standards group announced following its 108th meeting held at the beginning of April in Valencia, Spain.
In a verification test campaign of the HEVC, ITU-T Rec H.265 | ISO/IEC 23008-2 compression standard following the finalisation of the standard last year “a formal subjective quality assessment has been executed using a large variety of video material, ranging from wide-screen VGA resolution up to 4K. The material had not previously been used in optimizing HEVC's compression technology”, MPEG, announced in a prepared statement, adding: “Clear evidence was found that HEVC is able to achieve 50% bitrate savings and more, compared to the AVC High Profile”. The results will be made publicly available in the report N14420, to be published on the MPEG website.
HEVC's scope continues to be extended with a call for proposals on Screen Content Coding, the compression of video containing rendered graphics and animation. This extention is scheduled for completion by the end of 2015.
HEVC's 2nd edition includes support for additional colour formats and higher precision. The ‘Range Extensions amendment’, with technology allowing efficient compression of video content for colour sampling formats beyond 4:2:0 and up to 16 bits of processing precision has been finalised. In particular, the lossless and near lossless range of visual quality is more efficiently compressed than is possible with the current version 1 technology.
Web Video Coding the standard for a worldwide, reasonable and non-discriminatory, and free of charge licensable online compression scheme for use in browser has reached the final stage before approval. MPEG expects to complete the Final Draft International Standard in February 2015.
MPEG is also working on standardising what it refers to as ‘free-viewpoint television’. A public seminar on FTV (Free-viewpoint Television) will be held on July 8th to align MPEG's future standardization of FTV technologies with users and industry needs. Targeted application scenarios are Super Multiview Displays “where hundreds of very densely rendered views provide horizontal motion parallax for realistic 3D visualization, extracted from a dense or sparse set of input views/cameras in a circular or linear arrangement”.
“Integral Photography, where 3D video with both horizontal and vertical motion parallax are captured for realistic display”. And “Free Navigation that allows the user to freely navigate or fly through the scene, not just along predefined pathways”.
MPEG expects that future FTV systems will require new functionalities such as a substantial increase in coding efficiency and rendering capability compared to technology currently available. The FTV initiative will also consider novel means for acquiring 3D content that have recently emerged, e.g. plenoptic and light field cameras. You are invited to join the FTV seminar to learn more about MPEG activities in this area and to help revolutionise the viewing experience.
The increases in spatial resolution and colour resolution, scalable coding and autostereoscopic 3D, or in MPEG speak Multi-view, leads to amendments in the trusty old MPEG-TS, transport stream layer. The amendment specifies transport of layered coding extensions for the scalable and multiview enhancements of HEVC, and the signaling of associated descriptors so that different layers can be encapsulated and transported individually.
To support the new standards to offer 4K/8K UHDTV services by using a newly developed MPEG standard, MPEG Media Transport (MMT) an effort to promote the new transport layer standard has begun in Japan with a growing number of companies implementing MMT for various applications. MPEG is organising MMT Developers' Day in conjunction with its 109th meeting this July in Sapporo, Japan.
MPEG is also working on 3D audio and dynamic range control. The DRC system provides comprehensive control to adapt the audio as appropriate for the particular content, the listening device, environment, and user preferences. The loudness control can be applied to meet regulatory requirements and to improve the user experience, especially for content with large loudness variations.
By Donald Koeleman, Broadband TV News
Vantrix announced the creation of an open source version of the H.265 encoder, calling it the F265 project. The project aims to accelerate the industry-wide development and adoption of H.265, also known as High Efficiency Video Coding (HEVC).
H.265 is the successor to the industry standard H.264 codec used for video compression. The new specification, ratified in 2013, provides for double the data compression ratio of H.264 while ensuring the same level of visual quality. It is expected to be a major driver in the adoption of 4k Ultra High Definition and beyond by reducing the amount of transmission bandwidth required versus current standards.
Vantrix's F265 encoder will be licensed under the OSI BSD terms, enabling access to source code, free redistribution, and derived works. The intent is to encourage both researchers and commercial entities to contribute to the refinement and evolution of the code to accelerate the implementation of both software and hardware systems.
The project will initially target high quality offline encoding, but will not be limited to this scope. It is designed from the ground up to maximize quality and performance in offline and real time scenarios using recent hardware technology and interfaces such as the Intel AVX2 instruction set.
The F265 project site is in the process of being finalized and those interested in being notified of its availability can sign up at www.vantrix.com/f265.
Source: Vantrix
This work presents a performance comparison of the two latest video coding standards H.264/MPEG-AVC and H.265/MPEG-HEVC (High-Efficiency Video Coding) as well as the recently published proprietary video coding scheme VP9.
According to the experimental results, which were obtained for a whole test set of video sequences by using similar encoding configurations for all three examined representative encoders, H.265/MPEG-HEVC provides significant average bit-rate savings of 43.3% and 39.3% relative to VP9 and H.264/MPEG-AVC, respectively.
As a particular aspect of the conducted experiments, it turned out that the VP9 encoder produces an average bit-rate overhead of 8.4% at the same objective quality, when compared to an open H.264/MPEG-AVC encoder implementation – the x264 encoder. On the other hand, the typical encoding times of the VP9 encoder are more than 100 times higher than those measured for the x264 encoder.
When compared to the full-fledged H.265/MPEG-HEVC reference software encoder implementation, the VP9 encoding times are lower by a factor of 7.35, on average.
Telestream has announced the public availability of an open source H.265 (HEVC) encoder. The new project aims to create the world’s most efficient, highest quality H.265 codec.
The iniative is being introduced under both an open source and commercial license model and is being managed by co-founder MulticoreWare Inc, Telestream’s development partner.
“Telestream and MulticoreWare have had great success in the acceleration and commercial deployment of x264 and believe that a similar approach with the collaborative development of the next generation of high-efficiency codecs will benefit the industry,” commented Shawn Carnahan, CTO at Telestream. “The x264 project proved the effectiveness of developing a codec of this complexity. Leveraging the x264 technology in this new project will ensure that the new codec is as robust, efficient and high quality as its predecessor.”
Jason Garrett-Glaser, lead developer of the x264 project added: "Previous collaboration between Telestream and MulticoreWare led to successful work on the GPU acceleration of x264, a task deemed by many to be incredibly difficult, if not impossible. With these accomplishments in mind, I am excited to support Telestream in the founding of the x265 project, which follows in the x264 tradition of high performance, quality, and flexibility under an open source license and business model."
Access is free under GNU LGPL licensing, and commercial licenses are available for companies wishing to use the resulting implementation in their products. More information can be found at x265.org, where companies and individuals can contribute to the project.
Source: TVBEurope
A walkthrough of some of the features of the new HEVC video compression standard. Video playback using the Osmo4 player from GPAC and stream analysis using Elecard's HEVC Analyzer software.
By Iain Richardson, Vcodex
Video compression was one of the more ubiquitous topics at last month’s NAB Show. Perhaps equally ubiquitous was 4K and 8K. Seldom was one of either topic discussed without reference to the other.
Fortunately, in the world of digital television and digital video, a video-specific variation of Moore’s Law seems to be at work. With umpteen years of incremental NTSC picture quality progress that many viewers could barely see — if at all — the industry was ripe for the change to HDTV and self-contained big-screen displays.
Until Moore’s Law made it possible for common computers to handle digitized SD video, few analog engineers could envision what was in the future of the digital television. Some might remember the days of 1125/60 in the early 1990s. It was, more or less, the original analog HDTV format. Many design engineers were trying to compress it into the standard 6MHz broadcast television channel bandwidth using a variety of hardware-intensive systems. The industry even formed the 1125/60 Consortium before DTV was invented.
DTV, which was originally conceived to shoehorn HDTV into a standard 6MHz TV channel, has flooded the industry and viewing public with myriad unforeseen changes. Among many was progressive scan, streaming video, file-based video, the 1920 x 1080 raster and, more recently, 4K, 8K and beyond. While current DTV and ATSC transmission standards have capped the resolution TV stations can broadcast, computers, DVDs, the Internet and a host of video compression schemes and standards have eliminated barriers to delivering higher definition images to viewers from non-over-the-air sources. Current state-of-the-art video compression standards can reduce the bandwidth of baseband video by a factor of approximately 100.
The Codec
The first digital video codec standard was H.120. It was published in 1984 and revised in 1988, but the quality was so poor that there were very few users. H.120 was followed later in 1988 by H.261, an ITU-T video coding standard. The primary use for H.261 was for video transmission over ISDN lines at a resolution of 352 x 288 or 176 x 144.
MPEG-2, aka H.262, was first published in 1994. It paved the road to DTV, OTT and ATSC transmission, and it continues to be the standard used to create DVDs.
MPEG-4, aka H.264, was published in 2003 and is currently the most commonly used video codec and the standard for Blu-ray discs and HDTV.
Today, numerous compression standards are being used in a variety of ways to create and deliver content. The latest standards with the highest quality are JPEG 2000 (J2K) and more recently HEVC (High Efficiency Video Coding).
J2K
J2K is designed for compressing individual images, not video sequences. It is primarily used in production and video feeds with high bit rates up to approximately 120Mb/s. The higher bit rates make artifacts and blocking virtually invisible. It is hardware-intensive, and it can be accomplished in real time.
In J2K, each frame is compressed individually and, therefore, stands alone. In video compression terms, each individual complete frame is an I-Frame. While this feature is advantageous in maintaining video quality, its high bandwidth doesn’t lend itself well to distribution.
On April 15, 2013, the Video Services Forum issued a Technical Recommendation that defines profiles for streaming of JPEG 2000 Broadcast Profile in a MPEG-2 Transport Stream over IP with optional Forward Error Correction (FEC). The recommendation is for unidirectional transport of SD-SDI, HD-SDI and 3G-SDI signals, encapsulated in an RTP stream and transmitted via IP to a receiving device that will decode the output to an SDI signal.
HEVC
On the other hand, HEVC, aka H.265, and its modern predecessors H.264, MPEG-4, MPEG-2, Advanced Video Coding (AVC) use I-frames, P-frames and B-frames to encode moving images. To quickly review, the I in I-frame stands for Intra-coded and is a fully specified still image. The P in P-frame stands for Predicted picture, and it contains only the changes from the previous frame, saving unchanged data from having to be repeated. The B in B-frame stands for Bi-predictive. It saves more space than a P frame because it specifies the differences between it and the frame not just before it, but after it as well. Images are usually segmented into macroblocks, where prediction types can be determined based on the movement within each macroblock.
HEVC contains 33 directional modes for intra block prediction. MPEG-4 uses only eight directional modes. These modes use information from previously decoded neighboring prediction blocks. H.265 motion vector prediction is a 16-bit range for both H and V motion vectors (MVs) with quarter pixel precision. This gives HEVC a dynamic vector prediction range 16X greater than H.264.
Most pre-H.265 codecs independently encoded 16 x 16 pixel macroblocks. In HEVC, the image is split into Coding-Tree Units (CTUs), each up to 64 × 64 pixels. The root of a quadtree data structure. A Quadtree contains four branches that are used to partition a two-dimensional space which uses a recurring algorithm to subdivide it into four quadrants. The quadtree can then be sub-divided into leaf-level coding units (CUs), as illustrated in the following figure.
According to multiple studies, HEVC should deliver up to 50% better compression than H.264 in video on demand (VOD) applications, which means similar quality at half the bitrate. In live encoding, which obviously has to be performed in real time, the initial expectations are a 35% bandwidth reduction at similar quality levels. Alternatively, HEVC can also enable larger resolution movies, whether 2K or 4K.
Essentially, these are the two benefits of HEVC in the streaming space. The first relates to encoding existing SD and HD content with HEVC rather than H.264, enabling cost savings and/or the ability to stream higher quality video to lower bitrate connections. The second relates to opening up new markets for Ultra-High-Definition (UHD) videos.
On the playback side, there are multiple data points, but no real clear picture. Several companies have announced software decoders, but it’s unclear how much horsepower is necessary to drive them. The original targets for HEVC were 10x encoding complexity and 2x–3x decoding complexity as compared to H.264, and most sources have confirmed the 10x figure for encoding. Perusing various comments from various sources, decoding complexity has ranged from “same as H.264” to the 2x–3x figure.
Remember, however, that H.264 playback is accelerated in hardware on most playback platforms, including GPU-accelerated playback on computers. According to my source at graphics vendor NVIDIA, “There currently isn’t any dedicated [hardware] support for HEVC in our current GPUs. I’m pretty limited to what I can say about future products. But I’ll just say that our goal is for our GPUs to support all current video standards. Now, that said, it is quite possible for third parties to write HEVC encoders and decoders using CUDA to use the processing capability of current GPUs.”
Though GPU acceleration may be coming, it isn’t here yet, so H.264 and HEVC aren’t on a level playing field when it comes to accessible playback hardware. Still, according to a source at Qualcomm, Inc., “We are able to get 1080p, 30fps HEVC Main profile video with just a little bit over 50% CPU utilization on a quad-core architecture.”
On the mobile side, my source reported, “At CES we showcased Ittiam’s ARM based decoder and played back 1080p HEVC and 1080p H.264 videos side by side on recently announced Snapdragon 800 platform. Ittiam’s decoder is still in development and will get further enhancement.”
According to a report titled “HEVC Decoding in Consumer Devices,” senior analyst Michelle Abraham from Multimedia Research Group, Inc. estimated that the number of consumer devices that shipped in 2011 and 2012 that would be capable of HEVC playback with a software upgrade totaled around 1.4 billion, with more than a billion more expected to be sold in 2013. According to Abraham, in compiling these statistics she assumed that all PCs shipped in each year would be HEVC-capable.
HEVC Encoding
I spoke with several encoding companies; many were bullish on HEVC and have either made HEVC-related product announcements (Elemental Technologies, Inc.) or will at NAB. Another made the very cogent comment that the encoding side was always ahead of the game and that the path to actual producer adoption is widespread playback availability.
Speaking of playback, none of the major players -- Adobe, Apple, Google, or Microsoft -- have announced HEVC playback support in their respective players, browsers, or mobile or desktop operating systems. One reason why -- and a potential monkey wrench in at least the short-term HEVC adoption cycle -- is that no one knows what it will cost to use HEVC.
Royalty Issues with HEVC
What’s clear at this point is that multiple companies have patents relating to HEVC technology, and they plan to ask for royalties from those who use their technology. This was the case with H.264 as well, and though many in the streaming industry grumbled about the royalties, this disgruntlement certainly didn’t limit H.264’s success.
Two things are different with HEVC. First, where H.264 involved a single group of patent holders administered by MPEG LA, it appears that some HEVC patent holders want to pursue royalties outside of a patent group, which will make it more challenging for HEVC users to license the technologies. According to “Patent Snafus Could Delay New Video Codec,” Mediatek and Qualcomm do not want to join the HEVC group formulated by MPEG LA, and Samsung hasn’t decided either way.
One chipmaker executive, speaking anonymously for the EE Times article, commented, “HEVC has so many patent holders and some of them say they will not be part of the pool but want to collect royalties themselves. If say 20 people all want to collect royalties it will kill the standard -- we need a fixed cost, it cannot be variable,” he added.
Beyond this uncertainty, HEVC is coming to the streaming media market much faster than H.264, where royalty policies were in place well before any significant market adaption. To recount, the H.264 spec was approved in March 2003, and MPEG LA announced licensing terms in November 2003. Obviously, when Apple announced support for H.264 in QuickTime 7 in April 2005, royalty policies were firmly in place. Ditto for when Adobe announced that it would include H.264 in Flash in March 2008, and when Microsoft added H.264 to Silverlight in July 2009.
Our contact at MPEG LA reported that while the HEVC group had met three times as of February 2013, there was still no guarantee that a group would be formed or that all patent holders would join the group. So it appears that HEVC early adopters will have to decide to implement the technology without knowing the cost.
For large companies such as Adobe, Apple, Google, and Microsoft, that might be tenable; the H.264 license was capped, and it’s reasonable to assume that the HEVC license will also be capped. All four companies can amortize that cost over millions of product units shipped, and I think it’s highly likely that one or more of these companies will announce HEVC integration by NAB.
Even the encoding companies that I spoke with commented that they might incorporate HEVC technologies into their encoding tools without knowing the cost, because, as one exec said, “Supporting new formats is the race that we run.” The exec also noted, however, that this was the first time that they were ever forced to consider embracing a codec without having an idea about the licensing structure.
However, let’s get back to the two potential benefits that actual publishers seek from HEVC: cost savings and opening up new products and services. In both cases, it seems unlikely that any producer would use HEVC-encoded video without a known cost structure. Sure, H.264 usage for free internet video is free, but that decision was made under a completely different set of circumstances, and it’s doubtful if HEVC usage will be similarly unencumbered.
How H.264 Became Free
A short history lesson will explain why H.264 became free. When the terms of the initial H.264 license were announced, there was a royalty on H.264-encoded video deployed in a pay-per-view or subscription operation. The royalty was not on free internet video, at least through the initial term of the license, which ended Dec. 31, 2010.
The licensing terms attributed this waiver to the fact that the internet streaming market was “still developing,” though this is likely disingenuous. The fact of the matter was that the H.264 implementations of that time offered only a slight quality improvement over VP6, the predominant Flash codec, and required more CPU horsepower for playback. There was also no mobile platform such as iOS or Android that wasn’t compatible with VP6 that could force producers to use H.264. So 99% of producers were satisfied with VP6 and wouldn’t have experimented with H.264 if there was a royalty involved.
In February 2010, MPEG LA extended the royalty moratorium for free internet video through December 2016. In an interview with Streaming Media, MPEG LA president and CEO Larry Horn attributed this decision to the fact that “though some companies are doing well with advertising supported video, overall the models are still in flux, and the patent group didn’t want to plug a royalty into a business model that’s still unsettled.”
In May 2010, Google announced WebM, an open source alternative to H.264 that offered very similar quality and playback performance. In August 2010, MPEG LA announced that there would be no royalties on free internet usage of H.264 in perpetuity. Though MPEG LA never publicly admitted that the availability of a free, open source solution contributed to this decision, the timing would suggest it did.
Why HEVC Probably Won’t Be Free
Fast-forward to 2013. HEVC is ready, and at this point, it has no real competition. Sure, you can point to VP9, but considering how poorly Google executed taking VP8/WebM to market, it’s unlikely that any producers -- or patent groups -- will take it seriously. In 2012, online video advertising jumped to $2.9 billion, so it’s tough to say that this market is still in flux.
For these reasons, it seems unlikely that if HEVC enables large publishers to cut their bandwidth costs by 50%, HEVC patent holders wouldn’t want their share. It seems equally unlikely that publishers seeking to reduce bandwidth costs via HEVC would start using the technology until the cost structure was known. So HEVC implementation seeking to harvest this benefit is likely on hold pending the announcement.
HEVC and UHD Video
Again, I’m focusing my analysis on the streaming and OTT markets, since those are the ones I know best. Even without considering the royalty cost uncertainties, it seems unlikely that HEVC will spawn many new UHD-related products and services over the next 2 or 3 years for three reasons: bandwidth, the lack of 4K displays, and the lack of content.
Let’s start with bandwidth. In his blog post “H.265/HEVC Ratification and 4K Video Streaming,” compressionist Alex Zambelli, previously with Microsoft and now with iStreamPlanet, estimated that if HEVC produced a 40% bandwidth saving over H.264, a 4K movie would require bitrates of between 12Mbps and 15Mbps. Assuming that HEVC actually produced the 50% target, these numbers would drop to 10Mbps and 12Mbps.
According to the latest Akamai Technologies “State of the Internet” report, for 3Q 2012, the average connection speed in the U.S. was about 7.2Mbps, up from about 6Mbps the previous year. While users connecting on some premium services could handle HEVC’s 10Mbps–12Mbps in the short term, it’s unclear when a significant portion of the U.S. population will be able to support 4K HEVC movies.
Though the U.S. is far from the performance leader, only South Korea, with an average connection speed of 14.7Mbps, could sustain a 4K movie today, with Japan next at 10.5Mbps. Again, while dedicated satellite or cable networks could certainly carry this load, it’s unlikely that the type of shared internet connection used for OTT would be able to in the short term.
‘Why 4K TVs Are Stupid’
The second issue relates to the installed base of 4K-capable sets, which obviously will be necessary to view 4K movies. According to analyst DisplaySearch, global shipments of 4K sets will be well under a million in 2013, and just over 2 million in 2014.
When Samsung unveiled its next-generation smartphone, the Galaxy S4, in March this year, most of the Korean giant’s fans focused their attention on the device’s big 5-inch, 1920 x 1080 screen, its quad-core processor and its 13Mp camera. All impressive of course, but incremental steps in the ongoing evolution of the smartphone. More cutting edge is the S4’s promised support for a technology called HEVC.
HEVC is short for High Efficiency Video Coding. It’s the successor to the technology used to encode video stored on Blu-ray Discs and streamed in high-definition digital TV transmissions the world over. The current standard is called H.264 - aka MPEG 4, aka Advanced Video Coding (AVC) - so it’s no surprise that HEVC will become H.265 when the Is and Ts are dotted and crossed on the final, ratified version of the standard later this year.
This final standardisation is just a formality. The International Telecommunication Union (ITU-T), the body which oversees the "H" series of standards, and its partner in video matters, the ISO/IEC Moving Picture Experts Group (MPEG), have both given HEVC sufficient approval. This means device manufacturers such as Samsung, chipmakers such as Broadcom, content providers such as Orange France and mobile phone network operators such as NTT DoCoMo can begin announcing HEVC-related products safe in the knowledge that the standard will be completed with few, if any further changes.
Ratification of the H.265 (High Efficiency Video Coding) standard by the ITU (International Telecommunications Union) late January clears the way for its adoption as the anointed successor to H.264/MPEG4.
Henceforth to be known as H.265, the questions now are how quickly will it ripple through the market, and when we will arrive at an all H.265 world?
The answer is that H.265 will have a quite different adoption profile from H.264, being slower to be taken up by makers of traditional managed set top boxes, but much quicker for consumer devices.
When H.264 was at a similar stage a decade ago after its ratification in June 2003, there were in any case hardly any consumer devices for consumption of video content other than TVs and DVD players. This is the first big difference today, the existence of smartphones and tablets with a frenetic pace of product innovation and release that has vendors such as Apple eating their own lunch every six months or so. They will be the early adopters of H.265, which will be standard in tablets and smartphones by the end of 2014 if not a bit sooner.
By contrast, we will then be seeing only the first adoption of H.265 by the set tops based on chips that were announced by Broadcom at last month’s Consumer Electronics Show (CES) in Las Vegas.
The eagerness by the CE makers to adopt H.265 is driven by two markets, mobility and fixed line OTT, although with a different flavor in each case. For mobility bandwidth reduction is the primary driver as proliferating video threatens to bring cellular infrastructures to their knees. This will remain the case even though Cisco has just revised downwards its forecasts for mobile data volumes up till 2017 from the giddy numbers that had been projected.
So, although mobile data can and increasingly will be offloaded via WiFi onto broadband networks, even there the ability of H.265 to halve the bandwidth compared with H.264 will yield big cost savings. Over time, deployment of H.265 will also allow video quality to improve over mobile networks, but the emphasis in the short term at least will be on bandwidth reduction for video at existing resolutions.
In the case of fixed line OTT, it is the either way around, with quality in the driving seat. There, H.265 is seen as a way of delivering HD services over limited bandwidth, and I can see little reason why operators will not seize the opportunity. There is also an interesting IPTV angle, where the motive could be to increase the range rather than the quality, extending the existing service to consumers previously too far from the nearest exchange to obtain adequate QoS.
By halving the bandwidth required for a given quality it may be possible almost to double the distance. Even for those operators that currently deliver IPTV exclusively over Fiber to the Home, enabling multichannel HD services, H.265 may open up the possibility of reaching more customers via VDSL2 over copper, at distances up to 1 Km from the nearest fiber end point.
The other main driver for H.265 is ultra HD or 4K, and here, things get interesting. I have to admit to being among those who saw H.265 as inadequate for 4K transmission, given that it will generate 8X as many bits per second as most current 720p or 1080i HD services. But, that was before I looked more closely at the specification.
Although H.265 is touted as being about twice the efficiency of H.264, it will do far better than that for 4K. The reason is simply that at those high resolutions there will be even more scope for intra frame compression, because any area of the picture that is all a similar color can be represented in virtually the same number of bits irrespective of the pixel density.
For example, in the case of a sporting event where there is a lot of grass in the picture, that region can effectively be encoded with the same number of bits within ultra HD as standard definition, which means that the bit-rate reduction is correspondingly greater for the former. H.265 has been designed with this in mind through its support for larger blocks of pixels up to 64 x 64 than the 8x8 typically used in current H.264 codecs.
H.265 will also be able to exploit parallel processing, which will be employed in future codecs, by dividing the picture in the first instance into tiles that can be encoded independently of each other, giving further potential for efficient compression of ultra HD. For this reason I think that current estimates that H.265 will enable delivery over the Internet at bit rates between 20 Mbps and 30 Mbps, as against 45 Mbps for H.264, are too conservative. It looks now that H.265 could achieve a three or even fourfold improvement over H.264 for ultra HD, which means that 15 Mbps should certainly be achievable.
Even so, we are not going to be seeing widespread 4K services anytime soon, remembering also that it only really scores for TVs bigger than 50 inches and even then only given the right viewing distance. Although there is still debate over the relationship between screen size, distance and the resolution beyond which there is no discernible improvement in quality, it is clear that for several years ultra HD will be a niche market driven by the same cutting edge operators that currently offer 1080p60 HD.
It also looks unlikely there will be the same wholesale stampede to H.265 among set-top box makers that there was to H.264 But, in the case of tablets and smartphones, the stampede will be all the more notable.
By Philip Hunter, Broadcast Engineering Blog