Home arrow Testing & Monitoring arrow Measuring Video: Hardly Picture Perfect
Measuring Video: Hardly Picture Perfect Print E-mail
Written by Edwin E. Mier   

Well, a decade ago, they said that voice over IP wouldn’t work either. So now video over IP is proliferating, except in a lot more forms and complexity than good ol’ VoIP. Understandably, the test and measurement industry is running hard to keep up.

To see just how far video over IP has come, and how far it still remains from anything conventional or standard, MierConsulting conducted a survey in August of the network test and monitoring vendor community. At the cut-off, about half of the vendors we contacted responded, and only a relative handful indicated they now offer wares–many just released–specifically for assessing the quality of video-over-IP traffic.

But more on that later. We asked the network-monitoring experts what they were seeing–pardon the pun–in terms of video over IP’s shape, size, and growth. The respondents could rate on a scale of one to six–one being blazing-hot growth and six being stable, or even inconsequential, of different video-traffic types we suggested. Or they add their own. The results are summarized in Figure 1.

Currently the fastest growing form of video over IP is “video clips,” one-way and relatively short duration video segments– YouTube, cell phone, and podcast-type video snippets–involving bandwidth from 128 kbps to perhaps 768 kbps. The range reflects the fact that there are a hodgepodge of different formats for encoding and transmission, which include, for example, DVB-H, DAB-IP, S-DMB, MediaFLO, and others.

The many different flavors of this class of video traffic type also makes tracking it–let alone rating the quality of individual video transmissions–very difficult. And some vendors confide that they don’t see a big market demand for it anyway.

Where test and measurement vendors do see rosier business prospects is in tracking and quality measurement of broadcast video and video on demand (VoD)–services that carriers and service providers are clamoring to rush out the door. There are some standards in this traffic sector, MPEG-2 and MPEG-2 TS, which are giving way to the more bandwidth- efficient MPEG-4. Both MPEGs support “standard-definition” (SD) and high-definition (HD) transmission, with HD consuming two to three times the bandwidth of SD.

“We target the most high-value video content our customers have, namely broadcast and on-demand video,” says Laura Holly, Director of Video Service Assurance with Brix Networks. “In our target market there is currently less concern about the quality of videoconferencing, CC [closed-circuit, typically security] video, gaming, or other video-based applications,” she adds.

Clearly, bi-directional videoconferencing is of secondary stature. There is more growth seen in laptop/desktop and personal videoconferencing than in high-end, “studio-quality” videoconferencing, the respondents indicate. These are dramatically different in bandwidth, with “personal” videoconferencing using appreciably less than 1 Mbps per stream, while studio quality requires multi-megabits.

But one significant video-related traffic type didn’t make the chart–video file downloads. These files are DVD images and the like, of both authorized and, increasingly, bootlegged video content. And they are huge–in most cases multigigabytes. It has been estimated that as much as one-third of the Internet’s collective bandwidth today is consumed by such video file downloads.

Despite the obvious impact video downloading has on Internet traffic flow, few consider this actually video. Video file downloads are just that–data file transfers. Rather than UDP, file downloads invariably use TCP, which provides file-quality checking and retransmission, and can also dynamically throttle transmission rate around congestion. A video download can take hours, even over a beefy broadband connection. By comparison, most broadcast, video on demand, and videoconferencing require low overhead and timing consistency– and so use the simpler UDP over IP.

“Such file downloads may not be recognizable as video at all until after the fact,” says Loki Jorgenson, Chief Scientist of Apparent Networks.

The network test and measurement community, as far as video-traffic tracking and quality assessment, seems to be following the money. And at the present time, that means products oriented mainly for carriers and service providers for measuring and tracking broadcast and on-demand video services.

Figure 2 provides a thumbnail summary of leading wares offered today for video traffic monitoring that turned up in our survey. This may not be an all-inclusive listing.

Two of the packages, Brix Networks’ BrixVision Live Monitoring and Tektronix’s GeoProbe Video Performance Monitoring and Unified Assurance, track only broadcast and on-demand video monitoring. Both are oriented only to carriers and service providers.

The Brix and the Tektronix products can also rate the quality of individual video streams. While there are a few published specifications that touch on videoquality assessment, such as RFC 4445 and ETSI’s TR 101-290, virtually all of the video-quality assessment algorithms employed today, including all the products shown in the table, are proprietary. This means that the same video stream could be rated quite different by different vendors’ monitoring packages.

“Video-quality assessment is still in its infancy,” says Brix’s Laura Holly. “Organizations including the DSL Forum and the ITU are working on video-quality standards. But that standards process is measured in years, not months. In the meantime, customers out there face very real quality challenges for their very real services.”

Many of the survey respondents point out that tracking and reporting on video quality is a multi-headed conundrum. “There are at least three levels of quality involved: the quality of the network, the quality of the application (i.e., codec), and the quality of the user experience, including psycho-visual effects,” says Apparent Networks’ Jorgensen. “Measuring each requires distinct models and methodologies. Quality of user experience is often referenced, but that is not typically what is measured.”

From the network-level perspective, all of the products in figure 2 can assess the network’s effect on, and ability to carry, video streams with acceptable levels of delivery quality. It is in the higher application layer–rating the actual videostream quality–that they differ the most.

For example, Apparent Networks’ AppCritical and Netcordia’s NetMRI do not address application-level assessment of video streams. That’s because neither directly observes video traffic. AppCritical assesses the network level by actively sending and then rating its own simulated video streams. And NetMRI analyzes information about traffic it receives from other network devices, using the NetFlow traffic-reporting protocol.

Several other vendors say they are able to identify most types of video traffic, report the network-level issues affecting video streams, and also provide quality ratings of the video streams. These include JDSU’s QT-600 probe and analysis software, Spirent’s VTS (Video Test System), Telchemy’s VQMon/SA-VM, and WildPackets’ OmniPeek Enterprise with Enhanced Media Options.

Still, these are very different products, with a very diverse range of price tags. Telchemy’s software, for example, is typically licensed by other vendors and incorporated into their network devices and packages, and not sold directly to end users.

Users shopping for video-monitoring products need to understand how diverse this emerging class of products are, what they profess to do, and what they don’t do. More importantly, users need to have a good idea of what they want to measure in terms of type(s) of video traffic and at what level. V

Ed Mier, VON Magazine’s test and measurement columnist, runs MierConsulting LLC (www.mierconsulting.com), which focuses on VoIP and network monitoring, measurement, and management. He has designed and installed dozens of local and worldwide networks and been involved in many VoIP rollouts. He can be reached at emier@mierconsulting.com.