Research in video quality assessment relies on the exploitation of subjective scores collected from subjects looking at the test video sequences. The availability of databases for performance comparison, development and testing of new models is of crucial importance. Only few databases are currently available and more popular in quality assessment field. State of arts data bases are limited to packet loss rate, coding and compression artifacts only. Here our goal is to create the database considering key Quality of Service (QoS) transmission parameters: dealy, delay variation/jitter, Packet Loss Rate (PLR) and throughput limitations as a possible artifacts.
Database Description
The database contains 184 test videos obtained from eight source videos of different content characterized by wide span of spatial and temporal information and different motions. Test video sequences was generated by considering practical transmission scenario by using Network Emulator (NETEM) and Video LAN. Packet loss rate, jitter, delay, and throughput have been considered as possible distortions resulting from video transmission and its value is considered based on ITU and ETSI recommendations. Experiment setup has been designed based on the ITU standards to produce reliable and reproducible results. Original video sequence also being used for the evaluation as well, so that we could use Mean Opinion Score (MOS) and Difference Mean Opinion Score (DMOS) as a quality assessment metrics. Most stable and widely used video quality assessment technique called discrete single stimulus Absolute Category Rating (ACR) has been used for the quality evaluation. Video sequences, collected subjective scores, and results of the performed analysis are made publicly available for the research community, so that it could be used to design, test and compare subjective and objective video quality assessment metrics.
Download
We are making the ReTRiEVED Video Quality Database available to the research community free of charge.
Citation
If you use this database in your research, we kindly ask that you reference our paper listed below:
Paudyal, P.; Battisti, F.; Carli, M.
A study on the effects of quality of service parameters on perceived video quality Proceedings Article
In: 2014 5th European Workshop on Visual Information Processing (EUVIP), pp. 1-6, 2014.
@inproceedings{7018383,
title = {A study on the effects of quality of service parameters on perceived video quality},
author = {P. Paudyal and F. Battisti and M. Carli},
doi = {10.1109/EUVIP.2014.7018383},
year = {2014},
date = {2014-01-01},
urldate = {2014-01-01},
booktitle = {2014 5th European Workshop on Visual Information Processing (EUVIP)},
pages = {1-6},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}