TY - JOUR
T1 - A Meta-Learning Framework for Learning Multi-User Preferences in QoE Optimization of DASH
AU - Huo, Liangyu
AU - Wang, Zulin
AU - Xu, Mai
AU - Li, Yong
AU - Ding, Zhiguo
AU - Wang, Hao
N1 - Funding Information:
Manuscript received May 6, 2019; revised August 16, 2019; accepted August 25, 2019. Date of publication September 3, 2019; date of current version September 3, 2020. This work was supported in part by the NSFC under Project 61876013, Project 61922009, Project 61573037, and Project 61971025 and in part by the Fok Ying Tung Education Foundation under Grant 151061. This article was recommended by Associate Editor C. Wu. (Corresponding author: Mai Xu.) L. Huo, Z. Wang, M. Xu, and H. Wang are with the School of Electronic and Information Engineering, Beihang University, Beijing 100191, China (e-mail: [email protected]; [email protected]; [email protected]; [email protected]).
Publisher Copyright:
© 1991-2012 IEEE.
PY - 2020/9
Y1 - 2020/9
N2 - Dynamic adaptive video streaming over hypertext transfer protocol (DASH) plays a key role in video transmission over the Internet. The conventional DASH adaptation approaches mainly focus on optimizing the overall quality of experience (QoE) for all client sides, neglecting the QoE diversity of different users. In this paper, we propose a meta-learning framework for multi-user preferences (MLMP) as a new DASH adaptation approach, which is able to optimize the diverse QoE of different users. Specifically, we first design a subjective experiment to analyze the difference of QoE preferences across users, in which QoE refers to the metrics of visual quality, fluctuation, and rebuffering events. Based on our findings, we formulate the QoE optimization of multi-user preferences as a multi-task deep reinforcement learning (DRL) problem. In our formulation, the QoE preference of each user is modeled in the overall QoE calculation via assigning the weights to the three QoE metrics. Then, the MLMP framework is developed to solve the proposed multi-task DRL problem, such that the preferences regarding visual quality, fluctuation, and rebuffering events can be optimized for different users in DASH adaptation. Finally, the simulation results show that the proposed approach outperforms state-of-the-art DASH adaptation approaches in satisfying the different users' QoE preferences regarding visual quality, fluctuation, and rebuffering events.
AB - Dynamic adaptive video streaming over hypertext transfer protocol (DASH) plays a key role in video transmission over the Internet. The conventional DASH adaptation approaches mainly focus on optimizing the overall quality of experience (QoE) for all client sides, neglecting the QoE diversity of different users. In this paper, we propose a meta-learning framework for multi-user preferences (MLMP) as a new DASH adaptation approach, which is able to optimize the diverse QoE of different users. Specifically, we first design a subjective experiment to analyze the difference of QoE preferences across users, in which QoE refers to the metrics of visual quality, fluctuation, and rebuffering events. Based on our findings, we formulate the QoE optimization of multi-user preferences as a multi-task deep reinforcement learning (DRL) problem. In our formulation, the QoE preference of each user is modeled in the overall QoE calculation via assigning the weights to the three QoE metrics. Then, the MLMP framework is developed to solve the proposed multi-task DRL problem, such that the preferences regarding visual quality, fluctuation, and rebuffering events can be optimized for different users in DASH adaptation. Finally, the simulation results show that the proposed approach outperforms state-of-the-art DASH adaptation approaches in satisfying the different users' QoE preferences regarding visual quality, fluctuation, and rebuffering events.
KW - adaptation approaches
KW - DASH
KW - meta-learning
KW - reinforcement learning
KW - user preferences
UR - http://www.scopus.com/inward/record.url?scp=85071885337&partnerID=8YFLogxK
U2 - 10.1109/TCSVT.2019.2939282
DO - 10.1109/TCSVT.2019.2939282
M3 - Article
AN - SCOPUS:85071885337
SN - 1051-8215
VL - 30
SP - 3210
EP - 3225
JO - IEEE Transactions on Circuits and Systems for Video Technology
JF - IEEE Transactions on Circuits and Systems for Video Technology
IS - 9
M1 - 8823029
ER -