A Heuristically Assisted Deep Reinforcement Learning Approach for Network Slice Placement - Laboratoire d'Informatique de Paris 6 Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Network and Service Management Année : 2021

A Heuristically Assisted Deep Reinforcement Learning Approach for Network Slice Placement

Résumé

Network Slice placement with the problem of allocation of resources from a virtualized substrate network is an optimization problem which can be formulated as a multiobjective Integer Linear Programming (ILP) problem. However, to cope with the complexity of such a continuous task and seeking for optimality and automation, the use of Machine Learning (ML) techniques appear as a promising approach. We introduce a hybrid placement solution based on Deep Reinforcement Learning (DRL) and a dedicated optimization heuristic based on the "Power of Two Choices" principle. The DRL algorithm uses the so-called Asynchronous Advantage Actor Critic (A3C) algorithm for fast learning, and Graph Convolutional Networks (GCN) to automate feature extraction from the physical substrate network. The proposed Heuristically-Assisted DRL (HA-DRL) allows for the acceleration of the learning process and substantial gain in resource usage when compared against other state-of-theart approaches, as evidenced by evaluation results.
Fichier principal
Vignette du fichier
TNSM-2022.pdf (4 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03954579 , version 1 (24-01-2023)

Identifiants

Citer

Jose Jurandir Alves Esteves, Amina Boubendir, Fabrice Guillemin, Pierre Sens. A Heuristically Assisted Deep Reinforcement Learning Approach for Network Slice Placement. IEEE Transactions on Network and Service Management, 2021, pp.1-1. ⟨10.1109/TNSM.2021.3132103⟩. ⟨hal-03954579⟩
24 Consultations
22 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More