Recursive least-squares temporal difference learning for adaptive traffic signal control at intersection - Archive ouverte HAL Access content directly
Journal Articles Neural Computing and Applications Year : 2017

Recursive least-squares temporal difference learning for adaptive traffic signal control at intersection

(1) , ,
1
Biao Yin
  • Function : Author
  • PersonId : 1089294
Mahjoub Dridi
  • Function : Author
Abdellah El Moudni
  • Function : Author

Abstract

This paper presents a new method to solve the scheduling problem of adaptive traffic signal control at intersection. The method involves recursive least-squares temporal difference (RLS-TD(λ)) learning that is integrated into approximate dynamic programming. The learning mechanism of RLS-TD(λ) is to make an adaptation of linear function approximation by updating its parameters based on environmental feedback. This study investigates the method implementation after modelling a traffic dynamic system at intersection in discrete time. In the model, different traffic control schemes regarding signal phase sequence are considered, especially the defined adaptive phase sequence (APS). By simulating traffic scenarios, RLS-TD(λ) is superior to TD(λ) for updating functional parameters in the approximation, and APS outperforms other conventional control schemes on reducing traffic delay. By comparing with other traffic signal control algorithms, the proposed algorithm yields satisfying results in terms of traffic delay and computation time.
Fichier principal
Vignette du fichier
Yin_Recursive.pdf (1007.79 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01763263 , version 1 (23-06-2022)

Identifiers

Cite

Biao Yin, Mahjoub Dridi, Abdellah El Moudni. Recursive least-squares temporal difference learning for adaptive traffic signal control at intersection. Neural Computing and Applications, 2017, 31, pp.1013 - 1028. ⟨10.1007/s00521-017-3066-9⟩. ⟨hal-01763263⟩
113 View
8 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More