APPLICATION OF REINFORCEMENT LEARNING IN MULTISENSOR FUSION PROBLEMS WITH CONFLICTING CONTROL OBJECTIVES
Publication Date
2009
Journal or Book Title
INTELLIGENT AUTOMATION AND SOFT COMPUTING
Abstract
Smart agents are equipped with sensors that enable them to be sensitive to their surrounding environrnent. However, the mapping of multiple raw streams of sensory data to the appropriate actions is not an easy problem, especially when multiple conflicting objectives aze involved. This type of multi-sensor fusion problem through the domain of power management for smart mobile devices was investigated in this study. In this application domain, the objective is to keep the user’s mobile devices in an “on” state as long as possible such that just-in-time services (such as reminder announcements) can be provided. However, this conflicts with the mobile device’s inherent goal - to turn off to conserve power. Due to the stochastic nature of human behavior, ahand-coded fixed strategy may not be the best solution. A learning control approach to the problem is presented in this paper. The experimental results show that the approach learns the appropriate mapping from multiple streams of raw sensory data to power conserving actions that can out-perform the hand-crafted policies. The learned policies aze also shown to be more robust in handling unscheduled events.
DOI
https://doi.org/10.1080/10798587.2009.10643027
Pages
223-235
Volume
15
Issue
2
Recommended Citation
Ou, SC; Fagg, AH; Shenoy, P; and Chen, LC, "APPLICATION OF REINFORCEMENT LEARNING IN MULTISENSOR FUSION PROBLEMS WITH CONFLICTING CONTROL OBJECTIVES" (2009). INTELLIGENT AUTOMATION AND SOFT COMPUTING. 1012.
https://doi.org/10.1080/10798587.2009.10643027