APPLICATION OF REINFORCEMENT LEARNING IN MULTISENSOR FUSION PROBLEMS WITH CONFLICTING CONTROL OBJECTIVES

Publication Date

2009

Journal or Book Title

INTELLIGENT AUTOMATION AND SOFT COMPUTING

Abstract

Smart agents are equipped with sensors that enable them to be sensitive to their surrounding environrnent. However, the mapping of multiple raw streams of sensory data to the appropriate actions is not an easy problem, especially when multiple conflicting objectives aze involved. This type of multi-sensor fusion problem through the domain of power management for smart mobile devices was investigated in this study. In this application domain, the objective is to keep the user’s mobile devices in an “on” state as long as possible such that just-in-time services (such as reminder announcements) can be provided. However, this conflicts with the mobile device’s inherent goal - to turn off to conserve power. Due to the stochastic nature of human behavior, ahand-coded fixed strategy may not be the best solution. A learning control approach to the problem is presented in this paper. The experimental results show that the approach learns the appropriate mapping from multiple streams of raw sensory data to power conserving actions that can out-perform the hand-crafted policies. The learned policies aze also shown to be more robust in handling unscheduled events.

DOI

https://doi.org/10.1080/10798587.2009.10643027

Pages

223-235

Volume

15

Issue

2

This document is currently not available here.

Share

COinS