Date of Award


Document Type

Open Access Dissertation

Degree Name

Doctor of Philosophy (PhD)

Degree Program

Computer Science

First Advisor

Roderic Grupen

Second Advisor

Oliver Brock

Third Advisor

Andrew Barto

Subject Categories

Computer Sciences


The robotics community has succeeded in creating remarkable machines and task-level programming tools, but arguably has failed to apply sophisticated autonomous machines to sophisticated tasks. One reason is that this combination leads to prohibitive complexity. Biological systems provide many examples of integrated systems that combine high-performance and flexibility, with logically-organized low-level control. Sophisticated organisms have evolved that depend on physical dexterity to thrive in a particular ecological niche while mitigating computational and behavioral complexity. This dissertation investigates the potential for a new kind of hybrid robotic design process. A design for performance that combines mechanical dexterity with low-level embedded firmware that organizes behavior and facilitates programming at a higher level. I propose that dexterous machines can incorporate embedded firmware that express the "aptitudes'' implicit in the design of the robot and hierarchically organize the behavior of the system for programming. This is a win-win situation where the quality of the embedded firmware determines how efficiently programmers (autonomous learning algorithms or human programmers) can construct control programs that are robust, flexible, and respond gracefully to unanticipated circumstances. This dissertation introduces the uBot-5---a mobile manipulator concept for human environments that provides dexterous modes for mobility and manipulation and control firmware that organizes these behavioral modes locally for use by applications code. Postural control underlies the uniform treatment of several mobility modes that engage different combinations of sensory and motor resources. The result is a platform for studying "whole-body'' control strategies that can be applied jointly to simultaneous mobility and manipulation objectives. The thesis examines the specification and development of both: (1) a dexterous robot for unstructured environments, and (2) the embedded firmware that organizes dexterous behavior for mobility and manipulation tasks. Integrated solutions are proposed that control transitions between postural "modes'' and provide a logically organized dexterous behavior hierarchy. Firmware programming can also be used to construct an efficient API for user programming and autonomous machine learning. My goal is to contribute technologies that can support new robotic applications in our culture that require fully integrated dexterous robots in unstructured environments. Personal robotics is an important emerging application that depends on seamlessly integrated and sophisticated machines, controllers, and adaptability. Logically organized representations for use in task-level application development are critical to pull this off. The impact of such technology could be significant---with applications that include healthcare and telemedicine, exploration, emergency response, logistics, and flexible manufacturing.