Publication:
FUNCTION AND DISSIPATION IN FINITE STATE AUTOMATA - FROM COMPUTING TO INTELLIGENCE AND BACK

Simple item page
dc.contributor.advisorNeal G Anderson
dc.contributor.advisorMarco Duarte
dc.contributor.advisorWeibo Gong
dc.contributor.advisorDavid Moorman
dc.contributor.authorGanesh, Natesh
dc.contributor.departmentUniversity of Massachusetts Amherst
dc.date2024-03-28 16:24:48
dc.date.accessioned2024-04-26T15:33:21Z
dc.date.available2024-04-26T15:33:21Z
dc.date.submittedSeptember
dc.date.submitted2019
dc.description.abstractSociety has benefited from the technological revolution and the tremendous growth in computing powered by Moore's law. However, we are fast approaching the ultimate physical limits in terms of both device sizes and the associated energy dissipation. It is important to characterize these limits in a physically grounded and implementation-agnostic manner, in order to capture the fundamental energy dissipation costs associated with performing computing operations with classical information in nano-scale quantum systems. It is also necessary to identify and understand the effect of quantum in-distinguishability, noise, and device variability on these dissipation limits. Identifying these parameters is crucial to designing more energy efficient computing systems moving forward. In this dissertation, we will provide a physical description of finite state automaton, an abstract tool commonly used to describe computational operations under the Referential Approach to physical information theory. We will derive the fundamental limits of dissipation associated with a state transition in deterministic and probabilistic finite state automaton, and propose efficacy measures to capture how well a particular state transition has been physically realized. We will use these dissipation bounds to understand the limits of dissipation during learning during training and testing phases in feed-forward and recurrent neural networks. This study of dissipation in neural network provides key hints at how dissipation is fundamentally intertwined with learning in physical systems. These ideas connecting energy dissipation, entropy and physical information provide the perfect toolkit to critically analyze the very foundations of computing, and our computational approaches to artificial intelligence. In the second part of this dissertation, we derive the non-equilibrium reliable low dissipation condition for predictive inference in self-organized systems. This brings together the central ideas of homeostasis, prediction and energy efficiency under a single non-equilibrium constraint. The work was further extended to study the relationship between adaptive learning and the reliable high dissipation conditions, and the exploitation-exploration trade-offs in active agents. Using these results, we will discuss the differences between observer dependent and independent computing, and propose an alternative novel descriptive framework of intelligence in physical systems using thermodynamics. This framework is called thermodynamic intelligence and will be used to guide the engineering methodologies (devices and architectures) required to implement these descriptions.
dc.description.degreeDoctor of Philosophy (PhD)
dc.description.departmentElectrical and Computer Engineering
dc.identifier.doihttps://doi.org/10.7275/15141924
dc.identifier.orcidhttps://orcid.org/0000-0002-5321-266X
dc.identifier.urihttps://hdl.handle.net/20.500.14394/17974
dc.relation.urlhttps://scholarworks.umass.edu/cgi/viewcontent.cgi?article=2777&context=dissertations_2&unstamped=1
dc.source.statuspublished
dc.subjectThermodynamic computing
dc.subjectInformation Theory
dc.subjectAI
dc.subjectNon-equilibrium systems
dc.subjectEnergy efficiency
dc.subjectDissipation
dc.subjectArtificial Intelligence and Robotics
dc.subjectNanoscience and Nanotechnology
dc.subjectOther Computer Engineering
dc.subjectOther Computer Sciences
dc.subjectOther Electrical and Computer Engineering
dc.subjectOther Neuroscience and Neurobiology
dc.subjectOther Physics
dc.subjectPower and Energy
dc.subjectProbability
dc.subjectTheory and Algorithms
dc.titleFUNCTION AND DISSIPATION IN FINITE STATE AUTOMATA - FROM COMPUTING TO INTELLIGENCE AND BACK
dc.typeopenaccess
dc.typedissertation
digcom.contributor.authorisAuthorOfPublication|email:g.natesh.nitt@gmail.com|institution:University of Massachusetts Amherst|Ganesh, Natesh
digcom.identifierdissertations_2/1724
digcom.identifier.contextkey15141924
digcom.identifier.submissionpathdissertations_2/1724
dspace.entity.typePublication
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
PhD_Dissertation_NateshGanesh_Corrected.pdf
Size:
3.2 MB
Format:
Adobe Portable Document Format
Name: PhD_Dissertation_NateshGanesh_Corrected.pdf
Size: 3.2 MB
Kind: Adobe PDF
Collections
Dissertations