Reinforcement Learning: Optimal Feedback Control with Industrial Applications

本書提供了對於基於強化學習的反饋控制現代研究中所涉及的基本概念及科學技術創新的全面介紹。作者探討了各種系統，包括非線性、網絡化、多代理和多玩家系統的研究。

本書的基礎部分包括對經典強化學習（RL）的簡要描述、動態規劃的最優控制基礎以及網絡控制架構的介紹，並簡要介紹了典型算法。隨後，深入探討了針對具有未知動態的非線性系統和多玩家系統的數據驅動穩健控制研究。數據驅動的網絡單玩家和多玩家系統的最優控制引導讀者進入新型RL算法的開發，這些算法提高了學習效率。本書最後探討了這些RL算法如何實現具有未知模型參數的多代理系統的最優同步策略，以及遊戲RL如何解決各種過程工業中的最優運作問題。具體的數值範例和複雜的過程控制應用強調了所討論算法的實際應用價值。

《Reinforcement Learning》中所呈現的實用算法、理論分析和全面範例的結合，將吸引研究者和實務工作者，無論是在推進理論還是應用於礦物加工、化學加工、電力供應或其他行業的最優和自適應控制、機器學習、人工智慧及運籌學的研究或使用者。

Professor Jinna Li received the M.S. degree and the Ph. D. degree from Northeastern University, Shenyang, China, 2006 and 2009, respectively. She is an associate professor at Shenyang University of Chemical Technology, Shenyang, China. From April 2009 to April 2011, she carried out postdoctoral research at the Lab of Industrial Control Networks and Systems, Shenyang Institute of Automation, Chinese Academy of Sciences. From June 2014 to June 2015, she was a Visiting Scholar granted by China Scholarship Council with Energy Research Institute, Nanyang Technological University, Singapore. From September 2015 to June 2016, she was a Domestic Young Core Visiting Scholar granted by Ministry of Education of China with State Key Lab of Synthetical Automation for Process Industries, Northeastern University. From Jan. 2017 to Jul. 2017, she was a Visiting Scholar with the School of Electrical and Electronic Engineering, the University of Manchester, UK. Her current research interests include neural networks, reinforcement learning, optimal operational control, distributed optimization control and data-based control. She has authored two P.R.China patents, more than 40 journal papers, more than 20 conference papers, one books. Dr. Li is a Senior Fellow of the Institute of Electrical and Electronic Engineers. She presided 3 projects from the National Natural Science Foundation of China and 5 projects from provincial funding in P. R. China.

Frank L. Lewis is a Distinguished Scholar Professor and Moncrief-O'Donnell Chair at University of Texas at Arlington's Automation & Robotics Research Institute. He obtained his Bachelor's Degree in Physics/EE and MSEE at Rice University, his MS in Aeronautical Engineering from Univ. W. Florida, and his Ph.D. at Ga. Tech. He received the Fulbright Research Award, the Outstanding Service Award from Dallas IEEE Section, and was selected as Engineer of the year by Ft. Worth IEEE Section. He is an elected Guest Consulting Professor at South China University of Technology and Shanghai Jiao Tong University. He is a Fellow of the IEEE, Fellow of IFAC, Fellow of the U.K. Institute of Measurement & Control, and a U.K. Chartered Engineer. His current research interests include distributed control on graphs, neural and fuzzy systems, and intelligent control.

Associate Professor Jialu Fan, graduated from Northeastern University with a bachelor's degree in automation in 2006; in 2011, she graduated from Zhejiang University with a Ph.D. in engineering; from 2009 to 2010, she was sponsored by the China Scholarship Council as a visiting researcher at Pennsylvania State University. Her research interests include networked operation control, industrial wireless networks and mobile social networks. She is co-author of Data Dissemination and Query in Mobile Social Networks (ISBN 978-1-4614-2253-2, Springer) and (at the invitation of Professor Pedro Albertos, it's second author) of a Chinese translation of Feedback and Control for Everyone (Original English ISBN 978-3-642-03445-9, Springer). She has published more than 30 academic papers in the field of network communication in various IEEE Journals and in conferences in the field of control. Associate Professor Fan has been responsible for two National Natural Science Foundation key projects along with a National Natural Science Foundation youth project and 3 provincial and ministerial-level projects. She particapted as a key member, in the National 973 Program, 863 Key Program and National Natural Science Foundation of China. She has served as a reviewer for top international SCI journals such as the IEEE Transactions on Automatic Control, IEEE Transactions on Control Systems Technology and IEEE Network Magazine. She served as Secretary-General of World Congress on Intelligent Control and Automation in 2014, as Branch Chair of the Asian Control Conference 2015, and on the program committees of editions of the Indian Control Conference, Globecom and SmartGridComm. He is now a member of the Youth Working Committee of the Chinese Society of Automation and a member of the International Association of Electrical and Electronics Engineers. She has won numerous honors as an outstanding educator, supervisor and mentor.

教授 Jinna Li 於 2006 年和 2009 年分別獲得中國沈陽的東北大學碩士學位和博士學位。她是中國沈陽化工技術大學的副教授。從 2009 年 4 月到 2011 年 4 月，她在中國科學院沈陽自動化研究所的工業控制網路與系統實驗室進行博士後研究。從 2014 年 6 月到 2015 年 6 月，她獲得中國留學基金委的資助，作為訪問學者在新加坡南洋理工大學的能源研究所工作。從 2015 年 9 月到 2016 年 6 月，她獲得中國教育部的資助，成為東北大學過程工業綜合自動化國家重點實驗室的國內青年核心訪問學者。從 2017 年 1 月到 2017 年 7 月，她在英國曼徹斯特大學電氣與電子工程學院擔任訪問學者。她目前的研究興趣包括神經網路、強化學習、最佳操作控制、分散優化控制和基於數據的控制。她擁有兩項中國專利，發表了 40 余篇期刊論文、20 余篇會議論文和一本書籍。李博士是電氣與電子工程師學會的高級會員。她主持了 3 項來自中國國家自然科學基金的項目和 5 項來自中國省級資助的項目。

Frank L. Lewis 是德克薩斯大學阿靜頓分校自動化與機器人研究所的傑出學者教授及 Moncrief-O'Donnell 教席。他在萊斯大學獲得物理/電氣工程學士學位和電氣工程碩士學位，並在佛羅里達大學獲得航空工程碩士學位，最後在喬治亞理工學院獲得博士學位。他獲得了富布賴特研究獎、達拉斯 IEEE 分會的傑出服務獎，並被選為沃斯堡 IEEE 分會的年度工程師。他是南方科技大學和上海交通大學的客座諮詢教授。他是 IEEE 會士、IFAC 會士、英國測量與控制學會會士，以及英國特許工程師。他目前的研究興趣包括圖上的分散控制、神經系統和模糊系統，以及智能控制。

副教授 Jialu Fan 於 2006 年從東北大學獲得自動化學士學位，並於 2011 年從浙江大學獲得工程博士學位；2009 年至 2010 年，她獲得中國留學基金委的資助，作為訪問研究員在賓夕法尼亞州立大學工作。她的研究興趣包括網路操作控制、工業無線網路和移動社交網路。她是《Data Dissemination and Query in Mobile Social Networks》（ISBN 978-1-4614-2253-2, Springer）的共同作者，並受 Pedro Albertos 教授的邀請，擔任《Feedback and Control for Everyone》（原英文 ISBN 978-3-642-03445-9, Springer）中文翻譯的第二作者。她在各種 IEEE 期刊和控制領域的會議上發表了 30 余篇學術論文。Fan 副教授負責過兩項國家自然科學基金的重點項目，以及一項國家自然科學基金青年項目和 3 項省部級項目。她作為核心成員參與了國家 973 計畫、863 重點計畫和中國國家自然科學基金。她曾擔任《IEEE Transactions on Automatic Control》、《IEEE Transactions on Control Systems Technology》和《IEEE Network》雜誌等頂級國際 SCI 期刊的審稿人。她於 2014 年擔任世界智能控制與自動化大會的秘書長，2015 年擔任亞洲控制會議的分會主席，並參與了多個會議的程序委員會。