Embedded Machine Learning for Cyber-Physical, Iot, and Edge Computing: Use Cases and Emerging Challenges

本書介紹了在資源受限系統上有效實現機器學習模型的最新進展，涵蓋不同的應用領域。重點在於展示將機器學習應用於創新應用領域的有趣且新穎的案例，探索高效機器學習加速器的高效硬體設計、記憶體優化技術，說明模型壓縮和神經架構搜尋技術，以實現資源受限硬體平台上的能源效率和快速執行，並理解硬體-軟體共同設計技術，以獲得更大的能源、可靠性和性能效益。

- 討論在嵌入式系統、CPS、IoT 和邊緣計算中有效實現機器學習；
- 提供硬體設計、軟體設計以及硬體/軟體共同設計和共同優化的全面覆蓋；
- 描述實際應用以展示嵌入式系統、CPS、IoT 和邊緣應用如何受益於機器學習。

Sudeep Pasricha is a Walter Scott Jr. College of Engineering Professor in the Department of Electrical and Computer Engineering, the Department of Computer Science, and the Department of Systems Engineering at Colorado State University. He is Director of the Embedded, High Performance, and Intelligent Computing (EPIC) Laboratory and the Chair of Computer Engineering. Prof. Pasricha received the B.E. degree in Electronics and Communication Engineering from Delhi Institute of Technology, India, and his Ph.D. in Computer Science from the University of California, Irvine. He has several years of work experience in industry where his work focused on electronic chip design automation, model based design, and embedded system codesign. Prof. Pasricha has received more than $7M in funding for his research from various sponsors including the NSF, SRC, AFOSR, ORNL, DoD, Fiat-Chrysler, and NASA. He has co-authored multiple books, contributed to several book chapters, and published more than 250research articles in peer-reviewed conferences, journals, and books. He has been part of panels, keynotes, and also organized special sessions and tutorials on his research areas at premier conferences. He is a Senior Member of the IEEE (Computer Society), Distinguished Member of the ACM, and an ACM Distinguished Speaker.

Prof. Pasricha's research broadly focuses on software algorithms, hardware architectures, and hardware-software co-design for energy-efficient, fault-tolerant, real-time, and secure computing. These efforts target multi-scale computing platforms, including embedded and Internet of Things (IoT) systems, cyber-physical systems, mobile devices, and datacenters. Prof. Pasricha has received 16 Best Paper Awards and Nominations at various IEEE and ACM conferences, including at DAC, ASPDAC, NOCS, GLSVLSI, SLIP, AICCSA, and ISQED. Other notable awards include: the 2019 George T. Abell Outstanding Research Faculty Award, the 2016-2018 University Distinguished Monfort Professorship, 2016-2019 Walter Scott Jr. College of Engineering Rockwell-Anderson Professorship, 2018 IEEE-CS/TCVLSI Mid-Career Research Achievement Award, the 2015 IEEE/TCSC Award for Excellence for a Mid-Career Researcher, the 2014 George T. Abell Outstanding Mid-career Faculty Award, and the 2013 AFOSR Young Investigator Award.

Prof. Pasricha is currently the Vice Chair of ACM SIGDA and a Senior Associate Editor for the ACM Journal of Emerging Technologies in Computing (JETC). He is an Associate Editor for the ACM Transactions on Embedded Computing Systems (TECS), IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (TCAD), IEEE Consumer Electronics (CM), and IEEE Design & Test of Computers (D&T). He also serves as the Chair of the Steering Committee of IEEE Transactions on Sustainable Computing (TSUSC). He is currently or has been an Organizing Committee Member of several IEEE/ACM conferences such as DAC, ESWEEK, ICCAD, GLSVLSI, NOCS, RTCSA, etc. He has served as the General Chair for various IEEE/ACM conferences such as NOCS, HCW, IGSC, iSES, ICESS, etc.; and as Program Chair for CODES+ISSS, NOCS, IGSC, iNIS, VLSID, HCW, DAC PhD Forum, ICCAD Cadathlon, etc. He is also in the Technical Program Committee of several IEEE/ACM conferences such as DAC, DATE, ICCAD, ICCD, NOCS, etc. He holds an affiliate faculty member position at the Center for Embedded and Cyber-Physical Systems at UC Irvine. He has also received multiple awards for professional service, including the 2019 ACM SIGDA Distinguished Service Award, the 2015 ACM SIGDA Service Award, and the 2012 ACM SIGDA Technical Leadership Award.

Muhammad Shafique received his Ph.D. degree in computer science from the Karlsruhe Institute of Technology (KIT), Germany, in 2011. Afterwards, he established and led a highly recognized research group at KIT for several years as well as conducted impactful R&D activities across the globe. Before KIT, he was with Streaming Networks Pvt. Ltd. where he was involved in research and development of video coding systems several years. In Oct.2016, he joined the Institute of Computer Engineering at the Faculty of Informatics, Technische Universität Wien (TU Wien), Vienna, Austria as a Full Professor of Computer Architecture and Robust, Energy-Efficient Technologies. Since Sep.2020, he is with the Division of Engineering at New York University Abu Dhabi (NYU-AD) in UAE, and is a Global Network faculty at the NYU's Tandon School of Engineering (NYU-NY) in USA. He is the director of the eBrain research lab, and is also a Co-PI/Investigator in multiple large-scale research centers at NYUAD, including the Center of Artificial Intelligence and Robotics (CAIR), Center for Quantum and Topological Systems, Center of Cyber Security (CCS), and Center for InTeractIng urban nEtworkS (CITIES).

Dr. Shafique has demonstrated success in leading team-projects, meeting deadlines for demonstrations, motivating team membersto peak performance levels, and completion of independent challenging tasks. His experience is corroborated by strong technical knowledge and an educational record (throughout Gold Medalist). He also possesses an in-depth understanding of various video coding standards. His research interests are in brain-inspired computing, AI & machine learning hardware and system-level design, autonomous systems, wearable healthcare, energy-efficient systems, robust computing, hardware security, emerging technologies, FPGAs, MPSoCs, and embedded systems. His research has a special focus on cross-layer analysis, modeling, design, and optimization of computing and memory systems. The researched technologies and tools are deployed in application use cases from Internet-of-Things (IoT), smart Cyber-Physical Systems (CPS), and ICT for Development (ICT4D) domains.

Dr. Shafique has given several Keynotes, Invited Talks, and Tutorials at premier venues. He has also organized many special sessions atflagship conferences (like DAC, ICCAD, DATE, IOLTS, and ESWeek), and has served as the Guest Editor for IEEE Design and Test Magazine (D&T), IEEE Transactions on Sustainable Computing (T-SUSC), IEEE Transactions on Embedded Computing (TECS), and Elsevier MICPRO. He has served as the TPC Chair of several conferences like IGSC, ISVLSI, PARMA-DITAM, RTML, ESTIMedia and LPDC; General Chair of ISVLSI, DDECS and ESTIMedia; Track Chair at DAC, ICCAD, DATE, IOLTS, DSD and FDL; and PhD Forum Chair of ISVLSI. He has also served on the program committees of numerous prestigious IEEE/ACM conferences including ICCAD, DAC, ISCA, DATE, CASES, ASPDAC, and FPL. He holds one US patent and has (co-)authored 6 Books, 15+ Book Chapters, 300+ papers in premier journals and conferences, and over 50 archive articles.

Dr. Shafique received the prestigious 2015 ACM/SIGDA Outstanding New Faculty Award, the AI-2000 Chip Technology Most Influential Scholar Award in 2020, six gold medals in his educational career, and several best paper awards and nominations at prestigious conferences like CODES+ISSS, DATE, DAC and ICCAD, Best Master Thesis Award, DAC'14 Designer Track Best Poster Award, IEEE Transactions of Computer "Feature Paper of the Month" Awards, and Best Lecturer Award. Dr. Shafique is a senior member of the IEEE and IEEE Signal Processing Society (SPS), and a professional member of the ACM, SIGARCH, SIGDA, SIGBED, and HIPEAC.

Sudeep Pasricha 是科羅拉多州立大學電子與計算機工程系、計算機科學系及系統工程系的 Walter Scott Jr. 工程學院教授。他是嵌入式、高效能及智能計算（EPIC）實驗室的主任及計算機工程系的系主任。Pasricha 教授在印度德里技術學院獲得電子與通信工程的學士學位，並在加州大學爾灣分校獲得計算機科學的博士學位。他在業界擁有數年的工作經驗，專注於電子晶片設計自動化、基於模型的設計及嵌入式系統共同設計。Pasricha 教授的研究獲得超過 700 萬美元的資金支持，來自多個贊助機構，包括 NSF、SRC、AFOSR、ORNL、國防部、Fiat-Chrysler 和 NASA。他共同撰寫了多本書籍，貢獻了幾個書章，並在同行評審的會議、期刊及書籍上發表了超過 250 篇研究文章。他參與了多個小組討論、主題演講，並在頂尖會議上組織了特別會議和教程，專注於他的研究領域。他是 IEEE（計算機學會）的資深會員、ACM 的傑出會員及 ACM 傑出演講者。

Pasricha 教授的研究廣泛集中於軟體演算法、硬體架構及硬體-軟體共同設計，旨在實現能源高效、容錯、即時及安全的計算。這些努力針對多尺度計算平台，包括嵌入式系統和物聯網（IoT）系統、網路物理系統、行動裝置及數據中心。Pasricha 教授在多個 IEEE 和 ACM 會議上獲得 16 項最佳論文獎及提名，包括 DAC、ASPDAC、NOCS、GLSVLSI、SLIP、AICCSA 和 ISQED。其他顯著獎項包括：2019 年喬治·T·阿貝爾傑出研究教師獎、2016-2018 年大學傑出蒙福特教授獎、2016-2019 年 Walter Scott Jr. 工程學院 Rockwell-Anderson 教授獎、2018 年 IEEE-CS/TCVLSI 中期研究成就獎、2015 年 IEEE/TCSC 中期研究者卓越獎、2014 年喬治·T·阿貝爾傑出中期教師獎及 2013 年 AFOSR 年輕研究者獎。

目前，Pasricha 教授是 ACM SIGDA 的副主席及 ACM 新興計算技術期刊（JETC）的資深副編輯。他也是 ACM 嵌入式計算系統期刊（TECS）、IEEE 集成電路與系統計算機輔助設計期刊（TCAD）、IEEE 消費電子期刊（CM）及 IEEE 計算機設計與測試期刊（D&T）的副編輯。他還擔任 IEEE 可持續計算期刊（TSUSC）指導委員會的主席。目前或曾擔任多個 IEEE/ACM 會議的組織委員會成員，如 DAC、ESWEEK、ICCAD、GLSVLSI、NOCS、RTCSA 等。他曾擔任多個 IEEE/ACM 會議的總主席，如 NOCS、HCW、IGSC、iSES、ICESS 等；以及 CODES+ISSS、NOCS、IGSC、iNIS、VLSID、HCW、DAC 博士論壇、ICCAD Cadathlon 等的程序主席。他也在多個 IEEE/ACM 會議的技術程序委員會中任職，如 DAC、DATE、ICCAD、ICCD、NOCS 等。他在加州大學爾灣分校的嵌入式與網路物理系統中心擔任附屬教職。他還因專業服務獲得多項獎項，包括 2019 年 ACM SIGDA 傑出服務獎、2015 年 ACM SIGDA 服務獎及 2012 年 ACM SIGDA 技術領導獎。

穆罕默德·沙菲克於 2011 年在德國卡爾斯魯厄理工學院（KIT）獲得計算機科學博士學位。隨後，他在 KIT 建立並領導了一個備受認可的研究小組，並在全球範圍內進行了有影響力的研發活動。在加入 KIT 之前，他曾在 Streaming 工作。