Programming for Hybrid Multi/Manycore Mpp Systems
暫譯: 混合多核心/多處理器系統的程式設計

Levesque, John, Vose, Aaron

Programming for Hybrid Multi/Manycore Mpp Systems

商品描述

"Ask not what your compiler can do for you, ask what you can do for your compiler."
--John Levesque, Director of Cray's Supercomputing Centers of Excellence

 

 

 

 

 

 

 

The next decade of computationally intense computing lies with more powerful multi/manycore nodes where processors share a large memory space. These nodes will be the building block for systems that range from a single node workstation up to systems approaching the exaflop regime. The node itself will consist of 10's to 100's of MIMD (multiple instruction, multiple data) processing units with SIMD (single instruction, multiple data) parallel instructions. Since a standard, affordable memory architecture will not be able to supply the bandwidth required by these cores, new memory organizations will be introduced. These new node architectures will represent a significant challenge to application developers.

 

 

 

 

 

 

 

 

 

Programming for Hybrid Multi/Manycore MPP Systems attempts to briefly describe the current state-of-the-art in programming these systems, and proposes an approach for developing a performance-portable application that can effectively utilize all of these systems from a single application. The book starts with a strategy for optimizing an application for multi/manycore architectures. It then looks at the three typical architectures, covering their advantages and disadvantages.

 

 

 

 

 

 

 

 

 

The next section of the book explores the other important component of the target--the compiler. The compiler will ultimately convert the input language to executable code on the target, and the book explores how to make the compiler do what we want. The book then talks about gathering runtime statistics from running the application on the important problem sets previously discussed.

 

 

 

 

 

 

 

 

 

How best to utilize available memory bandwidth and virtualization is covered next, along with hybridization of a program. The last part of the book includes several major applications, and examines future hardware advancements and how the application developer may prepare for those advancements.

 

 

商品描述(中文翻譯)

「不要問你的編譯器能為你做什麼，問問你能為你的編譯器做什麼。」
--John Levesque，Cray 超級計算中心的主任

接下來十年的計算密集型計算將依賴於更強大的多核心/多核節點，這些處理器共享一個大型記憶體空間。這些節點將成為從單節點工作站到接近 exaflop 範疇系統的基礎構建塊。該節點本身將由數十到數百個 MIMD（多重指令，多重數據）處理單元組成，並具有 SIMD（單一指令，多重數據）並行指令。由於標準的、可負擔的記憶體架構無法提供這些核心所需的帶寬，因此將引入新的記憶體組織。這些新的節點架構將對應用開發者提出重大挑戰。

《混合多核心/多核 MPP 系統的程式設計》試圖簡要描述這些系統的當前最先進的程式設計狀態，並提出一種開發性能可攜式應用程式的方法，該應用程式能夠有效利用這些系統。該書首先提出了一種針對多核心/多核架構優化應用程式的策略。然後，它考察了三種典型架構，涵蓋其優缺點。

本書的下一部分探討了目標的另一個重要組成部分——編譯器。編譯器最終將把輸入語言轉換為目標上的可執行代碼，書中探討了如何使編譯器執行我們想要的操作。接著，書中談到了如何從運行應用程式中收集運行時統計數據，這些數據來自之前討論的重要問題集。

接下來將討論如何最佳利用可用的記憶體帶寬和虛擬化，以及程序的混合化。書的最後部分包括幾個主要應用，並檢視未來硬體的進步以及應用開發者如何為這些進步做好準備。

作者簡介

John Levesque works in the Chief Technology Office at Cray Inc. where he is responsible for application performance on Cray's HPC systems. He is also the director of Crays Supercomputing Center of Excellence for the Trinity System installed the end of 2016 at Los Alamos Scientific Laboratory. Prior to Trinity, he was director of the Center of Excellence at the Oak Ridge National Laboratory (ORNL). ORNL installed a 27 Petaflop Cray XK6 system, Titan which was the fastest computer in the world according to the Top500 list in 2012; and a 2.7 Petaflop Cray XT4, Jaguar which was number one in 2009. For the past 50 years, Mr. Levesque has optimized scientific application programs for successful HPC systems. He is an expert in application tuning and compiler analysis of scientific applications. He has written two previous books, on optimization for the Cray 1 in 1989 [20] and on optimization for multi-core MPP systems in 2010 [19].

 

 

 

 

 

 

 

Aaron Vose is an HPC software engineer who spent two years at Cray's Supercomputing Center of Excellence at Oak Ridge National Laboratory. Aaron helped domain scientists at ORNL port and optimize scientific software to achieve maximum scalability and performance on world-class, highperformance computing resources, such as the Titan supercomputer. Aaron now works for Cray Inc. as a software engineer helping R&D to design nextgeneration computer systems. Prior to joining Cray, Aaron spent time at the National Institute for Computational Sciences (NICS) as well as the Joint Institute for Computational Sciences (JICS). There, he worked on scaling and porting bioinformatics software to the Kraken supercomputer. Aaron holds a Master's degree in Computer Science from the University of Tennessee at Knoxville.

 

 

作者簡介(中文翻譯)

約翰·勒維斯克在 Cray Inc. 的首席技術辦公室工作，負責 Cray 的高效能計算（HPC）系統上的應用程式性能。他也是 Cray 超級計算中心的主任，該中心專注於 2016 年底在洛斯阿拉莫斯科學實驗室安裝的 Trinity 系統。在 Trinity 之前，他曾擔任橡樹嶺國家實驗室（ORNL）卓越中心的主任。ORNL 安裝了一台 27 Petaflop 的 Cray XK6 系統 Titan，根據 2012 年的 Top500 名單，這是當時世界上最快的電腦；以及一台 2.7 Petaflop 的 Cray XT4 系統 Jaguar，該系統在 2009 年排名第一。在過去的 50 年中，勒維斯克先生優化了科學應用程式，以適應成功的 HPC 系統。他是應用程式調優和科學應用程式編譯器分析的專家。他曾撰寫兩本書，分別是 1989 年關於 Cray 1 的優化 [20] 和 2010 年關於多核心 MPP 系統的優化 [19]。

亞倫·沃斯是一名 HPC 軟體工程師，在橡樹嶺國家實驗室的 Cray 超級計算中心工作了兩年。亞倫幫助 ORNL 的領域科學家移植和優化科學軟體，以在世界級的高效能計算資源（如 Titan 超級電腦）上實現最大的可擴展性和性能。亞倫目前在 Cray Inc. 擔任軟體工程師，協助研發設計下一代計算系統。在加入 Cray 之前，亞倫曾在國家計算科學研究所（NICS）和聯合計算科學研究所（JICS）工作。在那裡，他負責將生物資訊學軟體擴展和移植到 Kraken 超級電腦。亞倫擁有田納西州立大學（University of Tennessee at Knoxville）的計算機科學碩士學位。

類似商品

最後瀏覽商品 (15)