Cost-Effective Data Pipelines: Balancing Trade-Offs When Developing Pipelines in the Cloud
暫譯: 具成本效益的數據管道：在雲端開發管道時平衡取捨

Leonard, Sev

Cost-Effective Data Pipelines: Balancing Trade-Offs When Developing Pipelines in the Cloud

相關主題

商品描述

The low cost of getting started with cloud services can easily evolve into a significant expense down the road. That's challenging for teams developing data pipelines, particularly when rapid changes in technology and workload require a constant cycle of redesign. How do you deliver scalable, highly available products while keeping costs in check?

With this practical guide, author Sev Leonard provides a holistic approach to designing scalable data pipelines in the cloud. Intermediate data engineers, software developers, and architects will learn how to navigate cost/performance trade-offs and how to choose and configure compute and storage. You'll also pick up best practices for code development, testing, and monitoring.

By focusing on the entire design process, you'll be able to deliver cost-effective, high-quality products. This book helps you:

  • Reduce cloud spend with lower cost cloud service offerings and smart design strategies
  • Minimize waste without sacrificing performance by rightsizing compute resources
  • Drive pipeline evolution, head off performance issues, and quickly debug with effective monitoring
  • Set up development and test environments that minimize cloud service dependencies
  • Create data pipeline code bases that are testable and extensible, fostering rapid development and evolution
  • Improve data quality and pipeline operation through validation and testing

商品描述(中文翻譯)

雲端服務的低成本啟動可能會在未來演變成顯著的開支。這對於開發數據管道的團隊來說是一個挑戰，特別是當技術和工作負載的快速變化需要不斷的重新設計時。如何在控制成本的同時交付可擴展且高可用的產品？

在這本實用指南中，作者 Sev Leonard 提供了一種全面的方法來設計雲端中的可擴展數據管道。中級數據工程師、軟體開發人員和架構師將學習如何在成本與性能之間進行權衡，以及如何選擇和配置計算與儲存資源。您還將獲得有關代碼開發、測試和監控的最佳實踐。

通過專注於整個設計過程，您將能夠交付具成本效益的高品質產品。本書幫助您：

- 透過較低成本的雲端服務方案和智能設計策略來減少雲端開支
- 透過適當配置計算資源來最小化浪費而不犧牲性能
- 推動管道演進，預防性能問題，並通過有效的監控快速除錯
- 設置最小化雲端服務依賴的開發和測試環境
- 創建可測試和可擴展的數據管道代碼庫，促進快速開發和演進
- 通過驗證和測試來改善數據質量和管道運行

作者簡介

With over 20 years of experience in the technology industry Sev brings a breadth of experience spanning circuit design for Intel microprocessors, user-driven application development, and data platform development at both small and large scale. Throughout his career Sev has been a writer, speaker, and teacher along with his technical contributions, seeking to pass on what he has learned and make technology education accessible to all.

Sev's experience developing cloud data pipelines across multiple cloud service providers in large-scale batch and real-time environments, alongside his established record of writing and teaching, make him uniquely qualified to write Cost-effective Data Pipelines. Sev's hands-on experience as a data-engineer coupled with his ability to synthesize ideas provide him both with the subject matter expertise to speak on the topics in Cost-effective Data Pipelines and to elucidate these advanced concepts to readers. Sev's focus on providing actionable, hands-on content in his classes, tutorials, and interactive sessions guarantees an approach that readers will be able to quickly put into practice.

作者簡介(中文翻譯)

擁有超過20年的科技產業經驗，Sev在Intel微處理器的電路設計、以使用者為導向的應用程式開發以及大規模和小規模的數據平台開發方面擁有廣泛的經驗。在他的職業生涯中，Sev不僅是一位作家、演講者和教師，還積極進行技術貢獻，致力於傳遞他所學到的知識，並使科技教育對所有人都能夠獲得。

Sev在多個雲服務提供商中開發雲數據管道的經驗，涵蓋大規模批次和即時環境，加上他在寫作和教學方面的良好紀錄，使他具備撰寫《成本效益數據管道》的獨特資格。Sev作為數據工程師的實務經驗，加上他綜合想法的能力，使他在《成本效益數據管道》中的主題專業知識得以發揮，並能夠向讀者闡明這些先進概念。Sev專注於在他的課程、教程和互動會議中提供可行的實務內容，保證讀者能夠迅速將這些方法付諸實踐。

類似商品

最後瀏覽商品 (20)