分佈式數據庫架構設計與實踐

目 錄

第1章 數據庫的發展與現狀   ············1

1.1　數據庫的定義和分類   ······························1

1.1.1　網狀和層次數據庫    ······2

1.1.2　關系數據庫    ··················2

1.1.3　NoSQL數據庫    ············3

1.1.4　分佈式數據庫    ··············5

1.1.5　雲數據庫    ······················7

1.1.6　時序數據庫    ··················8

1.1.7　NewSQL數據庫    ········14

1.2　國產數據庫行業    ·····16

1.2.1　國產數據庫行業發展歷程   ·······················16

1.2.2　國產數據庫發展特點    21

1.2.3　國產數據庫行業市場格局分析   ···············23

1.3　數據庫的發展總結    ·25

1.4　小結    ·························26

第2章 分佈式數據庫架構概述   ······27

2.1　“去O”實踐特色    ·27

2.1.1　國產化趨勢分析    ········27

2.1.2　“去O”的廠商數據庫產品解析   ···········28

2.2　分佈式數據庫的概念   ····························32

2.3　分佈式數據庫的分類   ····························33

2.3.1　OLTP和OLAP對比    ·33

2.3.2　關於HTAP    ·················34

2.4　如何解決分佈式問題   ····························37

2.4.1　分佈式數據庫的事務處理技術   ···············37

2.4.2　分佈式存儲技術    ········44

2.5　分佈式數據庫的優點和缺點   ················50

2.5.1　分佈式數據庫的優點    50

2.5.2　分佈式數據庫的缺點    50

2.6　分佈式數據庫未來的趨勢思考   ············51

第3章AntDB分佈式關系數據庫架構 ··························53

3.1　AntDB架構概覽   ·····53

3.2　AntDB的SQL引擎   ······························54

3.2.1　計算節點Coordinator   ······························54

3.2.2　全局事務管理節點    ····59

3.3　AntDB執行器技術   ·60

3.3.1　邏輯計劃與物理計劃    61

3.3.2　分佈式執行    ················61

3.3.3　分佈式執行計劃的優勢   ···························62

3.4　AntDB存儲技術   ·····63

3.4.1　存儲節點    ····················63

3.4.2　Hash分片技術   ···········63

3.4.3　水平動態擴展技術    ····67

3.5　AntDB事務機制    ·····68

3.5.1　全局一致性    ················68

3.5.2　2PC協議和Paxos協議   ···························69

3.6　AntDB企業增強特性介紹   ····················72

3.6.1　數據分佈式存儲    ········72

3.6.2　分佈式集群下強一致備份恢復技術   ·······74

3.6.3　同步異步自適應流復制   ···························75

3.6.4　異構數據庫兼容評估    78

3.6.5　數據並行查詢    ············83

3.6.6　Oracle兼容    ················84

3.6.7　AntDB在線數據擴容   ······························85

3.6.8　讀寫分離    ····················89

3.6.9　與異構數據庫互聯    ····93

3.6.10　異構索引支持    ··········94

3.6.11　集群自愈    ··················97

3.6.12　異地多中心    ············103

3.7　AntDB 的Oracle兼容性   ·····················103

3.7.1　Oracle兼容性能力說明   ·························103

3.7.2　使用兼容模式訪問AntDB數據庫   ·······104

3.7.3　使用Oracle兼容特性開發應用系統   ····106

3.7.4　AntDB與Oracle語法對比   ····················107

3.8　AntDB管理節點Adbmgr介紹   ··········150

3.8.1　Adbmgr簡介    ···········150

3.8.2　管理AntDB集群    ····151

3.9　AntDB運維管理控制台介紹  ··············180

3.9.1　AntDB管理控制台產品定位   ················180

3.9.2　AntDB運維管理控制台系統架構   ········181

3.9.3　AntDB運維管理控制台功能介紹   ········182

第4章AntDB分佈式內存數據庫  184

4.1　AntDB分佈式內存數據庫架構  ··········184

4.2　存儲引擎介紹    ·······186

4.2.1　分層存儲    ··················186

4.2.2　持久化    ······················188

4.2.3　索引優化    ··················191

4.3　AntDB分佈式內存數據庫適用的場景 ·····························193

第5章AntDB數據庫實踐案例介紹  ···························194

5.1　某省核心營業庫案例   ··························194

5.2　某省高速公路清分結算系統改造升級案例  ·····················197

5.3　某省核心賬務庫案例   ··························201

5.4　某省計費中心項目   ······························204

第6章高可用性方案設計與最佳實踐 ························208

6.1　高可用架構基礎    ···208

6.1.1　各種高可用架構介紹   ·····························209

6.1.2　服務器的可靠性設計   ·····························211

6.2　基於共享存儲的高可用方案   ··············211

6.2.1　SAN存儲方案   ·········212

6.2.2　DRBD方案    ··············215

6.3　WAL日誌或流復制的高可用方案   ·····218

6.3.1　持續復制歸檔的Standby方法   ··············219

6.3.2　異步流復制方案    ······220

6.3.3　同步流復制方案    ······228

6.4　基於觸發器的同步方案   ······················229

6.4.1　基於觸發器的同步方案特點   ·················229

6.4.2　基於觸發器的同步軟件介紹   ·················230

6.5　基於中間件的高可用方案   ··················233

6.5.1　基於中間件的高可用方案的特點   ·········233

6.5.2　基於中間件的開源軟件介紹   ·················234

第7章 分佈式數據庫的發展展望   245

7.1　分佈式數據庫優化方案   ······················247

7.1.1　OLTP性能優化    ·······248

7.1.2　OLAP性能優化    ······249

7.2　分佈式數據庫的熱點技術   ··················256

7.2.1　時序數據處理    ··········256

7.2.2　流式計算    ··················258

7.2.3　全文檢索、地理空間信息、圖形關系處理  ························259

7.2.4　庫內機器學習    ··········259

7.2.5　向量相似度查詢    ······260

7.2.6　區塊鏈    ······················261

7.2.7　存儲計算分離    ··········263

7.2.8　插件化    ······················266

7.2.9　超融合    ······················266