Data Center Handbook: Plan, Design, Build, And Operations Of A Smart Data Center

Description

Written by 59 experts and reviewed by a seasoned technical advisory board, the Data Center Handbook is a thoroughly revised, one-stop resource that clearly explains the fundamentals, advanced technologies, and best practices used in planning, designing, building and operating a mission-critical, energy-efficient, sustainable data center. This handbook, in its second edition, covers anatomy, ecosystem and taxonomy of data centers that enable the Internet of Things and artificial intelligent ecosystems and encompass the following: SECTION 1: DATA CENTER OVERVIEW AND STRATEGIC PLANNING Megatrends, the IoT, artificial intelligence, 5G network, cloud and edge computing Strategic planning forces, location plan, and capacity planning Green design & construction guidelines and best practices Energy demand, conservation, and sustainability strategies Data center financial analysis & risk management SECTION 2: DATA CENTER TECHNOLOGIES Software-defined environment Computing, storage, network resource management Wireless sensor networks in data centers ASHRAE data center guidelines Data center telecommunication cabling, BICSI and TIA 942 Rack-level and server-level cooling Corrosion and contamination control Energy saving technologies and server design Microgrid and data centers SECTION 3: DATA CENTER DESIGN & CONSTRUCTION Data center site selection Architecture design: rack floor plan and facility layout Mechanical design and cooling technologies Electrical design and UPS Fire protection Structural design Reliability engineering Computational fluid dynamics Project management SECTION 4: DATA CENTER OPERATIONS TECHNOLOGIES Benchmarking metrics and assessment Data center infrastructure management Data center air management Disaster recovery and business continuity management The Data Center Handbook: Plan, Design, Build, and Operations of a Smart Data Center belongs on the bookshelves of any professionals who work in, with, or around a data center. COVER ......Page 1 TITLE PAGE ......Page 5 COPYRIGHT PAGE......Page 6 BRIEF CONTENTS ......Page 9 ABOUT THE EDITOR/AUTHOR......Page 11 TECHNICAL ADVISORY BOARD......Page 13 LIST OF CONTRIBUTORS......Page 15 FOREWORD (1)......Page 17 FOREWORD (2)......Page 19 FOREWORD (3)......Page 21 PREFACE DATA CENTER HANDBOOK (SECOND EDITION, 2021) ......Page 23 PREFACE DATA CENTER HANDBOOK (FIRST EDITION, 2015) ......Page 25 ACKNOWLEDGEMENTS DATA CENTER HANDBOOK (SECOND EDITION, 2021) ......Page 27 ACKNOWLEDGMENTS DATA CENTER HANDBOOK (FIRST EDITION, 2015) ......Page 29 TABLE OF CONTENTS......Page 31 PART IV DATA CENTER OPERATIONS MANAGEMENT......Page 0 1.1 INTRODUCTION......Page 43 1.2 ADVANCED TECHNOLOGIES......Page 44 1.4 STRATEGIC PLANNING......Page 48 1.5 DESIGN AND CONSTRUCTION CONSIDERATIONS......Page 50 1.6 OPERATIONS TECHNOLOGY AND MANAGEMENT......Page 51 1.7 BUSINESS CONTINUITY AND DISASTER RECOVERY......Page 52 1.9 GLOBAL WARMING AND SUSTAINABILITY......Page 53 REFERENCES......Page 54 FURTHER READING......Page 55 2.1 INTRODUCTION......Page 57 2.2 APPROACHES FOR MODELING DATA CENTER ENERGY USE......Page 58 2.3 GLOBAL DATA CENTER ENERGY USE: PAST AND PRESENT......Page 59 2.4 GLOBAL DATA CENTER ENERGY USE: FORWARD-LOOKING ANALYSIS......Page 61 2.6 OPPORTUNITIES FOR REDUCING ENERGY USE......Page 63 REFERENCES......Page 66 FURTHER READING......Page 68 3.1 INTRODUCTION......Page 69 3.2 MODULARITY IN DATA CENTERS......Page 74 3.3 COOLING A FLEXIBLE FACILITY......Page 75 3.4 PROPER OPERATING TEMPERATURE AND HUMIDITY......Page 77 3.5 AVOIDING COMMON PLANNING ERRORS......Page 79 3.6 DESIGN CONCEPTS FOR DATA CENTER COOLING SYSTEMS......Page 82 3.7 BUILDING ENVELOPE AND ENERGY USE......Page 84 3.8 AIR MANAGEMENT AND CONTAINMENT STRATEGIES......Page 86 3.9 ELECTRICAL SYSTEM EFFICIENCY......Page 88 3.10 ENERGY USE OF IT EQUIPMENT......Page 90 3.11 SERVER VIRTUALIZATION......Page 92 3.12 INTERDEPENDENCY OF SUPPLY AIR TEMPERATURE AND ITE ENERGY USE......Page 93 3.13 IT AND FACILITIES WORKING TOGETHER TO REDUCE ENERGY USE......Page 94 3.15 SERVER TECHNOLOGY AND STEADY INCREASE OF EFFICIENCY......Page 95 3.16 DATA COLLECTION AND ANALYSIS FOR ASSESSMENTS......Page 96 3.17 PRIVATE INDUSTRY AND GOVERNMENT ENERGY EFFICIENCY PROGRAMS......Page 97 3.18 STRATEGIES FOR OPERATIONS OPTIMIZATION......Page 101 3.19 UTILITY CUSTOMER-FUNDED PROGRAMS......Page 102 FURTHER READING......Page 104 4.2 HOSTING......Page 107 4.4 TYPES OF DATA CENTERS......Page 108 4.7 BUILD VERSUS BUY......Page 114 4.9 CONCLUSION......Page 116 SOURCES FOR DATA CENTER INDUSTRY NEWS AND TRENDS ......Page 117 5.1 INTRODUCTION TO CLOUD AND EDGE COMPUTING......Page 119 5.2 IT STACK......Page 120 5.3 CLOUD COMPUTING......Page 121 5.4 EDGE COMPUTING......Page 126 5.5 FUTURE TRENDS......Page 128 FURTHER READING......Page 129 6.1 INTRODUCTION TO FINANCIAL ANALYSIS, RETURN ON INVESTMENT, AND TOTAL COST OF OWNERSHIP......Page 131 6.2 FINANCIAL MEASURES OF COST AND RETURN......Page 139 6.3 COMPLICATIONS AND COMMON PROBLEMS......Page 146 6.4 A REALISTIC EXAMPLE......Page 156 6.5 CHOOSING TO BUILD, REINVEST, LEASE, OR RENT......Page 166 FURTHER READING......Page 168 7.2 BACKGROUND......Page 169 7.3 REFLECTION: THE BUSINESS CASE......Page 171 7.5 THEORY: THE DESIGN PHASE......Page 173 7.7 PRACTICE: THE BUILD PHASE......Page 178 7.8 KNOWLEDGE TRANSFER 3: PRACTICAL COMPLETION......Page 179 7.9 EXPERIENCE: OPERATION......Page 180 7.11 CONCLUSIONS......Page 182 REFERENCES......Page 183 8.1 INTRODUCTION......Page 187 8.2 SOFTWARE-DEFINED ENVIRONMENTS ARCHITECTURE......Page 188 8.3 SOFTWARE-DEFINED ENVIRONMENTS FRAMEWORK......Page 189 8.4 CONTINUOUS ASSURANCE ON RESILIENCY......Page 193 8.5 COMPOSABLE/DISAGGREGATED DATACENTER ARCHITECTURE......Page 194 8.6 SUMMARY......Page 195 REFERENCES......Page 196 9.2 RESOURCE VIRTUALIZATION AND RESOURCE MANAGEMENT......Page 199 9.3 CLOUD PLATFORM......Page 201 9.4 PROGRESS FROM SINGLE-CLOUD TO MULTI-CLOUD......Page 203 9.5 RESOURCE MANAGEMENT ARCHITECTURE IN LARGE-SCALE CLUSTERS......Page 204 REFERENCES......Page 206 10.1 INTRODUCTION......Page 207 10.2 WIRELESS SENSOR NETWORKS......Page 208 10.3 SENSORS AND ACTUATORS......Page 209 10.4 SENSOR ANALYTICS......Page 210 10.5 ENERGY SAVINGS......Page 213 10.6 CONTROL SYSTEMS......Page 214 10.7 QUANTIFIABLE ENERGY SAVINGS POTENTIAL......Page 216 REFERENCES......Page 218 11.2 THE GROUNDBREAKING ASHRAE “THERMAL GUIDELINES”......Page 219 11.3 THE THERMAL GUIDELINES CHANGE IN HUMIDITY CONTROL......Page 221 11.5 HIGH HUMIDITY AND POLLUTION......Page 222 11.6 THE ASHRAE “DATACOM SERIES”......Page 223 11.8 ASHRAE STANDARDS AND CODES......Page 231 11.10 THE DEVELOPMENT OF ANSI/ASHRAE STANDARD 90.4......Page 232 11.11 SUMMARY OF ANSI/ASHRAE STANDARD 90.4......Page 233 REFERENCES......Page 234 FURTHER READING......Page 235 12.1 WHY USE DATA CENTER TELECOMMUNICATIONS CABLING STANDARDS?......Page 237 12.2 TELECOMMUNICATIONS CABLING STANDARDS ORGANIZATIONS......Page 238 12.3 DATA CENTER TELECOMMUNICATIONS CABLING INFRASTRUCTURE STANDARDS......Page 239 12.4 TELECOMMUNICATIONS SPACES AND REQUIREMENTS......Page 240 12.5 STRUCTURED CABLING TOPOLOGY......Page 244 12.6 CABLE TYPES AND MAXIMUM CABLE LENGTHS......Page 245 12.7 CABINET AND RACK PLACEMENT (HOT AISLES AND COLD AISLES)......Page 249 12.8 CABLING AND ENERGY EFFICIENCY......Page 250 12.11 PATCH PANELS AND CABLE MANAGEMENT......Page 252 12.13 CONCLUSION AND TRENDS......Page 253 FURTHER READING......Page 254 13.1 INTRODUCTION......Page 255 13.2 USING PROPERTIES OF AMBIENT AIR TO COOL A DATA CENTER......Page 256 13.3 ECONOMIZER THERMODYNAMIC PROCESS AND SCHEMATIC OF EQUIPMENT LAYOUT......Page 257 13.4 COMPARATIVE POTENTIAL ENERGY SAVINGS AND REQUIRED TRIM MECHANICAL REFRIGERATION......Page 265 13.6 A NOTE ON LEGIONNAIRES’ DISEASE......Page 268 FURTHER READING......Page 269 14.1 INTRODUCTION......Page 271 14.2 RACK-LEVEL COOLING......Page 272 14.3 SERVER-LEVEL COOLING......Page 278 14.4 CONCLUSIONS AND FUTURE TRENDS......Page 280 FURTHER READING......Page 281 15.1 INTRODUCTION......Page 283 15.2 DATA CENTER ENVIRONMENTAL ASSESSMENT......Page 284 15.3 GUIDELINES AND LIMITS FOR GASEOUS CONTAMINANTS......Page 285 15.4 AIR CLEANING TECHNOLOGIES......Page 286 15.5 CONTAMINATION CONTROL FOR DATA CENTERS......Page 287 15.6 TESTING FOR FILTRATION EFFECTIVENESS AND FILTER LIFE......Page 292 15.7 DESIGN/APPLICATION OF DATA CENTER AIR CLEANING......Page 293 15.9 APPENDIX 1: ADDITIONAL DATA CENTER SERVICES......Page 296 15.11 APPENDIX 3: REACTIVITY MONITORING DATA EXAMPLES: SAMPLE CORROSION MONITORING REPORT ......Page 300 15.12 APPENDIX 4: DATA CENTER CASE STUDY......Page 304 FURTHER READING......Page 305 16.1 INTRODUCTION......Page 307 16.2 FUNDAMENTALS AND PRINCIPLES......Page 308 16.3 ELEMENTS OF THE SYSTEM......Page 315 16.4 CONSIDERATIONS FOR PLANNING AND SELECTING RACK PDUs......Page 324 16.5 FUTURE TRENDS FOR RACK PDUs......Page 331 FURTHER READING......Page 333 17.1 HISTORICAL PERSPECTIVE AND THE “STRUCTURED CABLING MODEL” FOR FIBER CABLING......Page 335 17.2 DEVELOPMENT OF FIBER TRANSPORT SERVICES (FTS) BY IBM......Page 336 17.3 ARCHITECTURE STANDARDS......Page 338 17.4 DEFINITION OF CHANNEL vs. LINK......Page 342 17.5 NETWORK/CABLING ELEMENTS......Page 344 17.6 PLANNING FOR FIBER-OPTIC NETWORKS......Page 348 17.7 LINK POWER BUDGETS AND APPLICATION STANDARDS......Page 353 17.8 LINK COMMISSIONING......Page 356 17.9 TROUBLESHOOTING, REMEDIATION, AND OPERATIONAL CONSIDERATIONS FOR THE FIBER CABLE PLANT......Page 360 WEB......Page 365 18.1 INTRODUCTION......Page 367 18.3 HIGH-EFFICIENT COMPUTE SERVER CLUSTER......Page 368 18.4 PROCESS TO DESIGN ENERGY-EFFICIENT SERVERS......Page 375 18.5 CONCLUSION......Page 379 WATER COOLING SEVERS......Page 380 19.1 INTRODUCTION......Page 381 19.2 ENERGY CONSUMPTION MODELING OF SERVERS IN DATA CENTERS......Page 382 19.3 ENERGY-SAVING TECHNOLOGIES OF SERVERS......Page 385 REFERENCES ......Page 391 20.2 BACKGROUND OF OT CONNECTIVITY IN DATA CENTERS......Page 393 20.3 VULNERABILITIES AND THREATS TO OT SYSTEMS......Page 394 20.4 LEGISLATION COVERING OT SYSTEM SECURITY......Page 396 20.5 CYBER INCIDENTS INVOLVING DATA CENTER OT SYSTEMS......Page 397 20.6 CYBERATTACKS TARGETING OT SYSTEMS......Page 398 20.7 PROTECTING OT SYSTEMS FROM CYBER COMPROMISE......Page 399 20.8 CONCLUSION......Page 401 REFERENCES......Page 402 21.1 INTRODUCTION......Page 403 21.2 DESCRIPTION OF MICROGRIDS......Page 404 21.3 CONSIDERING MICROGRIDS FOR DATA CENTERS......Page 406 21.4 U.S. MICROGRID MARKET......Page 408 FURTHER READING......Page 409 22.2 SITE SEARCHES VERSUS FACILITY SEARCHES......Page 413 22.3 GLOBALIZATION AND THE SPEED OF LIGHT......Page 414 22.4 THE SITE SELECTION PROCESS......Page 416 22.5 INDUSTRY TRENDS AFFECTING SITE SELECTION......Page 425 FURTHER READING......Page 426 23.2 FIBER OPTIC NETWORK DESIGN......Page 427 23.3 OVERVIEW OF RACK AND CABINET DESIGN......Page 432 23.4 SPACE AND POWER DESIGN CRITERIA......Page 435 23.5 PATHWAYS......Page 436 23.6 COORDINATION WITH OTHER SYSTEMS......Page 438 23.7 COMPUTER ROOM DESIGN......Page 441 23.8 SCALABLE DESIGN......Page 444 23.10 DATA CENTER SPACE PLANNING......Page 446 FURTHER READING......Page 448 24.2 KEY DESIGN CRITERIA......Page 449 24.3 MECHANICAL DESIGN PROCESS......Page 453 24.4 DATA CENTER CONSIDERATIONS IN SELECTING KEY COMPONENTS......Page 470 24.5 PRIMARY DESIGN OPTIONS......Page 475 24.6 CURRENT BEST PRACTICES......Page 482 24.7 FUTURE TRENDS......Page 484 FURTHER READING......Page 486 25.2 DESIGN INPUTS......Page 487 25.3 ARCHITECTURE RESILIENCE......Page 489 25.4 ELECTRICAL DESIGN CHALLENGES......Page 496 25.5 FACEBOOK, INC. ELECTRICAL DESIGN......Page 523 FURTHER READING......Page 527 26.1 INTRODUCTION......Page 529 26.2 PRINCIPAL OF UPS AND APPLICATION......Page 530 26.3 CONSIDERATIONS IN SELECTING UPS......Page 544 26.4 RELIABILITY AND REDUNDANCY......Page 548 26.5 ALTERNATE ENERGY SOURCES: ac AND dc......Page 559 26.6 UPS PREVENTIVE MAINTENANCE REQUIREMENTS......Page 561 26.7 UPS MANAGEMENT AND CONTROL......Page 563 FURTHER READING......Page 566 27.1 INTRODUCTION......Page 567 27.2 BUILDING DESIGN CONSIDERATIONS......Page 569 27.3 EARTHQUAKES......Page 570 27.4 HURRICANES, TORNADOES, AND OTHER WINDSTORMS......Page 573 27.5 SNOW AND RAIN......Page 574 27.6 FLOOD AND TSUNAMI......Page 575 27.7 COMPREHENSIVE RESILIENCY STRATEGIES......Page 576 REFERENCES......Page 578 28.1 FIRE PROTECTION FUNDAMENTALS......Page 579 28.3 LOCAL AUTHORITIES, NATIONAL CODES, AND STANDARDS......Page 580 28.4 LIFE SAFETY......Page 581 28.6 ACTIVE FIRE PROTECTION AND SUPPRESSION......Page 583 28.7 DETECTION, ALARM, AND SIGNALING......Page 592 REFERENCES......Page 595 30.1 INTRODUCTION......Page 625 30.2 FUNDAMENTALS OF CFD......Page 626 30.3 APPLICATIONS OF CFD FOR DATA CENTERS......Page 634 30.4 MODELING THE DATA CENTER......Page 638 30.5 POTENTIAL ADDITIONAL BENEFITS OF A CFD-BASED DIGITAL TWIN......Page 653 30.6 THE FUTURE OF CFD-BASED DIGITAL TWINS......Page 654 REFERENCES......Page 655 31.3 PREPARE PROJECT SCOPE OF WORK......Page 657 31.4 ORGANIZE PROJECT TEAM......Page 658 31.5 PROJECT SCHEDULE......Page 659 31.6 PROJECT COSTS......Page 661 FURTHER READING......Page 662 32.2 THE GREEN GRID’S PUE: A USEFUL METRIC......Page 665 32.3 METRICS FOR EXPRESSING PARTIAL ENERGY USE......Page 666 32.4 APPLYING PUE IN THE REAL WORLD......Page 667 32.6 The GREEN GRIDS XUE METRICS ......Page 668 32.8 ADDITIONAL INDUSTRY METRICS AND STANDARDS......Page 669 FURTHER READING......Page 672 33.1 WHAT IS DATA CENTER INFRASTRUCTURE MANAGEMENT......Page 675 33.2 TRIGGERS FOR DCIM ACQUISITION AND DEPLOYMENT......Page 677 33.3 WHAT ARE MODULES OF A DCIM SOLUTION......Page 679 33.4 THE DCIM SYSTEM ITSELF: WHAT TO EXPECT AND PLAN FOR......Page 684 33.5 CRITICAL SUCCESS FACTORS WHEN IMPLEMENTING A DCIM SYSTEM......Page 687 33.6 DCIM AND DIGITAL TWIN......Page 689 33.7 FUTURE TRENDS IN DCIM......Page 690 FURTHER READING......Page 691 34.2 COOLING DELIVERY......Page 693 34.3 METRICS......Page 696 34.4 AIR CONTAINMENT AND ITS IMPACT ON AIR PERFORMANCE......Page 699 34.5 IMPROVING AIR PERFORMANCE......Page 700 REFERENCES......Page 704 35.2 ENERGY CONSUMPTION TRENDS IN DATA CENTERS......Page 705 35.3 COOLING INFRASTRUCTURE IN A DATA CENTER......Page 706 35.4 COOLING ENERGY EFFICIENCY IMPROVEMENTS......Page 707 35.5 MEASUREMENT AND MANAGEMENT TECHNOLOGY (MMT)......Page 708 35.6 MMT-BASED BEST PRACTICES......Page 709 35.7 MEASUREMENT AND METRICS......Page 710 35.8 CONCLUSIONS......Page 715 REFERENCES......Page 716 36.2 CURRENT SITUATION OF DATA CENTER MANAGEMENT......Page 717 36.5 USAGE MODELS......Page 718 FURTHER READING......Page 721 37.2 DESIGN FOR BUSINESS CONTINUITY AND DISASTER RECOVERY......Page 723 37.4 THE 2011 GREAT EAST JAPAN EARTHQUAKE......Page 724 37.5 THE 2012 EASTERN U.S. COAST SUPERSTORM SANDY......Page 727 37.7 CONCLUSIONS......Page 731 FURTHER READING......Page 732 INDEX......Page 735 EULA......Page 755