Blockchain for Big Data: AI, IoT and Cloud Perspectives

Description

In recent years, the fast-paced development of social information and networks has led to the explosive growth of data. A variety of big data have emerged, encouraging researchers to make business decisions by analysing this data. However, many challenges remain, especially concerning data security and privacy. Big data security and privacy threats permeate every link of the big data industry chain, such as data production, collection, processing, and sharing, and the causes of risk are complex and interwoven. Blockchain technology has been highly praised and recognised for its decentralised infrastructure, anonymity, security, and other characteristics, and it will change the way we access and share information. In this book, the author demonstrates how blockchain technology can overcome some limitations in big data technology and can promote the development of big data while also helping to overcome security and privacy challenges. The author investigates research into and the application of blockchain technology in the field of big data and assesses the attendant advantages and challenges while discussing the possible future directions of the convergence of blockchain and big data. After mastering concepts and technologies introduced in this work, readers will be able to understand the technical evolution, similarities, and differences between blockchain and big data technology, allowing them to further apply it in their development and research. Author: Shaoliang Peng is the Executive Director and Professor of the College of Computer Science and Electronic Engineering, National Supercomputing Centre of Hunan University, Changsha, China. His research interests are high-performance computing, bioinformatics, big data, AI, and blockchain. Cover Half Title Title Page Copyright Page Table of Contents Preface: Background and Overview, Author, Chapter 1 The Development of Big Data 1.1 THE CONCEPT OF BIG DATA 1.1.1 Large Amount of Data 1.1.2 Variety of Data Types 1.1.3 Fast Processing Speed 1.1.4 Low-Value Density 1.2 THE PAST AND PRESENT OF BIG DATA 1.3 TECHNICAL SUPPORT OF BIG DATA 1.3.1 Storage Device Capacity Is Increa sing 1.3.2 Increasing Network Bandwidth 1.3.3 CPU Processing Capacity Increased Significantly 1.3.4 The Deepening of Machine Learning 1.4 THE VALUE OF BIG DATA 1.4.1 Big Data Decision-Making Has Become a New Decision-Making Method 1.4.2 Big Data Application Promotes Deep Integration of Information Technology and Various Industries 1.4.3 Big Data Development Promotes the Continuous Emergence of New Technologies and Applications 1.4.4 Big Data as a Strategic Resource 1.5 KEY TECHNOLOGIES OF BIG DATA 1.5.1 Big Data Acquisition Technology 1.5.2 Big Data Preprocessing Technology 1.5.3 Big Data Storage and Management Technology 1.5.4 Big Data Analysis and Mining Technology 1.5.5 Big Data Presentation Technology 1.6 CHAPTER SUMMARY REFERENCES Chapter 2 Blockchain Technology 2.1 DIGITAL CURRENCY AND BITCOIN 2.1.1 Digital Currency 2.1.2 Bitcoin 2.2 BLOCKCHAIN 2.2.1 Blockchain Architecture 2.2.1.1 Data Layer 2.2.1.2 Network Layer 2.2.1.3 Consensus Layer 2.2.1.4 Smart Contract Layer 2.2.1.5 Application Layer 2.2.2 Characteristics of Blockchain 2.2.2.1 No Tampering 2.2.2.2 Uniqueness Required to Express Value 2.2.2.3 Smart Contract 2.2.2.4 Decentralised Self-Organisation 2.2.3 Classification of Blockchain 2.2.3.1 Public Blockchain: Everyone can Participate 2.2.3.2 Consortium Blockchain: Only Consortium Members can Participate 2.2.3.3 Private Blockchain: Only for Individuals or Companies 2.3 CONSENSUS 2.3.1 Paxos and Raft 2.3.2 BFT and PBFT 2.3.3 Proof of Work 2.3.4 PoS 2.3.5 PoI 2.4 THE EVOLUTION OF BLOCKCHAIN TECHNOLOGY 2.4.1 The First Year of Blockchain History 2.4.2 Blockchain 1 .0 2.4.3 Blockchain 2 .0 2.4.4 Blockchain 3 .0 2.5 CHAPTER SUMMARY REFERENCES Chapter 3 Evolution of Two Technologies 3.1 DEVELOPMENT TREND OF BIG DATA TECHNOLOGY 3.2 KEY TECHNOLOGIES OF BIG DATA 3.2.1 Hadoop 3.2.2 MapReduce 3.2.3 Spark 3.3 DEVELOPMENT OF BLOCKCHAIN TECHNOLOGY 3.4 TAXONOMY OF BLOCKCHAIN SYSTEMS 3.5 SCALABILITY OF BLOCKCHAIN TECHNOLOGY 3.5.1 Sharding Mechanism 3.5.2 DAG-based 3.5.3 Off-Chain Payment Network 3.5.3.1 Lightning Network 3.5.3.2 Raiden Network 3.5.4 Cross-Chain Technology 3.5.4.1 Multi-Centre Witness 3.5.4.2 Side Chain/ Relay Technology 3.5.4.3 Hash Locking 3.5.4.4 Distributed Private Key Control Technology 3.6 SIMILARITIES BETWEEN BIG DATA AND BLOCKCHAIN TECHNOLOGY 3.7 DIFFERENCES BETWEEN BIG DATA AND BLOCKCHAIN TECHNOLOGIES 3.8 CHAPTER SUMMARY REFERENCES Chapter 4 Convergence of Blockchain and Big Data 4.1 THE COMMERCIAL VALUE OF BLOCKCHAIN 4.1.1 TCP/ IP 4.1.2 Smart Assets for the Society 4.1.3 Docking Machine Economy 4.1.4 Optimise the Social Structure 4.2 WHAT CHANGES CAN BLOCKCHAIN BRING? 4.2.1 Security and Privacy 4.2.2 Credibility and Transparency 4.2.3 Data Sharing 4.2.4 Data Analysis 4.2.5 Protection of Data Sovereignty 4.2.6 Cost Reduction 4.3 BLOCKCHAIN TECHNOLOGY RECONSTRUCTS BIG DATA INDUSTRY 4.3.1 Circulation Environment for Trusted Data Asset 4.3.2 Programmable Economy 4.3.3 Anonymity 4.3.4 Convenience of Payment 4.3.5 Irreversibility 4.4 CHALLENGES IN THE CONVERGENCE OF BLOCKCHAIN AND BIG DATA 4.4.1 Scalability 4.4.2 Difficulty in Accurate Analysis 4.4.3 Data Storage 4.4.4 Consensus Upgrade 4.4.5 Intensified Competition 4.5 CHAPTER SUMMARY REFERENCES Chapter 5 Applications of Blockchain Technology 5.1 CHANGES IN THE FINANCIAL INDUSTRY 5.1.1 Supply Chain Finance 5.1.2 Digital Bill 5.1.3 Cross-Border Payment 5.2 INTERNET OF THINGS 5.2.1 Documentation and Traceability of Sensor Data 5.2.2 Smart Meter-Based Energy Trading 5.2.3 Safe Communication and Group Intelligence for Drones 5.3 SMART HEALTHCARE 5.3.1 EHR 5.3.2 Drug Anti-Counterfeit Traceab ility 5.3.3 DNA Wallet 5.4 SUPPLY CHAIN 5.5 MANAGEMENT AND TRADING OF DIGITAL ASSETS 5.6 APPLICATION IN SMART CITY ROADSIDE PARKING 5.6.1 Edge-End Module 5.6.2 Fabric Module 5.6.3 Web Server Module 5.6.4 Client Module 5.7 APPLICATION IN TRACEABILITY OF CHINESE HERBS 5.8 VGUARD: A SPATIOTEMPORAL EFFICIENCY DOUBLE-LEVEL BLOCKCHAIN METHOD FOR VACCINE PRODUCTION SUPERVISION 5.8.1 Background 5.8.2 Specific Design of Blockchain 5.8.2.1 Double-Layer Blockchain Structure 5.8.2.2 Consensus Mechanism for Multi-Node Cooperate 5.8.2.3 Cutting Mechanism Based on Timestamp and Information Interaction 5.8.3 Specific Design of the System 5.8.3.1 Specific Process of vGuard 5.8.3.2 System Implementation 5.9 GEOAI-BASED EPIDEMIC CONTROL WITH GEO-SOCIAL DATA SHARING ON BLOCKCHAIN 5.9.1 Background 5.9.2 Proposed Model 5.9.2.1 Network Overview 5.9.2.2 Proposed System 5.9.2.3 Data Analysis by GeoAI 5.9.3 The System Based on WeChat-GeoAI on the Blockchain 5.9.3.1 Proposed System and the Flow Chart 5.9.3.2 Initialisation and Registration Phase 5.9.3.3 To Initiate a Transaction Application for Confirmation of Suspected Patients 5.9.3.4 Distribution of Infectious Diseases under the GeoAI System 5.10 BLOCKCHAIN DATA SHARING 5.10.1 Data Security 5.10.2 Blockchain File Storage and Sharing Advantages 5.10.3 Blockchain File Storage and Sharing System Solutions 5.10.4 Blockchain Distributed File Storage and Sharing System Case 5.10.4.1 Storage Layer 5.10.4.2 Protocol Layer 5.10.4.3 Service Layer 5.10.4.4 Application Layer 5.11 CHAPTER SUMMARY REFERENCES Chapter 6 Future Directions 6.1 LANDING IN SHARING ECONOMY 6.1.1 Reduce Platform Operating Costs with Decentralised Architecture 6.1.2 Reduce Single Point of Failure through Distributed Storage Mechanisms 6.1.3 Rely on Asymmetric Encryption Algorithm to Protect Users’ Private Data 6.1.4 Use of Data-Storage Sharing Mechanisms to Increase Reuse of Information 6.1.5 Using Offline Digital Currency to Shorten the Length of the Money Transmission Chain 6.2 COMBINING WITH CLOUD COMPUTING 6.3 EXPANDING THE VALUE OF ARTIFICIAL INTELLIGENCE 6.3.1 Intelligent Computing Power 6.3.2 Creating Diverse Data Sets 6.3.3 Data Protection 6.3.4 Data Monetisation 6.3.5 Trust in Artificial Intelligence Decision Making 6.4 PROMOTING THE DEVELOPMENT OF SMART CITIES 6.5 CHAPTER SUMMARY REFERENCES INDEX,