Hands-On Linux For Architects: Design And Implement Linux-based IT solutions

Description

It is very important to understand the flexibility of an infrastructure when designing an efficient environment. In this book, you will cover everything from Linux components and functionalities through to hardware and software support, which will help you to implement and tune effective Linux-based solutions. This book gets started with an overview of Linux design methodology. Next, you will focus on the core concepts of designing a solution. As you progress, you will gain insights into the kinds of decisions you need to make when deploying a high-performance solution using Gluster File System (GlusterFS). In the next set of chapters, the book will guide you through the technique of using Kubernetes as an orchestrator for deploying and managing containerized applications. In addition to this, you will learn how to apply and configure Kubernetes for your NGINX application. You’ll then learn how to implement an ELK stack, which is composed of Elasticsearch, Logstash, and Kibana. In the concluding chapters, you will focus on installing and configuring a Saltstack solution to manage different Linux distributions, and explore a variety of design best practices. By the end of this book, you will be well-versed with designing a high-performing computing environment for complex applications to run on. By the end of the book, you will have delved inside the most detailed technical conditions of designing a solution, and you will have also dissected every aspect in detail in order to implement and tune open source Linux-based solutions. Source Code And Errata: https://www.packtpub.com/codedownloaderrata Cover Title Page Copyright and Credits About Packt Contributors Dedication Table of Contents Preface Section 1: High-Performance Storage Solutions with GlusterFS Chapter 1: Introduction to Design Methodology Defining the stages of solution design and why they matter Analyzing the problem and asking the right questions Technical standpoint Business standpoint Functional standpoint Considering possible solutions POC Implementing the solution Summary Questions Further reading Chapter 2: Defining GlusterFS Storage Technical requirements What is a cluster? Computing a cluster Storage clusters What is GlusterFS? SDS Cost reduction Scalability Control The market is moving toward SDS Massive storage Block, file, and object storage Block storage File storage Object storage Why choose GlusterFS? GlusterFS features Commodity hardware – GlusterFS runs on pretty much anything GlusterFS can be deployed on private, public, or hybrid clouds No single point of failure Scalability Asynchronous geo-replication Performance Self-healing Flexibility Remote direct memory access (RDMA) Gluster volume types Distributed Replicated Distributed replicated Dispersed Distributed dispersed The need for highly redundant storage Disaster recovery RTO RPO Synchronous replication Asynchronous replication The need for high performance Parallel I/O Summary Questions Further reading Chapter 3: Architecting a Storage Cluster Technical requirements GlusterFS compute requirements RAM Why is cache important? CPU Cloud considerations How much space do you need? GlusterFS volume type Distributed Replicated Dispersed Space required by the application Projected growth Performance considerations Throughput Latency IOPS I/O size GlusterFS performance Volume type Brick layout Number of nodes Tuning parameters The best approach for high availability Replicated Dispersed Geo-replication How the workload defines requirements Documentation System tools File type and size Ask the right questions Summary Questions Further reading Chapter 4: Using GlusterFS on the Cloud Infrastructure Technical requirements Setting up the bricks used for backend storage Azure deployment ZFS as the backend for the bricks Installing ZFS Configuring the zpools Adding the ZFS cache to the pool (optional) Installing GlusterFS on the nodes Installing the packages Creating the trusted pool Creating the volumes Creating a dispersed volume Mounting the volume Optimizing performance GlusterFS tuning ZFS ARC L2ARC Summary Questions Further reading Chapter 5: Analyzing Performance in a Gluster System Technical requirements An overview of the implementation An overview of the cluster Performance testing Performance theory Performance tools The ZFS zpool iostat command iostat The FIO tester Availability testing Scaling Summary Questions Further reading Section 2: High-Availablility Nginx Web Application Using Kubernetes Chapter 6: Creating a Highly Available Self-Healing Architecture Microservices Creating container images FROM LABEL RUN ENV COPY EXPOSE CMD and ENTRYPOINT Building container images using best practices Container orchestration Kubernetes Summary Questions Further reading Bibliography/sources Chapter 7: Understanding the Core Components of a Kubernetes Cluster The Kubernetes control plane The kube-apiserver The kube-controller-manager The kube-scheduler The etcd database Kubernetes worker nodes Container runtime The kubelet The kube-proxy Kubernetes objects Pods – the basis of Kubernetes Deployments Services Kubernetes and persistent storage Volumes Persistent Volumes, Persistent Volume Claims, and Storage Classes Summary Questions Further reading Chapter 8: Architecting a Kubernetes Cluster Kube-sizing etcd considerations kube-apiserver sizing Worker nodes Load balancer considerations Storage considerations Network requirements Kubernetes DNS-based service discovery Customizing kube objects Namespacing Limiting namespace resources Customizing pods Summary Questions Further reading Chapter 9: Deploying and Configuring Kubernetes Infrastructure deployment Installing Azure CLI Configuring Azure CLI High-level design overview Provisioning network resources Provisioning compute resources Preparing the management VM Generating certificates Certificate authority Client certificates Control plane certificates Sending our certificates home Kubeconfigs Installing kubectl Kube-controller-manager Kube-scheduler Kubelet configs Kube-proxy Moving configs around Installing the control plane ETCD Installing etcd Encrypting etcd data Installing the Kubernetes controller binaries Kube-apiserver Kube-controller-manager Kube-scheduler Starting the control plane Setting RBAC permissions for kubelets. Cluster role Cluster role binding Load-balancer setup Creating the load-balancer Azure load-balancer The backend pool Health probes Load-balancing rules Worker node setup Downloading and preparing binaries Adding the Kubernetes repository Installing dependencies and kubectl Downloading and storing worker binaries Containerd setup The kubelet kube-proxy Starting services Kubernetes networking Getting the nodes ready Configuring remote access Installing Weave Net DNS server Managing Kubernetes on the cloud Summary Questions Further reading Bibliography/sources: Section 3: Elastic Stack Chapter 10: Monitoring with the ELK Stack Technical requirements Understanding the need for monitoring Decisions made through historical data Proactively detect problems Understand environment performance Plan for budget Centralized logs Elasticsearch overview Fast Scalable Highly available Logstash Grok Custom patterns Kibana brings everything together Summary Questions Further reading Chapter 11: Designing an ELK Stack Technical requirements Elasticsearch CPU requirements CPU count CPU speed CPU performance impact Startup Index per second Search latency Recommendations Test/dev Production Memory sizing for Elasticsearch Filesystem cache Disable swap Undersizing memory Unable start OOM killer Recommendations Storage configuration for Elasticsearch Capacity Performance Considerations Logstash and Kibana requirements Logstash Kibana Summary Questions Further reading Chapter 12: Using Elasticsearch, Logstash, and Kibana to Manage Logs Technical requirements Deployment overview Installing Elasticsearch The RPM repository The Elasticsearch data directory Partitioning the disk Formatting the filesystem Persistent mounting using fstab Configuring Elasticsearch Elasticsearch YAML Cluster name Discovery settings Node name Network host Path settings Starting Elasticsearch Adding an Elasticsearch node Installing Logstash and Kibana Configuring Logstash Logstash YAML Logstash pipelines Configuring Kibana Kibana YAML The coordinating node Starting Logstash and Kibana What are Beats? Filebeat Metricbeat Let's not skip a beat – installing Beats Configuring Beats clients Filebeat YAML Metricbeat YAML Next steps Summary Questions Further reading Section 4: System Management Using Saltstack Chapter 13: Solving Management Problems with Salty Solutions Centralizing system management New technologies and system management Recovering control of our own infrastructure Centralized tools to disperse problems Coding for a desired state Understanding NaCl Introducing Salt The SaltStack platform Salt capabilities Remote command execution modules The sys module The pkg module The test module   Salt states Grains of Salt Salt pillars Summary Questions Further reading Chapter 14: Getting Your Hands Salty Hands-on with Salt Scenario Terraforming our initial infrastructure Setting up Terraform Creating IaC Installing Salt with package managers Installing CentOS yum  Ubuntu apt-getting Salt Installing Salt via the bootstrap script Master and minion handshake Working with Salt Creating WebServer formulas Creating load-balancing formulas Summary Chapter 15: Design Best Practices Designing for the occasion On-premises environments Bare metal server Virtual machines Cloud environments The journey to the cloud Assessing Migrating Lift and shift Refactor Rearchitecting Rebuild Optimizing DevOps Monolithic waterfalls Agile solutions to monolithic problems Continuous culture for CI/CD Summary Questions Further reading Assessments Other Books You May Enjoy Index