Advent of Go Microservices

Description

Writing good services in Go can be a challenge - you have to write out your database structures, unit and integration testing with CI to see what breaks, keep them updated with migrations, define your API endpoints and routing, update your documentation - all of these things keep you from building your service. Let's be smart about it. Table of Contents Introduction About me Who is this book for? How should I study it? Requirements Linux and Docker Go: Introduction to Protobuf: Messages Protobufs and Go Generating Protobuf Go code Wrapping up Go: Introduction to Protobuf: Services Protobuf service definitions Our microservice Twitch RPC scaffolding Go: Introduction to Protobuf: gRPC Generating the gRPC scaffolding Comparing the server side Comparing the client side Make: Dynamic Makefile targets Building multiple targets with Go Dynamic Makefile target for building RPC/Protobuf files Building our services from cmd/ Bash: Poor mans code generation Generating our service cmd/ folders Generating the client for our service Server implementation Bash: Embedding files into Go Planning database migrations Poor mans file embedding Go: Scaffolding database migrations The migration API Drone CI: Testing database migrations Configuring Drone CI for database integration tests Go: Database first struct generation Database schema data structures and helpers Querying information schema Type conversions Moving forward Go: Generating database schema documentation Updating the Go generators Implementing a markdown output renderer A caveat emptor about database migrations Go: Dependency injection with Wire The Go way Runtime vs. compile time Wire and dependency providers Wire and dependency Injector Docker: Building images with security in mind Configuring Makefile targets The basic Dockerfile image Security implications of our docker image Possible improvements Go: implementing a microservice The database schema Improving the microservice environment Implementing Push Docker/Bash: Issuing requests against our microservice The docker-compose file Our first request Go: Improving our database handling Data source name - DSN Multiple database connections Updating database connections Database connection retry Migration improvements Re-testing the bundled migrations Go: Instrumenting the HTTP service with Elastic APM Wrapping our existing handler Logging errors too Setting up ELK Setting up APM Configuring our sender Reviewing ELK data Go: Instrumenting the Database client with Elastic APM Extending DB connection Verifying it's working Go: Stress testing our service Setting up our stress test Resolving detected errors Removing context cancellation Wrapping up Go: Background jobs Adding background jobs to our service Do we really need Init? The background job Housekeeping Verifying everything works Go: Optimizing requests with a queue The Queue The Producer The Consumer Benchmarking Notes and pitfalls