The Art of 64-Bit Assembly, Volume 1: x86-64 Machine Organization and Programming

Description

Randall Hyde's The Art of Assembly Language has long been the go-to guide for learning assembly language. In this long-awaited follow-up, Hyde presents a 64-bit rewrite of his seminal text. It not only covers the instruction set for today’s x86-64 class of processors in-depth (using MASM), but also leads you through the maze of assembly language programming and machine organization by showing you how to write code that mimics operations in high-level languages. Beginning with a “quick-start” chapter that gets you writing basic ASM applications as rapidly as possible, Hyde covers the fundamentals of machine organization, computer data representation and operations, and memory access. He’ll teach you assembly language programming, starting with basic data types and arithmetic, progressing through control structures and arithmetic to advanced topics like table lookups and string manipulation. In addition to the standard integer instruction set, the book covers the x87 FPU, single-instruction, multiple-data (SIMD) instructions, and MASM’s very powerful macro facilities. Throughout, you’ll benefit from a wide variety of ready-to-use library routines that simplify the programming process. You’ll learn how to: • Write standalone programs or link MASM programs with C/C++ code for calling routines in the C Standard Library • Organize variable declarations to speed up access to data, and how to manipulate data on the x86-64 stack • Implement HLL data structures and control structures in assembly language • Convert various numeric formats, like integer to decimal string, floating-point to string, and hexadecimal string to integer • Write parallel algorithms using SSE/AVX (SIMD) instructions • Use macros to reduce the effort needed to write assembly language code The Art of 64-bit Assembly, Volume 1 builds on the timeless material of its iconic predecessor, offering a comprehensive masterclass on writing complete applications in low-level programming languages. Brief Contents Contents in Detail Foreword Acknowledgments Introduction A Note About the Source Code in This Book Part I: Machine Organization Chapter 1: Hello, World of Assembly Language 1.1 What You’ll Need 1.2 Setting Up MASM on Your Machine 1.3 Setting Up a Text Editor on Your Machine 1.4 The Anatomy of a MASM Program 1.5 Running Your First MASM Program 1.6 Running Your First MASM/C++ Hybrid Program 1.7 An Introduction to the Intel x86-64 CPU Family 1.8 The Memory Subsystem 1.9 Declaring Memory Variables in MASM 1.9.1 Associating Memory Addresses with Variables 1.9.2 Associating Data Types with Variables 1.10 Declaring (Named) Constants in MASM 1.11 Some Basic Machine Instructions 1.11.1 The mov Instruction 1.11.2 Type Checking on Instruction Operands 1.11.3 The add and sub Instructions 1.11.4 The lea Instruction 1.11.5 The call and ret Instructions and MASM Procedures 1.12 Calling C/C++ Procedures 1.13 Hello, World! 1.14 Returning Function Results in Assembly Language 1.15 Automating the Build Process 1.16 Microsoft ABI Notes 1.16.1 Variable Size 1.16.2 Register Usage 1.16.3 Stack Alignment 1.17 For More Information 1.18 Test Yourself Chapter 2: Computer Data Representation and Operations 2.1 Numbering Systems 2.1.1 A Review of the Decimal System 2.1.2 The Binary Numbering System 2.1.3 Binary Conventions 2.2 The Hexadecimal Numbering System 2.3 A Note About Numbers vs. Representation 2.4 Data Organization 2.4.1 Bits 2.4.2 Nibbles 2.4.3 Bytes 2.4.4 Words 2.4.5 Double Words 2.4.6 Quad Words and Octal Words 2.5 Logical Operations on Bits 2.5.1 The AND Operation 2.5.2 The OR Operation 2.5.3 The XOR Operation 2.5.4 The NOT Operation 2.6 Logical Operations on Binary Numbers and Bit Strings 2.7 Signed and Unsigned Numbers 2.8 Sign Extension and Zero Extension 2.9 Sign Contraction and Saturation 2.10 Brief Detour: An Introduction to Control Transfer Instructions 2.10.1 The jmp Instruction 2.10.2 The Conditional Jump Instructions 2.10.3 The cmp Instruction and Corresponding Conditional Jumps 2.10.4 Conditional Jump Synonyms 2.11 Shifts and Rotates 2.12 Bit Fields and Packed Data 2.13 IEEE Floating-Point Formats 2.13.1 Single-Precision Format 2.13.2 Double-Precision Format 2.13.3 Extended-Precision Format 2.13.4 Normalized Floating-Point Values 2.13.5 Non-Numeric Values 2.13.6 MASM Support for Floating-Point Values 2.14 Binary-Coded Decimal Representation 2.15 Characters 2.15.1 The ASCII Character Encoding 2.15.2 MASM Support for ASCII Characters 2.16 The Unicode Character Set 2.16.1 Unicode Code Points 2.16.2 Unicode Code Planes 2.16.3 Unicode Encodings 2.17 MASM Support for Unicode 2.18 For More Information 2.19 Test Yourself Chapter 3: Memory Access and Organization 3.1 Runtime Memory Organization 3.1.1 The .code Section 3.1.2 The .data Section 3.1.3 The .const Section 3.1.4 The .data? Section 3.1.5 Organization of Declaration Sections Within Your Programs 3.1.6 Memory Access and 4K Memory Management Unit Pages 3.2 How MASM Allocates Memory for Variables 3.3 The Label Declaration 3.4 Little-Endian and Big-Endian Data Organization 3.5 Memory Access 3.6 MASM Support for Data Alignment 3.7 The x86-64 Addressing Modes 3.7.1 x86-64 Register Addressing Modes 3.7.2 x86-64 64-Bit Memory Addressing Modes 3.7.3 Large Address Unaware Applications 3.8 Address Expressions 3.9 The Stack Segment and the push and pop Instructions 3.9.1 The Basic push Instruction 3.9.2 The Basic pop Instruction 3.9.3 Preserving Registers with the push and pop Instructions 3.10 The Stack Is a LIFO Data Structure 3.11 Other push and pop Instructions 3.12 Removing Data from the Stack Without Popping It 3.13 Accessing Data You’ve Pushed onto the Stack Without Popping It 3.14 Microsoft ABI Notes 3.15 For More Information 3.16 Test Yourself Chapter 4: Constants, Variables, and Data Types 4.1 The imul Instruction 4.2 The inc and dec Instructions 4.3 MASM Constant Declarations 4.3.1 Constant Expressions 4.3.2 this and $ Operators 4.3.3 Constant Expression Evaluation 4.4 The MASM typedef Statement 4.5 Type Coercion 4.6 Pointer Data Types 4.6.1 Using Pointers in Assembly Language 4.6.2 Declaring Pointers in MASM 4.6.3 Pointer Constants and Pointer Constant Expressions 4.6.4 Pointer Variables and Dynamic Memory Allocation 4.6.5 Common Pointer Problems 4.7 Composite Data Types 4.8 Character Strings 4.8.1 Zero-Terminated Strings 4.8.2 Length-Prefixed Strings 4.8.3 String Descriptors 4.8.4 Pointers to Strings 4.8.5 String Functions 4.9 Arrays 4.9.1 Declaring Arrays in Your MASM Programs 4.9.2 Accessing Elements of a Single-Dimensional Array 4.9.3 Sorting an Array of Values 4.10 Multidimensional Arrays 4.10.1 Row-Major Ordering 4.10.2 Column-Major Ordering 4.10.3 Allocating Storage for Multidimensional Arrays 4.10.4 Accessing Multidimensional Array Elements in Assembly Language 4.11 Records/Structs 4.11.1 MASM Struct Declarations 4.11.2 Accessing Record/Struct Fields 4.11.3 Nesting MASM Structs 4.11.4 Initializing Struct Fields 4.11.5 Arrays of Structs 4.11.6 Aligning Fields Within a Record 4.12 Unions 4.12.1 Anonymous Unions 4.12.2 Variant Types 4.13 Microsoft ABI Notes 4.14 For More Information 4.15 Test Yourself Part II: Assembly Language Programming Chapter 5: Procedures 5.1 Implementing Procedures 5.1.1 The call and ret Instructions 5.1.2 Labels in a Procedure 5.2 Saving the State of the Machine 5.3 Procedures and the Stack 5.3.1 Activation Records 5.3.2 The Assembly Language Standard Entry Sequence 5.3.3 The Assembly Language Standard Exit Sequence 5.4 Local (Automatic) Variables 5.4.1 Low-Level Implementation of Automatic (Local) Variables 5.4.2 The MASM Local Directive 5.4.3 Automatic Allocation 5.5 Parameters 5.5.1 Pass by Value 5.5.2 Pass by Reference 5.5.3 Low-Level Parameter Implementation 5.5.4 Declaring Parameters with the proc Directive 5.5.5 Accessing Reference Parameters on the Stack 5.6 Calling Conventions and the Microsoft ABI 5.7 The Microsoft ABI and Microsoft Calling Convention 5.7.1 Data Types and the Microsoft ABI 5.7.2 Parameter Locations 5.7.3 Volatile and Nonvolatile Registers 5.7.4 Stack Alignment 5.7.5 Parameter Setup and Cleanup (or “What’s with These Magic Instructions?”) 5.8 Functions and Function Results 5.9 Recursion 5.10 Procedure Pointers 5.11 Procedural Parameters 5.12 Saving the State of the Machine, Part II 5.13 Microsoft ABI Notes 5.14 For More Information 5.15 Test Yourself Chapter 6: Arithmetic 6.1 x86-64 Integer Arithmetic Instructions 6.1.1 Sign- and Zero-Extension Instructions 6.1.2 The mul and imul Instructions 6.1.3 The div and idiv Instructions 6.1.4 The cmp Instruction, Revisited 6.1.5 The setcc Instructions 6.1.6 The test Instruction 6.2 Arithmetic Expressions 6.2.1 Simple Assignments 6.2.2 Simple Expressions 6.2.3 Complex Expressions 6.2.4 Commutative Operators 6.3 Logical (Boolean) Expressions 6.4 Machine and Arithmetic Idioms 6.4.1 Multiplying Without mul or imul 6.4.2 Dividing Without div or idiv 6.4.3 Implementing Modulo-N Counters with AND 6.5 Floating-Point Arithmetic 6.5.1 Floating-Point on the x86-64 6.5.2 FPU Registers 6.5.3 FPU Data Types 6.5.4 The FPU Instruction Set 6.5.5 FPU Data Movement Instructions 6.5.6 Conversions 6.5.7 Arithmetic Instructions 6.5.8 Comparison Instructions 6.5.9 Constant Instructions 6.5.10 Transcendental Instructions 6.5.11 Miscellaneous Instructions 6.6 Converting Floating-Point Expressions to Assembly Language 6.6.1 Converting Arithmetic Expressions to Postfix Notation 6.6.2 Converting Postfix Notation to Assembly Language 6.7 SSE Floating-Point Arithmetic 6.7.1 SSE MXCSR Register 6.7.2 SSE Floating-Point Move Instructions 6.7.3 SSE Floating-Point Arithmetic Instructions 6.7.4 SSE Floating-Point Comparisons 6.7.5 SSE Floating-Point Conversions 6.8 For More Information 6.9 Test Yourself Chapter 7: Low-Level Control Structures 7.1 Statement Labels 7.1.1 Using Local Symbols in Procedures 7.1.2 Initializing Arrays with Label Addresses 7.2 Unconditional Transfer of Control (jmp) 7.2.1 Register-Indirect Jumps 7.2.2 Memory-Indirect Jumps 7.3 Conditional Jump Instructions 7.4 Trampolines 7.5 Conditional Move Instructions 7.6 Implementing Common Control Structures in Assembly Language 7.6.1 Decisions 7.6.2 if/then/else Sequences 7.6.3 Complex if Statements Using Complete Boolean Evaluation 7.6.4 Short-Circuit Boolean Evaluation 7.6.5 Short-Circuit vs. Complete Boolean Evaluation 7.6.6 Efficient Implementation of if Statements in Assembly Language 7.6.7 switch/case Statements 7.7 State Machines and Indirect Jumps 7.8 Loops 7.8.1 while Loops 7.8.2 repeat/until Loops 7.8.3 forever/endfor Loops 7.8.4 for Loops 7.8.5 The break and continue Statements 7.8.6 Register Usage and Loops 7.9 Loop Performance Improvements 7.9.1 Moving the Termination Condition to the End of a Loop 7.9.2 Executing the Loop Backward 7.9.3 Using Loop-Invariant Computations 7.9.4 Unraveling Loops 7.9.5 Using Induction Variables 7.10 For More Information 7.11 Test Yourself Chapter 8: Advanced Arithmetic 8.1 Extended-Precision Operations 8.1.1 Extended-Precision Addition 8.1.2 Extended-Precision Subtraction 8.1.3 Extended-Precision Comparisons 8.1.4 Extended-Precision Multiplication 8.1.5 Extended-Precision Division 8.1.6 Extended-Precision Negation Operations 8.1.7 Extended-Precision AND Operations 8.1.8 Extended-Precision OR Operations 8.1.9 Extended-Precision XOR Operations 8.1.10 Extended-Precision NOT Operations 8.1.11 Extended-Precision Shift Operations 8.1.12 Extended-Precision Rotate Operations 8.2 Operating on Different-Size Operands 8.3 Decimal Arithmetic 8.3.1 Literal BCD Constants 8.3.2 Packed Decimal Arithmetic Using the FPU 8.4 For More Information 8.5 Test Yourself Chapter 9: Numeric Conversion 9.1 Converting Numeric Values to Strings 9.1.1 Converting Numeric Values to Hexadecimal Strings 9.1.2 Converting Extended-Precision Hexadecimal Values to Strings 9.1.3 Converting Unsigned Decimal Values to Strings 9.1.4 Converting Signed Integer Values to Strings 9.1.5 Converting Extended-Precision Unsigned Integers to Strings 9.1.6 Converting Extended-Precision Signed Decimal Values to Strings 9.1.7 Formatted Conversions 9.1.8 Converting Floating-Point Values to Strings 9.2 String-to-Numeric Conversion Routines 9.2.1 Converting Decimal Strings to Integers 9.2.2 Converting Hexadecimal Strings to Numeric Form 9.2.3 Converting Unsigned Decimal Strings to Integers 9.2.4 Conversion of Extended-Precision String to Unsigned Integer 9.2.5 Conversion of Extended-Precision Signed Decimal String to Integer 9.2.6 Conversion of Real String to Floating-Point 9.3 For More Information 9.4 Test Yourself Chapter 10: Table Lookups 10.1 Tables 10.1.1 Function Computation via Table Lookup 10.1.2 Generating Tables 10.1.3 Table-Lookup Performance 10.2 For More Information 10.3 Test Yourself Chapter 11: SIMD Instructions 11.1 The SSE/AVX Architectures 11.2 Streaming Data Types 11.3 Using cpuid to Differentiate Instruction Sets 11.4 Full-Segment Syntax and Segment Alignment 11.5 SSE, AVX, and AVX2 Memory Operand Alignment 11.6 SIMD Data Movement Instructions 11.6.1 The (v)movd and (v)movq Instructions 11.6.2 The (v)movaps, (v)movapd, and (v)movdqa Instructions 11.6.3 The (v)movups, (v)movupd, and (v)movdqu Instructions 11.6.4 Performance of Aligned and Unaligned Moves 11.6.5 The (v)movlps and (v)movlpd Instructions 11.6.6 The movhps and movhpd Instructions 11.6.7 The vmovhps and vmovhpd Instructions 11.6.8 The movlhps and vmovlhps Instructions 11.6.9 The movhlps and vmovhlps Instructions 11.6.10 The (v)movshdup and (v)movsldup Instructions 11.6.11 The (v)movddup Instruction 11.6.12 The (v)lddqu Instruction 11.6.13 Performance Issues and the SIMD Move Instructions 11.6.14 Some Final Comments on the SIMD Move Instructions 11.7 The Shuffle and Unpack Instructions 11.7.1 The (v)pshufb Instructions 11.7.2 The (v)pshufd Instructions 11.7.3 The (v)pshuflw and (v)pshufhw Instructions 11.7.4 The shufps and shufpd Instructions 11.7.5 The vshufps and vshufpd Instructions 11.7.6 The (v)unpcklps, (v)unpckhps, (v)unpcklpd, and (v)unpckhpd Instructions 11.7.7 The Integer Unpack Instructions 11.7.8 The (v)pextrb, (v)pextrw, (v)pextrd, and (v)pextrq Instructions 11.7.9 The (v)pinsrb, (v)pinsrw, (v)pinsrd, and (v)pinsrq Instructions 11.7.10 The (v)extractps and (v)insertps Instructions 11.8 SIMD Arithmetic and Logical Operations 11.9 The SIMD Logical (Bitwise) Instructions 11.9.1 The (v)ptest Instructions 11.9.2 The Byte Shift Instructions 11.9.3 The Bit Shift Instructions 11.10 The SIMD Integer Arithmetic Instructions 11.10.1 SIMD Integer Addition 11.10.2 Horizontal Additions 11.10.3 Double-Word–Sized Horizontal Additions 11.10.4 SIMD Integer Subtraction 11.10.5 SIMD Integer Multiplication 11.10.6 SIMD Integer Averages 11.10.7 SIMD Integer Minimum and Maximum 11.10.8 SIMD Integer Absolute Value 11.10.9 SIMD Integer Sign Adjustment Instructions 11.10.10 SIMD Integer Comparison Instructions 11.10.11 Integer Conversions 11.11 SIMD Floating-Point Arithmetic Operations 11.12 SIMD Floating-Point Comparison Instructions 11.12.1 SSE and AVX Comparisons 11.12.2 Unordered vs. Ordered Comparisons 11.12.3 Signaling and Quiet Comparisons 11.12.4 Instruction Synonyms 11.12.5 AVX Extended Comparisons 11.12.6 Using SIMD Comparison Instructions 11.12.7 The (v)movmskps, (v)movmskpd Instructions 11.13 Floating-Point Conversion Instructions 11.14 Aligning SIMD Memory Accesses 11.15 Aligning Word, Dword, and Qword Object Addresses 11.16 Filling an XMM Register with Several Copies of the Same Value 11.17 Loading Some Common Constants Into XMM and YMM Registers 11.18 Setting, Clearing, Inverting, and Testing a Single Bit in an SSE Register 11.19 Processing Two Vectors by Using a Single Incremented Index 11.20 Aligning Two Addresses to a Boundary 11.21 Working with Blocks of Data Whose Length Is Not a Multiple of the SSE/AVX Register Size 11.22 Dynamically Testing for a CPU Feature 11.23 The MASM Include Directive 11.24 And a Whole Lot More 11.25 For More Information 11.26 Test Yourself Chapter 12: Bit Manipulation 12.1 What Is Bit Data, Anyway? 12.2 Instructions That Manipulate Bits 12.2.1 The and Instruction 12.2.2 The or Instruction 12.2.3 The xor Instruction 12.2.4 Flag Modification by Logical Instructions 12.2.5 The Bit Test Instructions 12.2.6 Manipulating Bits with Shift and Rotate Instructions 12.3 The Carry Flag as a Bit Accumulator 12.4 Packing and Unpacking Bit Strings 12.5 BMI1 Instructions to Extract Bits and Create Bit Masks 12.6 Coalescing Bit Sets and Distributing Bit Strings 12.7 Coalescing and Distributing Bit Strings Using BMI2 Instructions 12.8 Packed Arrays of Bit Strings 12.9 Searching for a Bit 12.10 Counting Bits 12.11 Reversing a Bit String 12.12 Merging Bit Strings 12.13 Extracting Bit Strings 12.14 Searching for a Bit Pattern 12.15 For More Information 12.16 Test Yourself Chapter 13: Macros and the MASM Compile-Time Language 13.1 Introduction to the Compile-Time Language 13.2 The echo and .err Directives 13.3 Compile-Time Constants and Variables 13.4 Compile-Time Expressions and Operators 13.4.1 The MASM Escape (!) Operator 13.4.2 The MASM Evaluation (%) Operator 13.4.3 The catstr Directive 13.4.4 The instr Directive 13.4.5 The sizestr Directive 13.4.6 The substr Directive 13.5 Conditional Assembly (Compile-Time Decisions) 13.6 Repetitive Assembly (Compile-Time Loops) 13.7 Macros (Compile-Time Procedures) 13.8 Standard Macros 13.9 Macro Parameters 13.9.1 Standard Macro Parameter Expansion 13.9.2 Optional and Required Macro Parameters 13.9.3 Default Macro Parameter Values 13.9.4 Macros with a Variable Number of Parameters 13.9.5 The Macro Expansion (&) Operator 13.10 Local Symbols in a Macro 13.11 The exitm Directive 13.12 MASM Macro Function Syntax 13.13 Macros as Compile-Time Procedures and Functions 13.14 Writing Compile-Time “Programs” 13.14.1 Constructing Data Tables at Compile Time 13.14.2 Unrolling Loops 13.15 Simulating HLL Procedure Calls 13.15.1 HLL-Like Calls with No Parameters 13.15.2 HLL-Like Calls with One Parameter 13.15.3 Using opattr to Determine Argument Types 13.15.4 HLL-Like Calls with a Fixed Number of Parameters 13.15.5 HLL-Like Calls with a Varying Parameter List 13.16 The invoke Macro 13.17 Advanced Macro Parameter Parsing 13.17.1 Checking for String Literal Constants 13.17.2 Checking for Real Constants 13.17.3 Checking for Registers 13.17.4 Compile-Time Arrays 13.18 Using Macros to Write Macros 13.19 Compile-Time Program Performance 13.20 For More Information 13.21 Test Yourself Chapter 14: The String Instructions 14.1 The x86-64 String Instructions 14.1.1 The rep, repe, repz, and the repnz and repne Prefixes 14.1.2 The Direction Flag 14.1.3 The movs Instruction 14.1.4 The cmps Instruction 14.1.5 The scas Instruction 14.1.6 The stos Instruction 14.1.7 The lods Instruction 14.1.8 Building Complex String Functions from lods and stos 14.2 Performance of the x86-64 String Instructions 14.3 SIMD String Instructions 14.3.1 Packed Compare Operand Sizes 14.3.2 Type of Comparison 14.3.3 Result Polarity 14.3.4 Output Processing 14.3.5 Packed String Compare Lengths 14.3.6 Packed String Comparison Results 14.4 Alignment and Memory Management Unit Pages 14.5 For More Information 14.6 Test Yourself Chapter 15: Managing Complex Projects 15.1 The include Directive 15.2 Ignoring Duplicate Include Operations 15.3 Assembly Units and External Directives 15.4 Header Files in MASM 15.5 The externdef Directive 15.6 Separate Compilation 15.7 An Introduction to Makefiles 15.7.1 Basic Makefile Syntax 15.7.2 Make Dependencies 15.7.3 Make Clean and Touch 15.8 The Microsoft Linker and Library Code 15.9 Object File and Library Impact on Program Size 15.10 For More Information 15.11 Test Yourself Chapter 16: Stand-Alone Assembly Language Programs 16.1 Hello World, by Itself 16.2 Header Files and the Windows Interface 16.3 The Win32 API and the Windows ABI 16.4 Building a Stand-Alone Console Application 16.5 Building a Stand-Alone GUI Application 16.6 A Brief Look at the MessageBox Windows API Function 16.7 Windows File I/O 16.8 Windows Applications 16.9 For More Information 16.10 Test Yourself Part III: Reference Material Appendix A: ASCII Character Set Appendix B: Glossary Appendix C: Installing and Using Visual Studio C.1 Installing Visual Studio Community C.2 Creating a Command Line Prompt for MASM C.3 Editing, Assembling, and Running a MASM Source File Appendix D: The Windows Command Line Interpreter D.1 Command Line Syntax D.2 Directory Names and Drive Letters D.3 Some Useful Built-in Commands D.3.1 The cd and chdir Commands D.3.2 The cls Command D.3.3 The copy Command D.3.4 The date Command D.3.5 The del (erase) Command D.3.6 The dir Command D.3.7 The more Command D.3.8 The move Command D.3.9 The ren and rename Commands D.3.10 The rd and rmdir Commands D.3.11 The time Command D.4 For More Information Appendix E: Answers to Questions E.1 Answers to Questions in Chapter 1 E.2 Answers to Questions in Chapter 2 E.3 Answers to Questions in Chapter 3 E.4 Answers to Questions in Chapter 4 E.5 Answers to Questions in Chapter 5 E.6 Answers to Questions in Chapter 6 E.7 Answers to Questions in Chapter 7 E.8 Answers to Questions in Chapter 8 E.9 Answers to Questions in Chapter 9 E.10 Answers to Questions in Chapter 10 E.11 Answers to Questions in Chapter 11 E.12 Answers to Questions in Chapter 12 E.13 Answers to Questions in Chapter 13 E.14 Answers to Questions in Chapter 14 E.15 Answers to Questions in Chapter 15 E.16 Answers to Questions in Chapter 16 Index