Multimedia Fundamentals, Volume 1: Media Coding and Content Processing: Computing, Communications and Applications (IMSC Press Multimedia Series)

Description

The state-of-the-art in multimedia content analysis, media foundations, and compression Covers digital audio, images, video, graphics, and animation Includes real-world project sets that help you build and test your expertise By two of the world's leading experts in advanced multimedia systems development The practical, example-rich guide to media coding and content processing for every multimedia developer. From DVDs to the Internet, media coding and content processing are central to the effective delivery of high-quality multimedia. In this book, two of the field's leading experts introduce today's state-of-the-art, presenting realistic examples and projects designed to help implementers create multimedia systems with unprecedented performance. Ralf Steinmetz and Klara Nahrstedt introduce the fundamental characteristics of digital audio, images, video, graphics, and animation; demonstrate powerful new approaches to content analysis and compression; and share expert insights into system and end-user issues every advanced multimedia professional must understand. Coverage includes: Generic characteristics of multimedia and data streams, and their impact on multimedia system design Essential audio concepts and representation techniques: sound perception, psychoacoustics, music, MIDI, Speech signals, and related I/O and transmission issues Graphics and image characteristics: image formats, analysis, synthesis, reconstruction, and output Video signals, television formats, digitization, and computer-based animation issues Fundamental compression methods: run-length, Huffman, and subband coding Multimedia compression standards: JPEG, H.232, and various MPEG techniques Optical storage technologies and techniques: CD-DA, CD-ROM, DVD, and beyond Content processing techniques: Image analysis, video processing, cut detection, and audio analysis First in an authoritative 3-volume set on tomorrow's robust multimedia desktop: real-time audio, video, and streaming media. Multimedia Fundamentals offers a single, authoritative source for the knowledge and techniques you need to succeed with any advanced multimedia development project. Look for Volume 2 focusing on networking and operating system-related issues, and Volume 3 focusing on service and application issues. Cover Contents Preface 1 Introduction 1.1 Interdisciplinary Aspects of Multimedia 1.2 Contents of This Book 1.3 Organization of This Book 1.3.1 Media Characteristics and Coding 1.3.2 Media Compression 1.3.3 Optical Storage 1.3.4 Content Processing 1.4 Further Reading About Multimedia 2 Media and Data Streams 2.1 The Term "Multimedia" 2.2 The Term "Media" 2.2.1 Perception Media 2.2.2 Representation Media 2.2.3 Presentation Media 2.2.4 Storage Media 2.2.5 Transmission Media 2.2.6 Information Exchange Media 2.2.7 Presentation Spaces and Presentation Values 2.2.8 Presentation Dimensions 2.3 Key Properties of a Multimedia System 2.3.1 Discrete and Continuous Media 2.3.2 Independent Media 2.3.3 Computer-Controlled Systems 2.3.4 Integration 2.3.5 Summary 2.4 Characterizing Data Streams 2.4.1 Asynchronous Transmission Mode 2.4.2 Synchronous Transmission Mode 2.4.3 Isochronous Transmission Mode 2.5 Characterizing Continuous Media Data Streams 2.5.1 Strongly and Weakly Periodic Data Streams 2.5.2 Variation of the Data Volume of Consecutive Information Units 2.5.3 Interrelationship of Consecutive Packets 2.6 Information Units 3 Audio Technology 3.1 What Is Sound? 3.1.1 Frequency 3.1.2 Amplitude 3.1.3 Sound Perception and Psychoacoustics 3.2 Audio Representation on Computers 3.2.1 Sampling Rate 3.2.2 Quantization 3.3 Three-Dimensional Sound Projection 3.3.1 Spatial Sound 3.3.2 Reflection Systems 3.4 Music and the MIDI Standard 3.4.1 Introduction to MIDI 3.4.2 MIDI Devices 3.4.3 The MIDI and SMPTE Timing Standards 3.5 Speech Signals 3.5.1 Human Speech 3.5.2 Speech Synthesis 3.6 Speech Output 3.6.1 Reproducible Speech Playout 3.6.2 Sound Concatenation in the Time Range 3.6.3 Sound Concatenation in the Frequency Range 3.6.4 Speech Synthesis 3.7 Speech Input 3.7.1 Speech Recognition 3.8 Speech Transmission 3.8.1 Pulse Code Modulation 3.8.2 Source Encoding 3.8.3 Recognition-Synthesis Methods 3.8.4 Achievable Quality 4 Graphics and Images 4.1 Introduction 4.2 Capturing Graphics and Images 4.2.1 Capturing Real-World Images 4.2.2 Image Formats 4.2.3 Creating Graphics 4.2.4 Storing Graphics 4.3 Computer-Assisted Graphics and Image Processing 4.3.1 Image Analysis 4.3.2 Image Synthesis 4.4 Reconstructing Images 4.4.1 The Radon Transform 4.4.2 Stereoscopy 4.5 Graphics and Image Output Options 4.5.1 Dithering 4.6 Summary and Outlook 5 Video Technology 5.1 Basics 5.1.1 Representation of Video Signals 5.1.2 Signal Formats 5.2 Television Systems 5.2.1 Conventional Systems 5.2.2 High-Definition Television (HDTV) 5.3 Digitization of Video Signals 5.3.1 Composite Coding 5.3.2 Component Coding 5.4 Digital Television 6 Computer-Based Animation 6.1 Basic Concepts 6.1.1 Input Process 6.1.2 Composition Stage 6.1.3 Inbetween Process 6.1.4 Changing Colors 6.2 Specification of Animations 6.3 Methods of Controlling Animation 6.3.1 Explicitly Declared Control 6.3.2 Procedural Control 6.3.3 Constraint-Based Control 6.3.4 Control by Analyzing Live Action 6.3.5 Kinematic and Dynamic Control 6.4 Display of Animation 6.5 Transmission of Animation 6.6 Virtual Reality Modeling Language (VRML) 7 Data Compression 7.1 Storage Space 7.2 Coding Requirements 7.3 Source, Entropy, and Hybrid Coding 7.3.1 Entropy Coding 7.3.2 Source Coding 7.3.3 Major Steps of Data Compression 7.4 Basic Compression Techniques 7.4.1 Run-Length Coding 7.4.2 Zero Suppression 7.4.3 Vector Quantization 7.4.4 Pattern Substitution 7.4.5 Diatomic Encoding 7.4.6 Statistical Coding 7.4.7 Huffman Coding 7.4.8 Arithmetic Coding 7.4.9 Transformation Coding 7.4.10 Subband Coding 7.4.11 Prediction or Relative Coding 7.4.12 Delta Modulation 7.4.13 Adaptive Compression Techniques 7.4.14 Other Basic Techniques 7.5 JPEG 7.5.1 Image Preparation 7.5.2 Lossy Sequential DCT-Based Mode 7.5.3 Expanded Lossy DCT-Based Mode 7.5.4 Lossless Mode 7.5.5 Hierarchical Mode 7.6 H.261 (p×64) and H.263 7.6.1 Image Preparation 7.6.2 Coding Algorithms 7.6.3 Data Stream 7.6.4 H.263+ and H.263L 7.7 MPEG 7.7.1 Video Encoding 7.7.2 Audio Coding 7.7.3 Data Stream 7.7.4 MPEG-2 7.7.5 MPEG-4 7.7.6 MPEG-7 7.8 Fractal Compression 7.9 Conclusions 8 Optical Storage Media 8.1 History of Optical Storage 8.2 Basic Technology 8.3 Video Discs and Other WORMs 8.4 Compact Disc Digital Audio 8.4.1 Technical Basics 8.4.2 Eight-to-Fourteen Modulation 8.4.3 Error Handling 8.4.4 Frames, Tracks, Areas, and Blocks of a CD-DA 8.4.5 Advantages of Digital CD-DA Technology 8.5 Compact Disc Read Only Memory 8.5.1 Blocks 8.5.2 Modes 8.5.3 Logical File Format 8.5.4 Limitations of CD-ROM Technology 8.6 CD-ROM Extended Architecture 8.6.1 Form 1 and Form 2 8.6.2 Compressed Data of Different Media 8.7 Further CD-ROM-Based Developments 8.7.1 Compact Disc Interactive 8.7.2 Compact Disc Interactive Ready Format 8.7.3 Compact Disc Bridge Disc 8.7.4 Photo Compact Disc 8.7.5 Digital Video Interactive and Commodore Dynamic Total Vision 8.8 Compact Disc Recordable 8.9 Compact Disc Magneto-Optical 8.10 Compact Disc Read/Write 8.11 Digital Versatile Disc 8.11.1 DVD Standards 8.11.2 DVD-Video: Decoder 8.11.3 Eight-to-Fourteen+ Modulation (EFM+) 8.11.4 Logical File Format 8.11.5 DVD-CD Comparison 8.12 Closing Observations 9 Content Analysis 9.1 Simple vs. Complex Features 9.2 Analysis of Individual Images 9.2.1 Text Recognition 9.2.2 Similarity-Based Searches in Image Databases 9.3 Analysis of Image Sequences 9.3.1 Motion Vectors 9.3.2 Cut Detection 9.3.3 Analysis of Shots 9.3.4 Similarity-Based Search at the Shot Level 9.3.5 Similarity-Based Search at the Scene and Video Level 9.4 Audio Analysis 9.4.1 Syntactic Audio Indicators 9.4.2 Semantic Audio Indicators 9.5 Applications 9.5.1 Genre Recognition 9.5.2 Text Recognition in Videos 9.6 Closing Remarks Bibliography Index A B C D E F G H I J K L M N O P Q R S T U V W X Y Z