Photo Forensics

Description

The first comprehensive and detailed presentation of techniques for authenticating digital images. Photographs have been doctored since photography was invented. Dictators have erased people from photographs and from history. Politicians have manipulated photos for short-term political gain. Altering photographs in the predigital era required time-consuming darkroom work. Today, powerful and low-cost digital technology makes it relatively easy to alter digital images, and the resulting fakes are difficult to detect. The field of photo forensics--pioneered in Hany Farid's lab at Dartmouth College--restores some trust to photography. In this book, Farid describes techniques that can be used to authenticate photos. He provides the intuition and background as well as the mathematical and algorithmic details needed to understand, implement, and utilize a variety of photo forensic techniques. Farid traces the entire imaging pipeline. He begins with the physics and geometry of the interaction of light with the physical world, proceeds through the way light passes through a camera lens, the conversion of light to pixel values in the electronic sensor, the packaging of the pixel values into a digital image file, and the pixel-level artifacts introduced by photo-editing software. Modeling the path of light during image creation reveals physical, geometric, and statistical regularities that are disrupted during the creation of a fake. Various forensic techniques exploit these irregularities to detect traces of tampering. A chapter of case studies examines the authenticity of viral video and famously questionable photographs including "Golden Eagle Snatches Kid" and the Lee Harvey Oswald backyard photo. Contents 1 Introduction 2 Physics-Based 2.1 Cast Shadows 2.2 Attached Shadows 2.3 Shadow (Pen)umbra 2.4 Specularities 2.5 Lighting 2.6 Reflections 3 Geometric 3.1 Vanishing Points 3.2 Planar Rectication 3.3 Measuring Distance 3.4 3-D Modeling 4 Optical 4.1 Efficiency 4.2 Lens Distortion 4.3 Lens Flare 5 Sensor 5.1 Color Filter Array 5.2 Sensor Noise 5.3 Photo Response Non-Uniformity 6 File 6.1 Metadata 6.2 JPEG Quantization 6.3 Thumbnails 6.4 JPEG Markers 7 Pixel 7.1 Multi-JPEG Compression 7.2 Cloning 7.3 Re-sampling 8 Case Studies 8.1 Golden Eagle Snatches Kid 8.2 Footballer Momentarily Shrunk 8.3 The Lee Harvey Oswald Backyard Photo 9 Background 9.1 Bayesian Estimation 9.2 Convolution 9.3 Discrete Cosine Transform 9.4 Expectation Maximization 9.5 Fourier Transform 9.6 Least-Squares 9.7 Perspective Projection Bibliography Glossary Index