Digital Image Processing and Analysis (Image Recognition and Processing in Medicine, Satellite Imagery and Security)

Lecture



Image processing — any form of information processing for which the input data is represented by an image, for example, photographs or video frames. Image processing may be carried out either to produce an image as output (for example, preparation for printing, for television broadcasting, etc.), or to obtain other information (for example, text recognition, counting the number and type of cells in a microscope field, etc.). Besides static two-dimensional images, it is also necessary to process images that change over time, for example, video.

Digital image processing — the use of computer algorithms to process digital images . As a field of digital signal processing, digital image processing has many advantages over analogue processing[en]. It allows a much wider range of algorithms to be applied to the input data and avoids problems such as added noise and distortion during processing. Since images are defined as two-dimensional (or higher) arrays, digital image processing can be modelled using multidimensional systems .

History

As far back as the mid-20th century, image processing was for the most part analogue and was carried out by optical devices. Such optical methods are still important today in fields such as, for example, holography. Nevertheless, with the sharp growth in computer performance, these methods have been increasingly displaced by digital image processing methods. Digital image processing methods are usually more accurate, reliable, flexible and simple to implement than analogue methods. Specialized hardware, such as pipelined instruction processors and multiprocessor systems, is widely used in digital image processing. This applies especially to video processing systems. Image processing is also carried out using computer mathematics software, for example, MATLAB, Mathcad, Maple, Mathematica, and others. For this purpose they use both basic tools and the Image Processing extension packages.

Most methods for processing one-dimensional signals (for example, the median filter) are also applicable to two-dimensional signals, which images are. Some of these one-dimensional methods become significantly more complex with the transition to a two-dimensional signal. Image processing introduces several new concepts here, such as connectivity and rotational invariance, which are meaningful only for two-dimensional signals. In signal processing, the Fourier transform is widely used, as well as the wavelet transform and the Gabor filter. Image processing is divided into processing in the spatial domain (brightness transformation, gamma correction, etc.) and the frequency domain (Fourier transform, etc.). The Fourier transform of a discrete function (image) of spatial coordinates is periodic in spatial frequencies with a period of 2pi.

The first digital image processing techniques were developed in the 1960s at the Jet Propulsion Laboratory, the Massachusetts Institute of Technology, Bell Labs, the University of Maryland and other research centres as applications for satellite imagery, conversion to phototelegraph standards, medical imaging, videotelephony, character recognition and photograph enhancement . The cost of processing on the equipment of that time was, however, very high. The situation changed in the 1970s, when inexpensive computers and other equipment became available. It then became possible to process images in real time for some tasks, such as television standards conversion . As the power of general-purpose computers grew, they came to perform almost all specialized operations that required large amounts of computer resources. With the advent of fast computers and advanced signal processing algorithms, which became available in the 2000s, digital processing became the most common form of image processing and, in general, is used not only because of the flexibility of the methods applied, but also because of its low cost.

Digital image processing technology for medical applications was inducted into the U.S. Space Foundation Hall of Fame in 1994 .

Tasks

Digital image processing allows the application of significantly more complex algorithms, and consequently can provide both higher performance on simple tasks, as well as implement methods that would be impossible with an analogue implementation.

In particular, digital image processing is the only practical technology for:

  • classification
  • feature extraction
  • signal processing
  • pattern recognition
  • projection

Some techniques used in digital image processing:

  • Anisotropic diffusion
  • Hidden Markov models
  • Image editing
  • Image restoration
  • Independent component analysis
  • Linear filtering
  • Neural networks
  • Partial differential equations
  • Pixelation
  • Principal component analysis
  • Self-organizing (Kohonen) maps
  • Wavelets

Image processing for reproduction

Typical tasks

  • Geometric transformations, such as rotation and scaling.
  • Colour correction: changing brightness and contrast, colour quantization, conversion to another colour space.
  • Comparison of two or more images. As a special case — finding the correlation between an image and a template, for example, in a banknote detector.
  • Combining images in various ways.
  • Interpolation and smoothing.
  • Dividing an image into regions (image segmentation), for example, to simplify transmission over communication channels .
  • Editing and retouching.
  • Extending the dynamic range by combining images with different exposures (HDR).
  • Compensating for loss of sharpness, for example, by unsharp masking.

Image editing (Lat. redactus — put in order) — the modification of photographs (images) by classical or digital methods. It may also be referred to by the term retouching, retouch (Fr. retoucher — to touch up, to correct). The purpose of editing is defect correction, preparation for publication, and solving creative tasks.

Besides static two-dimensional images, sequences of images may also be processed

Types and purposes of image editing

Defects that can be removed from an image :

  • noise (random colour errors at each point of the image)
  • insufficient or excessive brightness
  • insufficient or excessive contrast (fog or excessive dynamic range of the image)
  • incorrect colour tone
  • blurriness (out of focus)
  • dust, scratches, “dead pixels”
  • removal of lens distortion and vignetting

Types of retouching: Portrait retouching includes :

  • skin retouching — removal of defects (pimples, scratches, scars, bruises, pore minimization, freckle removal or reduction, wrinkle smoothing);
  • eye enhancement (giving them greater expressiveness), teeth whitening;
  • changing hair colour, eye colour, as well as plastic correction: correcting figure flaws.

Structural image editing

  • cropping
  • panorama creation
  • removal of unwanted details from the image, composition changes
  • photomontage — creating a new image from parts of several images
  • adding drawings, incorporating technical diagrams, captions, symbols, markers, etc. into the image
  • applying special effects, filters, shadows, backgrounds, textures, highlights

Preparing photographs for publication in print, on television, on the internet

Each output device (monitor, printer, offset printing press, etc.) has its own colour gamut capabilities (not every colour can be reproduced). For example, on paper the lightness ratio between white and black reaches 40, whereas for a slide it exceeds 200. The main task is to convey the author's intent with the least loss. Colour conversion is performed, for example, in the case of printing on a paper medium, determining the amount of ink needed to reproduce each colour.

A specialist, when preparing photographs for publication, acting creatively, as an artist, or using standard methods, brings the image to a form corresponding to the technical capabilities of the reproduction process, while preserving the idea of the image as much as possible.

Editing images by digital methods

Today, image editing is done mostly on a computer using raster editors in digital form. For this purpose, an image, even one obtained from a traditional medium (film), is converted to digital form — for example, using a scanner.

Programs for viewing and simple image processing are often bundled with digital cameras and scanners. More complex and powerful programs (Adobe Photoshop, Corel PHOTO-PAINT, Paint Shop Pro, Microsoft Picture It!, Visualizer Photo Studio, Pixel image editor, PixBuilder Photo Editor, Fo2Pix ArtMaster, etc.) need to be obtained separately and, as a rule, for money. GIMP is an exception, a freely distributed program whose capabilities are comparable to those of Adobe Photoshop.

Modern editors are not free of shortcomings, but their competent use allows most problems arising during image editing to be solved. They make it possible, to some extent, to correct technical defects made during the shooting of the photograph.

Experience shows that the original of the image being processed should be preserved wherever possible. Copies can be edited freely — these will be copy 1, copy 2, copy 3, and so on.

Tools for the technical editing of digital images

Graphics editors — programs — are used for editing images.

It is possible to:

  • Select a fragment of an image for processing. Most programs use a method of processing the image in parts. First, a part of the image is selected, after which work is carried out only on it, without affecting the rest of the image. Selecting particular areas of the image can be done either by outlining a contour (for example, the lasso tool) or by using editable masks. The latter option offers more possibilities. The selected part of the image can usually also be moved, rotated, scaled, deformed, drawn on, etc.
  • A selection can be either temporary or permanent — the selected part of the image in various graphics editors can be formatted as a permanent “layer” or “object”. This makes it possible to split an image into fragments that overlap one another and to modify each of them separately.
  • Choose an algorithm that the program will apply to the whole image, a group of images, a selected fragment, or an object.

Image processing for applied and scientific purposes

Typical tasks

  • Text recognition in images
  • Processing of satellite imagery
  • Machine vision
  • Data processing for extracting various characteristics
  • Image processing in medicine
  • Identity verification (by face, iris, fingerprint data)
  • Automated vehicle control
  • Determining the shape of an object of interest
  • Determining the movement of an object
  • Applying filters
  • Image processing for security purposes (video surveillance cameras)

Optical character recognition (English optical character recognition, OCR) — the mechanical or electronic conversion of images of handwritten, typewritten or printed text into text data, used to represent characters in a computer (for example, in a text editor). Recognition is widely used for converting books and documents into electronic form, for automating record-keeping systems in business, or for publishing text on a web page. Optical character recognition makes it possible to edit text, search for words or phrases, store it in a more compact form, display or print the material without losing quality, analyse information, and also apply machine translation, formatting or text-to-speech conversion to the text. Optical character recognition is a research problem in the fields of pattern recognition, artificial intelligence and computer vision.

Digital Image Processing and Analysis (Image Recognition and Processing in Medicine, Satellite Imagery and Security)

Processing of satellite images (remote sensing data) (image processing) - the process of performing operations on aerospace imagery, including their correction, transformation and enhancement, interpretation, and visualization. The main stages of processing satellite image data: Preliminary processing; Thematic processing.

Digital Image Processing and Analysis (Image Recognition and Processing in Medicine, Satellite Imagery and Security)

The spectral angle method.

Digital Image Processing and Analysis (Image Recognition and Processing in Medicine, Satellite Imagery and Security)

The minimum distance method.

Digital Image Processing and Analysis (Image Recognition and Processing in Medicine, Satellite Imagery and Security)

The maximum likelihood method.

Digital Image Processing and Analysis (Image Recognition and Processing in Medicine, Satellite Imagery and Security)

The parallelepiped method.

Digital Image Processing and Analysis (Image Recognition and Processing in Medicine, Satellite Imagery and Security)

The Mahalanobis distance method.

Digital Image Processing and Analysis (Image Recognition and Processing in Medicine, Satellite Imagery and Security)
Binary coding.
Machine vision
Machine vision — this is the application of computer vision to industry and manufacturing.
Digital Image Processing and Analysis (Image Recognition and Processing in Medicine, Satellite Imagery and Security)

Image processing in medicine

Digital Image Processing and Analysis (Image Recognition and Processing in Medicine, Satellite Imagery and Security)
Information technologies can help at all stages of acquiring and processing medical images. Computers are directly involved in creating some types of images that cannot be obtained in any other way: computed tomography, positron emission tomography (PET), nuclear magnetic resonance. Digital image processing can be used for the purpose of:
- improving image quality, compensating for defects of the acquisition system, and reducing noise;
- calculating clinically important quantitative parameters (distance, area, volume, etc.);
- facilitating interpretation (structure recognition, dose calculation for radiation therapy);
- establishing feedback (automated surgical interventions)
- Image compression reduces the amount of memory needed for data storage and the time needed for their transmission.
Identity verification (by face, iris, fingerprint data
Digital Image Processing and Analysis (Image Recognition and Processing in Medicine, Satellite Imagery and Security)

Automated vehicle control

Digital Image Processing and Analysis (Image Recognition and Processing in Medicine, Satellite Imagery and Security)

the work of an autopilot's machine vision and how the car itself “sees” its surrounding space.

Image processing in video surveillance systems

Tasks of video surveillance systems

Digital Image Processing and Analysis (Image Recognition and Processing in Medicine, Satellite Imagery and Security)

See also

  • [[b12721]]
  • [[b12722]]
  • [[b12723]]
  • [[b12724]]
  • [[b12725]]
  • [[b12726]]
  • [[b12727]]
  • [[b8362]]
  • [[b12017]]
  • [[b5930]]
  • Balanced histogram thresholding algorithm
  • Digital image
  • Computer graphics
  • Computer vision
  • CVIPtools
  • Digitization
  • Fourier transform
  • Free boundary condition
  • GPGPU
  • Homomorphic filtering
  • Image analysis
  • IEEE Intelligent Transportation Systems Society
  • Least-squares spectral analysis
  • Multidimensional systems
  • Relaxation labelling
  • Remote sensing software
  • Standard test image
  • Super-resolution
  • Total variation denoising
  • Machine vision
  • Bounded variation (BV function)
  • Radiomics (in medicine)

See also

Comments

To leave a comment

If you have any suggestion, idea, thanks or comment, feel free to write. We really value feedback and are glad to hear your opinion.
To reply

Lectures and tutorial on "Methods and means of computer information technology"

Terms: Methods and means of computer information technology