Image analysis

Not to be confused with Image processing.

Image analysis or imagery analysis is the extraction of meaningful information from images; mainly from digital images by means of digital image processing techniques.^[1] Image analysis tasks can be as simple as reading bar coded tags or as sophisticated as identifying a person from their face.

Computers are indispensable for the analysis of large amounts of data, for tasks that require complex computation, or for the extraction of quantitative information. On the other hand, the human visual cortex is an excellent image analysis apparatus, especially for extracting higher-level information, and for many applications — including medicine, security, and remote sensing — human analysts still cannot be replaced by computers. For this reason, many important image analysis tools such as edge detectors and neural networks are inspired by human visual perception models.

Digital

Digital Image Analysis or Computer Image Analysis is when a computer or electrical device automatically studies an image to obtain useful information from it. Note that the device is often a computer but may also be an electrical circuit, a digital camera or a mobile phone. It involves the fields of computer or machine vision, and medical imaging, and makes heavy use of pattern recognition, digital geometry, and signal processing. This field of computer science developed in the 1950s at academic institutions such as the MIT A.I. Lab, originally as a branch of artificial intelligence and robotics.

It is the quantitative or qualitative characterization of two-dimensional (2D) or three-dimensional (3D) digital images. 2D images are, for example, to be analyzed in computer vision, and 3D images in medical imaging. The field was established in the 1950s—1970s, for example with pioneering contributions by Azriel Rosenfeld, Herbert Freeman, Jack E. Bresenham, or King-Sun Fu.

Techniques

There are many different techniques used in automatically analysing images. Each technique may be useful for a small range of tasks, however there still aren't any known methods of image analysis that are generic enough for wide ranges of tasks, compared to the abilities of a human's image analysing capabilities. Examples of image analysis techniques in different fields include:

• 2D and 3D object recognition,
• image segmentation,
• motion detection e.g. Single particle tracking,
• video tracking,
• optical flow,
• medical scan analysis,
• 3D Pose Estimation.

Applications

The applications of digital image analysis are continuously expanding through all areas of science and industry, including:

• assay micro plate reading, such as detecting where a chemical was manufactured.
• astronomy, such as calculating the size of a planet.
• automated species identification (e.g. plant and animal species)
• defense
• error level analysis
• filtering
• machine vision, such as to automatically count items in a factory conveyor belt.
• materials science, such as determining if a metal weld has cracks.
• medicine, such as detecting cancer in a mammography scan.
• metallography, such as determining the mineral content of a rock sample.
• microscopy, such as counting the germs in a swab.
• automatic number plate recognition;
• optical character recognition, such as automatic license plate detection.
• remote sensing, such as detecting intruders in a house, and producing land cover/land use maps.^[2][3]
• robotics, such as to avoid steering into an obstacle.
• security, such as detecting a person's eye color or hair color.

Object-based

 

Image segmentation during the object base image analysis

Object-based image analysis (OBIA) involves two typical processes, segmentation and classification. Segmentation helps to group pixels into homogeneous objects. The objects typically correspond to individual features of interest, although over-segmentation or under-segmentation is very likely. Classification then can be performed at object levels, using various statistics of the objects as features in the classifier. Statistics can include geometry, context and texture of image objects. Over-segmentation is often preferred over under-segmentation when classifying high-resolution images.^[4]

Object-based image analysis has been applied in many fields, such as cell biology, medicine, earth sciences, and remote sensing. For example, it can detect changes of cellular shapes in the process of cell differentiation.;^[5] it has also been widely used in the mapping community to generate land cover.^[4][6]

When applied to earth images, OBIA is known as geographic object-based image analysis (GEOBIA), defined as "a sub-discipline of geoinformation science devoted to (...) partitioning remote sensing (RS) imagery into meaningful image-objects, and assessing their characteristics through spatial, spectral and temporal scale".^[7][6] The international GEOBIA conference has been held biannually since 2006.^[8]

OBIA techniques are implemented in software such as eCognition or the Orfeo toolbox.

See also

• Archeological imagery
• Imaging technologies
• Image processing
• imc FAMOS (1987), graphical data analysis
• Land cover mapping
• Military intelligence
• Remote sensing

References

1. Solomon, C.J., Breckon, T.P. (2010). Fundamentals of Digital Image Processing: A Practical Approach with Examples in Matlab. Wiley-Blackwell. doi:10.1002/9780470689776. ISBN 978-0470844731.{{cite book}}: CS1 maint: multiple names: authors list (link)
2. Xie, Y.; Sha, Z.; Yu, M. (2008). "Remote sensing imagery in vegetation mapping: a review". Journal of Plant Ecology. 1 (1): 9–23. doi:10.1093/jpe/rtm005.
3. Wilschut, L.I.; Addink, E.A.; Heesterbeek, J.A.P.; Dubyanskiy, V.M.; Davis, S.A.; Laudisoit, A.; Begon, M.; Burdelov, L.A.; Atshabar, B.B.; de Jong, S.M (2013). "Mapping the distribution of the main host for plague in a complex landscape in Kazakhstan: An object-based approach using SPOT-5 XS, Landsat 7 ETM+, SRTM and multiple Random Forests". International Journal of Applied Earth Observation and Geoinformation. 23 (100): 81–94. Bibcode:2013IJAEO..23...81W. doi:10.1016/j.jag.2012.11.007. PMC 4010295. PMID 24817838.
4. Liu, Dan; Toman, Elizabeth; Fuller, Zane; Chen, Gang; Londo, Alexis; Xuesong, Zhang; Kaiguang, Zhao (2018). "Integration of historical map and aerial imagery to characterize long-term land-use change and landscape dynamics: An object-based analysis via Random Forests" (PDF). Ecological Indicators. 95 (1): 595–605. doi:10.1016/j.ecolind.2018.08.004. S2CID 92025959.
5. Salzmann, M.; Hoesel, B.; Haase, M.; Mussbacher, M.; Schrottmaier, W. C.; Kral-Pointner, J. B.; Finsterbusch, M.; Mazharian, A.; Assinger, A. (2018-02-20). "A novel method for automated assessment of megakaryocyte differentiation and proplatelet formation" (PDF). Platelets. 29 (4): 357–364. doi:10.1080/09537104.2018.1430359. ISSN 1369-1635. PMID 29461915. S2CID 3785563.
6. Blaschke, Thomas; Hay, Geoffrey J.; Kelly, Maggi; Lang, Stefan; Hofmann, Peter; Addink, Elisabeth; Queiroz Feitosa, Raul; van der Meer, Freek; van der Werff, Harald; van Coillie, Frieke; Tiede, Dirk (2014). "Geographic Object-Based Image Analysis – Towards a new paradigm". ISPRS Journal of Photogrammetry and Remote Sensing. 87 (100). Elsevier BV: 180–191. Bibcode:2014JPRS...87..180B. doi:10.1016/j.isprsjprs.2013.09.014. ISSN 0924-2716. PMC 3945831. PMID 24623958.
7. G.J. Hay & G. Castilla: Geographic Object-Based Image Analysis (GEOBIA): A new name for a new discipline. In: T. Blaschke, S. Lang & G. Hay (eds.): Object-Based Image Analysis – Spatial Concepts for Knowledge-Driven Remote Sensing Applications. Lecture Notes in Geoinformation and Cartography, 18. Springer, Berlin/Heidelberg, Germany: 75-89 (2008)
8. . Archived from the original on 2013-12-12.

Further reading

• The Image Processing Handbook by John C. Russ, ISBN 0-8493-7254-2 (2006)
• Image Processing and Analysis - Variational, PDE, Wavelet, and Stochastic Methods by Tony F. Chan and Jianhong (Jackie) Shen, ISBN 0-89871-589-X (2005)
• Front-End Vision and Multi-Scale Image Analysis by Bart M. ter Haar Romeny, Paperback, ISBN 1-4020-1507-0 (2003)
• Practical Guide to Image Analysis by J.J. Friel, et al., ASM International, ISBN 0-87170-688-1 (2000).
• Fundamentals of Image Processing by Ian T. Young, Jan J. Gerbrands, Lucas J. Van Vliet, Paperback, ISBN 90-75691-01-7 (1995)
• Image Analysis and Metallography edited by P.J. Kenny, et al., International Metallographic Society and ASM International (1989).
• Quantitative Image Analysis of Microstructures by H.E. Exner & H.P. Hougardy, DGM Informationsgesellschaft mbH, ISBN 3-88355-132-5 (1988).
• "Metallographic and Materialographic Specimen Preparation, Light Microscopy, Image Analysis and Hardness Testing", Kay Geels in collaboration with Struers A/S, ASTM International 2006.