OpenCV

OpenCV (Open Source Computer Vision Library) is a library of programming functions mainly for real-time computer vision.^[1] Originally developed by Intel, it was later supported by Willow Garage, then Itseez (which was later acquired by Intel^[2]). The library is cross-platform and licensed as free and open-source software under Apache License 2. Starting in 2011, OpenCV features GPU acceleration for real-time operations.^[3]

OpenCV

Original author(s)	Intel, Willow Garage, Itseez
Initial release	June 2000; 22 years ago (2000-06)
Stable release	4.7.0 / 29 December 2022; 54 days ago (2022-12-29)
Repository	github.com/opencv/opencv
Written in	C, C++, Python, Java, assembly language
Operating system	Cross-platform: Windows, Linux, macOS, FreeBSD, NetBSD, OpenBSD; Android, iOS, Maemo, BlackBerry 10
Platform	IA-32, x86-64
Size	~200 MB
Available in	English
Type	Library
License	Apache
Website	opencv.org

History

Officially launched in 1999 the OpenCV project was initially an Intel Research initiative to advance CPU-intensive applications, part of a series of projects including real-time ray tracing and 3D display walls.^[4] The main contributors to the project included a number of optimization experts in Intel Russia, as well as Intel's Performance Library Team. In the early days of OpenCV, the goals of the project were described^[5] as:

• Advance vision research by providing not only open but also optimized code for basic vision infrastructure. No more reinventing the wheel.
• Disseminate vision knowledge by providing a common infrastructure that developers could build on, so that code would be more readily readable and transferable.
• Advance vision-based commercial applications by making portable, performance-optimized code available for free – with a license that did not require code to be open or free itself.

The first alpha version of OpenCV was released to the public at the IEEE Conference on Computer Vision and Pattern Recognition in 2000, and five betas were released between 2001 and 2005. The first 1.0 version was released in 2006. A version 1.1 "pre-release" was released in October 2008.

The second major release of the OpenCV was in October 2009. OpenCV 2 includes major changes to the C++ interface, aiming at easier, more type-safe patterns, new functions, and better implementations for existing ones in terms of performance (especially on multi-core systems). Official releases now occur every six months^[6] and development is now done by an independent Russian team supported by commercial corporations.

In August 2012, support for OpenCV was taken over by a non-profit foundation OpenCV.org, which maintains a developer^[7] and user site.^[8]

In May 2016, Intel signed an agreement to acquire Itseez,^[9] a leading developer of OpenCV.^[10]

In July 2020, OpenCV announced and began a Kickstarter campaign for the OpenCV AI Kit, a series of hardware modules and additions to OpenCV supporting Spatial AI.

Applications

 

openFrameworks running the OpenCV add-on example

OpenCV's application areas include:

• 2D and 3D feature toolkits
• Egomotion estimation
• Facial recognition system
• Gesture recognition
• Human–computer interaction (HCI)
• Mobile robotics
• Motion understanding
• Object detection
• Segmentation and recognition
• Stereopsis stereo vision: depth perception from 2 cameras
• Structure from motion (SFM)
• Motion video tracking
• Augmented reality

To support some of the above areas, OpenCV includes a statistical machine learning library that contains:

• Boosting
• Decision tree learning
• Gradient boosting trees
• Expectation-maximization algorithm
• k-nearest neighbor algorithm
• Naive Bayes classifier
• Artificial neural networks
• Random forest
• Support vector machine (SVM)
• Deep neural networks (DNN)^[11]

Programming language

OpenCV is written in the programming language C++, as is its primary interface, but it still retains a less comprehensive though extensive older C interface. All newer developments and algorithms appear in the C++ interface. There are language bindings in Python, Java, and MATLAB/Octave. The application programming interface (API) for these interfaces can be found in the online documentation.^[12] Wrapper libraries in several languages have been developed to encourage adoption by a wider audience. In version 3.4, JavaScript bindings for a selected subset of OpenCV functions were released as OpenCV.js, to be used for web platforms.^[13]

Hardware acceleration

If the library finds Intel's Integrated Performance Primitives on the system, it will use these proprietary optimized routines to accelerate itself.

A Compute Unified Device Architecture (CUDA) based graphics processing unit (GPU) interface has been in progress since September 2010.^[14]

An OpenCL-based GPU interface has been in progress since October 2012,^[15] documentation for version 2.4.13.3 can be found at docs.opencv.org.^[16]

Operating system support

OpenCV runs on the desktop operating systems: Windows, Linux, macOS, FreeBSD, NetBSD, OpenBSD]; and on the mobile operating systems: Android, iOS, Maemo,^[17] BlackBerry 10 – QNX.^[18] The user can get official releases from SourceForge or take the latest sources from GitHub.^[19] OpenCV uses CMake.

See also

•  Free and open-source software portal

• AForge.NET – computer vision library for the Common Language Runtime of .NET Framework and Mono
• Robot Operating System (ROS) – uses OpenCV as main vision package
• VXL – alternative library written in C++
• CVIPtools – complete graphical user interface (GUI) based computer-vision and image-processing software environment, with C function libraries, a Component Object Model (COM) based dynamic-link library (DLL), and two utility programs for algorithm development and batch processing
• OpenNN – artificial neural network library written in C++, open-source
• List of free and open-source software packages

References

1. Pulli, Kari; Baksheev, Anatoly; Kornyakov, Kirill; Eruhimov, Victor (1 April 2012). "Realtime Computer Vision with OpenCV". Queue. 10 (4): 40:40–40:56. doi:10.1145/2181796.2206309.
2. Intel acquires Itseez: https://opencv.org/intel-acquires-itseez.html
3. "CUDA". opencv.org. Retrieved 2020-10-15.
4. Adrian Kaehler; Gary Bradski (14 December 2016). Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library. O'Reilly Media. pp. 26ff. ISBN 978-1-4919-3800-3.
5. Bradski, Gary; Kaehler, Adrian (2008). Learning OpenCV: Computer vision with the OpenCV library. O'Reilly Media, Inc. p. 6.
6. OpenCV change logs: http://code.opencv.org/projects/opencv/wiki/ChangeLog 2013-01-15 at the Wayback Machine
7. OpenCV Developer Site: http://code.opencv.org Archived 2013-01-13 at archive.today
8. OpenCV User Site: http://opencv.org/
9. "Intel Acquires Computer Vision for IOT, Automotive | Intel Newsroom". Intel Newsroom. Retrieved 2018-11-26.
10. "Intel acquires Russian computer vision company Itseez". East-West Digital News. 2016-05-31. Retrieved 2018-11-26.
11. OpenCV: http://opencv.org/opencv-3-3.html
12. OpenCV C interface: http://docs.opencv.org
13. Introduction to OpenCV.js and Tutorials
14. . Archived from the original on 2016-05-21.
15. OpenCL Announcement: http://opencv.org/opencv-v2-4-3rc-is-under-way.html
16. OpenCL-accelerated Computer Vision API Reference: http://docs.opencv.org/modules/ocl/doc/ocl.html
17. "Port of Intel's Open Source Computer Vision Library (OpenCV) to Maemo". Maemo Garage. 10 August 2011. Retrieved 2023-01-30.
18. hungc (4 September 2019). "Blackberry Port of OpenCV [partial]". GitHub.
19. "opencv/Opencv: Open Source Computer Vision Library". GitHub. 21 May 2020.