Fiducial marker

A fiducial marker or fiducial is an object placed in the field of view of an imaging system that appears in the image produced, for use as a point of reference or a measure. It may be either something placed into or on the imaging subject, or a mark or set of marks in the reticle of an optical instrument.

A ruler used as a fiducial marker

Applications

Microscopy

In high-resolution optical microscopy, fiducials can be used to actively stabilize the field of view. Stabilization to better than 0.1 nm is achievable.^[1]

 

On NASA photographs, crosshair reticles on a Réseau plate enable distortions due to processing and handling to be detected and corrected.

Physics

In physics, 3D computer graphics, and photography, fiducials are reference points: fixed points or lines within a scene to which other objects can be related or against which objects can be measured. Cameras outfitted with Réseau plates produce these reference marks (also called Réseau crosses) and are commonly used by NASA. Such marks are closely related to the timing marks used in optical mark recognition.^{[citation needed]}

Geographical survey

Airborne geophysical surveys also use the term "fiducial" as a sequential reference number in the measurement of various geophysical instruments during a survey flight. This application of the term evolved from air photo frame numbers that were originally used to locate geophysical survey lines in the early days of airborne geophysical surveying. This method of positioning has since been replaced by GPS, but the term "fiducial" continues to be used as the time reference for data measured during flights.^{[citation needed]}

Augmented reality

 

Comparison of augmented reality fiducial markers for computer vision

In applications of augmented reality, fiducials help resolve several problems of integration between the real world view and the synthetic images that augment it.^[2] Fiducials of known pattern and size can serve as real world anchors of location, orientation and scale. They can establish the identity of the scene or objects within the scene. For example, a fiducial printed on one page of an augmented reality popup book would identify the page to allow the system to select the augmentation content. It would also serve to moor the coordinates of the augmented content to the three dimensional location, orientation and scale of the open book, helping to create a stable and accurate fusion of real and synthetic imagery.

A slightly more complex example would be multiple fiducials, each attached to an individual piece in an augmented reality board game.

Metrology

The appearance of markers in images may act as a reference for image scaling, or may allow the image and physical object, or multiple independent images, to be correlated. By placing fiducial markers at known locations in a subject, the relative scale in the produced image may be determined by comparison of the locations of the markers in the image and subject. In applications such as photogrammetry, the fiducial marks of a surveying camera may be set so that they define the principal point, in a process called "collimation".^{[citation needed]} This would be a creative use of how the term collimation is conventionally understood.

Fiducial marker sets

 

QR code for the URL of the English Wikipedia Mobile main page includes four fiducial markers.

Some barcode readers can estimate the translation, orientation, and vertical depth of a known-size barcode relative to the barcode reader.^[3]

Some sets of fiducial markers are specifically designed to allow rapid, low-latency detection of 6D position estimation (3D location and 3D orientation) and identity of hundreds of unique fiducial markers.^[4] For example, the ArUco markers,^[5] the WhyCon marker,^[6] WhyCode markers,^[4] "amoeba" reacTIVision fiducials, the d-touch fiducials,^[7][8][9] or the TRIP circular barcode tags (ringcodes).^[10]

Medical imaging

Fiducial markers are used in a wide range of medical imaging applications. Images of the same subject produced with two different imaging systems may be correlated by placing a fiducial marker in the area imaged by both systems. In this case, a marker which is visible in the images produced by both imaging modalities must be used. By this method, functional information from SPECT or positron emission tomography can be related to anatomical information provided by magnetic resonance imaging (MRI).^[11]

Similarly, fiducial points established during MRI can be correlated with brain images generated by magnetoencephalography to localize the source of brain activity. Such fiducial points or markers are often created in tomographic images such as computed tomography, magnetic resonance and positron emission tomography images using devices such as the N-localizer^[12] and Sturm-Pastyr localizer.^[13]

Electrocardiography

In electrocardiography (ECG), fiducial points are landmarks on the ECG complex such as the isoelectric line (PQ junction), and onset of individual waves such as PQRST.

Cell biology

In processes that involve following a labelled molecule as it is incorporated in some larger polymer, such markers can be used to follow the dynamics of growth/shrinkage of the polymer, as well as its movement. Commonly used fiducial markers are fluorescently labelled monomers of bio-polymers. The task of measuring and quantifying what happens to these is borrowed from methods in physics and computational imaging like speckle imaging.

Social insect tracking

Automated behavioural tracking systems are used to study the organisation of social insect colonies, and the behaviour of individual colony members. These systems combine fiducial markers and machine vision to output the location and orientation of colony members multiple times per second and have, among other insights, revealed the social network structure of ant Camponotus fellah.^[14]

 

Ant workers tagged with fiducial markers

Radio therapy

In radiotherapy and radiosurgical systems, fiducial points are landmarks in the tumour to facilitate correct targets for treatment. In neuronavigation, a "fiducial spatial coordinate system" is used as a reference, for use in neurosurgery, to describe the position of specific structures within the head or elsewhere in the body. Such fiducial points or landmarks are often created in magnetic resonance imaging and computed tomography images by using the N-localizer or Sturm-Pastyr localizer.

Printed circuit boards

 

Fiducial marker for a chip to the left and the whole PCB beneath

In printed circuit board (PCB) manufacturing, fiducial marks, also known as circuit pattern recognition marks, allow SMT placement equipment to accurately locate and place parts on boards. These devices locate the circuit pattern by providing common measurable points. They are usually made by leaving a circular area of the board bare from solder-mask coating. Inside this area is a circle exposing the copper plating beneath. This center metallic disc can be solder-coated, gold-plated or otherwise treated, although bare copper is most common if not a current-carrying contact. Alternatively, it is possible to use clear solder-mask lacquer to cover the fiducials. In order to minimize rounding errors it was good practice to place fiducials in the same grid (or some multiple of it) that was used to place the parts, however, this isn't always possible on high-density boards nor is it a requirement any more with modern high-precision machines.

 

A gold-plated circular fiducial marker

Most placement machines are fed boards for assembly by a rail conveyor, with the board being clamped down in the assembly area of the machine. Each board will clamp slightly differently than the others, and the variance—which will generally be only tenths of a millimeter—is sufficient to ruin a board without proper calibration. Consequently, a typical PCB will have multiple fiducials to allow placement robots to precisely determine the board's orientation. By measuring the location of the fiducials relative to the board plan stored in the machine's memory, the machine can reliably compute the degree to which parts must be moved relative to the plan, called offset, to ensure accurate placement.

Using three fiducials enables the machine to determine PCB offset in both the X and Y axes, as well as to determine if the board has rotated during clamping, allowing the machine to rotate parts to be placed to match. Such fiducials are also called global fiducials. Global fiducials are also used in conjunction with stencil printing. Without them the printer would not print the solder paste in exact alignment with the pads. Parts requiring a very high degree of placement precision, such as ball grid array packages, may have additional local fiducials near the package placement area of the board to further fine-tune the targeting. Local fiducial, however, cannot be used in the stencil printing process.

Conversely, low end, low-precision boards may only have two fiducials, or use fiducials applied as part of the screen printing process applied to most circuit boards. Some very low-end boards may use the plated mounting screw holes as fiducials, although this yields very low accuracy.

For prototyping and small batch production runs, the use of a fiducial camera can greatly improve the process of board fabrication. By automatically locating fiducial markers, the camera automates board alignment. This helps with front to back and multilayer applications, eliminating the need for set pins.^[15]

Printing

In color printing, fiducials—also called "registration black"—are used at the edge of the cyan, magenta, yellow and black (CMYK) printing plates so that they can be correctly aligned with each other.

"Banana for scale"

 

A riot control agent projectile with a banana for scale

"Banana for scale" refers to an Internet meme involving using a banana as a fiducial marker. The meme began in August 2010, where a man posted to Facebook a picture of a safe with a banana beside it. From there, the meme spread primarily via Reddit; The Daily Dot remarked that "[the meme] had become a hilarious game with redditors try to one up each other. It’s a trend in the same vein as planking."^[16]

See also

• Secchi disk
• Landmark point

References

1. Carter, Ashley R.; King, Gavin M.; Ulrich, Theresa A.; Halsey, Wayne; Alchenberger, David; Perkins, Thomas T. (2007-01-04). "Stabilization of an optical microscope to 01 nm in three dimensions". Applied Optics. 46 (3): 421–7. Bibcode:2007ApOpt..46..421C. doi:10.1364/AO.46.000421. PMID 17228390.
2. Minhua Ma; Lakhmi C. Jain; Paul Anderson (25 April 2014). Virtual, Augmented Reality and Serious Games for Healthcare 1. Springer Science & Business. ISBN 978-3-642-54816-1.
3. Lo, Chih-Chung; Chang, C. A. (1995), "Neural networks for bar code positioning in automated material handling", Proceedings IEEE Conference on Industrial Automation and Control Emerging Technology Applications, pp. 485–491, doi:10.1109/IACET.1995.527607, ISBN 0-7803-2645-8, S2CID 111253679
4. Lightbody, Peter (2017). "An Efficient Visual Fiducial Localisation System" (PDF). SIGAPP Applied Computing Review. 17 (3): 28–37. doi:10.1145/3161534.3161537. S2CID 23129425.
5. Romero-Ramirez, Francisco J.; Muñoz-Salinas, Rafael; Medina-Carnicer, Rafael. "ArUco: a minimal library for Augmented Reality applications based on OpenCV".
6. Tomas, Krajnık (2014). "A Practical Multirobot Localization System" (PDF). Journal of Intelligent & Robotic Systems. 76 (3–4): 539–562. doi:10.1007/s10846-014-0041-x. S2CID 4985852.
7. Bencina, Ross; Kaltenbrunner, Martin. "The Design and Evolution of Fiducials for the reacTIVision System" (PDF).
8. Bencina, Ross; Kaltenbrunner, Martin; Jordà, Sergi. "Improved Topological Fiducial Tracking in the reacTIVision System" (PDF).
9. "reacTIVision: a toolkit for tangible multi-touch surfaces".
10. de Ipina, Diego Lopez; Mendonca, Paulo R. S.; Hopper, Andy (2002). "TRIP: a Low-Cost Vision-Based Location System for Ubiquitous Computing". CiteSeerX 10.1.1.20.2455. [1]
11. Erickson, B. J.; Jack, Jr., C. R. (1993). "Correlation of single photon emission CT with MR image data using fiduciary markers". American Journal of Neuroradiology. 14 (3): 713–720. PMC 8333382. PMID 8517364.
12. Galloway, RL Jr. (2015). "Introduction and Historical Perspectives on Image-Guided Surgery". In Golby, AJ (ed.). Image-Guided Neurosurgery. Amsterdam: Elsevier. pp. 2–4. doi:10.1016/B978-0-12-800870-6.00001-7. ISBN 978-0-12-800870-6.
13. Sturm V, Pastyr O, Schlegel W, Scharfenberg H, Zabel HJ, Netzeband G, Schabbert S, Berberich W (1983). "Stereotactic computer tomography with a modified Riechert-Mundinger device as the basis for integrated stereotactic neuroradiological investigations". Acta Neurochirurgica. 68 (1–2): 11–17. doi:10.1007/BF01406197. PMID 6344559. S2CID 38864553.
14. Mersch, Danielle P.; Crespi, Alessandro; Keller, Laurent (2013). "Tracking individuals shows spatial fidelity is a key regulator of ant social organization". Science. 340 (6136): 1090–1093. Bibcode:2013Sci...340.1090M. doi:10.1126/science.1234316. PMID 23599264. S2CID 27748253.
15. Fiducial Recognition Camera Overview – YouTube
16. Alfonso, Fernando, III (December 17, 2013). "How the 'banana for scale' became the yardstick of the Internet". The Daily Dot. Retrieved May 11, 2022.{{cite web}}: CS1 maint: multiple names: authors list (link)

 

Wikimedia Commons has media related to Fiducial markers.