Exposure fusion

Last updated
Manual exposure fusion Dynamic Range Increase.jpg
Manual exposure fusion
Automatic exposure fusion DRI-enfuse.jpg
Automatic exposure fusion

In image processing, computer graphics, and photography, exposure fusion is a technique for blending multiple exposures of the same scene (bracketing) into a single image. As in high dynamic range imaging (HDRI or just HDR), the goal is to capture a scene with a higher dynamic range than the camera is capable of capturing with a single exposure. [1] [2]

Contents

Technique

By using different exposure parameters on the same scene, a wider dynamic range can be represented and later merged into an image with better dynamic range. After correcting for small shifts that may inadvertently happen with hand-held devices, the full-image can be fused in two ways: [3]

The former method assumes a linear response from the camera, which may be provided by DNG or other raw formats. Some variants can take developed images, but the process of reconstructing the intensities is complicated and noisy, compromising the effective dynamic range. [5]

The latter method [Mertens-Kautz-Van Reeth (MKVr)] only cares about aligning features and taking the best parts, automatically (by contrast, saturation, and proper exposure) or manually, so it is immune to this drawback. However, it cannot be considered a true HDR technique because no HDR image is ever created. The image does look better on displays, but the resulting bit depth of the image is equal to the input depth, unlike on a true HDR image where a greater bit depth allows storing more detailed intensity changes. [1] Flexibility being its strength, this method can be extended to perform focus stacking by using contrast as the sole criteria. [7]

In photomicrography

In photomicrography, the exposure fusion is often the only way to acquire properly exposed images from stereomicroscopes. One of the software solutions designed for photomicrography is the HDR module for QuickPHOTO microscopy software. This module can be also combined with Deep Focus focus stacking module to solve another problem, which is shallow depth of field of stereomicroscopes.

Similar imaging techniques are used in other fields. For example, in THz computational imaging, due to the weak signal of THz radiation, synchronous amplifiers coupled with a detector are used. The spatial distribution of THz radiation reflected from the object under study has large brightness differences that do not allow it to be registered by a single ADC. To solve this problem, two ADCs are connected to the synchronous amplifier, allowing two sets of data to be received simultaneously. ADCs have complementary sensitivity settings: one ADC allows measuring weak signals at the noise level on the periphery of the registration area, and information from the second ADC with the settings allows registering powerful signals is used in the central areas, where intense THz radiation reflected from the object prevails. [8]

Software

Notes

    Related Research Articles

    <span class="mw-page-title-main">Multi-exposure HDR capture</span> Technique to capture HDR images and videos

    In photography and videography, multi-exposure HDR capture is a technique that creates high dynamic range (HDR) images by taking and combining multiple exposures of the same subject matter at different exposures. Combining multiple images in this way results in an image with a greater dynamic range than what would be possible by taking one single image. The technique can also be used to capture video by taking and combining multiple exposures for each frame of the video. The term "HDR" is used frequently to refer to the process of creating HDR images from multiple exposures. Many smartphones have an automated HDR feature that relies on computational imaging techniques to capture and combine multiple exposures.

    In photography, bracketing is the general technique of taking several shots of the same subject using different camera settings, typically with the aim of combining the images in postprocessing. Bracketing is useful and often recommended in situations that make it difficult to obtain a satisfactory image with a single shot, especially when a small variation in exposure parameters has a comparatively large effect on the resulting image. Given the time it takes to accomplish multiple shots, it is typically, but not always, used for static subjects. Autobracketing is a feature of many modern cameras. When set, it will automatically take several bracketed shots, rather than the photographer altering the settings by hand between each shot.

    <span class="mw-page-title-main">Computational photography</span> Set of digital image capture and processing techniques

    Computational photography refers to digital image capture and processing techniques that use digital computation instead of optical processes. Computational photography can improve the capabilities of a camera, or introduce features that were not possible at all with film-based photography, or reduce the cost or size of camera elements. Examples of computational photography include in-camera computation of digital panoramas, high-dynamic-range images, and light field cameras. Light field cameras use novel optical elements to capture three dimensional scene information which can then be used to produce 3D images, enhanced depth-of-field, and selective de-focusing. Enhanced depth-of-field reduces the need for mechanical focusing systems. All of these features use computational imaging techniques.

    <span class="mw-page-title-main">Tone mapping</span> Image processing technique

    Tone mapping is a technique used in image processing and computer graphics to map one set of colors to another to approximate the appearance of high-dynamic-range (HDR) images in a medium that has a more limited dynamic range. Print-outs, CRT or LCD monitors, and projectors all have a limited dynamic range that is inadequate to reproduce the full range of light intensities present in natural scenes. Tone mapping addresses the problem of strong contrast reduction from the scene radiance to the displayable range while preserving the image details and color appearance important to appreciate the original scene content.

    <span class="mw-page-title-main">Nikon D200</span> Digital single-lens reflex camera

    The Nikon D200 is a 10.2-megapixel digital single-lens reflex camera that falls between entry-level/midrange DSLR cameras such as the Nikon D40, Nikon D40x, and D80 and high-end models such as the Nikon D2Hs and D2Xs. It was released by the Nikon Corporation in November 2005. The D200 was succeeded by the D300 in August 2007.

    High dynamic range (HDR), also known as wide dynamic range, extended dynamic range, or expanded dynamic range, is a dynamic range higher than usual.

    <span class="mw-page-title-main">Exposing to the right</span> Photographic technique

    In digital photography, exposing to the right (ETTR) is the technique of adjusting the exposure of an image as high as possible at base ISO to collect the maximum amount of light and thus get the optimum performance out of the digital image sensor.

    <span class="mw-page-title-main">Helicon Filter</span> Editing software for Microsoft Windows

    Helicon Filter, also referred to as Helicon, Filter, or as HF, was a proprietary commercial and shareware photo editing software program for Microsoft Windows, similar to such programs as Adobe Photoshop and GIMP, developed and published by Helicon Soft Ltd. Unlike these other programs, Helicon Filter is designed primarily to edit and improve existing photos and not for graphics creation. Helicon Filter's interface also differs from other programs in that compact toolbars and menus containing editing tools are replaced with labeled "filter" tabs, each tab containing labeled edit options specific to a single aspect of the picture. Although some editors used to Photoshop-style programs may initially find this layout unfamiliar and unlike the standard toolbar layout, beginners and those who don't recognize the standard icons generally find this very helpful for getting through the editing process.

    <span class="mw-page-title-main">Focus stacking</span> Digital image processing technique

    Focus stacking is a digital image processing technique which combines multiple images taken at different focus distances to give a resulting image with a greater depth of field (DOF) than any of the individual source images. Focus stacking can be used in any situation where individual images have a very shallow depth of field; macro photography and optical microscopy are two typical examples. Focus stacking can also be useful in landscape photography.

    <span class="mw-page-title-main">SilverFast</span>

    SilverFast is the name of a family of software for image scanning and processing, including photos, documents and slides, developed by LaserSoft Imaging.

    <span class="mw-page-title-main">HDR PhotoStudio</span>

    HDR PhotoStudio is a discontinued high dynamic range (HDR) graphics application developed by Unified Color for the Windows and macOS operating systems. In addition to being a HDR-merge application, HDR PhotoStudio offered a set of image editing operations that worked in its dynamic range, human color range (gamut), and in high precision. It also had a Color Integrity feature that enabled preserving an image's color tone during image editing operations — for example changing an image's contrast would not change its chromatic data. This problem is usually referred to as "color shift".

    <span class="mw-page-title-main">Pentax K-5</span> Digital camera model

    The Pentax K-5 is a 16.3-megapixel digital single-lens reflex camera, announced on September 20, 2010. It began shipping in mid-October 2010 and it was replaced by the Pentax K-5 II in the third quarter of 2012.

    <span class="mw-page-title-main">Image editing</span> Processes of altering images

    Image editing encompasses the processes of altering images, whether they are digital photographs, traditional photo-chemical photographs, or illustrations. Traditional analog image editing is known as photo retouching, using tools such as an airbrush to modify photographs or editing illustrations with any traditional art medium. Graphic software programs, which can be broadly grouped into vector graphics editors, raster graphics editors, and 3D modelers, are the primary tools with which a user may manipulate, enhance, and transform images. Many image editing programs are also used to render or create computer art from scratch. The term "image editing" usually refers only to the editing of 2D images, not 3D ones.

    <span class="mw-page-title-main">Magic Lantern (firmware)</span> Firmware add-on for the Canon EOS cameras by Trammell Hudson

    Magic Lantern is a firmware add-on for various Canon digital single-lens reflex (DSLR) cameras and the EOS M. It adds features for DSLR filmmaking and still photography, and is free and open-source.

    <span class="mw-page-title-main">Darktable</span>

    Darktable is a free and open-source photography application and raw developer. Rather than being a raster graphics editor like Adobe Photoshop or GIMP, it comprises a subset of image editing operations specifically aimed at non-destructive raw image post-production. It is primarily focused on improving a photographer's workflow by facilitating the handling of large numbers of images. It is freely available in versions tailored for most major Linux distributions, macOS, Solaris and Windows and is released under the GPL-3.0-or-later.

    <span class="mw-page-title-main">Luminance HDR</span>

    Luminance HDR, formerly Qtpfsgui, is graphics software used for the creation and manipulation of high-dynamic-range images. Released under the terms of the GPL, it is available for Linux, Windows and Mac OS X. Luminance HDR supports several High Dynamic Range (HDR) as well as Low Dynamic Range (LDR) file formats.

    Epsilon photography is a form of computational photography wherein multiple images are captured with slightly varying camera parameters such as aperture, exposure, focus, film speed and viewpoint for the purpose of enhanced post-capture flexibility. The term was coined by Prof. Ramesh Raskar. The technique has been developed as an alternative to light field photography that requires no specialized equipment. Examples of epsilon photography include focal stack photography, High dynamic range (HDR) photography, lucky imaging, multi-image panorama stitching and confocal stereo. The common thread for all the aforementioned imaging techniques is that multiple images are captured in order to produce a composite image of higher quality, such as richer color information, wider-field of view, more accurate depth map, less noise/blur and greater resolution.

    <span class="mw-page-title-main">Pixel Camera</span> Camera application developed by Google for Pixel devices

    Pixel Camera, formerly Google Camera, is a camera phone application developed by Google for the Android operating system. Development for the application began in 2011 at the Google X research incubator led by Marc Levoy, which was developing image fusion technology for Google Glass. It was publicly released for Android 4.4+ on the Google Play on April 16, 2014. It was initially supported on all devices running Android 4.4 KitKat and higher, but became only officially supported on Google Pixel devices in the following years. The app was renamed Pixel Camera in October 2023, with the launch of the Pixel 8 and Pixel 8 Pro.

    JPEG XT is an image compression standard which specifies backward-compatible extensions of the base JPEG standard.

    Enblend-Enfuse are open source console application created by Andrew Mihal and mostly maintained by Hugin developers. It consists of Enblend, an image blending tool useful for creating panoramas, and Enfuse, an exposure fusion and focus stacking tool that combines the depth of field and dynamic range from multiple images of the same scene (bracketing). Enblend-enfuse accepts images already aligned by other methods.

    References

    1. 1 2 Evans, Mark (2009), Exposure Fusion: What is it? How does it Compare to HDR? How Do I Do It? , retrieved 2011-01-21
    2. McNeal, Kevin (2010), Exposure Fusion – Best Way To Blend Images , retrieved 2011-01-21
    3. Ward, Greg (6 April 2012). "Fast, Robust Image Registration for Compositing High Dynamic Range Photographs from Hand-Held Exposures" (PDF). Journal of Graphics Tools. 8 (2): 17–30. doi:10.1080/10867651.2003.10487583. S2CID   17984464.
    4. Luijk, Guillermo. "Zero Noise Virtual RAW". Zero Noise Photography. Retrieved 11 May 2019.
    5. 1 2 "What is HDRMerge?". HDRMerge Documentation. Retrieved 11 May 2019. HDRMerge merges raw images directly, without development. In fact, it can safely assume a linear response function of the camera.
    6. Mertens, Tom; Kautz, Jan; Van Reeth, Frank (2007). "Exposure Fusion". Pacific Graphics. Retrieved 2011-01-21.
    7. Mihal, Andrew; Spiel, Christoph. "Combining Multiple Images with Enfuse 4.2". enblend.sourceforge.net. Retrieved 11 May 2019.
    8. Petrov, N. V.; Perraud, J.-B.; Adrien, C; Guillet, J.-P.; Smolyanskaya, O. A.; Mounaix, P. (2020-07-20). "Terahertz phase retrieval imaging in reflection". Optics Letters. 45: 4168. doi:10.1364/OL.397935.

    See also