Phase stretch transform

Last updated June 11, 2022

Phase stretch transform (PST) is a computational approach to signal and image processing. One of its utilities is for feature detection and classification.^[1]^[2] PST is related to time stretch dispersive Fourier transform.^[3] It transforms the image by emulating propagation through a diffractive medium with engineered 3D dispersive property (refractive index). The operation relies on symmetry of the dispersion profile and can be understood in terms of dispersive eigenfunctions or stretch modes.^[4] PST performs similar functionality as phase-contrast microscopy, but on digital images. PST can be applied to digital images and temporal (time series) data. It is a physics-based feature engineering algorithm.^[5]

Operation principle

Here the principle is described in the context of feature enhancement in digital images. The image is first filtered with a spatial kernel followed by application of a nonlinear frequency-dependent phase. The output of the transform is the phase in the spatial domain. The main step is the 2-D phase function which is typically applied in the frequency domain. The amount of phase applied to the image is frequency dependent, with higher amount of phase applied to higher frequency features of the image. Since sharp transitions, such as edges and corners, contain higher frequencies, PST emphasizes the edge information. Features can be further enhanced by applying thresholding and morphological operations. PST is a pure phase operation whereas conventional edge detection algorithms operate on amplitude.

Physical and mathematical foundations of phase stretch transform

Photonic time stretch technique can be understood by considering the propagation of an optical pulse through a dispersive fiber. By disregarding the loss and non-linearity in fiber, the non-linear Schrödinger equation governing the optical pulse propagation in fiber upon integration ^[6] reduces to:

E_{o}(z,t)={\frac {1}{2\pi }}\int _{-\infty }^{\infty }{\tilde {E}}_{i}(0,\omega )\cdot e^{\frac {-i\beta _{2}z\omega ^{2}}{2}}\cdot e^{i\omega {t}}\,d\omega

(1)

where $\beta _{2}$ = GVD parameter, z is propagation distance, $E_{o}(z,t)$ is the reshaped output pulse at distance z and time t. The response of this dispersive element in the time-stretch system can be approximated as a phase propagator as presented in ^[4] $H(\omega )=e^{i\varphi (\omega )}=e^{i\sum _{m=0}^{\infty }\varphi _{m}(\omega )}=\prod _{m=0}^{\infty }H_{m}(\omega )$ (2)

Therefore, Eq. 1 can be written as following for a pulse that propagates through the time-stretch system and is reshaped into a temporal signal with a complex envelope given by ^[4]

E_{o}(t)={\frac {1}{2\pi }}\int _{-\infty }^{\infty }{\tilde {E}}_{i}(\omega )\cdot H(\omega )\cdot e^{i\omega t}\,d\omega

(3)

The time stretch operation is formulated as generalized phase and amplitude operations,

\mathbb {S} \{E_{i}(t)\}=\int _{-\infty }^{+\infty }{\mathcal {F}}\{E_{i}(t)\}\cdot e^{i\varphi (\omega )}\cdot {\tilde {L}}(\omega )\cdot e^{i\omega {t}}d\omega

(4)

where $e^{i\varphi (\omega )}$ is the phase filter and ${\tilde {L}}(\omega )$ is the amplitude filter. Next the operator is converted to discrete domain,

\mathbb {S} \{E_{i}[n]\}={\frac {1}{N}}\sum _{u=0}^{N-1}FFT\{E_{i}(n)\}\cdot {\tilde {K}}(u)\cdot {\tilde {L}}(u)\cdot e^{i{\frac {2\pi }{N}}un}

(5)

where $u$ is the discrete frequency, ${\tilde {K}}(u)$ is the phase filter, ${\tilde {L}}(u)$ is the amplitude filter and FFT is fast Fourier transform.

The stretch operator $\mathbb {S} \{\}$ for a digital image is then

\mathbb {S} \{E_{i}[n,m]\}={\frac {1}{MN}}\sum _{v=0}^{N-1}\sum _{u=0}^{M-1}FFT^{2}\{E_{i}(n,m)\}\cdot {\tilde {K}}(u,v)\cdot {\tilde {L}}(u,v)\cdot e^{i{\frac {2\pi }{M}}um}\cdot e^{i{\frac {2\pi }{N}}vn}

(6)

In the above equations, $E_{i}[n,m]$ is the input image, $n$ and $m$ are the spatial variables, $FFT^{2}$ is the two-dimensional fast Fourier transform, and $u$ and $v$ are spatial frequency variables. The function ${\tilde {K}}(u,v)$ is the warped phase kernel and the function ${\tilde {L}}(u,v)$ is a localization kernel implemented in frequency domain. PST operator is defined as the phase of the Warped Stretch Transform output as follows

PST\{E_{i}[n,m]\}\triangleq \measuredangle \{\mathbb {S} \{E_{i}[x,y]\}\}

(7)

where $\measuredangle \{\}$ is the angle operator.

PST kernel implementation

The warped phase kernel ${\tilde {K}}(u,v)$ can be described by a nonlinear frequency dependent phase

{\tilde {K}}(u,v)=e^{i\varphi (u,v)}

While arbitrary phase kernels can be considered for PST operation, here we study the phase kernels for which the kernel phase derivative is a linear or sublinear function with respect to frequency variables. A simple example for such phase derivative profiles is the inverse tangent function. Consider the phase profile in the polar coordinate system

\varphi (u,v)=\varphi _{\text{polar}}(r,\theta )=\varphi _{\text{polar}}(r)

From ${\frac {d\varphi (r)}{dr}}=\tan ^{-1}(r)$ we have $\varphi (r)=r\tan ^{-1}(r)-{\frac {1}{2}}\log(r^{2}+1)$

Therefore, the PST kernel is implemented as

\varphi (r)=S\cdot {\frac {(Wr)\cdot \tan ^{-1}(Wr)-{\frac {1}{2}}\log(1+(Wr)^{2})}{(Wr_{\max })\cdot \tan ^{-1}(Wr_{\max })-{\frac {1}{2}}\log(1+(Wr_{\max })^{2})}}

where $S$ and $W$ are real-valued numbers related to the strength and warp of the phase profile

Applications

PST has been used for edge detection in biological and biomedical images as well as synthetic-aperture radar (SAR) image processing.^[7]^[8]^[9] PST has also been applied to improve the point spread function for single molecule imaging in order to achieve super-resolution.^[10] The transform exhibits intrinsic superior properties compared to conventional edge detectors for feature detection in low contrast visually impaired images.^[11]

The PST function can also be performed on 1-D temporal waveforms in the analog domain to reveal transitions and anomalies in real time.^[4]

Open source code release

On February 9, 2016, a UCLA Engineering research group has made public the computer code for PST algorithm that helps computers process images at high speeds and "see" them in ways that human eyes cannot. The researchers say the code could eventually be used in face, fingerprint, and iris recognition systems for high-tech security, as well as in self-driving cars' navigation systems or for inspecting industrial products. The Matlab implementation for PST can also be downloaded from Matlab Files Exchange.^[12] However, it is provided for research purposes only, and a license must be obtained for any commercial applications. The software is protected under a US patent. The code was then significantly refactored and improved to support GPU acceleration. In May 2022, it became one algorithm in PhyCV: the first physics-inspired computer vision library.

Related Research Articles

In classical mechanics, a harmonic oscillator is a system that, when displaced from its equilibrium position, experiences a restoring force F proportional to the displacement x:

In mathematics, the Laplace transform, named after its inventor Pierre-Simon Laplace, is an integral transform that converts a function of a real variable to a function of a complex variable $. The transform has many applications in science and engineering because it is a tool for solving differential equations. In particular, it transforms linear differential equations into algebraic equations and convolution into multiplication. For suitable functions f, the Laplace transform is the integral$

In 1851, George Gabriel Stokes derived an expression, now known as Stokes law, for the frictional force – also called drag force – exerted on spherical objects with very small Reynolds numbers in a viscous fluid. Stokes' law is derived by solving the Stokes flow limit for small Reynolds numbers of the Navier–Stokes equations.

In mathematics, a linear form is a linear map from a vector space to its field of scalars.

The path integral formulation is a description in quantum mechanics that generalizes the action principle of classical mechanics. It replaces the classical notion of a single, unique classical trajectory for a system with a sum, or functional integral, over an infinity of quantum-mechanically possible trajectories to compute a quantum amplitude.

In control theory and signal processing, a linear, time-invariant system is said to be minimum-phase if the system and its inverse are causal and stable.

In mathematics and in signal processing, the Hilbert transform is a specific linear operator that takes a function, $u (t)$ of a real variable and produces another function of a real variable $H(u)(t)$ . This linear operator is given by convolution with the function $. The Hilbert transform has a particularly simple representation in the frequency domain: It imparts a phase shift of \pm90° to every frequency component of a function, the sign of the shift depending on the sign of the frequency. The Hilbert transform is important in signal processing, where it is a component of the analytic representation of a real-valued signal u (t) . The Hilbert transform was first introduced by David Hilbert in this setting, to solve a special case of the Riemann-Hilbert problem for analytic functions.$

In mathematics, the total variation identifies several slightly different concepts, related to the structure of the codomain of a function or a measure. For a real-valued continuous function f, defined on an interval [a, b] ⊂ R, its total variation on the interval of definition is a measure of the one-dimensional arclength of the curve with parametric equation x ↦ f(x), for x ∈ [a, b]. Functions whose total variation is finite are called functions of bounded variation.

In differential geometry, a Poisson structure on a smooth manifold $is a Lie bracket on the algebra of smooth functions on, subject to the Leibniz rule$

In quantum field theory, the LSZ reduction formula is a method to calculate S-matrix elements from the time-ordered correlation functions of a quantum field theory. It is a step of the path that starts from the Lagrangian of some quantum field theory and leads to prediction of measurable quantities. It is named after the three German physicists Harry Lehmann, Kurt Symanzik and Wolfhart Zimmermann.

In quantum field theory, a quartic interaction is a type of self-interaction in a scalar field. Other types of quartic interactions may be found under the topic of four-fermion interactions. A classical free scalar field $satisfies the Klein-Gordon equation. If a scalar field is denoted, a quartic interaction is represented by adding a potential energy term to the Lagrangian density. The coupling constant is dimensionless in 4-dimensional spacetime.$

Self-phase modulation (SPM) is a nonlinear optical effect of light–matter interaction. An ultrashort pulse of light, when travelling in a medium, will induce a varying refractive index of the medium due to the optical Kerr effect. This variation in refractive index will produce a phase shift in the pulse, leading to a change of the pulse's frequency spectrum.

Instantaneous phase and frequency are important concepts in signal processing that occur in the context of the representation and analysis of time-varying functions. The instantaneous phase of a complex-valued function s(t), is the real-valued function:

Ewald summation, named after Paul Peter Ewald, is a method for computing long-range interactions in periodic systems. It was first developed as the method for calculating electrostatic energies of ionic crystals, and is now commonly used for calculating long-range interactions in computational chemistry. Ewald summation is a special case of the Poisson summation formula, replacing the summation of interaction energies in real space with an equivalent summation in Fourier space. In this method, the long-range interaction is divided into two parts: a short-range contribution, and a long-range contribution which does not have a singularity. The short-range contribution is calculated in real space, whereas the long-range contribution is calculated using a Fourier transform. The advantage of this method is the rapid convergence of the energy compared with that of a direct summation. This means that the method has high accuracy and reasonable speed when computing long-range interactions, and it is thus the de facto standard method for calculating long-range interactions in periodic systems. The method requires charge neutrality of the molecular system in order to accurately calculate the total Coulombic interaction. A study of the truncation errors introduced in the energy and force calculations of disordered point-charge systems is provided by Kolafa and Perram.

In applied mathematics, discontinuous Galerkin methods form a class of numerical methods for solving differential equations. They combine features of the finite element and the finite volume framework and have been successfully applied to hyperbolic, elliptic, parabolic and mixed form problems arising from a wide range of applications. DG methods have in particular received considerable interest for problems with a dominant first-order part, e.g. in electrodynamics, fluid mechanics and plasma physics.

Curvelets are a non-adaptive technique for multi-scale object representation. Being an extension of the wavelet concept, they are becoming popular in similar fields, namely in image processing and scientific computing.

In mathematics, vector spherical harmonics (VSH) are an extension of the scalar spherical harmonics for use with vector fields. The components of the VSH are complex-valued functions expressed in the spherical coordinate basis vectors.

In mathematics, the method of steepest descent or saddle-point method is an extension of Laplace's method for approximating an integral, where one deforms a contour integral in the complex plane to pass near a stationary point, in roughly the direction of steepest descent or stationary phase. The saddle-point approximation is used with integrals in the complex plane, whereas Laplace’s method is used with real integrals.

An anamorphic stretch transform (AST) also referred to as warped stretch transform is a physics-inspired signal transform that emerged from time stretch dispersive Fourier transform. The transform can be applied to analog temporal signals such as communication signals, or to digital spatial data such as images. The transform reshapes the data in such a way that its output has properties conducive for data compression and analytics. The reshaping consists of warped stretching in the Fourier domain. The name "Anamorphic" is used because of the metaphoric analogy between the warped stretch operation and warping of images in anamorphosis and surrealist artworks.

Phase-Stretch Adaptive Gradient-Field Extractor (PAGE) is an edge detection algorithm based on physics of electromagnetic diffraction and dispersion. A computational imaging algorithm, it identifies edges, their orientations and sharpness in a digital image where the image brightness changes abruptly. Edge detection is a basic operation performed by the eye and is crucial to visual perception.

References

↑ M. H. Asghari, and B. Jalali, "Edge detection in digital images using dispersive phase stretch", International Journal of Biomedical Imaging, Vol. 2015, Article ID 687819, pp. 1–6 (2015).
↑ M. H. Asghari, and B. Jalali, "Physics-inspired image edge detection", IEEE Global Signal and Information Processing Symposium (GlobalSIP 2014), paper: WdBD-L.1, Atlanta, December 2014.
↑ Y. Han and B. Jalali, "Photonic time-stretched analog-to-digital converter: fundamental concepts and practical considerations", Journal of Lightwave Technology 21, 3085 (2003)
1 2 3 4 B. Jalali and A. Mahjoubfar, "Tailoring Wideband Signals With a Photonic Hardware Accelerator", Proceedings of the IEEE, Vol. 103, No. 7, pp. 1071–1086 (2015).
↑ Physics-based Feature Engineering. Jalali et al. Optics, Photonics and Laser Technology, 2019
↑ Agrawal, G. P. (2007). Nonlinear fiber optics. Academic press. Chicago.
↑ Abdol, A.M.; Bedard, Andrew; Lánský, Imke; Kaandorp, J.A. (2018). "High-throughput method for extracting and visualizing the spatial gene expressions from in situ hybridization images: A case study of the early development of the sea anemone Nematostella vectensis". Gene Expression Patterns. 27: 36–45. doi:10.1016/j.gep.2017.10.005. ISSN 1567-133X. PMID 29122675.
↑ M. H. Asghari, C. Clemente, B. Jalali, and J. Soraghan, "Synthetic aperture radar image compression using discrete anamorphic stretch transform", IEEE Global Signal and Information Processing Symposium (GlobalSIP 2014), paper: WsBD-P.7, Atlanta, December 2014.
↑ C. V. Ilioudis, C. Clemente, M. H. Asghari, B. Jalali, and J. Soraghan, "Edge detection in SAR images using Dispersive Phase Stretch Transform", submitted to 2nd IET International Conference on Intelligent Signal Processing, London, 2015
↑ T. Ilovitsh, B. Jalali, M. H. Asghari, and Z. Zalevsky, "Phase stretch transform for super-resolution localization microscopy", Biomedical optics express. 2016 Oct 1;7(10):4198–209.
↑ M. Suthar, H. Asghari, and B. Jalali, "Feature Enhancement in Visually Impaired Images", IEEE Access 6 (2018): 1407–1415.
↑ "JalaliLabUCLA/Image-feature-detection-using-Phase-Stretch-Transform – File Exchange – MATLAB Central".

External links

Github repository for MATLAB and python implementation for PST

This page is based on this Wikipedia article
Text is available under the CC BY-SA 4.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.

[original-1] M. H. Asghari, and B. Jalali, "Edge detection in digital images using dispersive phase stretch", International Journal of Biomedical Imaging, Vol. 2015, Article ID 687819, pp. 1–6 (2015).

[2] M. H. Asghari, and B. Jalali, "Physics-inspired image edge detection", IEEE Global Signal and Information Processing Symposium (GlobalSIP 2014), paper: WdBD-L.1, Atlanta, December 2014.

[3] Y. Han and B. Jalali, "Photonic time-stretched analog-to-digital converter: fundamental concepts and practical considerations", Journal of Lightwave Technology 21, 3085 (2003)

[prec-4] 1 2 3 4 B. Jalali and A. Mahjoubfar, "Tailoring Wideband Signals With a Photonic Hardware Accelerator", Proceedings of the IEEE, Vol. 103, No. 7, pp. 1071–1086 (2015).

[5] Physics-based Feature Engineering. Jalali et al. Optics, Photonics and Laser Technology, 2019

[agarwal-6] Agrawal, G. P. (2007). Nonlinear fiber optics. Academic press. Chicago.

[7] Abdol, A.M.; Bedard, Andrew; Lánský, Imke; Kaandorp, J.A. (2018). "High-throughput method for extracting and visualizing the spatial gene expressions from in situ hybridization images: A case study of the early development of the sea anemone Nematostella vectensis". Gene Expression Patterns. 27: 36–45. doi:10.1016/j.gep.2017.10.005. ISSN 1567-133X. PMID 29122675.

[8] M. H. Asghari, C. Clemente, B. Jalali, and J. Soraghan, "Synthetic aperture radar image compression using discrete anamorphic stretch transform", IEEE Global Signal and Information Processing Symposium (GlobalSIP 2014), paper: WsBD-P.7, Atlanta, December 2014.

[9] C. V. Ilioudis, C. Clemente, M. H. Asghari, B. Jalali, and J. Soraghan, "Edge detection in SAR images using Dispersive Phase Stretch Transform", submitted to 2nd IET International Conference on Intelligent Signal Processing, London, 2015

[10] T. Ilovitsh, B. Jalali, M. H. Asghari, and Z. Zalevsky, "Phase stretch transform for super-resolution localization microscopy", Biomedical optics express. 2016 Oct 1;7(10):4198–209.

[11] M. Suthar, H. Asghari, and B. Jalali, "Feature Enhancement in Visually Impaired Images", IEEE Access 6 (2018): 1407–1415.

[12] "JalaliLabUCLA/Image-feature-detection-using-Phase-Stretch-Transform – File Exchange – MATLAB Central".

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[11]

[12]