arXiv research

Optical flow refers to the visual motion observed between two consecutive images. Since the degree of freedom is typically much larger than the constraints imposed by the image observations, the straightforward formulation of optical flow as an inverse problem is ill-posed. Standard approaches to determine optical flow…

Recent work has shown that optical flow estimation can be formulated as a supervised learning task and can be successfully solved with convolutional networks. Training of the so-called FlowNet was enabled by a large synthetically generated dataset. The present paper extends the concept of optical flow estimation via co…

Motion is a dominant cue in automated driving systems. Optical flow is typically computed to detect moving objects and to estimate depth using triangulation. In this paper, our motivation is to leverage the existing dense optical flow to improve the performance of semantic segmentation. To provide a systematic study, w…

COMBO network improves optical flow estimation by combining deep learning with brightness constancy.

Making predictions of future frames is a critical challenge in autonomous driving research. Most of the existing methods for video prediction attempt to generate future frames in simple and fixed scenes. In this paper, we propose a novel and effective optical flow conditioned method for the task of video prediction wit…

In this article we prove two formulas for the topological entropy of an F-optical Hamiltonian flow induced by a C^{\infty} Hamiltonian, where F is a Lagrangian distribution. In these formulas, we calculate the topological entropy as the exponential growth rate of the average of the determinant of the differential of th…

New model predicts radiative properties of nanoparticle layers with high accuracy and uncertainty.

The finding that very large networks can be trained efficiently and reliably has led to a paradigm shift in computer vision from engineered solutions to learning formulations. As a result, the research challenge shifts from devising algorithms to creating suitable and abundant training data for supervised learning. How…

In microsurgery, lasers have emerged as precise tools for bone ablation. A challenge is automatic control of laser bone ablation with 4D optical coherence tomography (OCT). OCT as high resolution imaging modality provides volumetric images of tissue and foresees information of bone position and orientation (pose) as we…

We present a deep learning framework for wide-field, content-aware estimation of absorption and scattering coefficients of tissues, called Generative Adversarial Network Prediction of Optical Properties (GANPOP). Spatial frequency domain imaging is used to obtain ground-truth optical properties from in vivo human hands…

We describe two applications of machine learning in the context of IP/Optical networks. The first one allows agile management of resources at a core IP/Optical network by using machine learning for short-term and long-term prediction of traffic flows and joint global optimization of IP and optical layers using colorles…

In general relativity, spatial light rays of static spherically symmetric spacetimes are geodesics of surfaces in Riemannian optical geometry. In this paper, we apply results on the isoperimetric problem to show that length-minimizing curves subject to an area constraint are circles, and discuss implications for the ph…

New method speeds up galaxy analysis from hours to seconds.

New metrics prevent event collapse in contrast maximization frameworks.

We consider the problem of density estimation on Riemannian manifolds. Density estimation on manifolds has many applications in fluid-mechanics, optics and plasma physics and it appears often when dealing with angular variables (such as used in protein folding, robot limbs, gene-expression) and in general directional s…

In this paper, we focus on a prediction-based novelty estimation strategy upon the deep reinforcement learning (DRL) framework, and present a flow-based intrinsic curiosity module (FICM) to exploit the prediction errors from optical flow estimation as exploration bonuses. We propose the concept of leveraging motion fea…

Improved object segmentation and tracking in video using optical flow and initial state conditioning.

We consider an optical hypersurface $Σ$ in the cotangent bundle $τ:T^*M\to M$ of a closed manifold $M$ endowed with a twisted symplectic structure. We show that if the characteristic foliation of $Σ$ is Anosov, then a smooth 1-form $θ$ on $M$ is exact if and only $τ^*θ$ has zero integral over every closed characteristi…

Glaucoma is the second leading cause of blindness all over the world, with approximately 60 million cases reported worldwide in 2010. If undiagnosed in time, glaucoma causes irreversible damage to the optic nerve leading to blindness. The optic nerve head examination, which involves measurement of cup-to-disc ratio, is…

Paper introduces TAP-Vid, a benchmark for tracking any point in videos.

Glaucoma is a serious ocular disorder for which the screening and diagnosis are carried out by the examination of the optic nerve head (ONH). The color fundus image (CFI) is the most common modality used for ocular screening. In CFI, the central r

Derives exact gradients for linear optics with single photons.

Though machine learning has achieved notable success in modeling sequential and spatial data for speech recognition and in computer vision, applications to remote sensing and climate science problems are seldom considered. In this paper, we demonstrate techniques from unsupervised learning of future video frame predict…

SVM with local features improves human action recognition.

We consider a triality between the Zermelo navigation problem, the geodesic flow on a Finslerian geometry of Randers type, and spacetimes in one dimension higher admitting a timelike conformal Killing vector field. From the latter viewpoint, the data of the Zermelo problem are encoded in a (conformally) Painleve-Gullst…

Multi-layer optical film has been found to afford important applications in optical communication, optical absorbers, optical filters, etc. Different algorithms of multi-layer optical film design has been developed, as simplex method, colony algorithm, genetic algorithm. These algorithms rapidly promote the design and …

New method fuses optical and SAR data to fill LAI gaps during cloudy periods.

Purpose: Optical imaging is evolving as a key technique for advanced sensing in the operating room. Recent research has shown that machine learning algorithms can be used to address the inverse problem of converting pixel-wise multispectral reflectance measurements to underlying tissue parameters, such as oxygenation. …

Open problems in billiards and optics from a workshop.

DUPLE tackles cross-deployment recognition in fiber-optic perimeter security with meta-learning.

With the availability of the huge amounts of data produced by current and future large multi-band photometric surveys, photometric redshifts have become a crucial tool for extragalactic astronomy and cosmology. In this paper we present a novel method, called Weak Gated Experts (WGE), which allows to derive photometric …

New method generates optical vortices in any knot shape.

Method detects and locates eavesdropping in optical links.

Optical ESNs enable flexible, efficient machine learning with reduced energy.

Despite significant advances in artificial intelligence (AI) for computer vision, its application in medical imaging has been limited by the burden and limits of expert-generated labels. We used images from optical coherence tomography angiography (OCTA), a relatively new imaging modality that measures perfusion of the…

Paper develops a deforestation detection system using optical and SAR data.

Study of optical geometries with intrinsic torsion in general relativity.

Score-based models improve diffuse optical tomography accuracy.

A new method for computing image curvature efficiently and accurately.

Express Wavenet is an improved optical diffractive neural network. At each layer, it uses wavelet-like pattern to modulate the phase of optical waves. For input image with n2 pixels, express wavenet reduce parameter number from O(n2) to O(n). Only need one percent of the parameters, and the accuracy is still very high.…

Derives Levi-Civita connection formulas for specific geometries.

Study uses SAR data to estimate forest vegetation indices, improving monitoring of temperate forests.

Designs chiral photonic structures using machine learning for efficient optical properties.

The sum-product or belief propagation (BP) algorithm is a widely used message-passing technique for computing approximate marginals in graphical models. We introduce a new technique, called stochastic orthogonal series message-passing (SOSMP), for computing the BP fixed point in models with continuous random variables.…

Diffractive deep neural network (DNNet) is a novel machine learning framework on the modulation of optical transmission. Diffractive network would get predictions at the speed of light. It's pure passive architecture, no additional power consumption. We improved the accuracy of diffractive network with optical waves at…

New methods for constructing null fluid metrics and solving optical lift conjectures.

Model predicts phytoplankton subpopulations based on environmental factors.

We discuss recently emerging applications of the state-of-art deep learning methods on optical microscopy and microscopic image reconstruction, which enable new transformations among different modes and modalities of microscopic imaging, driven entirely by image data. We believe that deep learning will fundamentally ch…