Paper develops a framework for generating coherent image captions using visual features and hierarchical topics.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Coherent Multiplex analyzes real-time wavelet coherence among multiple signals.
A similarity metric for icon sets simplifies design selection.
The paper tackles entity induction and reference in visual storytelling.
New models explain image-based questions better with fewer examples.
GenInSAR uses CNNs to filter InSAR phase and estimate coherence without supervision.
We introduce a general-purpose conditioning method for neural networks called FiLM: Feature-wise Linear Modulation. FiLM layers influence neural network computation via a simple, feature-wise affine transformation based on conditioning information. We show that FiLM layers are highly effective for visual reasoning - an…
CMC method detects causal relationships in time series data.
ViCE uses superpixels to enhance self-supervised learning for better dense visual embeddings.
Twitmo analyzes geo-tagged Twitter data for topic modeling and visualization.
Generates coherent 3D scenes from monocular videos without supervision.
The seemingly infinite diversity of the natural world arises from a relatively small set of coherent rules, such as the laws of physics or chemistry. We conjecture that these rules give rise to regularities that can be discovered through primarily unsupervised experiences and represented as abstract concepts. If such r…
UN-AVOIDS visualizes and detects anomalies without needing labeled data.
Model improves information transfer from visual streams.
We consider Lagrangian coherent structures (LCSs) as the boundaries of material subsets whose advective evolution is metastable under weak diffusion. For their detection, we first transform the Eulerian advection-diffusion equation to Lagrangian coordinates, in which it takes the form of a time-dependent diffusion or h…
cGAP visualizes high-dimensional categorical data with interpretable geometric structure.
cGAP visualizes high-dimensional categorical data with interpretable geometric structure.
Interactive tool for better understanding t-SNE projections.
Develops ACE to automatically identify meaningful concepts from neural network predictions.
Bispectral OT improves dataset comparison by preserving intrinsic coherence.
Prediction is arguably one of the most basic functions of an intelligent system. In general, the problem of predicting events in the future or between two waypoints is exceedingly difficult. However, most phenomena naturally pass through relatively predictable bottlenecks---while we cannot predict the precise trajector…
Most existing text-to-image synthesis tasks are static single-turn generation, based on pre-defined textual descriptions of images. To explore more practical and interactive real-life applications, we introduce a new task - Interactive Image Editing, where users can guide an agent to edit images via multi-turn textual …
A new method for analyzing latent space models without reference configurations.
The increasingly photorealistic sample quality of generative image models suggests their feasibility in applications beyond image generation. We present the Neural Photo Editor, an interface that leverages the power of generative neural networks to make large, semantically coherent changes to existing images. To tackle…
Recent advances in deep generative models have lead to remarkable progress in synthesizing high quality images. Following their successful application in image processing and representation learning, an important next step is to consider videos. Learning generative models of video is a much harder task, requiring a mod…
Defines coherent manifolds and their quantum applications.
CoRe method improves time series forecasting coherency without strict constraints.
In this paper we present a theoretical framework for studying coherent acceptability indices in a dynamic setup. We study dynamic coherent acceptability indices and dynamic coherent risk measures, and we establish a duality between them. We derive a representation theorem for dynamic coherent risk measures in terms of …
Unified model improves coherence tasks, especially local contexts.
A given set of data-points in some feature space may be associated with a Schrodinger equation whose potential is determined by the data. This is known to lead to good clustering solutions. Here we extend this approach into a full-fledged dynamical scheme using a time-dependent Schrodinger equation. Moreover, we approx…
The transition amplitudes between coherent states on a coherent state manifold are expressed in terms of the embedding of the coherent state manifold into a projective Hilbert space. Consequences for the dimension of projective Hilbert space and a simple geometric interpretation of Calabi's diastasis follows.
We use mathematical induction to prove that the horizontal composition in the class of coherently diagonal complexes is indeed a binary operation. That is to say, the embedding of two coherently diagonal complexes in an alternating planar diagram produces a coherently diagonal complex.
Paper constructs Chern character for coherent sheaves.
The paper constructs minimal coherent filling pairs on surfaces.
In our work, we propose to represent HTM as a set of flat models, or layers, and a set of topical hierarchies, or edges. We suggest several quality measures for edges of hierarchical models, resembling those proposed for flat models. We conduct an assessment experimentation and show strong correlation between the propo…
Sparse coding in learned dictionaries has been established as a successful approach for signal denoising, source separation and solving inverse problems in general. A dictionary learning method adapts an initial dictionary to a particular signal class by iteratively computing an approximate factorization of a training …
Paper defines dynamical coherence for flows and proves it under specific conditions.
Develops equivariant Chern characters for coherent sheaves with group actions.
New metric -coherence measures gradient alignment during training, revealing surprising memorization patterns.
We present a method for identifying the coherent structures associated with individual Lagrangian flow trajectories even where only sparse particle trajectory data is available. The method, based on techniques in spectral graph theory, uses the Coherent Structure Coloring vector and associated eigenvectors to analyze t…
We study a space of coherent risk measures M_phi obtained as certain expansions of coherent elementary basis measures. In this space, the concept of ``Risk Aversion Function'' phi naturally arises as the spectral representation of each risk measure in a space of functions of confidence level probabilities. We give nece…
Generates coherent storybooks from plain text using diffusion models.
Extends coherence results to one-relator products of locally indicable groups.
Low-rank matrix approximations are often used to help scale standard machine learning algorithms to large-scale problems. Recently, matrix coherence has been used to characterize the ability to extract global information from a subset of matrix entries in the context of these low-rank approximations and other sampling-…
One of the most powerful approaches to imaging at the nanometer or subnanometer length scale is coherent diffraction imaging using X-ray sources. For amorphous (non-crystalline) samples, the raw data can be interpreted as the modulus of the continuous Fourier transform of the unknown object. Making use of prior informa…
Morse theory extended to noncompact manifolds with complex geometric data.
Develops non-standard analysis for coherent risk estimation.
A realization of coherent state Lie algebras by first-order differential operators with holomorphic polynomial coefficients on Kähler coherent state orbits is presented. Explicit formulas involving the Bernoulli numbers and the structure constants for the semisimple Lie groups are proved.