Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

17345067 · Jun 202019922001200920172026
48 results for data-consistent inversion

Improved inverse problem solving with data consistency in diffusion models.

problem Speed and data consistency issues in diffusion model-based inverse problems.
method Data Consistent Direct Diffusion Bridges (CDDB) that ensures data consistency without fine-tuning.
result CDDB outperforms inconsistent DDB in perception and distortion metrics.

New methods for parameter estimation in mechanistic models using data-consistent inversion.

problem Parameter estimation bias in Bayesian analysis for mechanistic models.
method Data-consistent inversion methods based on rejection sampling, MCMC, GANs, and constrained optimization.
result Improved parameter estimation without bias from uninformative priors.

Improved diffusion models for inverse problems by integrating data consistency constraints.

problem Errors in earlier steps of diffusion models during posterior sampling.
method Guided Decoupled Posterior Sampling (GDPS) with data consistency constraint.
result GDPS achieves state-of-the-art performance, improving accuracy over existing methods.

Review of diffusion priors for solving imaging inverse problems.

problem Solving inverse problems in imaging using diffusion priors.
method Categorizes approaches into explicit approximation and variational inference, sequential monte carlo, and decoupled data consistency.
result Systematic comparison of performance trade-offs across inverse problems.

Recently the field of inverse problems has seen a growing usage of mathematically only partially understood learned and non-learned priors. Based on first principles, we develop a projectional approach to inverse problems that addresses the incorporation of these priors, while still guaranteeing data consistency. We im…

2019-07-10abs ↗pdf ↗

CCDF reduces diffusion sampling steps for inverse problems.

problem Slow sampling from diffusion models in inverse problems.
method Starting from a single forward diffusion step with better initialization, followed by stochastic contraction.
result Significantly reduced sampling steps for state-of-the-art reconstruction.

Framework combines machine learning and inverse methods to quantify uncertainties in model parameters.

problem Combining aleatoric and epistemic uncertainties in engineered systems modeling.
method Develops a robust filtering step in LUQ to learn useful QoI maps from noisy datasets, iterates over time, and uses sufficiency tests.
result Transforms datasets into distributions for DC-based inversion, improving parameter quantification.

A new diffusion sampling method combines Krylov subspace and diffusion models for faster and more efficient inverse problems.

problem Efficiently solving large-scale inverse problems in high-performance computing.
method Proposes a novel diffusion sampling strategy that integrates Krylov subspace methods with diffusion models.
result Demonstrates significant speedup (80x faster inference time) and improved reconstruction quality on real-world medical imaging problems.

A new method for weakly supervised learning that improves model accuracy.

problem Training machine learning models with precise labels is expensive; weak supervision provides a low-cost alternative.
method Data consistent weak supervision algorithm that searches over classifiers to find plausible labelings, considering features of the training data and estimating labels for low/no coverage data.
result Empirically, the method significantly outperforms state-of-the-art weak supervision methods on text and image classification tasks.

This paper speeds up uncertainty quantification in inverse problems using conditional normalizing flows.

problem Uncertainty quantification in inverse problems with partial observations.
method Two-step scheme using normalizing flows and joint data to train conditional and inverse generators.
result Significant training speedup when reusing pretrained networks for new data.

We consider ill-posed inverse problems where the forward operator TT is unknown, and instead we have access to training data consisting of functions fif_i and their noisy images TfiTf_i. This is a practically relevant and challenging problem which current methods are able to solve only under strong assumptions on the t…

2021-08-05abs ↗pdf ↗

In scientific inference problems, the underlying statistical modeling assumptions have a crucial impact on the end results. There exist, however, only a few automatic means for validating these fundamental modelling assumptions. The contribution in this paper is a general criterion to evaluate the consistency of a set …

2018-08-17abs ↗pdf ↗

Deep kernel learning refers to a Gaussian process that incorporates neural networks to improve the modelling of complex functions. We present a method that makes this approach feasible for problems where the data consists of line integral measurements of the target function. The performance is illustrated on computed t…

2019-09-04abs ↗pdf ↗

Paper estimates differences in conditional independence graphs from time-dependent data.

problem Estimating changes in conditional dependencies between two time series with known similar structure.
method Penalized D-trace loss function approach in the frequency domain, using Wirtinger calculus, with convex and non-convex penalties.
result Established sufficient conditions for consistency and graph recovery in high-dimensional settings.

We analyze high-resolution foreign exchange data consisting of 20 million data points of USD-JPY for 13 years to report firm statistical laws in distributions and correlations of exchange rate fluctuations. A conditional probability density analysis clearly shows the existence of trend-following movements at time scale…

2002-11-08abs ↗pdf ↗

A composite loss framework is proposed for low-rank modeling of data consisting of interesting and common values, such as excess zeros or missing values. The methodology is motivated by the generalized low-rank framework and the hurdle method which is commonly used to analyze zero-inflated counts. The model is demonstr…

2017-09-06abs ↗pdf ↗

Suppose the data consist of a set SS of points xjx_j, 1jJ1\leq j \leq J, distributed in a bounded domain DRND\subset R^N, where NN is a large number. An algorithm is given for finding the sets LkL_k of dimension kNk\ll N, k=1,2,...Kk=1,2,...K, in a neighborhood of which maximal amount of points xjSx_j\in S lie. The algorithm is…

2009-02-25abs ↗pdf ↗

We study the problem of offline learning in automated decision systems under the contextual bandits model. We are given logged historical data consisting of contexts, (randomized) actions, and (nonnegative) rewards. A common goal is to evaluate what would happen if different actions were taken in the same contexts, so …

2019-01-15abs ↗pdf ↗

Method infers dynamics from incomplete time series data.

problem Challenges in inferring stochastic dynamics from time series with missing data.
method Expectation Maximization (EM) algorithm that iterates between E-step and M-step.
result The EM algorithm effectively recovers missing data points and infers underlying network models from real neuronal activities.

In this work we describe the preparation of a time series dataset of inertial measurements for determining the surface type under a wheeled robot. The data consists of over 7600 labeled time series samples, with the corresponding surface type annotation. This data was used in two public competitions with over 1500 part…

2019-05-01abs ↗pdf ↗

Kernel ridge regression imputation with consistent variance estimation for handling missing data.

problem Handling missing data in statistical analysis.
method Kernel ridge regression imputation combined with entropy method for variance estimation.
result Root-n consistency of the imputation estimator in a Sobolev space setting.

We study the boundary rigidity problem with partial data consisting of determining locally the Riemannian metric of a Riemannian manifold with boundary from the distance function measured at pairs of points near a fixed point on the boundary. We show that one can recover uniquely and in a stable way a conformal factor …

2013-06-12abs ↗pdf ↗

Consistent estimator derived for confounding strength in observational data.

problem Estimating confounding strength in observational data is challenging due to unobserved confounders.
method Derived and adapted a consistent estimator using tools from random matrix theory.
result The original estimator is not consistent, but an adapted one is.

We study the space of periodic solutions of the elliptic sinh\sinh-Gordon equation by means of spectral data consisting of a Riemann surface YY and a divisor DD. We show that the space MgpM_g^{\mathbf{p}} of real periodic finite type solutions with fixed period p\mathbf{p} can be considered as a completely integrable s…

2016-06-06abs ↗pdf ↗

For a Riemannian manifold (M,g)(M,g) with strictly convex boundary M\partial M, the lens data consists in the set of lengths of geodesics γγ with endpoints on M\partial M, together with their endpoints (x,x+)M×M(x_-,x_+)\in \partial M\times \partial M and tangent exit vectors (v,v+)TxM×Tx+M(v_-,v_+)\in T_{x_-} M\times T_{x_+} M. We show …

2014-12-04abs ↗pdf ↗

Paper uses machine learning for nowcasting corporate earnings from mixed-frequency data.

problem Predicting corporate earnings for a large cross-section of firms with different frequency data.
method Structured machine learning regressions with sparse-group LASSO regularization for panel data.
result Machine learning models outperform traditional methods in nowcasting corporate earnings.

The paper describes superconformal structures on super Riemann surfaces using fatgraphs.

problem Characterizing superconformal structures on super Riemann surfaces.
method Using fatgraphs to assign data, characterizing moduli and deformations with Strebel differentials and Čech cocycles.
result Superconformal structures on N=1N=1 super Riemann surfaces are computed as fixed points of involution on N=2N=2 super Riemann surfaces.

Proof of convergence for multi-objective optimization using inverse reinforcement learning.

problem Proving convergence in multi-objective optimization problems.
method Wasserstein inverse reinforcement learning with projective subgradient method and gradient descent.
result Convergence of inverse reinforcement learning for multi-objective optimization.