Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

2795588361,115 · Jun 202019922001200920172026
48 results for Non-ideal data

Review of diffusion models for SBI in non-ideal data scenarios.

problem Inference of parameters from complex simulation outputs with intractable likelihoods.
method Diffusion models for likelihood-free inference, addressing model misspecification, unstructured observations, and missing data.
result Improved robustness and efficiency in SBI methods for non-ideal data scenarios.

Paper proposes a new model and methods for robustly de-interleaving HMP mixtures.

problem Lack of robustness to non-ideal situations in existing HMP mixtures de-interleaving methods.
method Designs a generative model, formulates de-interleaving as posterior inference, develops exact and approximate inference methods, derives error probability bounds.
result Proposed methods are highly effective and robust for non-ideal situations, outperforming baseline methods.

Inspired by recent breakthroughs in predictive modeling, practitioners in both industry and government have turned to machine learning with hopes of operationalizing predictions to drive automated decisions. Unfortunately, many social desiderata concerning consequential decisions, such as justice or fairness, have no n…

2020-01-08abs ↗pdf ↗

Two non-local asymptotic invariants of magnetic fields for the ideal magnetohydrodynamics are introduced. The velocity of variation of the invariants for a non-ideal magnetohydrodynamics with a small magnetic dissipation is estimated. By means of the invariants the spectra of electromagnetic fields are investigated. A …

2011-10-05abs ↗pdf ↗

Geometry of hypersurfaces defined by the relation which generalizes classical formula for free energy in terms of microstates is studied. Induced metric, Riemann curvature tensor, Gauss-Kronecker curvature and associated entropy are calculated. Special class of ideal statistical hypersurfaces is analyzed in details. No…

2016-02-25abs ↗pdf ↗

Geometric approach to thermodynamics of chemical reaction networks.

problem Thermodynamics of chemical reaction networks with non-ideal behavior.
method Information geometry, Riemannian geometry, Cramer-Rao bound, absolute sensitivity.
result Absolute sensitivity is a projection operator onto the tangent bundle of the equilibrium manifold.

In this work we present a technique to use natural language to help reinforcement learning generalize to unseen environments. This technique uses neural machine translation, specifically the use of encoder-decoder networks, to learn associations between natural language behavior descriptions and state-action informatio…

2017-07-26abs ↗pdf ↗

Photometric stereo is a method that seeks to reconstruct the normal vectors of an object from a set of images of the object illuminated under different light sources. While effective in some situations, classical photometric stereo relies on a diffuse surface model that cannot handle objects with complex reflectance pa…

2017-10-24abs ↗pdf ↗

Nearest Neighbors Algorithm is a Lazy Learning Algorithm, in which the algorithm tries to approximate the predictions with the help of similar existing vectors in the training dataset. The predictions made by the K-Nearest Neighbors algorithm is based on averaging the target values of the spatial neighbors. The selecti…

2018-11-13abs ↗pdf ↗

Study laws of cosines and sines for hyperbolic shapes with ideal vertices.

problem Formulating trigonometric laws for shapes with ideal vertices in hyperbolic geometry.
method Using hyperboloid model and Lorentzian geometry, establishing laws for quadrilaterals, pentagons, and partially truncated tetrahedra.
result Transversal lengths of partially truncated tetrahedra depend only on internal edge lengths at ideal vertices.

New method uses single quantum state for machine learning tasks, improving accuracy.

problem Challenges in unsupervised learning with quantum data.
method SIngle-Preparation Quantum Information Processing (SIPQIP) concept.
result Significantly more accurate estimation compared to traditional methods.

Classical convolutional neural networks (cCNNs) are very good at categorizing objects in images. But, unlike human vision which is relatively robust to noise in images, the performance of cCNNs declines quickly as image quality worsens. Here we propose to use recurrent connections within the convolutional layers to mak…

2018-11-21abs ↗pdf ↗

A new complexity measure MDL-COMP for overparameterized models improves generalization performance.

problem Complexity measures based on Rissanen's MDL principle are not well-suited for overparameterized models.
method Developed a novel MDL-based complexity (MDL-COMP) for overparameterized models, defined via an optimality criterion over Ridge estimators.
result MDL-COMP scales linearly with dd when d<nd<n, but exponentially smaller for d>nd>n; it upper bounds in-sample MSE.

Hardware architectures composed of resistive cross-point device arrays can provide significant power and speed benefits for deep neural network training workloads using stochastic gradient descent (SGD) and backpropagation (BP) algorithm. The training accuracy on this imminent analog hardware however strongly depends o…

2019-09-17abs ↗pdf ↗

Big data sets must be carefully partitioned into statistically similar data subsets that can be used as representative samples for big data analysis tasks. In this paper, we propose the random sample partition (RSP) data model to represent a big data set as a set of non-overlapping data subsets, called RSP data blocks,…

2017-12-12abs ↗pdf ↗

Prevents sensitive data generation in diffusion models using labeled and unlabeled data.

problem Generating sensitive data in diffusion models using unlabeled data.
method Positive-Unlabeled Diffusion Models, approximating ELBO with labeled and unlabeled data.
result Prevents the generation of sensitive data without compromising image quality.

Study reveals Data Shapley's inconsistent performance in data selection tasks.

problem Inconsistency of Data Shapley's performance in data selection across different settings.
method Hypothesis testing framework and identification of utility functions.
result Data Shapley's performance is no better than random selection without specific constraints.

PRRO generates synthetic tabular data that improves SL performance and class distribution.

problem Low SL utility of synthetic data due to class imbalance and overlooked data relationships.
method Data pruning and column reordering to optimize SL utility.
result Synthetic data generated with PRRO enhances predictive performance and class distribution.

Defines data science as a natural ecosystem with challenges and missions.

problem Challenges and missions in data science due to 5D complexities and data life cycle phases.
method Systemic and data-centric view of data science as a fusion of data universe and its challenges, formalizing a general-purpose architecture.
result Essential data science as a natural ecosystem integrating specific disciplines and high-impact applications.

Differential privacy allows quantifying privacy loss resulting from accessing sensitive personal data. Repeated accesses to underlying data incur increasing loss. Releasing data as privacy-preserving synthetic data would avoid this limitation, but would leave open the problem of designing what kind of synthetic data. W…

2019-12-10abs ↗pdf ↗

Paper creates fair synthetic data ensuring equal predictions across sensitive attributes.

problem Ensuring fair predictions across sensitive attributes in synthetic data.
method Equalizing target probability distributions across sensitive attributes in synthetic data generation.
result Synthetic data provides strong fair predictions, equal across all thresholds.

Efficient synthetic data generation improves model performance on tabular data.

problem Improving model robustness and performance with scarce or low-quality data.
method Hardness characterization to identify high-value training points, generating synthetic data only from these points.
result Synthetic data generated from hardest points outperforms non-targeted methods on tabular datasets.

For most problems in science and engineering we can obtain data sets that describe the observed system from various perspectives and record the behavior of its individual components. Heterogeneous data sets can be collectively mined by data fusion. Fusion can focus on a specific target relation and exploit directly ass…

2013-07-02abs ↗pdf ↗

DAERNN models censored data using neural networks with data augmentation.

problem Handling censored data in expectile regression.
method Data augmentation based Expectile Regression Neural Networks (ERNNs).
result DAERNN outperforms existing censored ERNNs methods and achieves comparable predictive performance to fully observed data.

Data preprocessing techniques are devoted to correct or alleviate errors in data. Discretization and feature selection are two of the most extended data preprocessing techniques. Although we can find many proposals for static Big Data preprocessing, there is little research devoted to the continuous Big Data problem. A…

2018-10-14abs ↗pdf ↗

Data stream classification methods demonstrate promising performance on a single data stream by exploring the cohesion in the data stream. However, multiple data streams that involve several correlated data streams are common in many practical scenarios, which can be viewed as multi-task data streams. Instead of handli…

2019-08-15abs ↗pdf ↗