Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

2855708551,140 · Jun 202019922001200920182026
48 results for data provenance

Tribuo integrates ML models with provenance in Java.

problem Tracking and ensuring ML models behave appropriately as they grow in number and complexity.
method Integrates model training, inference, type-safety, runtime checking, and automatic provenance recording into a single Java library.
result Automatic recording of full processing pipeline and training details inside the model object.

PrIU optimizes machine learning model updates after data cleaning.

problem Incrementally updating machine learning models after removing problematic training samples.
method Provenance-based approach for efficient model parameter updates.
result PrIU-opt achieves up to two orders of magnitude speed-up compared to retraining from scratch.

Develops a technique to audit text-generation models trained on personal data.

problem Enforce data-protection regulations like GDPR and detect unauthorized data usage.
method Black-box auditing method that queries a model to detect if a user's data was used for training.
result Successfully audits well-generalized models without overfitting to training data.

It is proven that a local Lie algebra in the sense of A. A. Kirillov determines the base manifold up to a diffeomorphism provided the anchor map is nowhere-vanishing. In particular, the Lie algebras of nowhere-vanishing Poisson or Jacobi brackets determine manifolds. This result has been proven for different types of d…

2005-06-28abs ↗pdf ↗

Exploratory data analysis is crucial for developing and understanding classification models from high-dimensional datasets. We explore the utility of a new unsupervised tree ensemble called uncharted forest for visualizing class associations, sample-sample associations, class heterogeneity, and uninformative classes fo…

2018-02-11abs ↗pdf ↗

Multiple conventions have been adopted for denoting Interval Exchange Transformations (IETs). The "non-labeled" convention was the original, while the "labeled" convention has proven convenient when investigating Flat Surfaces as described by IETs. We establish the relationship between Extended Rauzy Classes, an equiva…

2014-08-03abs ↗pdf ↗

The positive energy theorem is proven for certain spacetimes with irregular curvature.

problem Proving the positive energy theorem for spacetimes with irregular curvature.
method Weak asymptotically anti-de Sitter initial data sets with distributional curvature under weak dominant energy condition.
result Positive energy theorem established for weakly irregular spacetimes.

We discuss several uses of blockchain (and, more generally, distributed ledger) technologies outside of cryptocurrencies with a pragmatic view. We mostly focus on three areas: the role of coin economies for what we refer to as data malls (specialized data marketplaces); data provenance (a historical record of data and …

2018-02-21abs ↗pdf ↗

PROVEN extends neural network robustness verification to probabilistic settings.

problem Quantifying robustness of neural networks under probabilistic noise distributions.
method PROVEN: Probabilistic Verification of Neural Networks (PROVEN) with statistical guarantees.
result PROVEN achieves up to 75% improvement in robustness certification compared to worst-case methods.

Kyle's equilibrium model stability proven for 1-2 trading times, but not for 3 or more.

problem Stability of Kyle's equilibrium model in a dynamic trading setting.
method Proof of stability for 1-2 trading times, non-stability for 3 or more trading times, independent of input parameters.
result Kyle's equilibrium model is stable for 1-2 trading times but not for 3 or more trading times.

Mini-Hes improves LFA model performance on HDI tasks with missing data.

problem Effective representation of high-dimensional, incomplete data for user behavior understanding.
method Proposes Mini-Hes, a parallelizable second-order LFA model using mini-block diagonal Hessian-free optimization.
result Mini-Hes outperforms state-of-the-art models in missing data estimation tasks on recommender system datasets.

Closed hyperbolic manifolds are proven to minimize volume over all Alexandrov spaces with curvature bounded below by -1 in the same bilipschitz class. As a corollary compact convex cores with totally geodesic boundary are proven to minimize volume over all hyperbolic manifolds in the same bilipschitz class. Also, close…

2001-12-11abs ↗pdf ↗

BigNN classifier improves nearest neighbor classification for large datasets.

problem Classification of large datasets that cannot fit into a single machine's memory.
method Divide and conquer scheme with majority voting for final decision; pre-training acceleration technique.
result Rates of convergence for bigNN classifier under minimal assumptions, proving it as optimal.

Unsupervised classification methods learn a discriminative classifier from unlabeled data, which has been proven to be an effective way of simultaneously clustering the data and training a classifier from the data. Various unsupervised classification methods obtain appealing results by the classifiers learned in an uns…

2012-10-02abs ↗pdf ↗

We develop the Ercolani-Sinha construction of SU(2) monopoles and make this effective for (a five parameter family of centred) charge 3 monopoles. In particular we show how to solve the transcendental constraints arising on the spectral curve. For a class of symmetric curves the transcendental constraints become a numb…

2006-01-20abs ↗pdf ↗

We present a general sufficient condition for the formation of black holes due to concentration of angular momentum. This is expressed in the form of a universal inequality, relating the size and angular momentum of bodies, and is proven in the context of axisymmetric initial data sets for the Einstein equations which …

2015-03-20abs ↗pdf ↗

Combines Fourier methods and RNNs for efficient time series prediction.

problem Efficiently processing and predicting time series data with memory and computational constraints.
method Uses short-time Fourier transform and weight reductions through low pass filtering in a Spectral RNN.
result Predicts time series data from chaotic systems and real-world data.

The stable Khovanov-Rozansky homology of torus knots has been conjecturally described as the Koszul homology of an explicit non-regular sequence of polynomials. We verify this conjecture against newly available computational data for sl(3)-homology. Special attention is paid to torsion. In addition, explicit conjectura…

2014-04-02abs ↗pdf ↗

We show how binary classification methods developed to work on i.i.d. data can be used for solving statistical problems that are seemingly unrelated to classification and concern highly-dependent time series. Specifically, the problems of time-series clustering, homogeneity testing and the three-sample problem are addr…

2012-10-22abs ↗pdf ↗

Stochastic gradient MCMC (SG-MCMC) algorithms have proven useful in scaling Bayesian inference to large datasets under an assumption of i.i.d data. We instead develop an SG-MCMC algorithm to learn the parameters of hidden Markov models (HMMs) for time-dependent data. There are two challenges to applying SG-MCMC in this…

2017-06-14abs ↗pdf ↗

SVRN accelerates Newton methods by reducing variance and improving performance.

problem Improving the efficiency of Newton methods for large-scale optimization problems.
method Stochastic Variance-Reduced Newton (SVRN) algorithm that accelerates Subsampled Newton and Iterative Hessian Sketch algorithms.
result SVRN accelerates Newton methods by reducing the number of passes over the data, achieving a significant improvement in performance.

Establishes a Penrose-type inequality for axisymmetric initial data with angular momentum and charge.

problem Establishing a Penrose-type inequality for axisymmetric initial data with angular momentum and charge.
method Maximal, axisymmetric initial data for the Einstein-Maxwell equations satisfying the weak energy condition. Rigidity statement proven.
result Reduces to the conjectured Penrose inequality with angular momentum and charge under certain conditions.

Study on random knot diagrams and their probability of forming specific knots.

problem Understanding the probability of forming specific knots from random knot diagrams.
method Analyzing free knot diagrams without over/under information and proving trefoil formation; making conjectures about unknot and trefoil probabilities.
result Every free knot diagram produces trefoil knots, and certain families of diagrams are completely worked out.

Researchers solved a model of an exhaustible resource with stochastic discoveries.

problem Optimal exploration of an exhaustible resource with uncertain discoveries.
method Impulse control and Poisson process of new discoveries.
result A frontier of critical levels of proven reserves exists, above which exploration is stopped.