Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,341 papers · 148 categories

Trend · papers per month

75151226301 · Jun 202019922001200920182026
48 results for costly measurements

DONE algorithm optimizes unknown functions with noisy measurements.

problem Online optimization of unknown functions with costly and noisy measurements.
method Uses a random Fourier expansion to maintain a surrogate function and iteratively update it with new measurements.
result DONE algorithm is significantly faster than Bayesian optimization while achieving similar or better performance.

Regulations impose idiosyncratic capital and funding costs for holding derivatives. Capital requirements are costly because derivatives desks are risky businesses; funding is costly in part because regulations increase the minimum funding tenor. Idiosyncratic costs mean no single measure makes derivatives martingales f…

2013-11-01abs ↗pdf ↗

Chameleon optimizes neural network compilation for faster execution and shorter time.

problem Faster execution and shorter compilation time for neural networks.
method Adaptive code optimization using reinforcement learning and adaptive sampling.
result 4.45x speed up in optimization time over AutoTVM, 5.6% improvement in inference time.

A method extracts binary features directly from CS measurements for compressive image classification.

problem Efficiently classify images using compressive sensing without reconstruction.
method DCT-based approach for binary feature extraction from CS measurements, feature fusion with CNN features.
result Fused features outperform state-of-the-art methods in image classification.

Active learning optimizes correlation clustering by querying the most informative pairwise comparisons.

problem Efficiently clustering data with limited pairwise similarity information.
method Developed principled active learning approach using information-theoretic acquisition functions.
result Significantly outperforms existing baselines in clustering accuracy and query efficiency.

Optimal sampling strategy improves prediction accuracy with surrogate variables under measurement constraints.

problem Measurement-constrained datasets and lack of labeled data.
method A-optimality criterion for optimal sampling, leveraging surrogate variables.
result Achieves lower asymptotic variance and reduced empirical mean squared error.

Develops a method to find costly high-confidence errors in black box models.

problem Finding rare high-confidence errors missed by random sampling.
method Adversarial perturbation-guided search technique to find errors at rates greater than expected given model confidence.
result Our Adversarial Distance search discovers high-confidence errors at a rate greater than expected given model confidence.

This paper develops efficient bounds on the Wasserstein metric for discrete measures.

problem Computing the exact Wasserstein metric is computationally expensive.
method Formulates and solves a Kantorovich problem on a coarse grid using quantized measures and cost matrices, followed by upscaling and correction.
result Achieves a 10x-100x speedup while maintaining low approximation error.

Measures policy-violating content prevalence with ML-assisted sampling and LLM labeling.

problem Accurate measurement of content violations that are often rare and costly to label.
method Design-based measurement system using ML-assisted probability sampling and LLM labeling.
result Produces unbiased prevalence estimates with confidence intervals and dashboard drilldowns.

Bayesian approach improves Shapley value estimation efficiency.

problem Efficiently estimating Shapley values in machine learning models.
method Bayesian experimental design using Gaussian process surrogate and adaptive coalition selection.
result Consistently improves sample efficiency in low-budget settings.

We present new algorithms to compute the mean of a set of empirical probability measures under the optimal transport metric. This mean, known as the Wasserstein barycenter, is the measure that minimizes the sum of its Wasserstein distances to each element in that set. We propose two original algorithms to compute Wasse…

2013-10-16abs ↗pdf ↗

IoT nodes compress measurements into DNN outputs for efficient communication.

problem Efficient communication of high-dimensional IoT data with limited bandwidth.
method Modeling IoT node measurements as DNN intermediate outputs and optimizing model parameters.
result Approximately 96% reduction in transmissions with only 2.5% loss in inference accuracy.

Bayesian Deep Learning tackles inverse problems with neural networks and approximate computations.

problem Solving inverse problems with indirect measurements and uncertainties.
method Bayesian Deep Learning, using neural networks and approximate computations.
result Effective solutions for inverse problems using Bayesian Deep Learning.

The new SMA for operational risk is criticized for not adequately measuring risk or linking management actions.

problem The new SMA for operational risk does not adequately measure risk or link management actions.
method The behavior of the SMA was studied under various conditions, showing its limitations.
result The SMA does not respond appropriately to changes in risk profile or differentiate among risk profiles.

Study proposes an active subsampling method for estimating individualized thresholds in high-dimensional data.

problem Estimating optimal individualized thresholds in high-dimensional data with limited labeled samples.
method Developed a K-step active subsampling algorithm to iteratively select and label the most informative data points.
result Revealed a phase transition phenomenon in the estimation of θθ with respect to the smoothness of the conditional density.

Simplified equation predicts model sensitivity to data.

problem Understanding model sensitivity to training data is challenging and costly.
method Derived using Bayesian principles, the Memory-Perturbation Equation (MPE) unifies and generalizes existing sensitivity measures.
result Empirical results show sensitivity estimates during training can predict generalization on unseen test data.

Bayesian optimization tackles mixed discrete-continuous problems with Gaussian processes.

problem Optimizing problems with both discrete and continuous variables using costly simulations.
method Relaxing discrete variables into continuous latent variables, using Bayesian optimization, and incorporating compatibility constraints with Lagrangians.
result Comparative analysis of different mixed Bayesian optimization approaches.

This work tackles costly feature acquisition for classification, using RL.

problem Classification with costly feature acquisition.
method Formulated as a sequential decision-making problem (MDP) and solved with deep reinforcement learning.
result Robust performance across various datasets and settings, outperforming prior-art.

Fair active learning selects data points to balance model accuracy and fairness.

problem Ensuring fairness in machine learning models used in high-stakes applications.
method Designing algorithms for fair active learning that select data points to balance model accuracy and fairness, focusing on demographic parity.
result Demonstrated the effectiveness of the proposed fair active learning approach over benchmark datasets.

Novel method reduces costly model evaluations in inference problems.

problem Efficiently approximating complex, costly model integrals.
method Compressed Monte Carlo (CMC) scheme for selecting model evaluations.
result Empirical evidence of method's performance in astronomy and remote sensing.

Improved classification with costly features using deep reinforcement learning.

problem Optimizing classification error with limited and costly feature acquisition.
method Revisited Q-learning approach with neural network approximation for sequential feature requests and classification decisions.
result Deep reinforcement learning approach comparable to state-of-the-art algorithms, robust across datasets.

We analyze a simple asset transfer model in which the transfer amount is a fixed fraction ff of the giver's wealth. The model is analyzed in a new way by Laplace transforming the master equation, solving it analytically and numerically for the steady-state distribution, and exploring the solutions for various values o…

2010-04-29abs ↗pdf ↗

Paper presents a method to accurately quantify neural network uncertainty without sampling.

problem Uncertainty quantification in neural networks for reliability and robustness.
method Sample-free moment propagation technique for mean vectors and covariance matrices.
result Analytic solution for covariance of nonlinear activation functions.

Survey of Monte Carlo methods for noisy, costly densities in reinforcement learning and ABC.

problem Dealing with intractable, costly, and noisy densities in real-world scenarios.
method Classification and description of Monte Carlo methodologies using surrogate models.
result Unified scheme and numerical comparisons of different methodologies.

Study optimizes data collection from biased, costly sources to minimize risk.

problem Estimating population means and group-conditional means from multiple sources with varying costs and biases.
method Develops a sampling plan that maximizes effective sample size, paired with a post-stratification estimator.
result Achieves budgeted minimax optimal risk for estimating population means and group-conditional means.

Optimal investment strategy with expert opinions in uncertain conditions.

problem Optimizing wealth in a model with unobservable drift and costly expert opinions.
method Embedding into a full information problem, using viscosity solutions and stochastic Perron's method.
result Constructing optimal trading and expert opinion strategies under sufficient regularity conditions.

LLMs help less-resourced researchers access costly data.

problem Unequal access to costly datasets limits research contributions.
method RAG framework with GPT-4o-mini for automated data collection.
result LLMs can collect CEO pay ratios and CAMs from corporate disclosures with high accuracy and low cost.

Optimizes optimal transport distances using low-dimensional embeddings.

problem High computational cost of optimal transport distances in high dimensions.
method Approximate OT distances using 1-Lipschitz maps in a lower-dimensional space.
result Efficiently approximates optimal transport distances with lower computational cost.