Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

2655307951,060 · Jun 202019922001200920172026
48 results for Data-Driven Algorithm Design

This work improves algorithm design for structured Pfaffian settings.

problem Designing algorithms for specific application domains with theoretical guarantees.
method Data-driven algorithm design using hyperparameter tuning and learning guarantees.
result Introduced the Pfaffian GJ framework for providing learning guarantees for Pfaffian function classes.

Paper proposes a hybrid model-based and data-driven approach for one-bit compressive autoencoding.

problem Designing efficient one-bit compressive autoencoding models for complex systems.
method Hybrid model-based and data-driven methodology for one-bit sparse signal recovery.
result Significant improvement in one-bit compressive autoencoding compared to state-of-the-art algorithms.

Paper proposes a hybrid model-based and data-driven method for one-bit compressive variational autoencoding.

problem Designing efficient one-bit compressive sensing systems.
method Hybrid model-based and data-driven approach for one-bit compressive variational autoencoding.
result Significant improvement in one-bit compressive sensing compared to state-of-the-art methods.

The goal of data-driven algorithm design is to obtain high-performing algorithms for specific application domains using machine learning and data. Across many fields in AI, science, and engineering, practitioners will often fix a family of parameterized algorithms and then optimize those parameters to obtain good perfo…

2019-04-18abs ↗pdf ↗

Data-driven method for error estimation without needing class complexity.

problem Constructing confidence intervals for a class of estimates.
method Data-driven approach to derive high-probability upper bounds on maximum error.
result Method naturally adapts to unknown correlation structures and works for finite and infinite classes.

METASET selects diverse unit cells for efficient data-driven metamaterial design.

problem Imbalanced datasets in unit cells can bias data-driven metamaterial design.
method METASET uses similarity metrics and DPPs to select diverse subsets of unit cells.
result Smaller, diverse subsets improve search process and structural performance.

Data-driven symbol detection improves performance in complex channels.

problem Designing robust symbol detectors in systems with poorly understood channels.
method Hybrid approach combining model-based algorithms with machine learning.
result Near-optimal performance of model-based algorithms achieved without channel model knowledge.

Data-driven method for option pricing using historical asset prices.

problem Tackling the gap between historical asset prices and risk-neutral option pricing.
method Identifying a pricing kernel process, solving utility maximization and functional optimization problems using deep learning.
result Demonstrated the efficiency of the data-driven option pricing methodology.

End-to-end algorithm for controlling bilinear systems with probabilistic noise.

problem Controlling bilinear systems with noisy data.
method Proposes an end-to-end algorithm using statistical learning theory and robust controller design.
result Derived finite sample identification error bounds and structurally suitable for control.

This research designs a data-driven partition to test independence between continuous variables.

problem Testing independence between continuous random variables.
method Empirical log-likelihood statistic and data-driven tree-structured partition.
result Strongly consistent test of independence over probability families.

Study identifies and analyzes spurious correlations in data-driven models.

problem Spurious correlations in data-driven models are unreliable and hard to detect.
method Collect and analyze synthetic datasets generated from causal graphs to investigate spurious correlations.
result Patterns connecting spurious correlation hypotheses and model design choices were observed.

Optimizes data-driven design problems on implicit manifolds using score functions.

problem Optimizing over implicit low-dimensional manifolds in high-dimensional data.
method Introduces a link function connecting data distribution to manifold operations, enabling efficient optimization.
result Establishes theoretical guarantees for feasibility and optimality of proposed algorithms.

New framework for data-driven hyperparameter tuning with structured loss.

problem Statistical foundations for multi-dimensional hyperparameter tuning remain limited.
method General framework using real algebraic geometry for semi-algebraic function classes.
result First general guarantees for multi-dimensional hyperparameter tuning.

A neural network and evolutionary algorithm framework designs nonlinear optical molecules.

problem Designing efficient nonlinear optical materials.
method Multi-stage Bayesian neural network (msBNN) and corrected Lewis-mode group contribution method (cLGC) combined with evolutionary algorithm (EA).
result Accurately and efficiently designs molecules with different optical properties using a small data set.

Paper proposes a new method for designing materials using deep learning.

problem Designing high-performance material distributions from given distributions.
method Iterative process of selecting, generating, and merging material distributions using a deep generative model.
result The method improves material performance through iterative refinement.

Develops a data-driven fault diagnosis framework for time-series data.

problem Fault diagnosis of dynamic systems using imbalanced and unknown fault classes.
method Kullback-Leibler divergence, data-driven fault classification, open-set classification.
result Framework handles imbalanced datasets, class overlapping, and unknown faults.

Study uses machine learning to optimize seismic design parameters.

problem Optimizing seismic design parameters for performance-based design.
method Implementing explainable machine learning models to map design variables and performance metrics, integrated into a genetic optimization algorithm.
result Highly accurate surrogate models (R2> 90%) across diverse building types and hazards, identifying optimal member properties.

A data-driven approach predicts morphological development under structural instability.

problem Understanding and predicting spatiotemporal complexities of morphogenesis under structural instability.
method Machine-learning framework based on physical modeling of morphogenesis.
result Identification of key bifurcation characteristics and prediction of history-dependent development.

Optimal data-driven formulations are found for learning and decision-making with historical data.

problem Designing optimal learning and decision-making formulations from historical data.
method Define a yardstick for measuring formulation quality, then construct an optimal formulation that is uniformly closer to the true cost.
result Existence of three distinct out-of-sample performance regimes with corresponding optimal formulations.

Develops scenario theory for multi-criteria decision making.

problem Need for robustness assessment with multiple criteria and datasets.
method Collectively treats risks associated with individual criteria for multi-criteria decision problems.
result More accurate robustness certificates and sharper quantification of simultaneous criterion satisfaction.

This paper designs sensor arrays for estimating unsteady flows efficiently.

problem Estimating high-dimensional unsteady flow fields with limited sensor placement.
method Combines data-driven modeling, Kalman Filter design, and sparsification for sensor selection.
result Proposed sensor arrays are highly effective for flow-field estimation across various conditions.

Enhances scenario approach for certifying design properties post-design.

problem Certifying additional useful properties in designs not considered during the design phase.
method Two-level framework of appropriateness: baseline and post-design. Distribution-free upper bounds on risk derived.
result Distribution-free upper bounds on the risk of failing to meet post-design appropriateness.

Paper examines vulnerabilities in data-driven pricing schemes.

problem Vulnerability of clustering-oriented pricing schemes to malicious user behavior.
method Defined a notion of disguising to identify strategic behaviors of malicious users, characterized sensitivity zones to evaluate malicious user percentages, conducted cost benefit analysis.
result Concluded with a vulnerability analysis of data-driven pricing schemes.

Paper tackles causal effect estimation in observational data with hidden variables.

problem Estimating causal effects in observational data with hidden confounders.
method Developed a theorem for local search to find superset of adjustment variables, proposing a data-driven algorithm.
result Proposed algorithm produces more accurate causal effect estimates than existing methods.

Optimizes natural frequencies of cellular composites with various microstructures.

problem Designing cellular composites with diverse microstructures for maximizing natural frequencies.
method Data-driven topology optimization with a latent-variable Gaussian process model.
result Cellular designs with multiclass microstructures achieve higher natural frequencies.

Designs a robust data-driven decision-making model to handle multiple overfitting sources.

problem Overfitting in data-driven models due to statistical error, data noise, and data misspecification.
method Holistic distributionally robust optimization formulation combining Kullback-Leibler and Lévy-Prokhorov approaches.
result Guaranteed holistic protection against statistical error, data noise, and data misspecification.

This work analyzes machine learning for Lagrangian Relaxation in MILP.

problem Improving efficiency in solving large-scale MILP problems.
method Data-driven Algorithm Design approach to learn Lagrangian multipliers.
result Stochastic Gradient Ascent achieves the minimax optimal rate for learning multipliers.

Meta-learning improved by using information theory to prioritize data-driven adaptation.

problem Challenges in meta-learning due to the need for mutually-exclusive tasks.
method Designing a meta-regularization objective using information theory.
result Successfully uses data from non-mutually-exclusive tasks to efficiently adapt to novel tasks.

Enhances topology optimization with multiclass microstructures using latent variable Gaussian process.

problem Lack of an inherent ordering or distance measure between different classes of microstructures.
method Extended latent-variable Gaussian process (LVGP) models to multi-response LVGP (MR-LVGP) models for metamaterials.
result Improved performance through consistent load-transfer paths for micro- and macro-structures.

Study compares data-driven vs model-based MRS quantification strategies, focusing on resilience to out-of-distribution effects.

problem Resilience to out-of-distribution effects in data-driven MRS quantification.
method Compared three data-driven strategies (supervised regression, self-supervised learning, test-time adaptation) against model-based fitting tools.
result Test-time adaptation proved most resilient to out-of-distribution effects, while self-supervised learning achieved intermediate performance.

Adaptive BO improves solder joint reliability by 3% with half the computational cost.

problem Improving solder joint reliability under thermomechanical loading.
method Adaptive Bayesian optimization with Gaussian process regression.
result Adaptive BO outperforms regular BO by 3% on average at any given computational budget.

Dataset of 4500 bicycle designs aids in design analysis and synthesis.

problem Identify gaps in bicycle market and design space, classify bicycles, synthesize new designs.
method Processed dataset, unsupervised dimensionality reduction, supervised classification, machine learning synthesis.
result Identified design parameters and factors influencing bicycle classification.

Optimizes hydrokinetic turbine design using morphing and Bayesian optimization.

problem Designing optimal hydrokinetic turbine shapes due to high cost and geometric constraints.
method Design-by-Morphing (DbM) and Mixed variable, Multi-Objective Bayesian Optimization (MixMOBO).
result Optimized shapes lead to maximum power output with minimal evaluations.

Crowdsourcing is an effective tool for human-powered computation on many tasks challenging for computers. In this paper, we provide finite-sample exponential bounds on the error rate (in probability and in expectation) of hyperplane binary labeling rules under the Dawid-Skene crowdsourcing model. The bounds can be appl…

2013-07-10abs ↗pdf ↗

The paper introduces tools for designing responsible scoring mechanisms using unbiased function sampling.

problem Ensuring fairness and responsibility in scoring mechanisms used by data-driven systems.
method Unbiased function sampling and perturbation in the function space for designing responsible scoring mechanisms.
result A novel algorithm for approximating the construction of hyperplane arrangements, which is linear in the number of samples and hyperplanes.