A method estimates causal parameters using a latent variable recovery.
problem Estimating causal parameters in contexts with multiple causes and unobserved confounding.
method Substitute adjustment via recovery of latent variables.
result Substitute adjustment estimates adjusted regression parameters under certain conditions.
We consider the bridge linear regression modeling, which can produce a sparse or non-sparse model. A crucial point in the model building process is the selection of adjusted parameters including a regularization parameter and a tuning parameter in bridge regression models. The choice of the adjusted parameters can be v…
Paper introduces a new robust loss function for RL.
problem Heuristic selection of threshold parameters in quantile Huber loss.
method Derived from Wasserstein distance, captures noise in quantile values.
result Enhances robustness against outliers and enables parameter adjustment.
Learning models of artificial intelligence can nowadays perform very well on a large variety of tasks. However, in practice different task environments are best handled by different learning models, rather than a single, universal, approach. Most non-trivial models thus require the adjustment of several to many learnin…
New algorithms improve community detection and parameter estimation for PABM.
problem Improving community detection and parameter estimation for PABM.
method Connecting PABM to GRDPG, constructing new algorithms, and deriving asymptotic properties.
result Absolute number of community detection errors tends to zero as graph vertices increase.
New method corrects selection bias in post-selective inference for Group LASSO.
problem Inference after Group LASSO selection is unreliable.
method Develops a consistent, post-selective Bayesian method to adjust for selection bias.
result Corrects bias in recovering effects of selected variables.
New method averages SGD iterates to achieve adjustable regularization.
problem Overfitting in machine learning models.
method Averaging SGD iterates for regularized solutions.
result Obtain regularized solutions without tuning parameters.
We describe a method for constructing Teichmüller geodesics where the vertical measured foliation ν is minimal but is not uniquely ergodic and where we have a good understanding of the behavior of the Teichmüller geodesic. The construction depends on various parameters, and we show that one can adjust the parameters …
The method of covariate adjustment is often used for estimation of population average treatment effects in observational studies. Graphical rules for determining all valid covariate adjustment sets from an assumed causal graphical model are well known. Restricting attention to causal linear models, a recent article der…
Simulation is a useful tool in situations where training data for machine learning models is costly to annotate or even hard to acquire. In this work, we propose a reinforcement learning-based method for automatically adjusting the parameters of any (non-differentiable) simulator, thereby controlling the distribution o…
Paper introduces Market-adaptive Ratio for better portfolio management.
problem Traditional risk-adjusted ratios fail to account for bull and bear markets.
method Integrates ρ parameter and uses reinforcement learning to adjust portfolio allocations dynamically. result Market-adaptive Ratio outperforms traditional ratios in bull and bear markets.
New method samples Jeffreys prior for objective Bayesian inference.
problem Sampling from Jeffreys prior is challenging.
method Metropolis-Adjusted Langevin Algorithm
result Samples can be directly used in Bayesian methods.
New methods for calculating credit valuation adjustment with reduced noise and faster computation.
problem High statistical noise in computing sensitivities of CVA due to non-differentiable default intensities.
method Ad hoc analytical estimators to overcome non-differentiability and finite differences.
result Low statistical noise and fast computation of sensitivities to market quotes.
When the in-sample Sharpe ratio is obtained by optimizing over a k-dimensional parameter space, it is a biased estimator for what can be expected on unseen data (out-of-sample). We derive (1) an unbiased estimator adjusting for both sources of bias: noise fit and estimation error. We then show (2) how to use the adjust…
Paper uses bond pricing and convexity adjustments to explain herd immunity paradox.
problem Early onset of herd immunity contradicts R value estimates from early stage growth.
method Utilizes Vasicek's bond pricing formula and de Finetti's Theorem approach.
result Reduces modeling discrepancy to simple convexity formulas.
Randomized methods of neural network learning suffer from a problem with the generation of random parameters as they are difficult to set optimally to obtain a good projection space. The standard method draws the parameters from a fixed interval which is independent of the data scope and activation function type. This …
This paper examines biases in foundation models under long-tailed data and proposes a method to mitigate parameter imbalance.
problem The bias introduced by imbalanced training data in foundation models affects long-tailed downstream tasks.
method The paper examines parameter imbalance and data imbalance, proposing a backdoor adjustment method to mitigate parameter imbalance.
result An average performance increase of about 1.67% on each dataset.
Study improves MACD trading strategy with volume and price adjustments.
problem Signal lag and false signals in traditional MACD trading rules.
method Develops VP-MACD framework with sensitivity calibration.
result Proposed framework outperforms baseline MACD in profitability and risk-adjusted return.
A new decentralized Bayesian learning method using Metropolis-adjusted Hamiltonian Monte Carlo.
problem Decentralized Bayesian learning with uncertainty quantification.
method Metropolis-adjusted Hamiltonian Monte Carlo in a decentralized federated learning setting.
result Theoretical guarantees and numerical effectiveness of the method on non-convex problems.
Analysis of momentum methods on quadratic models, showing SGD's superiority.
problem Analysis of stochastic gradient algorithms with momentum on quadratic models.
method Inspired by random matrix theory, exact characterization of loss values.
result Stochastic heavy-ball momentum does not improve over SGD in the strongly convex setting.
New inequalities for convex curves with multiple geometric factors.
problem Establishing inequalities for convex curves with multiple geometric factors.
method Parametric isoperimetric-type inequalities for closed convex curves with parameter conditions and equality conditions.
result Derived new inequalities and improved versions of existing inequalities.
We derive variance-optimal hedging strategies for SABR and rough Bergomi models.
problem Finding efficient hedging strategies in lognormal SABR and rough Bergomi models.
method Analytic expressions for variance-optimal hedging strategies and mean-square hedging errors.
result The variance-optimal hedging strategy in SABR coincides with Delta adjustment.
In this paper, we perform registration of noisy curves. We provide an appropriate model in estimating the rotation and scaling parameters to adjust a set of curves through a M-estimation procedure. We prove the consistency and the asymptotic normality of our estimators. Numerical simulation and a real life aeronautic e…
We propose the point process model as the Poissonian-like stochastic sequence with slowly diffusing mean rate and adjust the parameters of the model to the empirical data of trading activity for 26 stocks traded on NYSE. The proposed scaled stochastic differential equation provides the universal description of the trad…
Auto.gov uses RL to automate DeFi governance, improving security and profitability.
problem Manual DeFi governance is prone to human bias and financial risks.
method Auto.gov employs a deep Q-network reinforcement learning strategy for semi-automated parameter adjustments. result Auto.gov outperforms traditional governance methods by at least 14% in terms of protocol profitability. Automatically adjusts model size for continual Gaussian processes.
problem Determining optimal model size for incremental data.
method Automatic adjustment of model size during continual learning.
result Near-optimal performance across various datasets without hyperparameter tuning.
Improved particle filters for estimating model parameters using differentiable resampling.
problem Inability to differentiate sampling and resampling steps in particle filters.
method Extended reparameterisation trick to include stochastic input, enabling differentiation. Used p-MCMC and NUTS for parameter estimation.
result NUTS improves mixing of Markov chain and produces more accurate results in less time.
Develops a new flexible grid trading model using ANN and SSO.
problem Improving automated trading strategies in financial markets.
method Combines SSO algorithm with ANN for optimizing trading parameters.
result Provides a robust and efficient trading model with better returns.
We consider an optimal stochastic impulse control problem over an infinite time horizon motivated by a model of irreversible investment choices with fixed adjustment costs. By employing techniques of viscosity solutions and relying on semiconvexity arguments, we prove that the value function is a classical solution to …
SORSCNs improve nonstationary data modeling by self-organizing and adjusting network parameters.
problem Nonstationary data challenges traditional models in continuous learning.
method SORSCNs autonomously adjust network parameters and structure in real-time using adaptive algorithms.
result SORSCNs outperform other models in generalizing to nonstationary data.
Bayesian PROCOVA uses AI to adjust for covariates in RCTs.
problem Unbiased and precise treatment effect inferences from RCTs.
method Generative AI constructs digital twins for covariate adjustment, using an additive mixture prior.
result Efficiency gains in smaller RCTs compared to frequentist methods.
Model clarifies network effects on CVA, revealing significant differences in derivative contract values.
problem Network effects on CVA in financial contracts.
method Developed a model to analyze default probabilities in a network of contracts.
result Network effects can significantly alter CVA values, leading to multi-modal distributions.
An adaptive clustering algorithm learns from evolving data without manual tuning.
problem Clustering in dynamic data environments where distributions change over time.
method ART-based topological clustering with self-adjusting vigilance parameter.
result The algorithm outperforms state-of-the-art methods in clustering performance and continual learning.
This paper proposes a Lasso-type estimator for a high-dimensional sparse parameter identified by a single index conditional moment restriction (CMR). In addition to this parameter, the moment function can also depend on a nuisance function, such as the propensity score or the conditional choice probability, which we es…
Estimates proxy-based inference adjustments for distribution shifts.
problem Imperfect proxy data leads to biased inference.
method Empirical calibration of proxy-primary metric discrepancy as a random effect.
result Empowers inference without individual-level response data.
Stochastic Gradient TreeBoost is often found in many winning solutions in public data science challenges. Unfortunately, the best performance requires extensive parameter tuning and can be prone to overfitting. We propose PaloBoost, a Stochastic Gradient TreeBoost model that uses novel regularization techniques to guar…
Constrained optimization of high-dimensional numerical problems plays an important role in many scientific and industrial applications. Function evaluations in many industrial applications are severely limited and no analytical information about objective function and constraint functions is available. For such expensi…
In order to quantize the gate parameters of the LSTM (Long Short-Term Memory) neural network model with almost no recognition performance degraded, a new quantization method named Quantization Loss Re-Learn Method is proposed in this paper. The method does lossy quantization on gate parameters during training iteration…
A new method estimates protein evolutionary fields and couplings from alignments.
problem Estimating evolutionary fields and couplings from protein sequence alignments.
method Boltzmann machine with parallel, persistent Markov chain Monte Carlo method.
result Improved precision in predicting contact residue pairs.
Alpha-trimming prunes trees in random forests to improve predictive performance.
problem Improving predictive performance of random forests by locally adaptive tree pruning.
method Alpha-trimming is a fast pruning algorithm that prunes trees in a random forest based on signal-to-noise ratio, controlled by a tuning parameter.
result Alpha-trimming often lowers mean squared prediction error compared to fully grown random forests.
The study uses pre-trained neural networks to adjust for confounding in non-tabular data.
problem Neglecting non-tabular data sources can lead to biased ATE estimates.
method Leverages latent features from pre-trained neural networks to adjust for confounding.
result Neural networks can achieve fast convergence rates for ATE estimation with latent features.
Model analyzes cooccurrence data for recommender systems and item relevance.
problem High-dimensional cooccurrence data from online platforms.
method Shared parameter Alternating Tweedie (SA-Tweedie) model with Fisher scoring and learning rate adjustment.
result SA-Tweedie model outperforms other methods in optimizing parameters.
Much recent research has been conducted in the area of Bayesian learning, particularly with regard to the optimization of hyper-parameters via Gaussian process regression. The methodologies rely chiefly on the method of maximizing the expected improvement of a score function with respect to adjustments in the hyper-par…
We show how any dataset of any modality (time-series, images, sound...) can be approximated by a well-behaved (continuous, differentiable...) scalar function with a single real-valued parameter. Building upon elementary concepts from chaos theory, we adopt a pedagogical approach demonstrating how to adjust this paramet…
GeLoRA optimizes LoRA fine-tuning by dynamically adjusting ranks based on intrinsic dimensionality.
problem Efficient fine-tuning of large language models with limited computational resources.
method GeLoRA computes intrinsic dimensionality to adaptively select LoRA ranks, balancing expressivity and efficiency.
result GeLoRA consistently outperforms recent baselines within the same parameter budget on multiple tasks.
PIED optimizes experimental design for inverse problems using physics-informed neural networks.
problem Optimizing experimental design for inverse problems with limited budget and constraints.
method PIED uses physics-informed neural networks (PINNs) for continuous optimization of design parameters in one-shot deployments.
result PIED significantly outperforms existing ED methods in solving inverse problems, including unknown functions.
NROWAN-DQN improves stability and exploration in noisy networks.
problem Noisy networks struggle with stable exploration in complex tasks.
method Noise reduction and online weight adjustment for stable actions.
result NROWAN-DQN outperforms prior algorithms in stability and exploration.
This paper improves neural network approximation for analytic functions with adjustable depth and width.
problem Approximating analytic functions using neural networks with depth and width parameters.
method Characterizes approximation rates as a joint function of width (N) and depth (L) for ReLU networks.
result Establishes upper bounds for analytic function approximation rates of O(N^(-CL^τ)) with τ influenced by N and L.