This work tackles online memory selection in continual learning using information theory.
problem Online selection of a representative replay memory from data streams.
method Information-theoretic criteria (surprise, learnability) and Bayesian model for efficient computation.
result InfoRS improves robustness against data imbalance compared to reservoir sampling.
Continuous selections for optimal portfolios under convex risk measures fail in finite-dimensional settings.
problem Finding optimal financial positions with continuous selections under convex risk measures.
method Analyzing set-valued maps in finite-dimensional settings with convex risk measures.
result Continuous selections do not always exist for optimal portfolios under convex risk measures.
Survey of automated algorithm selection for various problems.
problem Selecting the best algorithm for each problem instance.
method Exploiting performance complementarity among algorithms.
result Major improvements in solving discrete combinatorial problems.
This work improves continual learning by selecting diverse samples for replay buffers.
problem Overcoming catastrophic forgetting in online continual learning.
method Formulates sample selection as a constraint reduction problem and uses gradient-based diversity maximization.
result Demonstrates improved performance compared to existing methods that rely on task boundaries.
Optimal contracts remain linear in output when both moral hazard and adverse selection are present.
problem Optimal compensation problems involving competing principals with uncertainty from both moral hazard and adverse selection.
method Continuous-time setting with risk-averse agent controlling drift of output process driven by Brownian motion. Shows linear contracts hold under type-dependent reservation utilities.
result Optimal contracts remain linear in output when both moral hazard and adverse selection are present.
RL approach to continuous-time MV portfolio selection with optimal policy being Gaussian.
problem Achieving optimal tradeoff between exploration and exploitation in continuous-time MV portfolio selection.
method Entropy-regularized, relaxed stochastic control problem; policy improvement theorem; RL algorithm.
result RL algorithm outperforms adaptive control and deep neural networks methods.
RL approach for continuous-time mean-variance portfolio selection with empirical validation.
problem Continuous-time mean-variance portfolio selection in unknown market coefficients.
method Reinforcement learning for diffusion processes, sublinear regret bound derivation.
result RL strategy consistently outperforms model-based counterparts, especially in volatile markets.
This survey covers in our opinion the most important results in the theory of continuous selections of multivalued mappings (approximately) from 2002 through 2012. It extends and continues our previous such survey which appeared in Recent Progress in General Topology, II, which was published in 2002. In comparison, our…
PEAKS selects key training examples incrementally based on prediction error and kernel similarity.
problem Dynamic data selection in deep learning models.
method Prediction Error Anchored by Kernel Similarity (PEAKS) for incremental data selection.
result PEAKS outperforms existing selection strategies and yields better performance returns as training data size grows.
Modyn automates continuous ML model training on growing datasets.
problem Continuous model retraining is costly and impractical.
method Data-centric ML platform with policies for continuous training.
result Modyn enables high throughput training with sample-level data selection.
The paper is devoted to generalization of well-known Michael's Selection theorem on the case of extension dimension.
Automated model selects best algorithm for continuous problems efficiently.
problem Optimizing continuous black-box problems with limited resources.
method Combining ELA features with machine learning for algorithm selection.
result Average resource requirement is less than half compared to best single solver.
Paper proves method for calculating NML code length works for continuous models.
problem Uncertainty in calculating NML code length for continuous models.
method Introduced a novel decomposition approach based on the coarea formula to prove correctness for continuous cases.
result Method accurately calculates NML code length for continuous models.
Stock selection improved with a novel neural model capturing continuous stock dynamics.
problem Lack of continuous stock dynamics prediction and implicit cross-domain dependencies.
method StockODE, a latent variable model with NRODEs and hierarchical hypergraph for continuous stock volatility and inter-domain dependencies.
result Significantly outperforms baselines, improving Sharpe Ratio by up to 18.57%.
Decomposes smooth manifolds into algebraic submanifolds.
problem Understanding the structure of smooth manifolds induced by continuous selections.
method Generic continuous selection of smooth functions provides stratification of the manifold.
result Stratification leads to local topological structure with nondegenerate critical points.
Develops a more powerful selective inference method for stepwise feature selection.
problem Loss of power in existing conditional SI methods due to over-conditioning.
method Uses homotopy continuation approach to overcome over-conditioning.
result Shows improved power and efficiency in selective inference for feature selection.
A new method optimises problems with both continuous and categorical inputs.
problem Optimising black-box problems with mixed continuous and categorical inputs.
method Continuous and Categorical Bayesian Optimisation (CoCaBO) combining multi-armed bandits and Bayesian optimisation.
result CoCaBO outperforms existing methods on synthetic and real-world tasks.
MaNet uses DL for feature selection to solve optimization problems.
problem Optimization problems with millions of parameters.
method Deep learning model with feature selection for continuous optimization.
result MaNet yields competitive results compared to hand-designed algorithms.
Naive investors make riskier choices than optimal strategies in continuous-time finance.
problem Continuous-time Markowitz portfolio selection with naive reoptimization.
method Analytical derivation of naive policies from discretely naive policies.
result Naive policies are always riskier and less efficient than equilibrium policies.
Novel optimization method detects change points in Gaussian data.
problem Detecting change points in univariate Gaussian data sequences.
method Continuous optimization for best subset selection (COMBSS) applied to a reformulated statistical inverse problem.
result Adaptation and evaluation of COMBSS for offline normal mean multiple change-point detection.
Proves FR-NGD optimally approximates evolutionary dynamics and continuous Bayesian inference.
problem Optimizing continuous time replicator equations and continuous Bayesian inference.
method Fisher-Rao natural gradient descent (FR-NGD) and its correspondence with evolutionary dynamics.
result FR-NGD optimally approximates continuous time replicator equations and continuous Bayesian inference.
This thesis studies two problems in modern statistics. First, we study selective inference, or inference for hypothesis that are chosen after looking at the data. The motiving application is inference for regression coefficients selected by the lasso. We present the Condition-on-Selection method that allows for valid s…
Method estimates treatment effects with continuous values, correcting for confounding.
problem Estimating treatment effects with continuous values, dealing with confounding.
method Two-stage kernel ridge regression: first stage learns response, second stage corrects for distribution shift.
result Optimal learning bounds achieved without estimating treatment density, adapts to unknown overlap and kernel spectral decay.
Unified Bayesian Optimisation for mixed variables improves performance.
problem Efficient optimisation of problems with both categorical and continuous variables.
method Derive value proposals from the Expected Improvement criterion to optimise both categorical and continuous variables under a single acquisition metric.
result Unified approach significantly outperforms existing methods across mixed-variable tasks.
Improved continual learning for neural networks with BN layers using K-FAC extension.
problem Continual learning challenges in neural networks with BN layers.
method Extended K-FAC method to account for inter-example relations, weight merging, and reparameterization for BN layers; proposed weight merging and reparameterization for BN layers; proposed method to select hyperparameters without source task data.
result Better performance in continual learning tasks with BN layers compared to baselines.
A hybrid model for Bayesian optimization handles mixed variables using MCTS for categorical and GP for continuous.
problem Optimizing functions with mixed variable types (continuous, integer, categorical).
method Merges MCTS for categorical and GP for continuous variables, integrates UCTS search strategy, and dynamically selects kernels.
result Hybrid models outperform traditional methods in Bayesian optimization.
Detects model changes in data streams using Ddim.
problem Early detection of model changes in data streams.
method Continuous model selection based on Ddim.
result Early warning signals of model changes.
AGS-CL selectively updates penalties based on node importance for continual learning.
problem Catastrophic forgetting in continual learning.
method Adaptive Group Sparsity (AGS) with proximal gradient descent.
result Significantly outperforms baselines on various continual learning benchmarks.
Adaptive cascade submodular maximization tackles sequential selection under uncertainty.
problem Maximizing expected utility from a set of items with unknown states and continuation probabilities.
method Proposed adaptive cascade submodular functions and a 0.12 approximation algorithm.
result Identified a class of functions (adaptive cascade submodular) that many practical applications satisfy.
The paper proves the law of one price in a continuous-time setting without friction.
problem Identifying conditions under which the law of one price holds in a continuous-time setting without frictions.
method Formulating a new mechanism for LOP failure and proving a novel variant of the uniform boundedness principle.
result Establishes the equivalence of the economic concept of LOP with the probabilistic property of the existence of a local $\scr{E}$-martingale state price density.
fastHDMI improves neuroimaging variable selection in high-dimensional data.
problem Efficient variable screening in high-dimensional neuroimaging datasets.
method Three mutual information estimation methods implemented in fastHDMI.
result FFTKDE-based method superior for continuous nonlinear outcomes.
Kernel ridge regression for causal inference with missing data.
problem Estimating treatment effects with missing data in selected samples.
method Kernel ridge regression estimators for nonparametric dose response curves and semiparametric treatment effects.
result Uniform consistency and finite sample rates for continuous treatment, root-n consistency for discrete treatment.
Two adaptive kernel selection methods improve the accuracy of Kernelized Diffusion Maps.
problem Selecting an appropriate kernel for Kernelized Diffusion Maps.
method Two complementary approaches: variational outer loop and unsupervised cross-validation.
result Both methods improve the quality and stability of the recovered eigenfunctions.
This paper concerns the continuous time mean-variance portfolio selection problem with a special nonlinear wealth equation. This nonlinear wealth equation has a nonsmooth coefficient and the dual method developed in [6] does not work. We invoke the HJB equation of this problem and give an explicit viscosity solution of…
The paper decouples shrinkage and selection in Bayesian Quantile Regression.
problem Improving prediction accuracy in high-dimensional Bayesian Quantile Regression.
method Two-step procedure: shrinkage through continuous priors, sparsification through SAVS.
result The method reduces bias and provides interpretable variable selection.
AI learns to learn sequentially without forgetting.
problem Preventing catastrophic forgetting in machine learning models.
method Meta-learning a neuromodulatory activation-gating function to control selective activation in deep neural networks.
result State-of-the-art continual learning performance with 600 classes (9,000 updates).
Paper proposes a new method for selective inference in robust regression.
problem Statistical inference after removing outliers identified by robust methods.
method Conditional SI using piecewise-linear homotopy continuation.
result Proposed method is applicable to a wide class of robust regression and outlier detection methods.
A novel method optimizes variable-stiffness structures for better strength and weight.
problem Optimizing variable-stiffness structures for higher strength and lighter weight.
method A novel multi-stage concurrent topology optimization scheme combining DMO, S-BPTO, and CFAO.
result The method ensures better fibre angle convergence and stable optimization.
Bayesian model selection improves multivariate causal discovery without restrictive assumptions.
problem Real-world causal discovery requires flexible assumptions to avoid restrictive model assumptions.
method Continuous relaxation of discrete model selection problem, using Causal Gaussian Process Conditional Density Estimator (CGP-CDE).
result Bayesian approach outperforms traditional methods in multivariate causal discovery.
Study on optimal portfolio selection with varying borrowing and saving rates in continuous-time markets.
problem Optimal portfolio selection in markets with different borrowing and saving rates.
method Hamilton-Jacobi-Bellman equation, partial differential equation, verification argument.
result Existence and smoothness of the value function, identification of trading regions and strategies.
We extend an offline evaluation method for continuous-armed bandits.
problem Evaluating policies in continuous-armed bandits with limited data.
method Extend existing offline evaluation method for continuous-armed bandits.
result Our method provides a consistent ranking of policies.
Paper solves a complex portfolio selection problem with time-inconsistent preferences.
problem Time-inconsistent preferences in portfolio selection.
method Unified framework with minimal assumptions, proving existence and uniqueness of solution.
result Existence and uniqueness of square-integrable solution for the integral equation.
Selects points from Jordan domains on Riemannian surfaces.
problem Selecting points from Jordan domains in Riemannian surfaces.
method Fiber bundle theory and conformal mappings.
result Space of Jordan domains retracts onto round disks.
New method protects whistleblowers from retaliation by ensuring their reports remain private.
problem Whistleblowers face retaliation, and current protections are insufficient.
method Formalizes protection against strong-adversary threat model as per-report (0,δ)-differential privacy, and provides a generic mechanism to reduce private auditing to private continual counting. result Demonstrates a reduction in selection error and improved utility over randomized response.
Method estimates causal effects from incremental data, overcoming missing data challenges.
problem Estimating causal effects from non-stationary, incrementally available observational data.
method Continual Causal Effect Representation Learning
result Method achieves continual causal effect estimation without compromising original data.
Paper proposes a new method to select memory data for online class-incremental learning.
problem Selecting which buffered images to replay for online class-incremental learning.
method Adversarial Shapley value scoring method to preserve latent decision boundaries.
result Proposed ASER method provides competitive or improved performance compared to state-of-the-art methods.
Paper derives necessary optimality condition for portfolio selection with distorted probabilities.
problem Continuous-time portfolio selection with S-shaped utility and probability distortions.
method Derives necessary condition for optimality using cumulative prospective theory.
result Derives a necessary condition for optimality in a behavioral portfolio selection problem.
The paper solves portfolio selection for complex preferences in continuous time.
problem Dynamic portfolio selection for nonlinear preferences with time inconsistency.
method Stochastic maximum principle and verification theorems for equilibrium strategies.
result Equilibrium strategies derived in closed form for CRRA and CARA preferences.