New method uses limited labeled data and multiple starts to adapt models across domains.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Paper tackles cold-start domain adaptation with language descriptions.
TransCORALNet uses transformer and CORAL for supply chain credit assessment with cold start.
Bayesian optimization (BO) is a model-based approach for gradient-free black-box function optimization. Typically, BO is powered by a Gaussian process (GP), whose algorithmic complexity is cubic in the number of evaluations. Hence, GP-based BO cannot leverage large amounts of past or related function evaluations, for e…
Adaptive SAA solves large-scale stochastic linear programs efficiently.
This paper investigates the effectiveness of decoupled weight decay at the start of training.
In this paper, we study the design and analysis of experiments conducted on a set of units over multiple time periods where the starting time of the treatment may vary by unit. The design problem involves selecting an initial treatment time for each unit in order to most precisely estimate both the instantaneous and cu…
In this paper, we propose a generic framework for devising an adaptive approximation scheme for value function approximation in reinforcement learning, which introduces multiscale approximation. The two basic ingredients are multiresolution analysis as well as tree approximation. Starting from simple refinable function…
We derive a class of macroscopic differential equations that describe collective adaptation, starting from a discrete-time stochastic microscopic model. The behavior of each agent is a dynamic balance between adaptation that locally achieves the best action and memory loss that leads to randomized behavior. We show tha…
Optimizes group testing for COVID-19 to reduce test numbers.
We introduce a gradient-based learning method to automatically adapt Markov chain Monte Carlo (MCMC) proposal distributions to intractable targets. We define a maximum entropy regularised objective function, referred to as generalised speed measure, which can be robustly optimised over the parameters of the proposal di…
Fast algorithms developed for adaptive and fully adaptive submodular maximization problems.
Adaptive querying learns user psychometrics with AI personas.
Using the linear Gaussian latent variable model as a starting point we relax some of the constraints it imposes by deriving a nonparametric latent feature Gaussian variable model. This model introduces additional discrete latent variables to the original structure. The Bayesian nonparametric nature of this new model al…
Cold-start is a very common and still open problem in the Recommender Systems literature. Since cold start items do not have any interaction, collaborative algorithms are not applicable. One of the main strategies is to use pure or hybrid content-based approaches, which usually yield to lower recommendation quality tha…
A general study of symmetries in optimal control theory is given, starting from the presymplectic description of this kind of system. Then, Noether's theorem, as well as the corresponding reduction procedure (based on the application of the Marsden-Weinstein theorem adapted to the presymplectic case) are stated both in…
ASD algorithm maximizes model estimates by adaptively labeling points.
Cold-start problems are long-standing challenges for practical recommendations. Most existing recommendation algorithms rely on extensive observed data and are brittle to recommendation scenarios with few interactions. This paper addresses such problems using few-shot learning and meta learning. Our approach is based o…
DWTS uses observational data to improve clinical trial efficiency.
We present an adaptive approach for valuing the European call option on assets with stochastic volatility. The essential feature of the method is a reduction of uncertainty in latent volatility due to a Bayesian learning procedure. Starting from a discrete-time stochastic volatility model, we derive a recurrence equati…
Bayesian optimisation for dynamically adjusting learning rates in machine learning models.
We consider an online decision making setting known as contextual bandit problem, and propose an approach for improving contextual bandit performance by using an adaptive feature extraction (representation learning) based on online clustering. Our approach starts with an off-line pre-training on unlabeled history of co…
In this work we study generalization of neural networks in gradient-based meta-learning by analyzing various properties of the objective landscapes. We experimentally demonstrate that as meta-training progresses, the meta-test solutions, obtained after adapting the meta-train solution of the model, to new tasks via few…
CDLF predicts product life-cycles in cold-start phases with high accuracy.
The paper proposes an efficient method for estimating ATEs using adaptive experiments.
Efficiently selects seed nodes to maximize content influence in unknown social networks.
Skew-adaptive method improves prediction intervals for regression.
Model-Agnostic Meta-Learning (MAML) and its variants have achieved success in meta-learning tasks on many datasets and settings. On the other hand, we have just started to understand and analyze how they are able to adapt fast to new tasks. For example, one popular hypothesis is that the algorithms learn good represent…
Various factorization-based methods have been proposed to leverage second-order, or higher-order cross features for boosting the performance of predictive models. They generally enumerate all the cross features under a predefined maximum order, and then identify useful feature interactions through model training, which…
Study examines preservation of curvature-adaptedness during mean curvature flow.
Training deep neural networks requires intricate initialization and careful selection of learning rates. The emergence of stochastic gradient optimization methods that use adaptive learning rates based on squared past gradients, e.g., AdaGrad, AdaDelta, and Adam, eases the job slightly. However, such methods have also …
We give a Riccati type formula adapted for two metrics having the same geodesics rays starting from a point or orthogonal to an hypersurface, one of these metrics being a warped product if the dimension is greater than or equal to 3. This formula has non-trivial geometric consequences such as a positive mass type t…
Study shows how steepest descent algorithms' geometric margin increases during training.
This study explores complex structures on Lie algebras from graph perspectives.
A nonlinear wave alternative for the standard Black-Scholes option-pricing model is presented. The adaptive-wave model, representing 'controlled Brownian behavior' of financial markets, is formally defined by adaptive nonlinear Schrödinger (NLS) equations, defining the option-pricing wave function in terms of the stock…
We explain how to adapt a construction of M. Sageev's to construct a proper action on a CAT(0) cube complex starting from a proper action on a wall space, and use this to deduce that if G is a group containing an amenable subgroup H of super-polynomial growth and G acts properly on a space with walls then there are arb…
Two-Tailed Averaging improves generalization by optimizing the number of leading iterates to ignore.
We prove that if an ALE Ricci-flat manifold is linearly stable and integrable, it is dynamically stable under Ricci flow, i.e. any Ricci flow starting close to g exists for all time and converges modulo diffeomorphism to an ALE Ricci-flat metric close to . By adapting Tian's approach in the closed case, we s…
One approach to deal with the statistical inefficiency of neural networks is to rely on auxiliary losses that help to build useful representations. However, it is not always trivial to know if an auxiliary task will be helpful for the main task and when it could start hurting. We propose to use the cosine similarity be…
This paper introduces Deep Incremental Boosting, a new technique derived from AdaBoost, specifically adapted to work with Deep Learning methods, that reduces the required training time and improves generalisation. We draw inspiration from Transfer of Learning approaches to reduce the start-up time to training each incr…
Optimal adaptive experiment for choosing best treatment with binary outcomes.
In this paper, we introduce the use of a personalized Gaussian Process model (pGP) to predict the key metrics of Alzheimer's Disease progression (MMSE, ADAS-Cog13, CDRSB and CS) based on each patient's previous visits. We start by learning a population-level model using multi-modal data from previously seen patients us…
New trading strategy beats traditional grid in crypto markets.
This paper explores adaptive methods in over-parameterized linear regression.
Stochastic gradient descent is the method of choice for large scale optimization of machine learning objective functions. Yet, its performance is greatly variable and heavily depends on the choice of the stepsizes. This has motivated a large body of research on adaptive stepsizes. However, there is currently a gap in o…
There is an increasing concern that most current published research findings are false. The main cause seems to lie in the fundamental disconnection between theory and practice in data analysis. While the former typically relies on statistical independence, the latter is an inherently adaptive process: new hypotheses a…
Model improves fraud detection for new scenes with limited data.
Enhances time-series modeling by dropping patches, improving efficiency and adaptability.