ADA augments data using AR replicas for robust regression.
problem Improving robustness in nonlinear over-parametrized regression.
method Extends Anchor regression (AR) for data augmentation, using replicas of modified samples.
result ADA provides more robust regression predictions compared to state-of-the-art solutions.
FALL improves local model training with anchor regularization.
problem Efficient local model training in regression tasks.
method Regularization with precomputed anchor models, closed-form solution.
result FALL outperforms network Lasso in accuracy with significantly less training time.
Study improves predictive models for ICU data across hospitals.
problem Degradation of predictive model performance in new hospitals.
method Anchor regression and anchor boosting for domain generalization.
result Anchor regularization enhances out-of-distribution performance.
Proposes KAR for nonlinear causal discovery using kernel methods.
problem Learning causal relationships in nonlinear settings.
method Kernel anchor regression (KAR) with improved three-stage nonparametric regression.
result KAR outperforms existing methods in nonlinear causal discovery.
Δ-UQ uses anchoring to estimate uncertainty in models.
problem Estimating uncertainty in predictive models.
method Anchoring input into a tuple for uncertainty estimation.
result Δ-UQ outperforms baselines in various use-cases.
Regularizes ML algorithms for robust multivariate analysis against distribution shifts.
problem Ensuring robustness of multivariate analysis algorithms against distribution shifts.
method Integrates a causal regularisation term into the loss function of multivariate analysis algorithms.
result Demonstrates improved out-of-distribution generalisation with reduced-rank regression and partial least squares.
A new method recovers rewards from behavior policies using classification and regression.
problem Recovering meaningful rewards from observed behavior in reinforcement learning.
method GenPQR, a modular procedure that estimates behavior policy, evaluates soft Q-function, and recovers normalized reward using classification and regression.
result GenPQR matches or improves reward recovery compared to DeepPQR, while being simpler and more modular.
MultiPath predicts multi-modal future trajectories for better motion planning.
problem Predicting human behavior in uncertain real-world domains like autonomous driving.
method Leverages fixed future state-sequence anchors and regresses offsets with uncertainties.
result Achieves more accurate predictions with an order of magnitude fewer trajectories.
We consider the question of estimating a solution to a system of equations that involve convex nonlinearities, a problem that is common in machine learning and signal processing. Because of these nonlinearities, conventional estimators based on empirical risk minimization generally involve solving a non-convex optimiza…
Adaptive anchor methods improve multi-modal learning by balancing intra-modal and inter-modal information.
problem Fixed anchor methods limit multi-modal learning by over-reliance on a single modality and inadequate cross-modal correlation.
method Adaptive anchor methods using centroid-based anchors from all modalities.
result Adaptive anchor methods like CentroBind consistently outperform fixed anchor methods across various datasets.
Private anchors affect how information is communicated and can improve or distort transmission.
problem How private anchors influence strategic communication and information transmission.
method Analyzed a sender-receiver game with costly reports and privately observed anchors.
result Small positive reporting costs can lead to full revelation, even with zero costs.
PULSE estimator improves prediction in causal inference with bounded interventions.
problem Optimizing causal models for bounded interventions.
method Relates K-class estimators to anchor regression, introduces PULSE estimator for minimization of mean squared prediction error with bounded constraints.
result PULSE estimator outperforms other estimators in real data and simulation experiments, especially in weak instrument settings.
Anchors explain text model decisions by highlighting key words.
problem Explaining neural network decisions for text data.
method Formalized Anchors for text classification, analyzing different models.
result Neural network words with highest partial derivatives are selected by Anchors.
LargeMvC-Net improves scalability of multi-view clustering.
problem Scalability issues in multi-view clustering.
method Deep unfolding of multi-view clustering into a network architecture with three modules.
result LargeMvC-Net consistently outperforms state-of-the-art methods in scalability and effectiveness.
Anchoring is a term used in psychology to describe the common human tendency to rely too heavily (anchor) on one piece of information when making decisions. A trading algorithm inspired by biological motors, introduced by L. Gil\cite{Gil}, is suggested as a testing ground for anchoring in financial markets. An exact so…
Separable Non-negative Matrix Factorization (SNMF) is an important method for topic modeling, where "separable" assumes every topic contains at least one anchor word, defined as a word that has non-zero probability only on that topic. SNMF focuses on the word co-occurrence patterns to reveal topics by two steps: anchor…
Paper explores anchoring for vision models, improving generalization and safety.
problem Anchoring can lead to undesirable shortcuts, limiting generalization.
method Introduced a new anchored training protocol with a regularizer to mitigate undesirable shortcuts.
result Significant performance gains in generalization and safety metrics.
Language is dynamic, constantly evolving and adapting with respect to time, domain or topic. The adaptability of language is an active research area, where researchers discover social, cultural and domain-specific changes in language using distributional tools such as word embeddings. In this paper, we introduce the gl…
Market stability depends on a fundamental value anchor, not price crashes.
problem Stability of order-book markets under fundamental anchoring.
method Analytical model and empirical analysis of six transmission channels.
result Fundamental anchoring stabilizes markets by mean-reverting prices and refilling books; removing the anchor leads to market failure.
This paper is about metric data structures in high-dimensional or non-Euclidean space that permit cached sufficient statistics accelerations of learning algorithms. It has recently been shown that for less than about 10 dimensions, decorating kd-trees with additional "cached sufficient statistics" such as first and sec…
This work merges 3-anchored bundles into 3-Lie algebroids.
problem Combining two 3-anchored bundles into a unified structure.
method Develops algebraic framework for merging bundles with mutual actions and cocycle terms.
result Unified setting for 3-Lie algebroids and special cases.
A new noise model for preferential Bayesian optimization using user anchors.
problem Inadequate assumption of homoscedastic noise in human-in-the-loop settings.
method Proposes a heteroscedastic noise model with anchors and a KDE uncertainty map.
result Risk-adjusted performance improvement and clarified anchor placement effects.
The formalism of anchor words has enabled the development of fast topic modeling algorithms with provable guarantees. In this paper, we introduce a protocol that allows users to interact with anchor words to build customized and interpretable topic models. Experimental evidence validating the usefulness of our approach…
PAGER detects failures in deep regression models using a new framework.
problem Detecting failures in deep regression models.
method PAGER uses a combination of epistemic uncertainty and manifold non-conformity scores.
result PAGER accurately characterizes and detects failures in deep regressors.
In this article, we continue the classification of finite type Gauss map surfaces in the Euclidean 3-space E3 with respect to the first fundamental form by studying a subclass of tubes, namely the anchor rings. We show that anchor rings are of infinite type Gauss map.
A new method resolves non-identifiability in reward modeling using anchor labels.
problem Non-identifiability in reward modeling from pairwise preferences alone.
method Anchor-guided Variance-aware Reward Modeling (AVRM) framework.
result AVRM resolves non-identifiability and improves reward modeling performance.
We propose a computationally efficient estimator, formulated as a convex program, for a broad class of non-linear regression problems that involve difference of convex (DC) non-linearities. The proposed method can be viewed as a significant extension of the "anchored regression" method formulated and analyzed in [10] f…
A pre-Lie algebroid is an anchored bundle provided with an almost Lie bracket such that the anchor is compatible with the Lie bracket of vector fields. We firstly show how most geometrical structures intensively studied in the framework of Lie algebroid can easily be extended in the pre-Lie algebroid context. The princ…
Anchor PCA improves robustness in multi-domain PCA.
problem PCA on pooled data can focus on spurious directions.
method Anchor PCA focuses on shared directions of variation.
result Anchor PCA outperforms pooling and worst-case alternatives.
New method improves continual learning by anchoring past knowledge.
problem Catastrophic forgetting in continual learning.
method Bilevel optimization to update current task knowledge while keeping past task predictions.
result Improves accuracy and forgetting metrics compared to experience replay.
Paper proposes an alternative to anchor points for learning with noisy labels.
problem Learning with noisy labels is challenging due to inaccurate labels.
method Estimates transition matrix using clusterability condition and noisy labels.
result Estimation of transition matrix is more accurate and efficient than anchor points.
A new method for efficient inference in sequential latent-variable models.
problem Computational challenges in integrating subject-specific random effects.
method Anchored variational inference framework to approximate posterior distributions.
result The method achieves accurate estimation with significant computational gains.
Anchor-TS uses median anchoring to improve online decision-making from offline data with distribution shift.
problem Improving online decision-making from offline data with distribution shift.
method Sample-Mean Anchored Thompson Sampling (Anchor-TS) with median anchoring.
result Anchor-TS safely leverages offline data to accelerate online learning and reduces regret.
In label-noise learning, \textit{noise transition matrix}, denoting the probabilities that clean labels flip into noisy labels, plays a central role in building \textit{statistically consistent classifiers}. Existing theories have shown that the transition matrix can be learned by exploiting \textit{anchor points} (i.e…
In topic modeling, many algorithms that guarantee identifiability of the topics have been developed under the premise that there exist anchor words -- i.e., words that only appear (with positive probability) in one topic. Follow-up work has resorted to three or higher-order statistics of the data corpus to relax the an…
Develops a new framework for temporal anchoring in deep embedding spaces.
problem Temporal anchoring in deep embedding spaces, especially drift and convergence issues.
method Operator-theoretic framework with drift maps and event-indexed blocks, proving convergence theorems and equivalence theorems.
result Proves convergence theorems and equivalence theorems for the proposed framework.
New method shows spectral clustering is consistent with theoretical guarantees.
problem Lack of theoretical support for anchor-based spectral clustering.
method Defined and analyzed a specific anchor-based algorithm.
result Theoretical consistency of the method in asymptotic settings.
A framework visualizes embedding spaces of neural survival analysis models using anchor directions.
problem Visualizing complex embeddings in neural survival analysis models.
method Estimating anchor directions through clustering or user-supplied concepts, revealing relationships with raw inputs and survival times.
result Visualization strategies reveal how anchor directions relate to raw clinical features and survival time distributions.
First, we extend the notion of second order differential equations (SODE) on a smooth manifold to anchored Banach vector bundles. Then we define the Banach Lie algebroids as Lie algebroids structures modeled on anchored Banach vector bundles and prove that they form a category.
Anchors explains text classifiers by highlighting key words.
problem Interpreting machine learning models, especially for text classifiers.
method Formalizes Anchors' algorithm and analyzes its behavior on linear text classifiers.
result Anchors produces meaningful results on linear text classifiers.
AutoAnchor uses cross-attention to improve text-to-image model unlearning.
problem Mitigating harmful or copyrighted content in text-to-image models.
method Two-stage framework that automatically synthesizes manifold-proximal anchors using cross-attention consistency loss.
result Effective robust and unbiased unlearning across various baselines.
Paper refines InfoNCE for accurate mutual information estimation.
problem Indirect connection of InfoNCE to mutual information estimation.
method Introduces InfoNCE-anchor with an auxiliary anchor class for consistent density ratio estimation.
result InfoNCE-anchor yields a plug-in MI estimator with significantly reduced bias.
Some tasks, such as surface normals or single-view depth estimation, require per-pixel ground truth that is difficult to obtain on real images but easy to obtain on synthetic. However, models learned on synthetic images often do not generalize well to real images due to the domain shift. Our key idea to improve domain …
Study improves materials discovery for high-entropy alloys using sparse linear models.
problem Inefficient materials discovery due to combinatorial explosion in alloy compositions.
method Sparse mixed linear modeling with anchor-based guidance for feature selection and prediction.
result Developed a method that balances predictive performance and interpretability for materials discovery.
Transformers improve Alzheimer's disease progression prediction by accounting for irregular biomarker histories.
problem Difficult prediction of medium-horizon Alzheimer's disease progression due to tied clinical scores and irregular biomarker observations.
method Developed a residual gap-aware transformer that combines statistical reference with transformer-based residual learning.
result The proposed model reduces mean error and improves prediction-observation correlation compared to baseline models.
This paper is devoted to the framework of direct limit of anchored Banach bundles over a convenient manifold which is a direct limit of Banach manifold. In particular we give a criterion of integrability for distributions on such convenient manifolds which are locally direct limits of particular sequences of Banach anc…
Results describing Lie ideals and maximal finite-codimensional Lie subalgebras of the Lie algebras associated with Lie algebroids with non-singular anchor maps are presented. It is also proved that every isomorphism of such Lie algebras induces a diffeomorphism of base manifolds respecting the generalized foliations de…
Under appropriate assumptions, we generalize the concept of linear almost Poisson struc- tures, almost Lie algebroids, almost differentials in the framework of Banach anchored bundles and the relation between these objects. We then obtain an adapted formalism for mechanical systems which is illustrated by the evolution…