Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,932 papers · 148 categories

Trend · papers per month

25.0%50.0%75.0%100.0% · Dec 199219922001200920172026
48 results for correntropy objective function

Correntropy is a local similarity measure defined in kernel space and the maximum correntropy criterion (MCC) has been successfully applied in many areas of signal processing and machine learning in recent years. The kernel function in correntropy is usually restricted to the Gaussian function with center located at ze…

2019-04-13abs ↗pdf ↗

A new asymmetric correntropy method improves robust adaptive filtering for asymmetric error distributions.

problem Inadequate handling of asymmetric error distributions in adaptive filtering.
method Proposes asymmetric correntropy using an asymmetric Gaussian kernel and develops a robust adaptive filtering algorithm.
result The proposed algorithm shows better steady-state convergence performance for asymmetric error distributions.

As a robust nonlinear similarity measure in kernel space, correntropy has received increasing attention in domains of machine learning and signal processing. In particular, the maximum correntropy criterion (MCC) has recently been successfully applied in robust regression and filtering. The default kernel function in c…

2015-04-12abs ↗pdf ↗

The unscented transformation (UT) is an efficient method to solve the state estimation problem for a non-linear dynamic system, utilizing a derivative-free higher-order approximation by approximating a Gaussian distribution rather than approximating a non-linear function. Applying the UT to a Kalman filter type estimat…

2016-08-26abs ↗pdf ↗

Proposes AML loss function for TransE to improve link prediction in knowledge graphs.

problem Low performance of TransE due to insufficient scores of positive triples.
method Introduces Adaptive Margin Loss (AML) to automatically adjust margin during training.
result AML improves TransE's performance on link prediction tasks in knowledge graphs.

Traditional Kalman filter (KF) is derived under the well-known minimum mean square error (MMSE) criterion, which is optimal under Gaussian assumption. However, when the signals are non-Gaussian, especially when the system is disturbed by some heavy-tailed impulsive noises, the performance of KF will deteriorate serious…

2015-09-15abs ↗pdf ↗

The maximum correntropy criterion (MCC) has recently been successfully applied in robust regression, classification and adaptive filtering, where the correntropy is maximized instead of minimizing the well-known mean square error (MSE) to improve the robustness with respect to outliers (or impulsive noises). Considerab…

2017-03-23abs ↗pdf ↗

A new test statistic measures discrepancy between conditional distributions.

problem Measuring the discrepancy between two conditional distributions.
method Proposes a Bregman matrix divergence-based statistic that avoids explicit distribution estimation.
result The new statistic inherits high-order statistics and demonstrates utility in multi-task learning, concept drift detection, and feature selection.

Constrained adaptive filtering algorithms inculding constrained least mean square (CLMS), constrained affine projection (CAP) and constrained recursive least squares (CRLS) have been extensively studied in many applications. Most existing constrained adaptive filtering algorithms are developed under mean square error (…

2016-10-06abs ↗pdf ↗

Paper studies MCCR models with scale parameters tending to zero, revealing optimal learning rate and comparing robustness.

problem Analyzing MCCR models with scale parameters approaching zero.
method Investigates MCCR models with scale parameters tending to zero, revealing optimal learning rate and comparing robustness.
result Optimal learning rate of MCCR models is O(n1){\mathcal{O}}(n^{-1}) in the asymptotic sense.

Correntropy is a second order statistical measure in kernel space, which has been successfully applied in robust learning and signal processing. In this paper, we define a nonsecond order statistical measure in kernel space, called the kernel mean-p power error (KMPE), including the correntropic loss (CLoss) as a speci…

2016-12-21abs ↗pdf ↗

This paper studies the nonparametric modal regression problem systematically from a statistical learning view. Originally motivated by pursuing a theoretical understanding of the maximum correntropy criterion based regression (MCCR), our study reveals that MCCR with a tending-to-zero scale parameter is essentially moda…

2017-02-20abs ↗pdf ↗

Paper proposes S2S^2ConvSCN for robust subspace clustering and classification.

problem Insufficient handling of nonlinear manifolds, data corruptions, and out-of-sample data.
method Self-supervised convolutional subspace clustering network (S2S^2ConvSCN) with FC layer, CIM for robustness, and BD regularization.
result Robust S2S^2ConvSCN outperforms baseline on unseen data.

Neural-optimized objective functions simplify optimization tasks.

problem Designing effective objective functions for optimization problems is challenging.
method A neural network learns the objective function from training data through an inner and outer optimization process.
result The approach can learn objective functions from data and produce solutions for optimization tasks.

A new method for incorporating preferences in multi-objective Bayesian optimization.

problem Incorporating preferences in computationally expensive multi-objective optimization problems.
method Building independent surrogate models on each objective function and using Generalised value distribution to approximate the scalarizing function.
result The proposed multi-surrogate approach outperforms the mono-surrogate approach on benchmark and real-world problems.

Many objective Bayesian optimization tackles redundant objectives in expensive black-box functions.

problem Efficiently optimizing multiple expensive and noisy black-box functions with redundant objectives.
method Proposes a metric to identify redundant objectives and a Bayesian optimization algorithm to stop evaluating them.
result Reduces computational cost by stopping evaluation of redundant objectives, improving efficiency.

We propose a new neural sequence model training method in which the objective function is defined by αα-divergence. We demonstrate that the objective function generalizes the maximum-likelihood (ML)-based and reinforcement learning (RL)-based objective functions as special cases (i.e., ML corresponds to α0α\to 0 and R…

2017-06-30abs ↗pdf ↗

Cost-aware multi-objective Bayesian optimization for non-uniformly expensive functions.

problem Non-uniform cost of function evaluations in Bayesian optimization.
method Introduces cost-aware constraints and a new acquisition function to optimize multi-objective functions with varying costs.
result Demonstrates improved optimization in hyperparameter tuning of neural networks and random forests.

Simulated annealing improves candidate optimization for multi-objective Bayesian optimization.

problem Efficient candidate optimization for multi-objective acquisition functions in Bayesian optimization.
method Simulated annealing-based approach for batch acquisition function optimization.
result Simulated annealing outperforms SLSQP in most multi-objective optimization problems, achieving higher hypervolume values and better convergence characteristics.

Proposes a method to learn both constraints and objective functions from data.

problem Data-driven inverse optimization for mixed-integer linear programs (MILPs).
method Two-stage approach: first learns constraints, then estimates objective-function weights conditioned on learned constraints.
result Proposes and validates a method for learning both objective functions and constraints from data.

Improves Bayesian optimization by focusing on well-behaved structure in objectives.

problem Bayesian optimization struggles with real-world objectives that are often poorly behaved.
method Proposes surrogate models that focus on well-behaved structure, absorbing challenging structures as irreducible uncertainty.
result Surrogate models with appropriate noise distributions improve reliability and performance in challenging objective functions.

In this paper a new connection between the discrete conformal geometry problem of disk pattern construction and the continuous conformal geometry problem of metric uniformization is presented. In a nutshell, we discuss how to construct disk patterns by optimizing an objective function, which turns out to be intimately …

2000-10-31abs ↗pdf ↗

This paper studies continuum-armed bandits under Besov smoothness conditions and derives minimax rates.

problem Optimizing an unknown function with limited evaluations.
method Studies continuum-armed bandits under Besov smoothness conditions and derives minimax rates.
result Minimax rates over Besov spaces are identical to those over the smallest Hölder space into which Besov spaces embed.

New approach categorizes objective functions for embodied agents.

problem Understanding how objectives relate to each other and discovering new objectives.
method Introducing Action Perception Divergence (APD) to categorize objective functions.
result Introduces a spectrum of objectives from narrow to general, explaining various unsupervised objectives.