Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

130261391521 · Jun 202019922001200920172026
48 results for Feature Constraints

Tree ensemble kernels improve Bayesian optimization for mixed features and constraints.

problem Optimizing over mixed-feature spaces with known constraints.
method Kernel interpretation of tree ensembles as Gaussian Process prior, compatible optimization formulation for acquisition function, integration of known constraints.
result Framework outperforms state-of-the-art methods for mixed-feature spaces and constraints.

FedCONST adapts update magnitudes to enhance feature generalization in FL.

problem Heterogeneous client data in FL leads to overfitting and distorted transferable features.
method FedCONST uses linear convex constraints to stabilize training and preserve generalization.
result FedCONST enhances feature transferability and robustness, achieving state-of-the-art performance.

The paper introduces logic constraints to improve AI model interpretability.

problem The black box nature of AI models limits their trustworthiness in high-stakes fields.
method The paper extends AI models with logic constraints to make feature importance more interpretable.
result Promising experimental results have been achieved for the Adult dataset.

Distributed sensors compress and send features to a fusion center for linear regression.

problem Efficiently compress and transmit features from distributed sensors to a fusion center under varying communication constraints.
method Designs a distributed and adaptive feature compression scheme using optimal quantizers and simple adaptive strategies.
result Demonstrates improved inference performance through simulated experiments.

A new model improves uncertainty estimation in deep learning.

problem Deep Kernel Learning (DKL) produces unreliable uncertainty estimates.
method Proposed a bi-Lipschitz constraint to preserve distances in feature space.
result DUE model outperforms previous DKL and other methods in uncertainty quality.

This work interprets SFA through variational inference, relaxing linearity constraints.

problem Recover non-linear SFA from variational inference.
method Probabilistic interpretation of SFA through variational inference, relaxing linearity constraints.
result Reinterprets SFA as a variational framework, allowing slowness as a regularizer to reconstruction loss.

This paper proposes an active metric learning method for clustering with pairwise constraints.

problem Clustering with pairwise constraints and improving clustering performance.
method Active metric learning method that queries informative instance pairs and updates the learned metric sequentially.
result The proposed method enhances clustering performance and provides a tighter error bound.

ParamBoost uses gradient boosting to create interpretable non-linear models with constraints.

problem Creating interpretable non-linear models with expert knowledge constraints.
method Gradient Boosting of cubic polynomials with specified constraints.
result ParamBoost outperforms state-of-the-art GAMs in real-world datasets.

A new metric learning scheme for structured data combining graph and feature-space information.

problem Learning a metric from structured data while respecting metric constraints.
method Training metric-constrained linear combinations of dissimilarity matrices, applying graph-based optimization under constraints.
result Our approach can reduce computational complexity by one order of magnitude for some cases.

Unsupervised domain adaptation studies the problem of utilizing a relevant source domain with abundant labels to build predictive modeling for an unannotated target domain. Recent work observe that the popular adversarial approach of learning domain-invariant features is insufficient to achieve desirable target domain …

2020-01-03abs ↗pdf ↗

Most learning methods with rank or sparsity constraints use convex relaxations, which lead to optimization with the nuclear norm or the 1\ell_1-norm. However, several important learning applications cannot benefit from this approach as they feature these convex norms as constraints in addition to the non-convex rank a…

2012-06-07abs ↗pdf ↗

Study optimal consumption and portfolio strategies with no-borrowing constraint in financial markets.

problem Maximizing utility from consumption under constraints in a stochastic environment.
method Lagrange duality and singular control problem to solve dynamic no-borrowing constraint.
result Retrieve optimal portfolio and consumption plans via dual singular control problem.

Efficient learning of minimax risk classifiers in high dimensions.

problem Efficient learning of classifiers in high-dimensional data.
method Iterative algorithm leveraging constraint generation methods for minimax risk classifiers.
result The algorithm provides efficient learning and feature selection in high-dimensional scenarios.

We propose to prune a random forest (RF) for resource-constrained prediction. We first construct a RF and then prune it to optimize expected feature cost & accuracy. We pose pruning RFs as a novel 0-1 integer program with linear constraints that encourages feature re-use. We establish total unimodularity of the constra…

2016-06-16abs ↗pdf ↗

Graph Attention Networks (GATs) are the state-of-the-art neural architecture for representation learning with graphs. GATs learn attention functions that assign weights to nodes so that different nodes have different influences in the feature aggregation steps. In practice, however, induced attention functions are pron…

2019-10-25abs ↗pdf ↗

New RL algorithm achieves sublinear regret and constraint violation without simulators.

problem Maximizing reward under utility constraints in large-scale systems.
method Model-free, simulator-free algorithm using LSVI-UCB with primal-dual optimization and soft-max policy.
result Achieves ildeO(d3H3T) ilde{\mathcal{O}}(\sqrt{d^3H^3T}) regret and ildeO(d3H3T) ilde{\mathcal{O}}(\sqrt{d^3H^3T}) constraint violation bounds.

Paper proposes a method to extract style features from unlabeled data.

problem Extracting fine-grained features like styles from unlabeled data.
method Contrastive conditioned variational autoencoders with mutual information constraints.
result The method efficiently extracts style features from real-world natural image datasets.

Decomposes bias in linear models under demographic parity constraints.

problem Understanding and quantifying bias in linear models under fairness constraints.
method Post-processing framework to decompose bias into direct and indirect components.
result Analytical characterization of how demographic parity reshapes model coefficients.

In this paper, we propose a Ward-like hierarchical clustering algorithm including spatial/geographical constraints. Two dissimilarity matrices D0D_0 and D1D_1 are inputted, along with a mixing parameter α[0,1]α\in [0,1]. The dissimilarities can be non-Euclidean and the weights of the observations can be non-uniform. The fi…

2017-07-12abs ↗pdf ↗

This paper describes a new approach, based on linear programming, for computing nonnegative matrix factorizations (NMFs). The key idea is a data-driven model for the factorization where the most salient features in the data are used to express the remaining features. More precisely, given a data matrix X, the algorithm…

2012-06-06abs ↗pdf ↗

When applied to high-dimensional datasets, feature selection algorithms might still leave dozens of irrelevant variables in the dataset. Therefore, even after feature selection has been applied, classifiers must be prepared to the presence of irrelevant variables. This paper investigates a new training method called Co…

2018-11-20abs ↗pdf ↗

Two new methods solve large-scale stochastic convex problems with linear constraints.

problem Solving large-scale stochastic convex optimization problems with many linear constraints.
method Conditional gradient-based methods that process only a subset of constraints at each iteration.
result Rigorous convergence guarantees for the proposed methods.

Proposes a method to enforce fairness in machine learning models without sensitive data.

problem Bias in machine learning models from historical data.
method Infers sensitive attributes from auxiliary features and integrates fairness constraints into model training.
result Mitigates bias while preserving predictive accuracy.

We propose a mixed integer programming (MIP) model and iterative algorithms based on topological orders to solve optimization problems with acyclic constraints on a directed graph. The proposed MIP model has a significantly lower number of constraints compared to popular MIP models based on cycle elimination constraint…

2017-01-20abs ↗pdf ↗

We propose learning flexible but interpretable functions that aggregate a variable-length set of permutation-invariant feature vectors to predict a label. We use a deep lattice network model so we can architect the model structure to enhance interpretability, and add monotonicity constraints between inputs-and-outputs.…

2018-05-31abs ↗pdf ↗

FairMixRep learns fair representations from mixed data types.

problem Representation learning in mixed numerical and categorical data with fairness constraints.
method Efficient encoder-decoder framework + fairness constraints.
result Excellent performance in preserving information and fairness in mixed data representations.

We consider the problem of metric learning subject to a set of constraints on relative-distance comparisons between the data items. Such constraints are meant to reflect side-information that is not expressed directly in the feature vectors of the data items. The relative-distance constraints used in this work are part…

2016-12-01abs ↗pdf ↗

Dynamic risk constraints help limit risky behavior in financial portfolios.

problem Static risk measures fail to control tail-risk-seeking traders.
method Introduces dynamic risk constraints applied throughout the trading horizon.
result Dynamic risk constraints can effectively limit risky behavior in portfolios.

Develops an algorithm for bilevel optimization with coupled constraints.

problem Challenges in bilevel optimization with coupled constraints.
method Primal-dual-assisted penalty approach and a fully first-order algorithm (BLOCC).
result Established rigorous convergence theory and demonstrated effectiveness on real-world applications.

This paper explores the potential of Lagrangian duality for learning applications that feature complex constraints. Such constraints arise in many science and engineering domains, where the task amounts to learning optimization problems which must be solved repeatedly and include hard physical and operational constrain…

2020-01-26abs ↗pdf ↗

Framework optimizes model performance and interpretability for tabular data.

problem Balancing model performance and interpretability in machine learning models.
method Model-agnostic multi-objective optimization framework with evolutionary algorithm.
result Framework generates diverse models that trade off performance and interpretability efficiently.