New method combines Bloom filters and belief propagation for efficient group testing.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Over the course of the past decade, a variety of randomized algorithms have been proposed for computing approximate least-squares (LS) solutions in large-scale settings. A longstanding practical issue is that, for any given input, the user rarely knows the actual error of an approximate solution (relative to the exact …
We present here an introduction to Brainstorming approach, that was recently proposed as a consensus meta-learning technique, and used in several practical applications in bioinformatics and chemoinformatics. The consensus learning denotes heterogeneous theoretical classification method, where one trains an ensemble of…
Adam is the most practical optimizer, especially in low-budget scenarios.
GEMSS discovers multiple sparse solutions in high-dimensional data.
Simple DP algorithms find approximate solutions for nonconvex ERM.
Fast algorithm solves BVPs in linear time with probabilistic uncertainty.
The study compares machine learning models for depression detection and highlights the importance of feature selection.
Although stochastic gradient descent (SGD) method and its variants (e.g., stochastic momentum methods, AdaGrad) are the choice of algorithms for solving non-convex problems (especially deep learning), there still remain big gaps between the theory and the practice with many questions unresolved. For example, there is s…
A popular approach of achieving fairness in optimization problems is by constraining the solution space to "fair" solutions, which unfortunately typically reduces solution quality. In practice, the ultimate goal is often an aggregate of sub-goals without a unique or best way of combining them or which is otherwise only…
Study uses neural networks to solve complex equations efficiently.
Efficiently tunes hyperparameters with dynamic accuracy method.
New LP method recovers MAP solution from noisy stable instances.
Extends Demographic Parity for fairer wage predictions with expert knowledge.
Paper tightens optimization bounds using conformal prediction.
Paper presents ERM with -divergence regularization and its properties.
GAIL with neural networks converges to global optima and has a known rate.
New method tackles inexact bilevel optimization for faster parameter learning.
The study improves deep learning models for safer autonomous vehicles.
Classifies privacy policy segments for better user understanding.
Information-maximization clustering learns a probabilistic classifier in an unsupervised manner so that mutual information between feature vectors and cluster assignments is maximized. A notable advantage of this approach is that it only involves continuous optimization of model parameters, which is substantially easie…
TDL uses topological features for deep learning models, promising new insights and solutions.
Clinical AI models fail to transfer between sites due to site-specific practices.
We view a conic optimization problem that has a unique solution as a map from its data to its solution. If sufficient regularity conditions hold at a solution point, namely that the implicit function theorem applies to the normalized residual function of [Busseti et al., 2018], the problem solution map is differentiabl…
FOSC-X: An extended framework for extracting multiple optimal flat clusterings from hierarchical cluster trees
Proposes guidelines for developing medical AI products.
It is common practice in using regression type models for inferring causal effects, that inferring the correct causal relationship requires extra covariates are included or ``adjusted for''. Without performing this adjustment erroneous causal effects can be inferred. Given this phenomenon it is common practice to inclu…
In this paper, a new theory is developed for first-order stochastic convex optimization, showing that the global convergence rate is sufficiently quantified by a local growth rate of the objective function in a neighborhood of the optimal solutions. In particular, if the objective function in the -sub…
In this work, we describe practical lessons we have learned from successfully using contextual bandits (CBs) to improve key business metrics of the Microsoft Virtual Agent for customer support. While our current use cases focus on single step einforcement learning (RL) and mostly in the domain of natural language proce…
Measuring the relationship between any pair of variables is a rich and active area of research that is central to scientific practice. In contrast, characterizing the common information among any group of variables is typically a theoretical exercise with few practical methods for high-dimensional data. A promising sol…
Analytical solution found for a three-layer network with a specific activation function.
In this work, we provide theoretical guarantees for reward decomposition in deterministic MDPs. Reward decomposition is a special case of Hierarchical Reinforcement Learning, that allows one to learn many policies in parallel and combine them into a composite solution. Our approach builds on mapping this problem into a…
Graph ConvNet learns to solve Tree Decomposition problems efficiently.
We present and analyze a simple, two-step algorithm to approximate the optimal solution of the sparse PCA problem. Our approach first solves a L1 penalized version of the NP-hard sparse PCA optimization problem and then uses a randomized rounding strategy to sparsify the resulting dense solution. Our main theoretical r…
Minimax optimization plays a key role in adversarial training of machine learning algorithms, such as learning generative models, domain adaptation, privacy preservation, and robust learning. In this paper, we demonstrate the failure of alternating gradient descent in minimax optimization problems due to the discontinu…
Spectral clustering has found extensive use in many areas. Most traditional spectral clustering algorithms work in three separate steps: similarity graph construction; continuous labels learning; discretizing the learned labels by k-means clustering. Such common practice has two potential flaws, which may lead to sever…
A discrete time probabilistic model, for optimal equity allocation and portfolio selection, is formulated so as to apply to (at least) reinsurance. In the context of a company with several portfolios (or subsidiaries), representing both liabilities and assets, it is proved that the model has solutions respecting constr…
Matching one set of objects to another is a ubiquitous task in machine learning and computer vision that often reduces to some form of the quadratic assignment problem (QAP). The QAP is known to be notoriously hard, both in theory and in practice. Here, we investigate if this difficulty can be mitigated when some addit…
Non-convex regularizers usually improve the performance of sparse estimation in practice. To prove this fact, we study the conditions of sparse estimations for the sharp concave regularizers which are a general family of non-convex regularizers including many existing regularizers. For the global solutions of the regul…
Optimizes marketing strategies with practical constraints.
The Infinite Relational Model (IRM) is a probabilistic model for relational data clustering that partitions objects into clusters based on observed relationships. This paper presents Averaged CVB (ACVB) solutions for IRM, convergence-guaranteed and practically useful fast Collapsed Variational Bayes (CVB) inferences. W…
In all the practical applications of partial differential equations, what is mostly needed and what is in fact hardest to obtains are the solutions of the system or, occasionally, some specific solutions. This work is based on a most enlightening Mémoire written by Élie Cartan in 1914 and that the majority ignores. We …
Randomized matrix compression techniques, such as the Johnson-Lindenstrauss transform, have emerged as an effective and practical way for solving large-scale problems efficiently. With a focus on computational efficiency, however, forsaking solutions quality and accuracy becomes the trade-off. In this paper, we investi…
SAA method solves insurance portfolio optimization with CVaR constraints.
Graph cuts find global optima for Potts models in slight perturbations.
Developing a range-aware Bayesian optimization framework for discovering diverse designs within target property windows.
DiPCA algorithm improves scalability and solution quality for time-dependent data.
RL research overhypes potential but lacks deployable solutions.