Greedy convex combination of models outperforms baselines.
problem Overfitting and underfitting in convex combinations of models.
method Greedy learning of convex combinations with early stopping.
result Greedy approach is competitive or better than boosting and random forests.
Breathing k-means outperforms greedy k-means++ in clustering.
problem Improving k-means clustering solutions.
method Dynamic adjustment of centroids through breathing technique.
result Breathing k-means outperforms other k-means techniques, especially greedy k-means++.
We provide new approximation guarantees for greedy low rank matrix estimation under standard assumptions of restricted strong convexity and smoothness. Our novel analysis also uncovers previously unknown connections between the low rank estimation and combinatorial optimization, so much so that our bounds are reminisce…
Differentiable Greedy Networks improve sentence selection for claim verification.
problem Optimal selection of sentences for claim verification in FEVER task.
method Proposes a trainable subset selection algorithm based on submodular optimization and unfolds a greedy algorithm into a computational graph.
result Differentiable Greedy Network (DGN) outperforms other methods in precision and recall.
WiGS improves active learning for regression by dynamically selecting informative samples.
problem Reducing labeling costs in regression tasks.
method Formulated as a reinforcement learning problem, WiGS adapts the exploration-investigation balance.
result WiGS outperforms static methods in accuracy and labeling efficiency, especially in irregular data density.
Greedy algorithms are widely used for problems in machine learning such as feature selection and set function optimization. Unfortunately, for large datasets, the running time of even greedy algorithms can be quite high. This is because for each greedy step we need to refit a model or calculate a function using the pre…
A new method combines classical and machine learning PDE solvers efficiently.
problem Combining classical and machine learning PDE solvers to reduce computational cost and improve accuracy.
method Proposes an approximate greedy router to select solvers at each iteration, mimicking a greedy approach.
result Consistently reduces final error and AUC of the error trajectory compared to single-solver baselines and hybrid approaches.
LGES speeds up causal discovery while maintaining accuracy.
problem Causal discovery from observational data with computational and accuracy limitations.
method LGES modifies GES by avoiding certain edge insertions, using prior knowledge, and leveraging interventional data.
result LGES outperforms GES in speed, accuracy, and robustness to misspecified knowledge.
Efficiently decomposes tensors with Boolean factors using BMP.
problem Tensor decomposition with Boolean factors is challenging due to non-convexity and combinatorial constraints.
method Binary Matching Pursuit (BMP) iteratively searches for atoms in a greedy fashion, solving the greedy atom search step via MAXCUT-like boolean quadratic program.
result BMP converges sublinearly to the optimal solution and recovers factors under mild conditions.
A study evaluates contextual bandit algorithms using supervised learning datasets.
problem Understanding practical behavior of contextual bandit algorithms.
method Empirical evaluation of contextual bandit algorithms using optimization oracles from supervised learning.
result A recent method using optimism under uncertainty performs best overall.
This work explores scalable submodular optimization for networked systems.
problem Optimal subset selection in large systems with high computational complexity.
method Leader-selection in multi-agent networks, stochastic and distributed greedy algorithms, accelerated computation oracles.
result Significant speedups with little loss of optimality compared to baseline algorithms.
New algorithm improves mean field inference in probabilistic models.
problem Improving mean field inference in probabilistic models.
method DR-DoubleGreedy algorithm for continuous DR-submodular maximization with box-constraints.
result Achieves optimal 1/2 approximation ratio for continuous DR-submodular maximization.
A novel method for learning Bayesian network structures from decentralized data, balancing privacy and efficiency.
problem Privacy and communication costs in learning Bayesian network structures from decentralized data.
method Fed-Sparse-BNSL, combining differential privacy with greedy updates targeting only a few relevant edges per participant.
result Achieves utility close to non-private baselines while offering stronger privacy and communication efficiency.
Paper develops a method to generate discrete adversarial attacks on text classification models using submodular optimization.
problem Generating adversarial examples for discrete structures like text is challenging.
method Formulated adversarial attacks as an optimization task on submodular set functions, guided by gradient information.
result Achieved a 1-1/e approximation factor for attacks using the greedy algorithm.
In this paper, we consider active information acquisition when the prediction model is meant to be applied on a targeted subset of the population. The goal is to label a pre-specified fraction of customers in the target or test set by iteratively querying for information from the non-target or training set. The number …
New method uses reward prediction error for efficient exploration.
problem Efficient exploration in reinforcement learning, especially in complex environments.
method Reward prediction error (RPE) as an intrinsic motivation for exploration, combined with a deep reinforcement learning method (QXplore).
result QXplore outperforms state-novelty methods in diverse tasks, especially when state novelty is not correlated with improved reward.
Simple policy search outperforms advanced learnable test-time augmentation techniques.
problem Improving predictive performance through test-time data augmentation.
method Greedy policy search (GPS) for learning test-time augmentation policies.
result Augmentation policies learned with GPS achieve superior predictive performance and robustness.
Paper tackles regression under human assistance, showing NP-hardness and developing a greedy algorithm.
problem Optimizing machine learning models under human intervention.
method Introduced ridge regression under human assistance, derived NP-hardness, and developed a greedy algorithm.
result Greedy algorithm achieves good performance in medical diagnosis and content moderation applications.
Timber targets decision trees, outperforming existing attacks.
problem Poisoning decision trees to manipulate model predictions.
method Greedy attack strategy using sub-tree retraining for efficiency.
result Timber outperforms existing attacks in effectiveness and efficiency.
Chemical space is so large that brute force searches for new interesting molecules are infeasible. High-throughput virtual screening via computer cluster simulations can speed up the discovery process by collecting very large amounts of data in parallel, e.g., up to hundreds or thousands of parallel measurements. Bayes…
Regularized greedy policies outperform classical greedy in finite-horizon bandit problems.
problem Optimizing decision-making in sequential experiments with finite time constraints.
method Developed regularized greedy algorithms for multi-armed Bernoulli bandits.
result Calibrated regularized greedy policies consistently match or outperform state-of-the-art algorithms.
A new method selects models for ensemble learning to maximize mutual information, outperforming existing approaches.
problem Selecting models for ensemble learning to improve performance and reduce correlation issues.
method Formulate budgeted ensemble selection as maximizing mutual information, use Gaussian-copula to model correlated errors, propose a greedy mutual-information selection algorithm.
result Our method consistently outperforms strong baselines across multiple datasets.
PDP framework learns CSP solvers without explicit search strategy.
problem Learning effective search strategies for CSP solvers.
method Proposes a generic neural framework based on propagation, decimation, and prediction.
result Demonstrates effectiveness in SAT solving compared to neural and state-of-the-art baselines.
Greedy algorithm achieves sublinear regret for various distributions.
problem Efficient performance of greedy algorithms in linear contextual bandit problems.
method Introduced Local Anti-Concentration (LAC) condition to ensure sublinear regret.
result Greedy algorithm achieves O(polylogT) cumulative expected regret. Greedy algorithm optimizes consumption habits with power utility.
problem Optimizing lifetime consumption with habit formation under power utility.
method Developed a greedy algorithm using Monte Carlo simulation.
result Greedy solution is a good approximation to the optimal solution.
A new framework uses directed information to efficiently select context chunks.
problem Efficiently selecting relevant context chunks for query understanding.
method Directed Information γ-covering framework, formulated as a γ-cover problem, with a greedy algorithm for context selection. result The γ-covering algorithm provides clear advantages in hard-decision regimes like context compression and single-slot prompt selection. New algorithms improve reinforcement learning with multi-step greedy policies.
problem Difficulty in monotonic policy improvement with soft-policy updates.
method Formulated and analyzed online and approximate algorithms using multi-step greedy operators.
result Guaranteed monotonic policy improvement with sufficiently large update stepsize.
Greedy policy achieves good results for adaptive submodular problems.
problem Sequential decision making with adaptive stochastic optimization.
method Adaptive submodularity ratio to analyze greedy policy performance.
result Greedy policy achieves approximation guarantees for a broader class of problems.
Greedy AutoAugment improves accuracy with less computation.
problem Finding effective data augmentation policies to cover the search space.
method Greedy approach to reduce the number of trials from exponential to linear growth.
result Greedy AutoAugment increases accuracy by 360 times with fewer resources.
Proposes a method to decompose multivariate signals into Gaussian components.
problem Decomposing multivariate signals into Gaussian components.
method Greedy variational method for non-negative multivariate signals as a weighted sum of Gaussians.
result Upper bound for the distance from any mode of a Gaussian mixture model to the set of corresponding means.
We present an information-theoretic framework for sequential adaptive compressed sensing, Info-Greedy Sensing, where measurements are chosen to maximize the extracted information conditioned on the previous measurements. We show that the widely used bisection approach is Info-Greedy for a family of k-sparse signals b…
Improves heuristics for routing problems using attention models.
problem Improving heuristics for combinatorial optimization problems, especially for routing problems.
method Proposed a model based on attention layers and trained it using REINFORCE with a simple greedy rollout.
result Significantly improved results for TSP and other routing problems, close to optimal or specialized algorithms.
STRAPSim measures ETF portfolio similarity better than existing methods.
problem Measuring portfolio similarity for ETFs and portfolios.
method Semantic, two-level, residual-aware portfolio similarity computation.
result STRAPSim outperforms existing methods in predictive accuracy and ranking alignment.
New distributions allow greedy arm selection in sparse bandit problems.
problem Sparse contextual bandit problem with sparse parameters and feature distributions.
method Introduced new distribution classes and demonstrated that mixtures of these distributions are also greedy-applicable.
result Greedy algorithm applicable to a wider range of arm feature distributions, including those with origin-asymmetric support.
Simpler ε-greedy with longer action durations improves exploration.
problem Limited exploration capability of ε-greedy in complex domains.
method Temporally extended ε-greedy with repeated actions for random durations.
result Temporally extended ε-greedy outperforms sophisticated methods on various domains.
Parallel decoding speeds up deep autoregressive models.
problem Sequential generation limits deep autoregressive models' speed.
method Blockwise parallel decoding scheme for multiple time steps.
result Up to 7x speedup in wall-clock time with no loss in quality.
This paper is a follow up to the previous author's paper on convex optimization. In that paper we began the process of adjusting greedy-type algorithms from nonlinear approximation for finding sparse solutions of convex optimization problems. We modified there three the most popular in nonlinear approximation in Banach…
Introduces greedy feature selection for classifier-dependent feature ranking.
problem Feature selection for classification tasks.
method Greedy feature selection, identifying the most important feature at each step based on the selected classifier.
result Theoretical and numerical benefits of greedy feature selection.
Greedy approach constructs efficient neural networks with ReLU.
problem Constructing efficient neural networks with limited resources.
method Greedy algorithm with integral representation of the network using ridgelet transform.
result Proposed approach constructs efficient shallow neural networks.
Greedy coordinate descent achieves linear convergence for non-smooth composite problems.
problem Optimization of non-smooth composite problems.
method Greedy selection of subgradients for optimization.
result Linear convergence rates independent of problem dimension n. Greedy selection works well in a toy model of independent increments.
problem Iterative selection of maximum-value processes from i.i.d. stochastic processes.
method Fixed greedy selection at each stage.
result Optimal strategy is greedy selection under independent increments.
Greedy policy maximizes information in unknown linear systems.
problem Exploration in unknown linear dynamical systems.
method Online greedy policy maximizing information.
result Competitive performance compared to gradient-based methods.
This paper proposes and evaluates the k-greedy equivalence search algorithm (KES) for learning Bayesian networks (BNs) from complete data. The main characteristic of KES is that it allows a trade-off between greediness and randomness, thus exploring different good local optima. When greediness is set at maximum, KES co…
Paper analyzes Greedy-GQ for reinforcement learning with Markovian noise.
problem Analyzing Greedy-GQ for reinforcement learning with Markovian noise.
method Develops finite-sample analysis for Greedy-GQ with linear function approximation under Markovian noise.
result Provides theoretical justification for choosing stepsizes for faster convergence.
New interactive greedy algorithm for group sparsity in high dimensions.
problem Benefits of group sparsity for greedy-type methods in high-dimensional data analysis.
method Interactive Greedy Approach
result Proposed algorithm attains desired benefits of group sparsity under high dimensional settings.
New algorithm speeds up learning of graphical models.
problem Learning graphical models with sparse structure efficiently.
method Vertex-greedy score-based algorithm for learning DAGs.
result Polynomial runtime for learning DAG models.
Paper improves greedy algorithm for non-submodular matroid constraints.
problem Maximizing non-submodular functions subject to matroid constraints.
method Developed and analyzed a greedy algorithm with approximation guarantees.
result Greedy algorithm offers approximation factors for matroid constraints.
Improved greedy 2-coordinate updates for optimization problems with constraints.
problem Minimizing smooth functions subject to constraints.
method Exploiting a connection to steepest descent in the 1-norm, we give faster convergence rates and efficient computation.
result Greedy selection converges faster than random selection and can be computed in O(nlogn) time.