This dissertation uses ILP to learn Bayesian network structures efficiently.
problem Learning the structure of Bayesian networks from data.
method Integer Linear Programming formulation with cluster constraints and cutting planes.
result The approach finds feasible solutions for Bayesian network structures efficiently.
New MIP approach for efficient change-point detection.
problem Offline multiple change-point detection in data streams.
method Mixed-integer programming (MIP) for globally optimal PWL fitting.
result Provable tighter relaxations for segment assignment variables.
We define a pseudo-inverse for line graphs using linear integer programming.
problem Not all graphs have a corresponding root graph, making the line graph operation non-invertible.
method Propose a linear integer program to edit the smallest number of edges in the line graph to recover a root graph.
result The pseudo-inverse operation is well-behaved and works in practice as shown by empirical experiments.
Transformers improve solving mixed-integer programs, especially CLSP.
problem Solving Capacitated Lot Sizing Problem (CLSP) with mixed-integer programming.
method Employing transformer models to predict binary variables in CLSP.
result Transformer model outperforms CPLEX and LSTM in solving CLSP.
ReLU networks trained with MILPs match deep learning accuracy.
problem Training deep neural networks efficiently.
method Iterative training with Mixed Integer Linear Programs (MILPs).
result ReLU networks can be trained with MILPs achieving similar accuracy to deep learning methods.
This paper presents an acceleration framework for packing linear programming problems where the amount of data available is limited, i.e., where the number of constraints m is small compared to the variable dimension n. The framework can be used as a black box to speed up linear programming solvers dramatically, by two…
A new portfolio optimization model minimizes maximum drawdown, offering faster and more robust solutions.
problem Optimizing portfolios during financial distress, especially during crises.
method Linearization of Markowitz model based on maximum drawdown, with a Mixed-Integer Linear Programming variation.
result 200 times faster solving time with a more profitable and robust solution.
New method learns BN structures from data efficiently.
problem Learning sparse DAG structure of BN from continuous data.
method Consistent second-order conic integer programming with early stopping criterion.
result Near-optimal solutions to medium-size problems within reasonable time.
New LNS framework improves integer program solving.
problem Solving large-scale integer linear programs efficiently.
method Large neighborhood search with imitation and reinforcement learning.
result Framework significantly outperforms commercial solvers.
Method constructs confidence regions for linear models with arbitrary predictors.
problem Constructing confidence regions for linear models with non-linear predictors.
method Mixed Integer Linear Programming for constraints.
result Empty confidence regions for hypothesis testing.
This work analyzes machine learning for Lagrangian Relaxation in MILP.
problem Improving efficiency in solving large-scale MILP problems.
method Data-driven Algorithm Design approach to learn Lagrangian multipliers.
result Stochastic Gradient Ascent achieves the minimax optimal rate for learning multipliers.
Paper uses integer programming for non-convex boosting in classification.
problem Improving classification performance using non-convex optimization.
method Non-convex boosting via integer programming.
result Results comparable to or better than state-of-the-art.
The paper analyzes how behavioral investors make portfolio decisions using Markowitz Stochastic Dominance criteria.
problem Understanding how behavioral investors make portfolio decisions.
method Developed stochastic optimization problems and MILP models to capture subjective decision weights and probability weighting functions.
result The developed models can be used to formulate computationally tractable portfolio analysis problems.
Optimizes financial auditor schedules to reduce time and costs.
problem Efficiently scheduling financial auditors with multiple constraints.
method Used Integer Linear Programming and compared two exact formulations.
result Multi-commodity network flow formulation is 24 times faster.
The paper uses clustering and integer programming to optimize stock selection for investment funds.
problem Maximizing profits and minimizing risk in stock markets.
method Data-oriented analysis and clustering techniques with integer programming.
result Reconstructed NASDAQ 100 index fund example demonstrates effectiveness.
The paper analyzes financial networks with default charges and defines a model using fixpoint problems.
problem Modeling systemic risk in interbank networks with crossholdings and default charges.
method Mixed integer-linear programming and Gaussian elimination algorithm for computing clearing pairs.
result Developed methods to compute maximal and minimal clearing pairs.
Optimizes intervention design for causal discovery using integer programming.
problem Identifying causal structures from observational data due to confounding variables.
method Uses integer programming to design minimal intervention sets for causal structure identifiability.
result Provides exact and modular solutions adaptable to various experimental settings and constraints.
New algorithm completes nonnegative tensors with fewer samples and faster convergence.
problem Tensor completion tension between sample complexity and computational complexity.
method Integer programming and Blended Conditional Gradients algorithm.
result Achieves information-theoretic sample complexity rate with practical convergence.
Let SL(n,Z) be the special linear group over integers and M=S1r×S2r,T1r×S2r , or T0r×S1r×S2r, products of spheres and tori. We prove that any group action of SL(n,Z) on Mr by diffeomorphims or piecewise linear homeomorphisms is trivial if r<n−1. This confirms a conjec…
This study optimizes cycle representatives in persistent homology using linear programming.
problem Non-uniqueness of cycle representatives in persistent homology creates ambiguity.
method Optimization of cycle representatives using linear programming methods.
result Optimization reduces the size of cycle representatives and is effective in most data sets.
Improves clustering fairness by learning fair clusters adaptively.
problem Fairness in deep clustering, especially for protected status variables.
method Formulates group-level fairness as ILP, integrates into discriminative deep clustering, refines learning algorithm.
result Consistently outperforms fair clustering algorithms on real-world datasets.
Paper proposes methods to improve SVM classifiers in noisy data scenarios.
problem Improving SVM classifiers when training data contains label noise.
method Mixed Integer Linear and Non Linear models with relabeling and clustering.
result Effective methods improve SVM performance in noisy data scenarios.
Algorithm removes units and layers of neural networks without losing accuracy.
problem Deploying large neural networks under limited resources.
method Mixed-Integer Linear Programming (MILP) and L1 regularization.
result Lossless compression of neural networks is achieved.
Best-of-∞ improves LLM performance by efficiently allocating inference-time computation.
problem Achieving optimal performance in test-time LLM ensembling with infinite budget.
method Adaptive generation scheme and weighted ensembles of LLMs, formulated as mixed-integer linear program.
result Optimal ensemble weighting improves performance over individual models.
Paper presents a framework to automatically discover constraints from data.
problem Discovering constraints from data for structured output prediction.
method Formulates structured output prediction as ILP, mines constraints by estimating polytopes of feasible set.
result Successfully identifies feasible sets and constraints for various tasks.
New algorithm for nonnegative tensor completion with linear convergence rate.
problem Tensor completion without known optimal sample complexity rate.
method Integer optimization using a specific 0-1 polytope gauge norm.
result Achieves information-theoretic rate with linear convergence.
Develops a method to identify causal effects in linear models with latent variables.
problem Identifying causal effects in models with latent variables that are not independent.
method A novel graphical criterion and an integer linear program algorithm.
result Sufficient condition for identifying causal effects by rational formulas in the covariance matrix.
Proposes a method to learn both constraints and objective functions from data.
problem Data-driven inverse optimization for mixed-integer linear programs (MILPs).
method Two-stage approach: first learns constraints, then estimates objective-function weights conditioned on learned constraints.
result Proposes and validates a method for learning both objective functions and constraints from data.
Novel framework combines tree-based discretization and ILP matching for causal inference.
problem Challenges in identifying causal relationships from observational data.
method Combines tree-based discretization and ILP matching for causal inference.
result Yields computational efficiency and less biased ATT estimates.
Introduces CCR for constructing confidence regions from conformal predictions.
problem Challenges in constructing confidence regions for model parameters.
method Combines conformal prediction intervals for model outputs to establish confidence regions for parameters under minimal assumptions.
result Valid coverage guarantees for finite sample regime, applicable to various model types.
We propose to prune a random forest (RF) for resource-constrained prediction. We first construct a RF and then prune it to optimize expected feature cost & accuracy. We pose pruning RFs as a novel 0-1 integer program with linear constraints that encourages feature re-use. We establish total unimodularity of the constra…
Estimating a constrained relation is a fundamental problem in machine learning. Special cases are classification (the problem of estimating a map from a set of to-be-classified elements to a set of labels), clustering (the problem of estimating an equivalence relation on a set) and ranking (the problem of estimating a …
We study the problem of instance segmentation in biological images with crowded and compact cells. We formulate this task as an integer program where variables correspond to cells and constraints enforce that cells do not overlap. To solve this integer program, we propose a column generation formulation where the prici…
Paper defines predictive multiplicity and measures its severity in classification problems.
problem Challenges in machine learning due to competing models with conflicting predictions.
method Formal measures and integer programming tools for linear classification problems.
result Real-world datasets may admit competing models with wildly conflicting predictions.
Scoring systems are linear classification models that only require users to add, subtract and multiply a few small numbers in order to make a prediction. These models are in widespread use by the medical community, but are difficult to learn from data because they need to be accurate and sparse, have coprime integer co…
A method for ranking items using distance-based learning from positive and unlabeled data.
problem Learning to rank items without an analytic description of what constitutes a good ranking.
method Combining representations using an integer linear program for ranking items based on nominations.
result The method is effective in simulation and real data examples, especially when supervision is light.
New method learns DAGs from noisy data without identifiability assumptions.
problem Learning DAGs from non-identifiable Gaussian models with heteroscedastic noise.
method Mixed-integer programming framework for medium-sized problems.
result Asymptotically optimal solution with early stopping criterion.
The European market clearing problem is characterized by a set of heterogeneous orders and rules that force the implementation of heuristic and iterative solving methods. In particular, curtailable block orders and the uniform purchase price (UPP) pose serious difficulties. A block is an order that spans over multiple …
We study the multiscale simplicial flat norm (MSFN) problem, which computes flat norm at various scales of sets defined as oriented subcomplexes of finite simplicial complexes in arbitrary dimensions. We show that the multiscale simplicial flat norm is NP-complete when homology is defined over integers. We cast the mul…
We consider the problem of learning decision rules for prediction with feature budget constraint. In particular, we are interested in pruning an ensemble of decision trees to reduce expected feature cost while maintaining high prediction accuracy for any test example. We propose a novel 0-1 integer program formulation …
The paper tackles online resource allocation with uncertain coefficients and chance constraints.
problem Online stochastic resource allocation problem with chance constraints.
method Linearization and primal-dual algorithms with heuristic corrections.
result Optimality gap and constraint violation are on the order of √n.
Structured prediction is used in areas such as computer vision and natural language processing to predict structured outputs such as segmentations or parse trees. In these settings, prediction is performed by MAP inference or, equivalently, by solving an integer linear program. Because of the complex scoring functions …
Study counterfactuals in combinatorial choice using a representative agent model.
problem Analyzing decision-making from aggregated binary polytope data.
method Nonparametric approach based on a representative agent model, solving polynomial and mixed-integer convex programs.
result Developed a method for counterfactual prediction that works even under model misspecification.
Paper proposes algorithms for BMF using integer programming.
problem Approximating binary input matrix as product of two smaller binary factors.
method Alternating optimization strategy using integer programming to solve subproblems and combine solutions.
result Proposed algorithms outperform state of the art on medium-scale problems.
The crosscap number of a knot is an invariant describing the non-orientable surface of smallest genus that the knot bounds. Unlike knot genus (its orientable counterpart), crosscap numbers are difficult to compute and no general algorithm is known. We present three methods for computing crosscap number that offer varyi…
New MIP algorithms improve sparse classifier learning times.
problem Sparse classifier learning at large scales.
method Developed exact and approximate MIP algorithms for ℓ0-regularized classification. result Significantly improved statistical performance compared to existing methods.
Paper uses RL to optimize branching strategy in B&B algorithms.
problem Optimizing Branch and Bound algorithms for mixed integer linear programs.
method FMSTS, a Reinforcement Learning approach for variable selection.
result FMSTS outperforms commercial solvers in efficiency and generalization.
New model uses Half-Full/Half-Empty approach for better portfolio selection.
problem Improving portfolio selection through behavioral finance.
method Generalized Half-Full/Half-Empty approach to positive/negative lotteries, developing nonconvex optimization and mixed-integer linear programming models.
result The Half-Full/Half-Empty model outperforms other methods in risk and profitability.