Machine learning improves solving inverse problems and integrating data.
problem Solving complex inverse problems and integrating data effectively.
method Integrates machine learning techniques with inverse problems and data assimilation.
result Demonstrates machine learning's potential to enhance these fields.
Develops robust coresets for distributed machine learning problems.
problem Need different coresets for various machine learning problems, increasing communication overhead.
method Introduces robust coreset construction algorithms for multiple machine learning tasks.
result Established theoretical conditions and developed algorithms for generating coresets that approximate various machine learning problems.
Quantum computers can speed up machine learning optimization problems.
problem Long computation times and high resource requirements for classical optimization algorithms in machine learning.
method Developed a mathematical model to leverage quantum parallelism for machine learning.
result Quantum machine learning applied to a 3D time-varying image demonstrated significant speedup.
This paper surveys optimization methods in machine learning.
problem Challenges in optimization methods due to growing data and model complexity.
method Systematic review of optimization methods from machine learning perspective.
result Guidance for optimization and machine learning research.
Machine learning models solve inverse eigenvalue problems for symmetric potentials and refractive indices.
problem Solving inverse eigenvalue problems for symmetric potentials and refractive indices.
method Supervised regression models (k-Nearest Neighbours, Random Forests, Multi-Layer Perceptron) trained on eigenvalue datasets.
result Machine learning methods can numerically solve inverse eigenvalue problems under appropriate parameter tuning.
Study uses machine learning to recommend best solvers for slab transport problems.
problem Auto-selecting the best solvers for transport problems in uniform slabs.
method Three solvers (Richardson, diffusion synthetic acceleration, nonlinear diffusion acceleration) and five machine learning algorithms (linear discriminant analysis, K-nearest neighbors, support vector machine, random forest, neural networks) were tested.
result Random forest and K-nearest neighbors showed potential as best solvers for classification problems.
This paper uses QUBO to train machine learning models on quantum computers.
problem Efficiently training machine learning models on quantum computers.
method Formulated three machine learning models (linear regression, SVM, k-means) as QUBO problems.
result Formulations are more efficient or equivalent in time and space complexity to classical methods.
Abstract: Surveying connections between ML and Control Theory.
problem Addressing the intersection of Machine Learning and Control Theory.
method Develops connections through reinforcement learning, supervised learning, deep learning, and stochastic gradient descent.
result Machine Learning and Control Theory are interconnected, with ML solving large control problems and Control Theory providing tools for ML.
Machine learning aids in clinical prediction tasks.
problem Improving accuracy in clinical predictions.
method Introduction to machine learning concepts and algorithms, followed by practical application to clinical datasets.
result Demonstrated the application of machine learning models to clinical prediction problems.
New analysis reveals diverse problem-solving behaviors in machine learning models.
problem Understanding and evaluating the diverse problem-solving behaviors of machine learning models.
method Spectral Relevance Analysis to characterize and validate machine learning models.
result Standard performance metrics fail to distinguish diverse problem-solving behaviors.
This paper surveys the recent attempts, both from the machine learning and operations research communities, at leveraging machine learning to solve combinatorial optimization problems. Given the hard nature of these problems, state-of-the-art algorithms rely on handcrafted heuristics for making decisions that are other…
Machine learning applied to algebraic geometry for physics problems.
problem Reformulating algebraic geometry problems as tensor mappings for machine learning.
method Supervised and unsupervised machine learning techniques applied to algebraic geometry problems.
result Machine learning provides insights into the structure of algebraic geometry data.
We propose a clustering-based iterative algorithm to solve certain optimization problems in machine learning, where we start the algorithm by aggregating the original data, solving the problem on aggregated data, and then in subsequent steps gradually disaggregate the aggregated data. We apply the algorithm to common m…
Machine learning benefits from causal inference concepts.
problem Machine learning's hard problems are related to causality.
method Introduces key concepts linking machine learning and causal inference.
result Machine learning and AI's challenges are intertwined with causality.
OMLT combines ML and optimization for solving complex problems.
problem Solving complex decision-making problems in computer science and engineering.
method OMLT integrates neural networks and gradient-boosted trees into optimization problems using machine learning.
result OMLT seamlessly integrates with Pyomo and solves real-world problems.
Kempe discusses NTK approach to machine learning problems.
problem Generally unsolvable machine learning problems.
method NTK approach focusing on kernel formulations.
result Practical applications like data distillation and adversarial robustness.
Machine learning reduces combinatorial optimization problem dimensions.
problem Reducing the complexity of large combinatorial optimization problems.
method Generalization of a machine learning model for problem reduction on TSP.
result Machine learning can predict which variables are not part of an optimal solution.
This chapter explores Meta-Learning algorithms to solve online data challenges in machine learning.
problem Lack of sufficient samples per class and limited distributed data in online learning.
method Investigates Meta-Learning (MTL) algorithms to address these challenges.
result MTL algorithms can learn to learn and handle unseen classes and online data effectively.
Survey on principles and challenges of interpretable machine learning.
problem Improving machine learning models' interpretability for high-stakes decisions.
method Identification and analysis of 10 technical challenges in interpretable machine learning.
result Identification of 10 technical challenges in interpretable machine learning.
This paper explores hyperparameter optimization for machine learning models.
problem Finding the best hyper-parameters for machine learning models.
method Introduces state-of-the-art optimization techniques and discusses their application.
result Comparison of different optimization methods on benchmark datasets.
This paper explores causal analysis in machine learning for better interpretability.
problem The lack of causality in traditional interpretable machine learning models.
method An overview of causal approaches for interpretable machine learning.
result Causal analysis improves the interpretability of machine learning models.
A new method for group invariant machine learning using geometric projections.
problem Supervised group invariant and equivariant machine learning.
method Geometric topology approach involving projection of input data into a geometric space parametrizing symmetry group orbits.
result Improvement in accuracy compared to existing methods.
Survey of machine learning methods for Windows malware classification.
problem Difficulties in malware classification through data collection, labeling, feature creation, and selection.
method Review of current methods and challenges in malware classification.
result Discussion of constraints and unaddressed problems for machine learning in cybersecurity.
New regularizer for machine learning using private data.
problem Machine learning with private data.
method Distributionally-robust optimization with locally-differentially-private datasets.
result New regularizer for training linear regression models.
Nonlinear MCMC improves Bayesian machine learning sampling.
problem Sampling problems in Bayesian machine learning.
method Nonlinear MCMC technique with convergence guarantees.
result Improves sampling in Bayesian neural networks.
Fatal accidents are a major issue hindering the wide acceptance of safety-critical systems using machine-learning and deep-learning models, such as automated-driving vehicles. Quality assurance frameworks are required for such machine learning systems, but there are no widely accepted and established quality-assurance …
Introduces new gradient-based methods for machine learning problems.
problem New challenges in machine learning due to decision-making and multi-agent problems.
method Gradient-based optimization and variational inequalities.
result Shifts focus from pattern recognition to decision-making and multi-agent problems.
Serial problems can't be efficiently parallelized, affecting machine learning models.
problem Inefficiency of parallelization in inherently serial problems.
method Formalized distinction in complexity theory, demonstrated with diffusion models.
result Diffusion models cannot solve inherently serial problems.
New model enhances SPIM for solving low-rank combinatorial optimization and statistical learning problems.
problem Solving large-scale combinatorial optimization problems efficiently.
method Proposed a new computing model for SPIM that can handle low-rank interaction matrices.
result Demonstrated efficient learning, classification, and sampling of MNIST images using the model.
RandNLA uses randomness for matrix problems in machine learning.
problem Matrix problems in machine learning.
method Randomized Numerical Linear Algebra.
result New challenges in RandNLA due to hardware trends and advances in ML.
SBI with ML helps solve complex problems in science and engineering.
problem Solving inverse problems in science and engineering.
method Bayesian and frequentist statistical frameworks with machine learning.
result Machine learning methods can be applied to Bayesian and frequentist inference.
Machine learning improves optimization algorithms in data science.
problem Improving optimization algorithms in data science.
method Training machine learning methods to automatically improve optimization algorithms.
result Machine learning leads to more effective outcomes for optimization problems.
Autotune optimizes machine learning models with multiple objectives and constraints.
problem Building and selecting optimal machine learning models is a multi-objective optimization problem.
method Derivative-free optimization methods and multi-level parallelism in a distributed computing environment.
result Autotune efficiently captures Pareto fronts and guides the search to more promising regions.
Quantum machine learning improves pulsar classification in radio astronomy.
problem Improving classification of pulsars in radio astronomy.
method Used a Born machine (quantum neural network) with a single-qubit architecture.
result Comparable accuracies to classical machine learning methods achieved.
Surveying machine learning for solving graph optimization problems.
problem Solving combinatorial optimization problems on graphs requires algorithmic engineering.
method Surveying machine learning approaches for graph optimization.
result Machine learning offers new ways to solve graph optimization problems.
Machine learning predicts arithmetic curve invariants with high accuracy.
problem Classifying arithmetic curves based on their invariants.
method Training machine learning algorithms on datasets of elliptic and genus 2 curves.
result High accuracy in classifying curves, including rank, torsion, and integral points.
New approach to machine learning optimization using distribution space.
problem Optimization challenges in machine learning with non-convex constraints.
method Relaxation to convex optimization in distribution space, numerical algorithm based on mixture distributions.
result Approximate optimization in distribution space is consistent and effective.
This paper introduces the distinction between aleatoric and epistemic uncertainty in machine learning.
problem The need to distinguish between types of uncertainty in machine learning.
method Introduction and overview of existing methods.
result The distinction between aleatoric and epistemic uncertainty.
A theorem for debiasing machine learning with finite sample guarantees.
problem Calculating confidence intervals for machine learning functionals.
method Debiased machine learning based on bias correction and sample splitting.
result Nonasymptotic debiased machine learning theorem with finite sample guarantees.
New method trains Boltzmann machines without supervision.
problem Training unsupervised learning models.
method Mixed binary quadratic feasibility problem formulation.
result Theory validated on XOR patterns.
This primer tackles biases in machine learning for image analysis, proposing solutions.
problem Causal and statistical biases in machine learning methods for image analysis.
method Introduction of causal and statistical structures that induce failure, highlighting two problems: no fair lunch and subgroup separability.
result Current fair representation learning methods fail to solve these problems, suggesting new paths forward.
BackboneLearn speeds up MIO-based machine learning problems.
problem Scaling mixed-integer optimization problems in machine learning.
method An open-source Python framework for MIO problems with indicator variables.
result Solves MIO problems faster and more accurately than existing methods.
GENO framework generates efficient solvers for machine learning problems.
problem Designing efficient solvers for machine learning problems.
method GENO framework combines a modeling language with a generic solver to generate solvers from optimization problem specifications.
result Automatically generated solvers are as efficient as well-engineered specialized solvers and orders of magnitude more efficient than classical modeling language plus solver approaches.
New machine learning algorithms inspired by ecological principles.
problem Improving machine learning performance.
method Inspired by ecological dynamics, developed new online SVM algorithms.
result New algorithms outperform traditional methods on the MNIST dataset.
The key to success in machine learning (ML) is the use of effective data representations. Traditionally, data representations were hand-crafted. Recently it has been demonstrated that, given sufficient data, deep neural networks can learn effective implicit representations from simple input representations. However, fo…
We use ellipsoids to solve power system voltage regulation problems.
problem Voltage regulation in power systems under uncertainty.
method Tractable ellipsoidal approximation for chance constrained optimizations.
result Efficiently trained machine learning model approximates uncertainty region.
New PCA method for derivatives problems.
problem Reducing dimensionality in derivatives pricing models.
method Supervised Principal Component Analysis (PCA)
result Improved accuracy in machine learning applications.
The paper offers a framework to analyze machine learning problems using concentration of measure.
problem Analyzing machine learning algorithms defined by implicit equations.
method Develops a concentration of measure framework to solve convex problems and implicit formulations.
result Provides precise estimations for the first moments of the solution, describing the behavior and performance of machine learning classifiers.