A new ML method teaches constraints directly to models.
problem Addressing safety and fairness in AI systems.
method Directly teaching constraint satisfaction to ML models using a constraint solver.
result Empirically, our approach performs well on fairness and synthetic constraints.
We introduce TzK (pronounced "task"), a conditional probability flow-based model that exploits attributes (e.g., style, class membership, or other side information) in order to learn tight conditional prior around manifolds of the target observations. The model is trained via approximated ML, and offers efficient appro…
SEMF predicts prediction intervals for ML models using latent variables.
problem Uncertainty quantification in ML models, especially for diverse data distributions.
method Supervised Expectation-Maximization Framework (SEMF) extending EM algorithm for latent variable modeling.
result SEMF produces narrower prediction intervals with desired coverage probability.
Proposes ML-GCN for multi-label graph node classification using GCN and relaxed skip-gram model.
problem Loss of label correlations in multi-label graph node classification.
method Uses a GCN to embed node features and graph topology, generates random label vectors, and detects correlations using a skip-gram model.
result Significantly outperforms state-of-the-art methods on graph classification datasets.
Study predicts heart failure patient survival using stacked ensemble ML.
problem Predicting survival of heart failure patients.
method Collect and analyze patient data, apply SMOTE, use K-Means, Fuzzy C-Means clustering, Random Forest, XGBoost, Decision Tree, and propose a stacked ensemble model.
result Supervised ML algorithms outperform unsupervised models, achieving high accuracy and F1 score.
This paper reviews ML applications in finance, enhancing asset pricing models.
problem Limitations of traditional asset pricing models in complex market dynamics.
method Exploring ML models including supervised, unsupervised, semi-supervised, and reinforcement learning.
result Enhanced return prediction and portfolio optimization through ML integration.
SECRET combines ML and NLP for better real-world task classification.
problem Limited integration of semantic relationships in supervised ML.
method SECRET fuses semantic information from NLP with feature space of supervised ML.
result Up to 14.0% accuracy and 13.1% F1 score improvements over traditional supervised learning.
We consider the problem of metric learning subject to a set of constraints on relative-distance comparisons between the data items. Such constraints are meant to reflect side-information that is not expressed directly in the feature vectors of the data items. The relative-distance constraints used in this work are part…
Automates MIPs solution with semi-supervised graph neural networks.
problem Solving recurrent Mixed-Integer Programming (MIP) problems efficiently.
method Semi-supervised Graph Neural Networks (GNNs) for predicting variable values.
result GNNs can solve MIPs with unlabeled data and improve over other ML approaches.
Machine learning aids causal inference in policy evaluation.
problem Causal inference from counterfactuals without direct observation.
method Incorporating supervised ML into causal parameter estimation.
result Machine learning tools improve causal inference accuracy.
Overview of SML techniques with banking applications.
problem Credit risk modeling in banking.
method Tree-based ensemble algorithms, Feedforward NNs, hyper-parameter optimization, machine learning interpretability.
result Comparison of ML algorithm features and their application in banking.
Over the last several years, the use of machine learning (ML) in neuroscience has been rapidly increasing. Here, we review ML's contributions, both realized and potential, across several areas of systems neuroscience. We describe four primary roles of ML within neuroscience: 1) creating solutions to engineering problem…
Objective: To determine the completeness of argumentative steps necessary to conclude effectiveness of an algorithm in a sample of current ML/AI supervised learning literature. Data Sources: Papers published in the Neural Information Processing Systems (NeurIPS, née NIPS) journal where the official record showed a 2017…
Paper tackles BA in dual-band systems using ML.
problem Choosing the best frequency band for communication in dual-band systems.
method Formulated as binary classification problem, proposed supervised ML solutions.
result Analytical and Viterbi Algorithm-based solutions for directional BA.
Paper proposes counterfactual explanations for ML on multivariate time series data.
problem Lack of user trust and difficulty in debugging ML frameworks using multivariate time series data.
method Proposes a novel explainability technique for providing counterfactual explanations.
result Outperforms state-of-the-art explainability methods in metrics like faithfulness and robustness.
Optimizes VAE hyperparameters for efficient training and manifold discovery.
problem Efficiently optimizing hyperparameters in VAEs for complex data.
method Latent Bayesian Optimization (zBO) for hyperparameter trajectory optimization.
result Demonstrated improved performance in finding joint rotationally invariant representations.
Discuss ML methods for economists, highlighting better performance in econometrics.
problem Applying ML methods to econometrics problems.
method Supervised and unsupervised learning methods, matrix completion, causal inference, optimal policy estimation.
result ML methods often outperform traditional econometric methods in specific econometrics problems.
MLDemon monitors ML systems post-deployment, improving reliability with real-time performance estimates and expert labels.
problem Ensuring reliability of machine learning systems post-deployment, especially when user inputs differ from training data.
method Integrates unlabeled and on-demand labeled data to monitor ML model performance in real-time, deciding when to acquire expert labels.
result Outperforms existing approaches in temporal datasets with diverse distribution drifts, providing theoretical optimality for distribution drifts.
Machine learning algorithms can misrepresent training data, study finds.
problem Misrepresentation of training data in machine learning algorithms.
method Demonstrated through underestimation of training data due to irreducible error, regularization, and class imbalance.
result Careful management of synthetic counterfactuals can mitigate underestimation bias.
Regularized target encoding beats traditional methods for high cardinality features in ML.
problem Efficiently encoding high cardinality categorical variables for ML algorithms.
method Regularized target encoding compared to traditional encodings like integer and one-hot encoding.
result Regularized target encoding consistently provided the best results in a large-scale benchmark experiment.
Paper offers guidelines for using ML in cyber security, focusing on botnet detection.
problem Lack of public benchmark datasets for evaluating ML-based cyber security systems.
method Provided concrete guidelines and recommendations for using supervised ML in cyber security, focusing on botnet detection.
result Ensemble models are well-suited to handle class imbalance in botnet detection.
Study assesses hyperparameter tuning for causal inference with DML.
problem Optimizing hyperparameters for causal inference with DML.
method Empirical simulation study using DML approach.
result Hyperparameter tuning crucial for causal estimation with DML.
Paper uses ML to predict insulator flashover risk.
problem Predicting flashover risk of aging insulators.
method Supervised ML with XGBoost, using LC and voltage features.
result Model accurately estimates insulator flashover probability.
Proposes a model to interpret complex ML algorithms.
problem Complex ML models are hard to interpret.
method Uses model-based regression trees and interpretable main-effects models.
result Surrogate model provides interpretable results with good predictive performance.
Machine learning predicts failure in brittle materials with high accuracy.
problem Predicting failure in brittle materials under repetitive loads.
method Phase-field model combined with supervised machine learning.
result Framework predicts failure with acceptable accuracy even in noisy data.
Paper proposes mechanism learning to reverse causal inference in ML.
problem Machine learning models learn associational, not causal, relationships.
method Causally weighted Gaussian mixture models (CW-GMMs).
result CW-GMMs can deconfound observational data for reverse causal inference.
Due to the lack of information such as the space environment condition and resident space objects' (RSOs') body characteristics, current orbit predictions that are solely grounded on physics-based models may fail to achieve required accuracy for collision avoidance and have led to satellite collisions already. This pap…
The use of machine learning (ML) is on the rise in many sectors of software development, and automotive software development is no different. In particular, Advanced Driver Assistance Systems (ADAS) and Automated Driving Systems (ADS) are two areas where ML plays a significant role. In automotive development, safety is…
Organizations adapt ML models to new data types using existing resources.
problem Adapting ML models to new data types in evolving applications.
method Utilize organizational resources like statistics, knowledge bases, and existing services to create a common feature space.
result Reduces model development time from months to days.
Differential ML combines AAD with ML for fast, accurate financial derivatives pricing and risk management.
problem Computational bottlenecks in financial derivatives risk management.
method Novel algorithms using automatic adjoint differentiation (AAD) for training fast, accurate approximations in real-time.
result Convergence guarantees for fast, accurate pricing and risk approximations for arbitrary derivatives instruments.
Review and benchmark 58 feature selection methods for ML applications.
problem Selecting appropriate features for predictive modeling in ML applications.
method Synthesizes literature on feature selection benchmarking and evaluates 58 methods.
result Well-performing candidate methods identified: random forest, DISR, JIM.
DL2 uses deep learning to optimize resource allocation in DL clusters.
problem Efficient resource scheduling for deep learning clusters is challenging.
method DL2 combines supervised learning and reinforcement learning to dynamically allocate resources.
result DL2 reduces average training completion time by 44.1% compared to fairness scheduler.
Machine Learning (ML) is one of the most exciting and dynamic areas of modern research and application. The purpose of this review is to provide an introduction to the core concepts and tools of machine learning in a manner easily understood and intuitive to physicists. The review begins by covering fundamental concept…
Spin-opstrings from QMC simulations enable ML of quantum phases.
problem Capturing and predicting quantum phase transitions using ML.
method Spin-opstrings derived from QMC simulations used as ML input.
result Spin-opstrings accurately predict quantum phase transitions.
Detects malicious accounts in permissionless blockchains using graph properties and ML.
problem Identifying and classifying malicious accounts in permissionless blockchains.
method Temporal graph properties, ML algorithms (ExtraTreesClassifier, K-Means), cosine similarity, behavior change analysis.
result ExtraTreesClassifier performs best in detecting malicious accounts on Ethereum blockchain.
Most modern supervised statistical/machine learning (ML) methods are explicitly designed to solve prediction problems very well. Achieving this goal does not imply that these methods automatically deliver good estimators of causal parameters. Examples of such parameters include individual regression coefficients, avera…
SAGE-FIN detects financial fraud using GNNs and Granger causality.
problem Detecting fraud in financial networks with limited labeled data and lack of explainability.
method Semi-supervised GNN approach with Granger causal explanations.
result SAGE-FIN outperforms on real-world financial network dataset with explainable flagged items.
This study compares transfer learning and self-supervised learning for better model performance.
problem Choosing between transfer learning and self-supervised learning for optimal model performance.
method Comprehensive comparative study of transfer learning and self-supervised learning under various data and task properties.
result Self-supervised learning outperforms transfer learning in certain applications, and vice versa.
Machine learning enhances physical layer attacks on IoT devices using OFDM.
problem Machine learning improves physical layer attacks on IoT devices using OFDM.
method Investigates supervised and unsupervised machine learning approaches to exploit non-contiguous OFDM systems.
result Variational autoencoders can learn PHY characteristics from NC-OFDM signals, enabling spoofing.
Bayesian methods improve adversarial machine learning robustness.
problem Improving machine learning systems' security against adversarial manipulation.
method Integrating Bayesian perspectives to relax unrealistic assumptions in game-theoretic models.
result Bayesian approach provides more robust inferences about opponent's beliefs and interests.
The paper proposes a method to create domain-invariant representations using Wasserstein distance.
problem Domain shifts in training data affect machine learning model performance across different domains.
method The method combines classification/regression losses with a GAN-type discriminator to minimize the Wasserstein distance between domains.
result The approach produces the highest minimum classification accuracy and most invariant representation across domains.
Parsimonious representations are ubiquitous in modeling and processing information. Motivated by the recent Multi-Layer Convolutional Sparse Coding (ML-CSC) model, we herein generalize the traditional Basis Pursuit problem to a multi-layer setting, introducing similar sparse enforcing penalties at different representat…
Extracts StarCraft II tournament data for AI and ML studies.
problem Lack of accessible esports data for scientific use.
method Gathered and processed StarCraft II tournament replays using an API parser library.
result The largest publicly available StarCraft II esports dataset.
POEM predicts drug properties without tuning, outperforming other methods.
problem Predicting drug properties from molecular structures efficiently.
method POEM combines multiple molecular representations without hyperparameter tuning.
result POEM outperforms industry-standard methods across 17 tasks.
Future wireless networks have a substantial potential in terms of supporting a broad range of complex compelling applications both in military and civilian fields, where the users are able to enjoy high-rate, low-latency, low-cost and reliable information services. Achieving this ambitious goal requires new radio techn…
A scalable system learns acoustic models from 1 Million hours of untranscribed audio.
problem Learning acoustic models from large, untranscribed audio datasets.
method Semi-supervised learning with a student/teacher learning paradigm, focusing on the data and model pipelines.
result Relative accuracy improvements of 10-20% in noisy conditions, with no extensive hyper-parameter tuning.
We would like to learn a representation of the data which decomposes an observation into factors of variation which we can independently control. Specifically, we want to use minimal supervision to learn a latent representation that reflects the semantics behind a specific grouping of the data, where within a group the…
Abstract: Surveying connections between ML and Control Theory.
problem Addressing the intersection of Machine Learning and Control Theory.
method Develops connections through reinforcement learning, supervised learning, deep learning, and stochastic gradient descent.
result Machine Learning and Control Theory are interconnected, with ML solving large control problems and Control Theory providing tools for ML.