Study finds different active learning techniques better for various learning objectives.
problem Matching active learning techniques to specific learning objectives.
method Survey of students' perceptions and ratings of various techniques.
result Different active learning techniques are best suited for different learning objectives.
New unsupervised learning technique learns independent kernels for better machine learning tasks.
problem Improving unsupervised representation learning for machine learning tasks.
method Stacking convolutional transforms using alternating proximal minimization scheme.
result DCTL outperforms shallow version CTL on benchmark datasets.
Reduces survival analysis to common regression tasks.
problem Applying standard machine learning tools to survival analysis.
method Various reduction techniques to simplify survival analysis.
result Benchmark analysis shows improved predictive performance.
This paper analyzes and improves active learning techniques for real-world projects.
problem Reducing labelling effort in machine learning models with real-world constraints.
method Systematic study of active learning issues, proposing techniques to address model convergence, annotation error, and dataset imbalance.
result Presentation of two techniques to speed up active learning: partial uncertainty sampling and larger query size.
Overview of SML techniques with banking applications.
problem Credit risk modeling in banking.
method Tree-based ensemble algorithms, Feedforward NNs, hyper-parameter optimization, machine learning interpretability.
result Comparison of ML algorithm features and their application in banking.
Improved DP models with active learning on public data.
problem Differentially private models trained on sensitive data degrade performance.
method Fine-tuning DP models through active learning on public data.
result Improved accuracy for DP models while maintaining privacy guarantees.
Enhanced Bayesian target encoding uses sampling techniques to improve model performance.
problem Improving target encoding for better model performance in machine learning.
method Using sampling techniques in Bayesian target encoding to extract intra-category distribution information.
result Improves generalization and reduces target leakage in machine learning models.
This paper compares traditional econometric and contemporary machine/deep learning techniques for forecasting foreign exchange rates.
problem Accurate prediction of foreign exchange rates for investment purposes.
method Multivariate time series analysis using Vector Auto Regression, Support Vector Machine, and Recurrent Neural Networks.
result Contemporary machine/deep learning techniques outperform traditional econometric methods in forecasting foreign exchange rates.
Various stochastic models have been proposed to estimate mortality rates. In this paper we illustrate how machine learning techniques allow us to analyze the quality of such mortality models. In addition, we present how these techniques can be used for differentiating the different causes of death in mortality modeling…
Proves and tests methods for learning time-series with breaks.
problem Learning time-series with structural breaks.
method Complete proofs and experimental validation of a regularized loss function.
result Experimental results support the validity of the techniques.
Framework converts singer identity and vocal technique from non-parallel corpora.
problem Converts singer identity and vocal technique from non-parallel corpora.
method Uses variational autoencoders with separate encoders for singer identity and vocal technique.
result Successfully disentangles and converts singer identity and vocal technique.
New report on machine learning visualization techniques and trends.
problem Improving trust in machine learning models through visualization.
method Analysis of peer-reviewed articles on machine learning visualization techniques.
result Rapid growth in machine learning visualization techniques over the past three years.
Deep learning improves GW signal detection efficiency and robustness.
problem Traditional matched-filtering techniques are limited in detecting new GW signals.
method Optimized CNN models with techniques like batch normalization and dropout.
result CNN models are robust to the variation of GW waveform parameters.
Two retraining techniques outperform fine-tuning in neural network pruning.
problem Improving accuracy and compression in neural network pruning.
method Weight rewinding and learning rate rewinding compared to fine-tuning.
result Rewinding techniques outperform fine-tuning in accuracy and compression.
Deep learning constitutes a recent, modern technique for image processing and data analysis, with promising results and large potential. As deep learning has been successfully applied in various domains, it has recently entered also the domain of agriculture. In this paper, we perform a survey of 40 research efforts th…
Policy gradient is an efficient technique for improving a policy in a reinforcement learning setting. However, vanilla online variants are on-policy only and not able to take advantage of off-policy data. In this paper we describe a new technique that combines policy gradient with off-policy Q-learning, drawing experie…
Deep learning aids in autism diagnosis and rehabilitation using neuroimaging data.
problem Challenges in automated detection and rehabilitation of ASD using neuroimaging data.
method Deep learning techniques applied to neuroimaging data for ASD diagnosis and rehabilitation.
result Deep learning improves accuracy in ASD diagnosis and rehabilitation.
Many machine learning (ML) approaches are widely used to generate bioclimatic models for prediction of geographic range of organism as a function of climate. Applications such as prediction of range shift in organism, range of invasive species influenced by climate change are important parameters in understanding the i…
In machine learning, a nonparametric forecasting algorithm for time series data has been proposed, called the kernel spectral hidden Markov model (KSHMM). In this paper, we propose a technique for short-term wind-speed prediction based on KSHMM. We numerically compared the performance of our KSHMM-based forecasting tec…
Paper presents a method for probabilistic load forecasting using adaptive online learning.
problem Inability to assess intrinsic uncertainties and capture dynamic changes in consumption patterns.
method Adaptive online learning of hidden Markov models for recursive parameter updates and sequential prediction.
result Significant improvement in performance compared to existing techniques across various scenarios.
New algorithm learns Markov decision processes from test data.
problem Learning Markov decision processes from limited test data.
method L*-based active learning with sampling.
result Sampling-based algorithm outperforms passive learning.
Study uses machine learning to predict rain in Australia.
problem Challenging task of predicting rainfall with uncertain outcomes.
method Machine learning techniques, including modeling inputs, methods, and pre-processing.
result Comparison of various machine learning techniques' reliability in predicting rainfall.
For many natural language processing (NLP) tasks the amount of annotated data is limited. This urges a need to apply semi-supervised learning techniques, such as transfer learning or meta-learning. In this work we tackle Named Entity Recognition (NER) task using Prototypical Network - a metric learning technique. It le…
New technique learns STL formulas for classifying time-series data.
problem Lack of interpretability in traditional machine learning for time-series data.
method Systematically explores the space of all STL formulas, prunes the space, and learns semantically equivalent formulas.
result Automatically learns STL formulas for clustering and classifying real-valued time-series data.
Meta-learning techniques like MAML and Reptile fail to generalize well to out-of-distribution tasks compared to simple finetuning.
problem Generalization of meta-learning techniques in low-data scenarios.
method Investigation of MAML, Reptile, and finetuning on various tasks.
result MAML and Reptile specialize for fast adaptation but fail to generalize to out-of-distribution tasks.
We describe two techniques that significantly improve the running time of several standard machine-learning algorithms when data is sparse. The first technique is an algorithm that effeciently extracts one-way and two-way counts--either real or expected-- from discrete data. Extracting such counts is a fundamental step…
The paper reviews machine learning safety techniques for autonomous vehicles.
problem Challenges in machine learning safety for autonomous vehicles.
method Organizes practical safety techniques to complement engineering safety.
result Enhances dependability and safety of machine learning algorithms in autonomous vehicles.
This paper surveys techniques to personalize federated learning models.
problem Personalized models outperform shared models for some clients, reducing participation.
method Surveys recent research on personalizing federated learning models.
result Personalization techniques improve model performance for individual clients.
New technique improves imitation learning by preventing local minima and exploring states.
problem Behavioral cloning gets stuck in local minima and lacks effective exploration.
method Two-phase model with sampling mechanisms and self-attention modules.
result Significantly outperforms previous state-of-the-art in various environments.
In this work we present a technique to use natural language to help reinforcement learning generalize to unseen environments. This technique uses neural machine translation, specifically the use of encoder-decoder networks, to learn associations between natural language behavior descriptions and state-action informatio…
GraphGen generates large labeled graphs efficiently and accurately.
problem Scalability and comprehensive evaluation of graph generation techniques.
method Converts graphs to sequences using minimum DFS codes and learns joint distributions with an LSTM.
result Significantly faster and better quality than state-of-the-art techniques.
Survey examines anomaly detection methods for deep learning.
problem Out-of-distribution and adversarial examples in deep learning.
method Taxonomy of existing anomaly detection techniques.
result Discussion of strengths and weaknesses of techniques.
RL techniques improve radar spectrum sharing in crowded conditions.
problem Optimizing radar performance in congested spectrum environments.
method Comparison of RL algorithms including policy iteration and Deep RL.
result RL techniques outperform traditional SAA methods in radar spectrum sharing.
Determining the quality of the results obtained by clustering techniques is a key issue in unsupervised machine learning. Many authors have discussed the desirable features of good clustering algorithms. However, Jon Kleinberg established an impossibility theorem for clustering. As a consequence, a wealth of studies ha…
This paper reviews deep learning techniques for face recognition and sketch matching.
problem Matching composite sketches to photo images of faces is challenging due to limited details.
method Uses deep learning for feature extraction and classification in face recognition.
result Deep learning improves face recognition accuracy with large datasets.
The energy output a photo voltaic(PV) panel is a function of solar irradiation and weather parameters like temperature and wind speed etc. A general measure for solar irradiation called Global Horizontal Irradiance (GHI), customarily reported in Watt/meter2, is a generic indicator for this intermittent energy resour…
This paper explores deep learning in music generation, from history to current techniques.
problem Creating music automatically using deep learning.
method Analysis of historical and recent deep learning music generation systems.
result Deep learning can learn musical styles and generate music samples.
The recent advances in deep neural networks (DNNs) make them attractive for embedded systems. However, it can take a long time for DNNs to make an inference on resource-constrained computing devices. Model compression techniques can address the computation issue of deep inference on embedded devices. This technique is …
Paper proposes an iterative NAS technique inspired by Boolean function learning.
problem Challenges in Neural Architecture Search (NAS).
method Inspired by algorithms for learning low-degree sparse Boolean functions.
result Validated on DARTs and NAS-Bench-201, providing theoretical analysis.
This study evaluates data pre-processing techniques for class imbalance in biomedical data.
problem Class imbalance in biomedical datasets affects model performance.
method Resampling and feature selection techniques evaluated using SVM, C4.5, LDA, and KNN classifiers.
result Feature Selection outperforms other methods in most cases, especially with SVM.
The paper proposes a deep learning technique for structured and composable representations.
problem Learning structured and composable representations from input images and discrete labels.
method End-to-end deep learning to learn representations based on distance estimates between class label and contextual information.
result The representations have a clear structure allowing for class and environment decomposition.
Generating a description of an image is called image captioning. Image captioning requires to recognize the important objects, their attributes and their relationships in an image. It also needs to generate syntactically and semantically correct sentences. Deep learning-based techniques are capable of handling the comp…
Deep learning is a broad set of techniques that uses multiple layers of representation to automatically learn relevant features directly from structured data. Recently, such techniques have yielded record-breaking results on a diverse set of difficult machine learning tasks in computer vision, speech recognition, and n…
This paper proposes neural network-based undersampling techniques to improve model performance on class-imbalanced datasets.
problem Class imbalance problem in machine learning models leads to biased predictions and lower performance metrics.
method Neural network-based undersampling techniques applied to class-imbalanced datasets.
result Neural network-based undersampling outperforms other resampling techniques in terms of AUC, F1, and G-mean scores.
Several applications of Reinforcement Learning suffer from instability due to high variance. This is especially prevalent in high dimensional domains. Regularization is a commonly used technique in machine learning to reduce variance, at the cost of introducing some bias. Most existing regularization techniques focus o…
Enhances load forecasting for multiple entities with dynamic similarities.
problem Inaccurate probabilistic load predictions due to uncertainties and dynamic changes.
method Online multi-task learning for probabilistic load forecasting.
result Significantly enhances load forecasting accuracy across various scenarios.
Survey of deep learning methods for medical anomaly detection.
problem Medical anomaly detection using machine learning.
method Thorough review of deep learning techniques across various medical domains.
result Comparison and contrast of deep learning models and their limitations.
Compact SE models are created with PP and PQ techniques, reducing size by 10.03%.
problem Balancing denoising performance and computational cost in SE models.
method Parameter pruning and quantization techniques integrated for compactness.
result 10.03% reduction in model size with minor performance losses.