Semi-supervised method predicts faults in systems with multiple operation modes.
problem Fault detection in industrial systems with missing target data.
method Semi-supervised soft sensor modeling incorporating mode transition properties.
result Regression coefficients estimated under constraint conditions from mode transitions.
Study develops a semi-supervised deep ResNet for Wi-Fi mode detection.
problem Utilizing Wi-Fi signals for multimodal transportation mode detection with limited labeled data.
method Semi-supervised deep residual network (ResNet) framework.
result Framework achieves high prediction accuracy (81.8% for walking, 82.5% for biking, 86.0% for driving).
Study provides guidelines for smartphone-based transportation mode detection.
problem Developing a reliable transportation mode detection system using smartphone sensors.
method Detailed dataset construction, sensor relevance analysis, and unknown user detection.
result Demonstrated the feasibility and effectiveness of smartphone-based TMD.
Multimodal clustering is an unsupervised technique for mining interesting patterns in n-adic binary relations or n-mode networks. Among different types of such generalized patterns one can find biclusters and formal concepts (maximal bicliques) for 2-mode case, triclusters and triconcepts for 3-mode case, closed $n…
The paper develops methods to infer modes of linear systems from noisy data.
problem Detecting oscillations in power flow in AC electrical networks.
method Develops methods to infer modes (real or complex) from observations of linear systems forced by Gaussian noise.
result Inference of damping rates, frequencies, and mode shapes for real and complex modes.
Microwave-based breast cancer detection has been proposed as a complementary approach to compensate for some drawbacks of existing breast cancer detection techniques. Among the existing microwave breast cancer detection methods, machine learning-type algorithms have recently become more popular. These focus on detectin…
New tool detects 'fleeting modes' causing excess risk in financial markets.
problem Detecting portfolios with statistically significant excess risk in financial markets.
method Random Matrix Theory to identify 'fleeting modes' independent of underlying correlation structure.
result Fleeting modes exist in both futures and equity markets, and momentum is a source of excess risk.
We utilize Wi-Fi communications from smartphones to predict their mobility mode, i.e. walking, biking and driving. Wi-Fi sensors were deployed at four strategic locations in a closed loop on streets in downtown Toronto. Deep neural network (Multilayer Perceptron) along with three decision tree based classifiers (Decisi…
Predicting transportation modes from GPS (Global Positioning System) records is a hot topic in the trajectory mining domain. Each GPS record is called a trajectory point and a trajectory is a sequence of these points. Trajectory mining has applications including but not limited to transportation mode detection, tourism…
DMD separates mixed time series with uncorrelated components.
problem Separating mixed time series with uncorrelated components.
method Dynamic Mode Decomposition (DMD) applied to a data matrix of mixed time series.
result DMD can approximate the mixing matrix of uncorrelated time series.
Develops MENT for interpreting and detecting changes in network trajectories.
problem Distortion of network geometry and invalidation of temporal comparisons in dynamic network analysis.
method Develops Multiscale Euclidean Network Trajectories (MENT) framework based on second-moment geometry.
result Validates and interprets network trajectories through isotropic normalization and orthogonal transformations.
TailGAN uses GANs to detect anomalies near data distribution tails.
problem Anomaly detection near data distribution tails with current GAN limitations.
method TailGAN leverages GANs with maximum entropy regularization to generate and detect anomalies near data distribution tails.
result TailGAN achieves competitive performance on various datasets compared to existing methods.
New method prevents mode collapse in deep SVDD for anomaly detection.
problem Mode collapse in deep SVDD due to architectural constraints.
method Two regularizers: noise injection and minibatch variance penalization.
result Regularized deep SVDD outperforms state-of-the-art methods.
Deep learning helps remove secondary B-mode polarization to detect primordial gravitational waves.
problem Removing secondary B-mode polarization from CMB data to detect primordial gravitational waves. method Applied deep learning (ResUNet-CMB) to estimate and remove multiple sources of secondary B-mode polarization. result Deep learning can produce nearly optimal, unbiased estimates of the amplitude of primordial gravitational waves.
Hybrid f0 extraction method for various speech modes with high accuracy.
problem Reliable f0 extraction across different speech modes.
method Ordinal regression CNN and filtering/autocorrelation for pitch estimation.
result Significantly reduces pitch detection error and generalizes to unseen modes.
Proposes a flexible normalization method to handle multi-modal data.
problem Reduced effectiveness of batch normalization in multi-modal distributions.
method Extends normalization to multiple means and variances, detecting data modes on-the-fly.
result Outperforms batch normalization and other methods in various experiments.
Transfer learning improves chatter detection accuracy with EEMD over WPT.
problem Improving chatter detection accuracy in metal cutting using transfer learning.
method Wavelet Packet Transform (WPT) and Ensemble Empirical Mode Decomposition (EEMD) for feature extraction; Support Vector Machine (SVM), Logistic Regression, Random Forest Classification, and Gradient Boosting with RFE for classification; Transfer learning applied to different turning configurations.
result EEMD outperforms WPT in transfer learning applications, achieving up to 95% accuracy.
K-Metamodes clusters security data without converting categorical attributes.
problem Clustering heterogeneous security data sets with categorical and numerical attributes.
method Frequency-based distance function for ensemble-based k-modes clustering, adapted feature discretisation.
result Higher effectiveness compared to previous methods on public security data sets.
Proposes hinge-Wasserstein to improve uncertainty estimation in regression tasks.
problem Estimating multimodal aleatoric uncertainty in regression tasks from images.
method Regression-by-classification paradigm with hinge-Wasserstein loss.
result Hinge-Wasserstein loss improves uncertainty estimation on challenging tasks.
The paper reviews techniques for detecting errors in semantic segmentation models.
problem Detecting false positives and false negatives in semantic segmentation models.
method Uncertainty quantification techniques applied to semantic segmentation.
result Techniques for detecting false positives and false negatives are proposed and discussed.
We introduce a Bayesian defect detector to facilitate the defect detection on the motion blurred images on rough texture surfaces. To enhance the accuracy of Bayesian detection on removing non-defect pixels, we develop a class of reflected non-local prior distributions, which is constructed by using the mode of a distr…
We investigate nearest neighbor and generative models for transferring pose between persons. We take in a video of one person performing a sequence of actions and attempt to generate a video of another person performing the same actions. Our generative model (pix2pix) outperforms k-NN at both generating corresponding f…
ERDMD discovers sparse, nonuniformly timed DMD models from chaotic attractors.
problem Discovering high-fidelity, nonuniformly timed DMD models from chaotic data.
method Entropic regression for nonlinear information flow detection, combined with multi-step DMD.
result ERDMD produces highly efficient and robust models with minimal complexity.
Kernel methods detect coherent structures in dynamical data.
problem Detecting coherent structures in complex dynamical systems.
method Kernel-based dimensionality reduction techniques and eigendecompositions of RKHS operators.
result Coherent sets of particle trajectories can be computed by kernel CCA.
Community detection in graphs has been the subject of many algorithms. Recent methods want to optimize a modularity function which shows a maximum of relationships within communities and found a minimum of inter-community relations. these algorithms are applied to unipartite, multipartite and directed graphs. However, …
Adaptive Stress Testing detects financial fraud by simulating potential failures.
problem Detecting and mitigating vulnerabilities in financial systems.
method Developed a simplified model using historical data and reinforcement learning.
result Identified the most likely path to system failure and improved fraud detection.
VAEBM combines VAEs and EBMs for efficient image generation.
problem Sampling from EBMs is slow and VAEs generate blurry images.
method VAEBM uses a VAE for quick sampling and an EBM to refine and exclude non-data regions.
result VAEBM generates high-quality images with short MCMC chains.
Proposes a method to sample from flat basins of posterior distributions in Bayesian deep learning.
problem Sampling from multi-modal posterior distributions leads to overfitting due to trapping in bad modes.
method Introduces an auxiliary guiding variable to bias MCMC sampling towards flat basins of the energy landscape.
result The method converges faster and outperforms existing methods in sampling from flat basins of the posterior.
iWGAN improves GANs by stabilizing training and preventing mode collapse.
problem Stable and effective training of GANs with mode collapse.
method iWGAN combines auto-encoders and WGANs using iterative primal dual optimization.
result iWGAN provides a clear stopping criterion and mitigates mode collapse.
VINNAS uses variational inference to avoid mode collapse in neural architecture search.
problem Mode collapse in gradient-based NAS methods, leading to suboptimal architectures.
method Differentiable variational inference with variational dropout and automatic relevance determination.
result State-of-the-art accuracy with up to twice fewer non-zero parameters.
BADAC combines Bayesian methods for anomaly detection and classification.
problem Statistical uncertainties in machine learning algorithms, especially for anomaly detection.
method Unified hierarchical Bayesian framework that marginalizes over unknown data values.
result BADAC outperforms standard algorithms in classification and anomaly detection with uncertainties.
Measuring uncertainty is a promising technique for detecting adversarial examples, crafted inputs on which the model predicts an incorrect class with high confidence. But many measures of uncertainty exist, including predictive en- tropy and mutual information, each capturing different types of uncertainty. We study th…
Paper introduces an unsupervised tensor-based anomaly detection method for spatiotemporal data.
problem Challenges in detecting anomalies in spatiotemporal data, especially in urban traffic monitoring and medical imaging.
method Formulates anomaly detection as a regularized robust low-rank + sparse tensor decomposition, incorporating spatiotemporal smoothness and local dependencies.
result Demonstrates improved anomaly detection performance on both synthetic and real data.
Detects synchronized behavior in streaming data.
problem Tracking synchronized behavior in time-stamped tuples.
method AugSplicing algorithm for streaming dense block detection.
result Effective and robust in detecting anomalous behavior.
TinyML models detect RF and cyber threats in spacecraft with low latency.
problem Detecting cyber-RF threats in autonomous spacecraft with low latency.
method Analysis of classical models (RF, LR, SVM, MLP) for latency-accuracy trade-offs.
result Logistic Regression achieves microsecond-level inference with minimal accuracy loss.
Community detection using both graphs and social networks is the focus of many algorithms. Recent methods aimed at optimizing the so-called modularity function proceed by maximizing relations within communities while minimizing inter-community relations. However, given the NP-completeness of the problem, these algorith…
Improved KSD test for better detection of differences in distributions.
problem Low power of KSD test when distributions have same modes but different mixing proportions.
method Perturb the observed sample using Markov transition kernels to improve KSD test power.
result Perturbed KSD test can lead to substantially higher power than the original KSD test.
Bipartite networks are a common type of network data in which there are two types of vertices, and only vertices of different types can be connected. While bipartite networks exhibit community structure like their unipartite counterparts, existing approaches to bipartite community detection have drawbacks, including im…
Periodic surfaces have a limited number of bending modes, equal to their membrane modes.
problem Understanding the limitations of bending modes in periodic surfaces.
method Analyzing deformation modes of periodic, piecewise smooth, simply connected surfaces.
result Effective membrane modes and bending modes are orthogonal, limiting the total number of modes to 3.
New measures quantify diversity of latent representations using metric space magnitude.
problem Evaluating the diversity of latent representations in machine learning models.
method Developed magnitude-based measures for latent representations, stable under data perturbations.
result Demonstrated superior performance across various domains and tasks.
Geometric approach improves functional outlier detection.
problem Detecting outliers in functional data sets.
method Developed a geometric perspective on functional manifold for outlier detection.
result Improved understanding and differentiation of outliers.
Sparse-mode DMD disambiguates local and global modes in spatiotemporal data.
problem Disambiguating local and global modes in spatiotemporal data.
method Sparse-mode DMD with sparsity-promoting regularization.
result Explicitly constructs discrete and continuous spectra.
Paper presents ADEPOS framework for energy-efficient anomaly detection.
problem Energy and bandwidth limitations in IoT systems.
method Low precision computing and adaptive neural networks.
result 8.95X energy savings with no loss in detection accuracy.
Evaluating generative adversarial networks (GANs) is inherently challenging. In this paper, we revisit several representative sample-based evaluation metrics for GANs, and address the problem of how to evaluate the evaluation metrics. We start with a few necessary conditions for metrics to produce meaningful scores, su…
Motivated by advantages of current-mode design, this brief contribution explores the implementation of weight matrices in neuromemristive systems via current-mode memristor crossbar circuits. After deriving theoretical results for the range and distribution of weights in the current-mode design, it is shown that any we…
While Generative Adversarial Networks (GANs) have empirically produced impressive results on learning complex real-world distributions, recent works have shown that they suffer from lack of diversity or mode collapse. The theoretical work of Arora et al. suggests a dilemma about GANs' statistical properties: powerful d…
Gaussian Processes outperform other models in estimating uncertainty for radiology report observation detection.
problem Uncertainty quantification in automatic data labelling for semi-supervised learning in clinical NLP.
method Investigation of uncertainty estimates from various predictive models using NLPP and MMPCL metrics.
result Gaussian Processes provide superior performance in quantifying uncertainty for radiology report observation detection.
Reliable data quality monitoring is a key asset in delivering collision data suitable for physics analysis in any modern large-scale High Energy Physics experiment. This paper focuses on the use of artificial neural networks for supervised and semi-supervised problems related to the identification of anomalies in the d…