New method helps nonconvex optimization algorithms avoid local minima.
problem Nonconvex optimization problems often get stuck in local minima.
method Run-and-Inspect Method: Adds inspection phase to existing algorithms.
result Approximate R-local minimizers are globally optimal under certain conditions.
Framework for efficient defect classification and inspection.
problem Adaptive defect classification and inspection from high volume data.
method Continual learning framework for dynamic classifier updates.
result Efficient storage and computational needs reduction.
New dataset for industrial machine malfunction detection with domain shifts.
problem Challenges in detecting anomalies due to domain shifts in industrial sounds.
method Created a dataset with domain shifts for five types of industrial machines.
result Significant performance differences between source and target domains.
Novel anti-grokking phase discovered in neural networks, revealed by HTSR layer quality metric.
problem Understanding and detecting overfitting in neural networks.
method 3-layer MLP, weight decay, HTSR layer quality metric α, correlation traps, Kolmogorov–Smirnov tests. result Anti-grokking phase detected late in training, revealed by α<2 and correlation traps. Deep learning improves defect classification in real-time surface inspection.
problem Real-time defect classification in manufacturing industry using limited datasets.
method Convolutional Neural Networks (CNNs) designed for speed and accuracy, neural data augmentation for class imbalance.
result 98.0% accuracy in binary defect classification with 22,000 labeled images.
Deep learning detects corrosion in nuclear fuel canisters.
problem Ensuring safety and integrity of used nuclear fuel dry storage canisters.
method Residual neural networks (ResNets) for real-time corrosion detection of canister images.
result Deep learning approach accurately detects corrosion and classifies canisters as corroded or intact.
New insights into how to inspect and learn from multi-stage processes and AI reasoning.
problem Understanding how to attribute outcomes to early stages in multi-stage operations and AI reasoning.
method Information-theoretic analysis and mathematical proofs of four key results.
result Uniform checkpoint spacing is minimax-optimal for inspection design under homogeneous signal attenuation.
Paper proposes machine learning models for more accurate road inspection.
problem Traditional road inspection systems have safety, energy, and cost issues.
method Hybrid machine learning models using surface deflection data from FWD tests.
result CMIS model outperforms other models with APRE=2.3303, AAPRE=11.6768, RMSE=12.0056, and SD=0.0210.
Study examines human factors in radiographic testing to improve inspection performance.
problem Insufficient consideration of human and organizational factors in NDT.
method CREAM method applied to analyze and model HOF on radiogram interpretation tasks.
result Model CREAM well-adapted for estimating HOF impact on NDT performances.
Enhances privacy in data annotation and inspection with synthetic data.
problem Improving privacy in machine learning tasks like data annotation and inspection.
method Employing Bayesian differential privacy to generate higher-fidelity synthetic data.
result Produces higher-fidelity samples, detecting more subtle data errors and biases.
We identify spectral conditions for reliable neural probe interpretation.
problem Unreliable performance of linear probes in interpreting neural representations.
method Formalized Spectral Identifiability Principle (SIP) based on eigengap and Fisher error.
result Reliability of neural probes depends on the eigengap relative to Fisher estimation error.
Generative models help debug data issues in private, decentralized datasets.
problem Manual data inspection is impractical for private, decentralized datasets.
method Differentially private federated generative models.
result Generative models can effectively debug data issues in private datasets.
Study compares deep feature methods for anomaly detection in limited data scenarios.
problem Handling limited data in industrial inspection applications.
method Three approaches (KNN, Mahalanobis, PaDiM) using pre-trained deep features with data augmentation.
result Data augmentation significantly improves performance in small data regimes.
A curve around a sphere must be at least 4π long.
problem Finding the shortest closed curve that encloses a sphere.
method Analyzing curves in Euclidean 3-space and comparing their lengths.
result The shortest curve is composed of 4 semicircles arranged like a baseball seam.
We develop the concept of Cartan ribbons together with a rolling-based method to ribbonize and approximate any given surface in space by intrinsically flat ribbons. The rolling requires that the geodesic curvature along the contact curve on the surface agrees with the geodesic curvature of the corresponding Cartan deve…
This work tackles maintenance planning with deep reinforcement learning under uncertainty.
problem Optimizing inspection and maintenance policies in deteriorating environments with incomplete information and constraints.
method Joint framework of constrained POMDPs and multi-agent DRL addressing challenges of state/action space, history, uncertainty, and constraints.
result The proposed framework outperforms existing methods in resource and risk-aware decision-making.
Unified probabilistic models improve audio signal processing efficiency and interpretability.
problem High computational cost and difficulty in interpreting probabilistic models in time-frequency analysis.
method Equivalence to Spectral Mixture Gaussian processes, state space representation, Kalman smoothing, efficient parameter learning.
result Unified models make it easier to interpret and modify model assumptions.
There is an especially strong need in modern large-scale data analysis to prioritize samples for manual inspection. For example, the inspection could target important mislabeled samples or key vulnerabilities exploitable by an adversarial attack. In order to solve the "needle in the haystack" problem of which samples t…
Bayes-TrEx finds in-distribution examples for model inspection.
problem Challenges in interpreting neural networks, especially high-confidence failures and ambiguous classifications.
method Bayesian sampling approach to find in-distribution examples with specified prediction confidence.
result Bayes-TrEx enables more flexible holistic model analysis than just inspecting the test set.
Active learning improves inspection systems by using weakly labeled data.
problem Rapidly updating machine vision inspection systems in evolving manufacturing processes.
method Developed a methodology for active learning from weakly labeled data, addressing covariate shift with domain-adversarial training.
result Demonstrated that active learning can accelerate the annotation process and reduce false positives.
Federated CTMC model estimates bridge deterioration hazards without sharing raw data.
problem Bridge inspection data privacy and cross-organizational data sharing constraints.
method Federated CTMC hazard model with local optimization and FedAvg aggregation.
result Federated model converges on global benchmark parameters without data transfer.
Inspection-L detects illicit cryptocurrency transactions using GNNs and self-supervised learning.
problem Detect illicit cryptocurrency transactions for anti-money laundering.
method Graph Neural Network (GNN) framework based on self-supervised Deep Graph Infomax (DGI) and Graph Isomorphism Network (GIN) with supervised learning algorithms.
result Inspection-L outperforms state-of-the-art methods in key classification metrics.
Interactive framework improves understanding of deep neural networks.
problem False sense of comprehension from static explanation methods.
method Interactive framework allowing exhaustive inspection and testing of decisions.
result Interactive approach leads to better understanding of complex decision boundaries.
We briefly review our recent studies on stochastic processes modelling internet on-line trading. We present a way to evaluate the average waiting time between the observation of the price in financial markets and the next price change, especially in an on-line foreign exchange trading service for individual customers v…
The paper corrects biases in estimating intrinsic dimension and differential entropy.
problem Systematic bias in estimating intrinsic dimension and differential entropy.
method A bias-corrected estimator for both measures is proposed, highlighting shared steps and useful consequences.
result Simultaneous estimation of differential entropy and intrinsic dimension provides complementary perspectives on underlying manifolds.
A new image representation method using hypernetworks.
problem Representing images in a way that allows for continuous manipulation and analysis.
method Constructing a hypernetwork that maps pixel positions to colors, allowing for continuous image manipulation.
result Comparable image super-resolution results to existing methods using a single model.
Manifold visualizes machine learning model outcomes without accessing their internal logic.
problem Lack of generic frameworks for interpreting and diagnosing different machine learning models.
method Generic framework that observes inputs and outputs, not model's internal logic.
result Supports interpretation, debugging, and comparison of machine learning models in a transparent and interactive manner.
The paper proposes a mechanism for business cycles using coupled real economy and stock market dynamics.
problem Understanding and predicting business cycles.
method Developed a dynamic stock market model based on opinion interactions and integrated it into a macroeconomic framework.
result The model generates quasiperiodic fluctuations (business cycles) through coupled real economy and stock market dynamics.
New method learns search policies by inspecting and improving past roll-outs.
problem Learning good search policies for complex combinatorial spaces.
method Retrospective imitation learning, improving policy through past roll-outs.
result Policy can iteratively scale up to larger problems.
Random forest model predicts sewer pipe deterioration with high accuracy.
problem Challenges in predicting and scheduling sewer pipe inspections.
method Random forest classification model for sewer pipe condition prediction.
result Model achieved excellent AUC of 0.81 in a case study for City of LA.
MMD-Flagger detects hallucinations in LLMs by tracking MMD between outputs and temperature-generated counterparts.
problem Detecting hallucinations in large language models.
method Maximum Mean Discrepancy (MMD) to track the difference between model outputs and temperature-generated counterparts.
result MMD-Flagger detects most hallucinations by analyzing the shape of the MMD trajectory.
SparseIDS uses RL to significantly reduce packet inspection in IDSs.
problem Efficiently inspecting large volumes of network packets for security threats.
method SparseIDS employs RL to learn optimal packet sampling strategies.
result SparseIDS reduces packet inspection by more than 75% while maintaining high accuracy.
Study optimizes inspection and monitoring of deteriorating structures using POMDPs.
problem Optimizing decision-making for deteriorating engineering systems with uncertain observations.
method Developed theoretical and computational foundations for Value of Information (VoI) and Value of Structural Health Monitoring (VoSHM) in POMDPs.
result POMDP policies inherently leverage VoI to guide optimal observational actions, improving long-term cost.
Study uncovers that loan maturity layers in interbank networks are crucial for understanding their structure and functions.
problem Lack of maturity details in interbank lending networks hinders understanding of network structure and functions.
method Used a complete interbank loan contract dataset and applied the layered stochastic block model to investigate multiple maturity layers.
result Optimal maturity granularity reveals specific economic functions, such as liquidity intermediation and financing.
Study reveals how illiquidity network signals Chinese stock market crashes.
problem Understanding and predicting Chinese stock market crashes.
method Established an illiquidity network to model market dynamics.
result Market crashes are preceded by a more densely connected illiquidity network.
Improved VGG networks enhance image classification accuracy.
problem Enhancing image classification accuracy using modified VGG architectures.
method Two improved VGG architectures were created by freezing the first two blocks and applying different dilation rates in the last three blocks.
result Significant out-performance on image classification tasks on CIFAR-10 and CIFAR-100 datasets.
Machine learning analysis of galaxy catalogues finds only one class separable.
problem Difficulty in classifying galaxies using visual inspection schemes.
method Generalized Relevance Matrix Learning Vector Quantization and Random Forests.
result Only one class, Little Blue Spheroids, is consistently separable.
Solves Dirichlet problem for Lagrangian phase equation with critical and supercritical phase.
problem Solving Dirichlet problem for Lagrangian phase equation with critical and supercritical phase.
method Uses interior C2 estimate. result Result is sharp, showing existence of singular solutions in subcritical phase.
A statistical test controls false positives in anomaly localization using diffusion models.
problem Uncertainty and bias in generative models for anomaly localization.
method Selective inference to quantify significance and control false positives.
result The method effectively controls false positive detection rates.
Graph deep learning models are vulnerable to adversarial attacks, which this paper addresses.
problem Adversarial attacks on graph data models, especially their discreteness and imperceptible perturbations.
method Proposed both attack and defense techniques, including integrated gradients for attacks and graph inspection for defenses.
result Demonstrated the effectiveness of proposed methods through experiments on various datasets.
AKM2D framework speeds up anomaly detection in point-based sensing.
problem Efficient anomaly detection in point-based sensing systems.
method Adaptive Kernelized Maximum-Minimum Distance (AKM2D) framework for intelligent sequential sampling. result Balances exploration and exploitation for accurate anomaly quantification.
Convolutional neural networks learn phase-dependent frequency representations.
problem Capturing phase dependence in frequency representations for better signal analysis.
method Convolutional neural networks learn filters with different phases, which rectify to phase-dependent descriptors.
result Phase harmonics correlations can compressively represent signals with sparse wavelet coefficients.
Study on stable partitions in convex domains with three phases, finding disconnected phase stability.
problem Stability of partitions in convex domains with multiple phases.
method Careful derivation of the second variation of area, proving existence of stable partitions involving disconnected phases.
result Existence of stable partitions involving a disconnected phase in three phase problem.
New dataset for industrial machine sounds to aid maintenance.
problem Lack of public datasets for industrial machine sounds.
method Recorded normal and anomalous sounds of industrial machines.
result Assists in automated facility maintenance development.
It is commonly believed that increasing the interpretability of a machine learning model may decrease its predictive power. However, inspecting input-output relationships of those models using visual analytics, while treating them as black-box, can help to understand the reasoning behind outcomes without sacrificing pr…
Goresky, Kottwitz and MacPherson have recently shown that the computation of the equivariant cohomology ring of a G-manifold can be reduced to a computation in graph theory. This opens up the possibility that many of the fundamental theorems in equivariant de Rham theory may, on closer inspection, turn out simply to be…
New algorithms handle phase retrieval with rank d measurements, revealing phase transitions.
problem Phase retrieval with rank d measurements.
method Random duality theory (RDT) and descending phase retrieval algorithms (dPR).
result Minimal sample complexity ratio for dPR's success exhibits phase transitions.
DecompKAN improves time series forecasting accuracy and transparency.
problem Accurate and transparent time series forecasting in scientific domains.
method Combines decomposition, patching, normalization, and B-spline KAN edge functions.
result Achieves best or tied-best MSE on 20 of 36 comparisons across 9 datasets.