Paper proposes a non-iterative method to speed up DCNN training.
problem Training deep convolutional neural networks (DCNN) is time-consuming.
method Eliminates backpropagation at dense layers using Moore-Penrose Inverse.
result Significant performance improvements over 30 state-of-the-art methods.
A new method for fast, non-iterative graphical model estimation.
problem Scalability issues in iterative proportional fitting for high-dimensional data.
method Non-iterative approach for positive definite graphical model estimation.
result The proposed method outperforms state-of-the-art methods in high-dimensional settings.
Two methods allow non-iterative fusion of knowledge in neural networks.
problem Combining new knowledge into existing neural networks without retraining.
method Two methods: weight summation and modification of non-essential weights.
result Fused networks perform better than chance level in classification tasks.
A fast, non-iterative method for missing value imputation using random trees.
problem Missing value imputation in large and high-dimensional datasets.
method Recursive semi-random hyperplane cuts to assign observations to buckets and calculate weighted averages as imputations.
result Significantly faster than chained equations and scales well to large datasets.
Efficient methods for sparse random projections improve classification accuracy in very high-dimensional data.
problem Handling very high-dimensional sparse data efficiently.
method Non-iterative and iterative classification methods using sparse random projections and Jaccard kernel.
result Non-iterative methods yield larger, more accurate models than iterative methods.
Proposes a new ridge estimator for smooth covariates with adaptive centering.
problem Estimating coefficients and center function for smooth covariates in linear models.
method SACR framework with convex formulation, roughness penalty, and adaptive centering.
result Improves prediction and variable selection for smooth covariates.
New algorithm identifies outliers in PCA without needing parameters.
problem Robust PCA with unknown outlier fraction and subspace dimension.
method Non-iterative, parameter-free method for structured and unstructured outliers.
result Analytical guarantees and performance comparison with existing methods.
New method solves inverse Ising problem without iteration.
problem Solving inverse Ising problems accurately and non-iteratively.
method Tree-reweighted approximation for analytic solution.
result Optimal interaction matrix derived analytically.
Optimized parallel RNN training reaches up to 845x speedup.
problem Expensive RNN training through back-propagation through time (BPTT).
method Optimized parallel algorithm \opt based on ELM, leveraging GPU shared memory and QR factorization.
result Up to 845x speedup over sequential training and 20x less time to train.
Efficiently compress neural networks with MUSCO method.
problem Compression of deep neural networks.
method Iterative approach alternating low-rank factorization with rank selection and fine-tuning.
result Improves compression rate while maintaining accuracy.
Deep learning improves causal effect estimation from complex observational data.
problem Estimating causal effects from complex observational data with low bias.
method Unified deep learning framework using multitask recurrent neural networks.
result Deep learning estimator shows lower bias in causal effect estimates.
New methods improve accuracy in detecting concentric objects.
problem Detecting concentric geometric objects in noisy data.
method Developed new estimators and compared performance of existing methods.
result New methods outperform existing non-iterative methods and are robust to noise.
BM2 learns Schrödinger bridges using neural networks.
problem Learning dynamic transport maps between two distributions.
method Coupled Bridge Matching (BM2) with neural networks. result Preliminary theoretical analysis and numerical experiments show BM2's effectiveness. New method resolves density ratio estimation saturation issues.
problem Error saturation in density ratio estimation methods.
method Iterated regularization to improve kernel methods.
result Achieves fast error rates on regular learning problems.
We introduce a new method for sparse principal component analysis, based on the aggregation of eigenvector information from carefully-selected axis-aligned random projections of the sample covariance matrix. Unlike most alternative approaches, our algorithm is non-iterative, so is not vulnerable to a bad choice of init…
Paper discusses the pseudoinverse learning algorithm and its variants.
problem Improving learning algorithms for neural networks.
method Review and discussion of the pseudoinverse learning algorithm and its variants.
result Extreme Learning Machine (ELM) is a variant of the pseudoinverse learning algorithm.
A method to simplify deep neural networks for specific tasks.
problem Reducing deep neural networks to a smaller size while maintaining functionality.
method Advanced Supervised Principal Component Analysis-based shallowing algorithm.
result The method can reduce network depth without significant performance loss.
SNAP improves robust computation by emphasizing trustworthy items and downweighting outliers.
problem Improving robustness in computation, especially in high-dimensional settings.
method SNAP assigns weights based on mutual agreement, suppressing outlier contributions.
result SNAP ensures outliers contribute negligibly to computations, even in high-dimensional settings.
We propose a new framework for manifold denoising based on processing in the graph Fourier frequency domain, derived from the spectral decomposition of the discrete graph Laplacian. Our approach uses the Spectral Graph Wavelet transform in order to per- form non-iterative denoising directly in the graph frequency domai…
Nowadays, data are generated massively and rapidly from scientific fields as bioinformatics, neuroscience and astronomy to business and engineering fields. Cluster analysis, as one of the major data analysis tools, is therefore more significant than ever. We propose in this work an effective Semi-supervised Divisive Cl…
'Big' high-dimensional data are commonly analyzed in low-dimensions, after performing a dimensionality-reduction step that inherently distorts the data structure. For the same purpose, clustering methods are also often used. These methods also introduce a bias, either by starting from the assumption of a particular geo…
Highly expressive directed latent variable models, such as sigmoid belief networks, are difficult to train on large datasets because exact inference in them is intractable and none of the approximate inference methods that have been applied to them scale well. We propose a fast non-iterative approximate inference metho…
Proposes AE for robust PCA, improving robustness to outliers.
problem PCA's sensitivity to outliers.
method Angular Embedding (AE) and Truncated Angular Embedding (TAE).
result AE/TAE outperforms state-of-the-art RPCA methods.
Hidden Markov models have successfully been applied as models of discrete time series in many fields. Often, when applied in practice, the parameters of these models have to be estimated. The currently predominating identification methods, such as maximum-likelihood estimation and especially expectation-maximization, a…
XIMP improves molecular property prediction by integrating multiple graph representations.
problem Graph neural networks struggle in data-scarce regimes and fail to surpass traditional methods.
method Cross-graph inter-message passing with multiple graph abstractions.
result XIMP outperforms state-of-the-art baselines across diverse molecular property tasks.
New algorithm improves online binary classification with constant time complexity.
problem Online binary classification with rebalancing.
method Non-iteratively reweighted recursive least-squares.
result Exacts converges to batch formulation and outperforms existing algorithms.
BCD-Net improves low-dose CT image reconstruction.
problem Challenges in obtaining accurate low-dose CT images.
method Modified iterative regression CNN, BCD-Net, with faster numerical solvers.
result BCD-Net achieves better image quality and generalization than state-of-the-art methods.
Randomly chosen primary hidden units and derived secondary units reduce neural network complexity.
problem Large number of hidden units in neural networks.
method Introducing primary and secondary hidden units with random weights for primary units and derived weights for secondary units.
result Significant reduction in the number of hidden units without compromising accuracy.
The calibration of a measurement device is crucial for every scientific experiment, where a signal has to be inferred from data. We present CURE, the calibration uncertainty renormalized estimator, to reconstruct a signal and simultaneously the instrument's calibration from the same data without knowing the exact calib…
We reduce a broad class of machine learning problems, usually addressed by EM or sampling, to the problem of finding the k extremal rays spanning the conical hull of a data point set. These k "anchors" lead to a global solution and a more interpretable model that can even outperform EM and sampling on generalizatio…
RPE detects anomalies robustly in time-series data.
problem Detecting anomalies in time-series data efficiently and robustly.
method Window-based, robust projection step, closed-form algorithm.
result RPE can identify anomalies in time-stamp level and outperforms existing methods.
New framework models non-conservative stochastic processes without energy conservation constraints.
problem Existing Schrödinger Bridge methods are limited by energy-conservation assumptions.
method Introduces non-conservative generalized Schrödinger bridge (NCGSB) based on contact Hamiltonian mechanics.
result Contact Wasserstein geodesic (CWG) provides a broader class of real-world stochastic processes.
This paper presents a remarkably simple, yet powerful, algorithm termed Coherence Pursuit (CoP) to robust Principal Component Analysis (PCA). As inliers lie in a low dimensional subspace and are mostly correlated, an inlier is likely to have strong mutual coherence with a large number of data points. By contrast, outli…
A new method detects changes in mixture models quickly and accurately.
problem Detecting changes in mixture models with heavy-tailed components.
method Change-point methods based on robust and quick approach.
result The method is up to 500 times faster and more accurate than existing methods.
AI systems can be corrected without rebuilding them, using simple linear methods.
problem Errors in AI systems can lead to serious consequences.
method Developed fast non-destructive methods using linear Fisher discriminant.
result Simple linear methods can separate error-prone situations from correct ones.
Proposes a new model for directed graphs combining deep learning and latent variable models.
problem Graph representation learning for directed graphs.
method Deep Latent Space Model (DLSM) integrating GCN encoder and stochastic decoder with hierarchical variational auto-encoder architecture.
result Achieves state-of-the-art performance on link prediction and community detection tasks.
Spectral algorithm reduces samples needed for multitask regression.
problem Jointly recover shared and task-specific components in low-rank multitask regression.
method Common mechanism regression (CMR) model with a non-iterative spectral algorithm.
result Provable non-convex bi-linear structure is overcome with spectral algorithm.
This paper is concerned with the problem of top-K ranking from pairwise comparisons. Given a collection of n items and a few pairwise comparisons across them, one wishes to identify the set of K items that receive the highest ranks. To tackle this problem, we adopt the logistic parametric model --- the Bradley-Te…
DADC algorithm improves clustering for data with varying density.
problem Sparse cluster loss and cluster fragmentation in density peak clustering.
method Domain-adaptive density measurement, cluster center self-identification, and cluster self-ensemble.
result DADC achieves more reasonable clustering results on data with varying density.
The European market clearing problem is characterized by a set of heterogeneous orders and rules that force the implementation of heuristic and iterative solving methods. In particular, curtailable block orders and the uniform purchase price (UPP) pose serious difficulties. A block is an order that spans over multiple …
TinyBayes detects crop diseases from images on edge devices with high accuracy and minimal resources.
problem Automated disease detection for cocoa crops in resource-constrained settings.
method Combines YOLOv8-Nano for lesion localisation, MobileNetV3-Small for feature extraction, and Jacobi prior for Bayesian classification.
result Achieves 78.7% accuracy on Amini Cocoa Contamination Challenge dataset with 9.5 MB model size and 150 ms inference time.
While loopy belief propagation (LBP) performs reasonably well for inference in some Gaussian graphical models with cycles, its performance is unsatisfactory for many others. In particular for some models LBP does not converge, and in general when it does converge, the computed variances are incorrect (except for cycle-…
This work proposes external correctors for quick AI error corrections without system modification.
problem Quick corrections of AI errors without modifying legacy systems.
method Special `external` devices with classifiers for high-dimensional data.
result Simple classifiers can correct small errors in high-dimensional data.