Adapts POD basis for parametric ROMs using pGP.
problem Updating POD basis for accurate system behavior over parameter space.
method Formulates problem as supervised statistical learning, uses pGP to learn mapping between parameter space and Grassmann manifold.
result Proposes pGP for optimal estimation of POD basis parameters and quantifies uncertainty.
New methods combine low and high-fidelity data for accurate surrogate modeling.
problem Challenges in surrogate modeling for high-dimensional outputs with limited training data.
method Projection-based multifidelity linear regression methods integrating low-fidelity and high-fidelity data.
result Multifidelity methods achieve up to 12% improvement in median accuracy compared to single-fidelity methods.
WeldNet reduces complex dynamics to simpler, manageable segments.
problem Complex, high-dimensional time-dependent datasets from physical processes are costly to simulate.
method Windowed Encoders for Learning Dynamics, splitting time domain into windows for nonlinear dimension reduction and propagator training.
result WeldNet captures nonlinear latent structures and dynamics, outperforming existing methods.
Sparse model for noisy datasets using hierarchical regularization.
problem Learning from large noisy datasets with sparse representations.
method Hierarchical learning strategy with projection-based penalty operators.
result Efficient sparse model reconstruction and generalizability on real datasets.
A faster Wasserstein k-means algorithm for histogram data reduces computation and maintains clustering quality.
problem Efficiently clustering histogram data with reduced computation time.
method Sparse simplex projection to reduce data samples, centroids, and ground cost matrix, dynamically removing lower-valued samples.
result Significant reduction in computational complexity without compromising clustering quality.
Paper uses autoencoders for efficient reduced-order modeling of eigenvalue problems.
problem Efficiently modeling eigenvalue problems in high dimensions.
method Autoencoder-based reduced-order modeling for eigenvalue problems.
result Autoencoder-based models outperform standard POD-Galerkin methods in neutron diffusion applications.
New algorithm recovers model coefficients and supports from noisy data.
problem Simultaneous estimation and support recovery in linear models with Gaussian noise.
method Projection-based algorithm for STG regularized minimization problem, proving convergence and support recovery guarantees.
result New algorithm outperforms existing methods in support recovery for various data setups.
PCA-based dimensionality reduction improves robustness in overparameterized linear models.
problem Improving robustness in overparameterized linear models.
method PCA-based dimensionality reduction (PCA-OLS)
result PCA-OLS can achieve better generalization than ordinary least squares (OLS) in the overparameterized regime.
Over the past few decades, we have witnessed a large family of algorithms that have been designed to provide different solutions to the problem of dimensionality reduction (DR). The DR is an essential tool to excavate the important information from the high-dimensional data by mapping the data to a low-dimensional subs…
FROCC uses random projections for fast one-class classification.
problem Efficient one-class classification for large datasets.
method Random projection of data onto random unit vectors, with region bounding.
result Significant improvement in ROC performance with substantial speedup.
Inferring the latent variable generating a given test sample is a challenging problem in Generative Adversarial Networks (GANs). In this paper, we propose InvGAN - a novel framework for solving the inference problem in GANs, which involves training an encoder network capable of inverting a pre-trained generator network…
We study the problem of determining the optimal low dimensional projection for maximising the separability of a binary partition of an unlabelled dataset, as measured by spectral graph theory. This is achieved by finding projections which minimise the second eigenvalue of the graph Laplacian of the projected data, whic…
Paper proposes a new method for efficient Pareto Front modeling.
problem Efficient modeling of Pareto Front (PF) in decision making problems.
method Projection based active Gaussian process regression (P-aGPR) method.
result The proposed method can provide a generative PF model and examine new points efficiently.
Study optimizes portfolio to minimize relative drawdown duration, penalizing unfavorable performance states.
problem Minimizing relative drawdown duration in portfolio optimization relative to a benchmark.
method Introduces a benchmark-relative drawdown-duration criterion penalizing unfavorable performance states. Uses a one-dimensional Markovian representation and Hamilton-Jacobi-Bellman equation.
result Derives explicit projection-based characterization of the optimal feedback control and identifies geometric settings for unique strong solutions.
Using sparse-inducing norms to learn robust models has received increasing attention from many fields for its attractive properties. Projection-based methods have been widely applied to learning tasks constrained by such norms. As a key building block of these methods, an efficient operator for Euclidean projection ont…
Efficient algorithms solve large-scale DRSVM problems.
problem Optimizing support vector machines under worst-case distribution uncertainty.
method Epigraphical projection-based incremental algorithms.
result Incremental algorithms solve DRSVM problems up to 1000x faster than state-of-the-art methods.
Linear regression is arguably the most prominent among statistical inference methods, popular both for its simplicity as well as its broad applicability. On par with data-intensive applications, the sheer size of linear regression problems creates an ever growing demand for quick and cost efficient solvers. Fortunately…
New ARIMA framework improves forecast accuracy for economic and financial time series.
problem Improving forecast accuracy for nonlinear dynamics in time series data.
method Projection-based ARIMA framework using Galerkin basis expansions.
result Galerkin-SARIMA matches or improves forecast accuracy compared to classical ARIMA/SARIMA.
Measuring conditional dependence is an important topic in statistics with broad applications including graphical models. Under a factor model setting, a new conditional dependence measure based on projection is proposed. The corresponding conditional independence test is developed with the asymptotic null distribution …
This study provides an independent, outside-in estimate of the cost and schedule risks of nuclear waste storage projects. Based on a reference class of 216 past, comparable projects, risk of cost overrun was found to be 202% or less, with 80% certainty, i.e., 20% risk of an overrun above 202%. Based on a reference clas…
Mathematical method based on a direct or indirect analysis of growth rates is described. It is shown how simple assumptions and a relatively easy analysis can be used to describe mathematically complicated trends and to predict growth. Only rudimentary knowledge of calculus is required. Projected trajectories based on …
A new method slices and sums radial kernels faster.
problem Fast computation of large kernel sums in kernel methods.
method Random projections to 1D subspaces and QMC for selecting projections.
result QMC-slicing outperforms existing methods on test datasets.
Flora uses random projections to achieve high-rank updates with low memory usage.
problem Excessive memory usage in large neural networks during training.
method Flora approximates LoRA using random projections to enable high-rank updates with sublinear space complexity.
result Flora achieves high-rank updates with significantly reduced memory usage compared to LoRA.
Develops exact and invariant study-based decompositions for network meta-analysis.
problem Lack of exact contribution decompositions in network meta-analysis.
method Contrast-space projection formulation of NMA, study-based definition of direct and indirect evidence.
result Exact covariance-aware decompositions of NMA estimator into direct and indirect contributions.
Proposes using GANs to solve phase retrieval problems.
problem Solving phase retrieval problems in various contexts.
method Applying conditional GANs with knowledge of measurement process.
result Method provides more robust and detailed solutions.
This article presents results from the first statistically significant study of cost escalation in transportation infrastructure projects. Based on a sample of 258 transportation infrastructure projects worth US$90 billion and representing different project types, geographical regions, and historical periods, it is fou…
We propose a novel, projection based way to incorporate the conditional information into the discriminator of GANs that respects the role of the conditional information in the underlining probabilistic model. This approach is in contrast with most frameworks of conditional GANs used in application today, which use the …
Paper solves robust multi-dimensional scaling with accelerated projections.
problem Localize point locations from noisy pairwise distances.
method Alternating projections with tangent space acceleration.
result Linear convergence of reconstructed points to original points.
New algorithms improve machine learning performance with explicit regret bounds.
problem Improving machine learning performance with explicit regret bounds.
method Projection-based linear regression algorithms with a focus on modern machine-learning models and their algorithmic performance.
result Established a priori regret bounds with explicit λ-dependence.
We propose a randomized second-order method for optimization known as the Newton Sketch: it is based on performing an approximate Newton step using a randomly projected or sub-sampled Hessian. For self-concordant functions, we prove that the algorithm has super-linear convergence with exponentially high probability, wi…
Review of modern computational optimal transport methods for biomedical applications.
problem Efficient computation of optimal transport for big data.
method Regularization-based and projection-based computational methods.
result Advancements in computational optimal transport methods for biomedical research.
Paper introduces rational Gaussian wavelets for efficient signal approximation.
problem Efficiently approximating complex signals with few coefficients.
method Continuous wavelet transform using rational Gaussian wavelets with adjustable parameters.
result Proposed rational Gaussian wavelets provide accurate signal approximations.
Consider a smooth, projective family of canonically polarized varieties over a smooth, quasi-projective base manifold Y, all defined over the complex numbers. It has been conjectured that the family is necessarily isotrivial if Y is special in the sense of Campana. We prove the conjecture when Y is a surface or threefo…
We develop necessary and sufficient conditions and a novel provably consistent and efficient algorithm for discovering topics (latent factors) from observations (documents) that are realized from a probabilistic mixture of shared latent factors that have certain properties. Our focus is on the class of topic models in …
The paper introduces a new method for detecting financial data outliers.
problem Detecting outliers in multivariate financial data.
method The approach uses the Cumulant Generating Function (CGF) to maximize projections on directions.
result The CGF maximization approach can be interpreted as an extension of principal component analysis.
We present a structural clustering algorithm for large-scale datasets of small labeled graphs, utilizing a frequent subgraph sampling strategy. A set of representatives provides an intuitive description of each cluster, supports the clustering process, and helps to interpret the clustering results. The projection-based…
Improved diffusion models solve inverse problems more accurately by correcting sample paths off the data manifold.
problem Current diffusion models for inverse problems often produce suboptimal results due to sample paths deviating from the data manifold.
method Proposed an additional correction term inspired by manifold constraints to make iterations closer to the data manifold.
result The proposed method boosts performance by a large margin, producing promising results in various applications.
A new faster neural network training method using backprojection.
problem Training feedforward neural networks more efficiently.
method Projection and reconstruction at each layer to force projected data and reconstructed labels to be similar.
result The proposed method is faster than backpropagation and gives insights into networks.
This work presents a methodology for forward electricity contract price projection based on market equilibrium and social welfare optimization. In the methodology supply and demand for forward contracts are produced in such a way that each agent (generator/load/trader) optimizes a risk adjusted expected value of its re…
New schemes for SDEs on manifolds keep solutions close to the manifold.
problem Solving SDEs constrained to manifolds in high accuracy.
method Geometrically invariant numerical schemes that remain close to the manifold.
result The schemes converge under standard assumptions and outperform existing methods.
Soft-Radial Projection solves gradient saturation in constrained deep learning.
problem Gradient saturation in deep learning models when integrating hard constraints.
method Introduces Soft-Radial Projection, a differentiable layer that maps predictions onto constraint boundaries without rank-deficient Jacobians.
result Improves convergence and solution quality over state-of-the-art methods.
Paper uses virtual big data to improve autoencoder training and address imbalanced data classification.
problem Imbalanced data classification and autoencoder over-fitting.
method Cross-concatenation using Virtual Big Data.
result Cross-concatenation method effectively balances imbalanced class distributions.
Hyperplane hashing aims at rapidly searching nearest points to a hyperplane, and has shown practical impact in scaling up active learning with SVMs. Unfortunately, the existing randomized methods need long hash codes to achieve reasonable search accuracy and thus suffer from reduced search speed and large memory overhe…
Randomized spectral co-clustering speeds up large-scale directed networks.
problem Co-clustering directed networks efficiently for large-scale data.
method Randomized spectral co-clustering algorithms using random-projection and random-sampling techniques.
result Theoretical and numerical validation of approximation and misclustering error rates.
Conditional gradients constitute a class of projection-free first-order algorithms for smooth convex optimization. As such, they are frequently used in solving smooth convex optimization problems over polytopes, for which the computational cost of orthogonal projections would be prohibitive. However, they do not enjoy …
Paper studies randomized spectral clustering for large-scale networks.
problem Computational challenges in large-scale network community detection.
method Randomized sketching algorithms for spectral clustering.
result Theoretical bounds for approximation, misclassification, and link probability estimation.
Study efficient algorithms for nonconvex optimization with state-dependent Markov data.
problem Stochastic optimization with Markovian data and state-dependent transition kernels.
method Projection-based and projection-free algorithms for constrained nonconvex problems.
result The number of oracle calls to achieve an ε-stationary point is O(1/ε2.5). A new method for generating time-dependent densities efficiently.
problem Computational difficulties in deep learning for temporal density modeling.
method Projection-based optimal transport and transport splines.
result The method is highly competitive with state-of-the-art normalizing flows.