An adaptive dropout approach improves high-dimensional Bayesian optimization.
problem High-dimensional black-box optimization problems.
method Adaptive dropout of variables in the acquisition function.
result AdaDropout effectively tackles high-dimensional challenges and improves solution quality.
In this paper, we propose the idea of radial scaling in frequency domain and activation functions with compact support to produce a multi-scale DNN (MscaleDNN), which will have the multi-scale capability in approximating high frequency and high dimensional functions and speeding up the solution of high dimensional PDEs…
New BO method efficiently optimizes high-dimensional functions by automatically selecting variables.
problem Efficiently optimizing functions with high-dimensional domains.
method Exploits variable selection to automatically learn sub-spaces without pre-specified dimensions.
result Empirically validated on synthetic and real problems, demonstrating efficiency.
DF2M uses deep neural networks within a factor model for high-dimensional functional time series forecasting.
problem Forecasting high-dimensional functional time series with explainability and accuracy.
method Bayesian nonparametric model based on Indian Buffet Process and multi-task Gaussian Process, incorporating a deep kernel function.
result DF2M provides better explainability and superior predictive accuracy compared to conventional deep learning models.
A new method for high-dimensional functional regression reduces multicollinearity and improves interpretability.
problem Multicollinearity, overfitting, and interpretability in high-dimensional functional linear models.
method Partition-based functional ridge regression framework.
result Improved numerical stability and enhanced interpretability without explicit variable selection.
Bayesian optimization improved for high-dimensional outputs using randomized priors.
problem Efficient global optimization of high-dimensional black-box functions.
method Deep learning framework with bootstrapped ensembles of neural architectures with randomized priors.
result Superior performance in tasks with high-dimensional outputs compared to state-of-the-art methods.
Derives a method to optimize high-dimensional functions on low-dimensional manifolds.
problem High-dimensional derivative-free optimization with high sample complexity.
method Online learning approach that learns the manifold while optimizing the function.
result Significantly reduces sample complexity compared to existing methods.
Novel method converts time series data into functional data for high dimensional classification.
problem Small sample size problem in high dimensional time series data.
method Classwise Functional Principal Component Analysis (PCA) followed by Bayesian linear classifier.
result Demonstrated efficacy on synthetic and real data sets.
Develops methods for selecting and estimating smooth functional coefficients in high-dimensional multivariate functional data.
problem Functional predictor selection and estimation of smooth functional coefficients in high-dimensional multivariate functional data.
method Functional group-sparse regression methods in a generic Hilbert space of infinite dimension.
result Consistency of estimation and selection (oracle property) under infinite-dimensional Hilbert spaces.
EnSF improves accuracy in tracking high-dimensional nonlinear systems.
problem Low accuracy in high-dimensional, nonlinear filtering problems.
method Score-based diffusion model, mini-batch Monte Carlo estimator.
result EnSF outperforms state-of-the-art methods in tracking high-dimensional systems.
ProFnet models HDFTS with neural networks, offering scalable probabilistic forecasts.
problem Modeling high-dimensional functional time series with nonlinear trends and high spatial dimensions.
method Integrates feedforward and deep neural networks with probabilistic modeling.
result Superior performance in forecasting Japan's mortality rates.
SILBO optimizes high-dimensional Bayesian optimization using semi-supervised embedding learning.
problem Bayesian optimization struggles with high-dimensional search spaces.
method SILBO uses semi-supervised dimension reduction to find a low-dimensional space for iterative optimization.
result SILBO outperforms existing methods on high-dimensional Bayesian optimization tasks.
Recent methods for estimating sparse undirected graphs for real-valued data in high dimensional problems rely heavily on the assumption of normality. We show how to use a semiparametric Gaussian copula--or "nonparanormal"--for high dimensional inference. Just as additive models extend linear models by replacing linear …
DiBO uses diffusion models to optimize high-dimensional black-box functions efficiently.
problem Optimizing high-dimensional and complex black-box functions efficiently.
method DiBO iterates two stages: training a diffusion model and casting candidate selection as posterior inference.
result DiBO outperforms state-of-the-art baselines across synthetic and real-world tasks.
A new BO method tackles high-dimensional optimization without reconstruction.
problem Optimizing high-dimensional black-box functions is challenging, especially when low-dimensional structures are assumed.
method Tackles the problem in the original high-dimensional space using learned low-dimensional structure.
result Our method explores the high-dimensional space more effectively than existing approaches.
Data repetition improves SGD's learning of high-dimensional functions.
problem Learning pertinent features in multi-index models with high-dimensional noisy data.
method Investigation of two-layer shallow neural networks trained with gradient-based algorithms, focusing on data repetition.
result Data repetition significantly improves the computational efficiency of SGD, learning all directions with at most O(dlogd) steps. DET unifies geometric and functional alignment for high-dimensional scientific data.
problem Challenges in nonrigid registration for high-dimensional, irregular data.
method Domain Elastic Transform (DET) treats data as functions on irregular domains, using a Bayesian framework for elastic motion registration.
result DET achieves 92% topological preservation on MERFISH data and successfully registers whole-embryo Stereo-seq atlases.
This is an introductory article on high dimensional knots for the beginners. High dimensional knot theory is an exciting field. It is a field of knot theory, which is one of topology and is connected with many ones. In this article we use few literal expressions, equations, functions, etc. We barely suppose that the re…
Bayesian optimization (BO) has been broadly applied to computational expensive problems, but it is still challenging to extend BO to high dimensions. Existing works are usually under strict assumption of an additive or a linear embedding structure for objective functions. This paper directly introduces a supervised dim…
Deep networks learn hierarchical functions more efficiently than shallow ones.
problem Understanding the advantage of deep neural networks over shallow models.
method Analytical study of learning dynamics and generalization performance of deep networks compared to shallow ones.
result Deep networks reduce effective dimensionality, enabling learning with fewer samples.
Newfluence improves model interpretability in high-dimensional AI models.
problem Challenges in interpreting high-dimensional AI models.
method Introduced Newfluence, an alternative approximation to influence functions.
result Newfluence offers significantly improved accuracy in high-dimensional settings.
SGE-Kriging reduces high-dimensional surrogate modelling costs.
problem High-dimensional function approximation for expensive models.
method Splitting training data into slices, using sliced likelihood function, and learning hyper-parameters from sensitivity indices.
result SGE-Kriging achieves comparable accuracy to standard GE-Kriging but with lower training costs.
In this note we propose a method based on artificial neural network to study the transition between states governed by stochastic processes. In particular, we aim for numerical schemes for the committor function, the central object of transition path theory, which satisfies a high-dimensional Fokker-Planck equation. By…
Mapper and Ball Mapper tools for complex data analysis.
problem Exploring and visualizing high-dimensional data and scalar functions.
method Combining Mapper and Ball Mapper, adding new features for encoding structure and symmetries.
result A new hybrid algorithm, Mapper on Ball Mapper, for comparing high-dimensional data descriptors.
Deep learning method proves convergence for high-dimensional PDEs.
problem Solving high-dimensional nonlinear PDEs for mean field control problems.
method Deep Galerkin method (DGM) for Hamilton-Jacobi-Bellman (HJB) equations.
result DGM converges to the true value function of mean field control problems.
Paper detects and estimates breaks in high-dimensional functional time series.
problem Detecting and estimating structural breaks in heterogeneous mean functions of high-dimensional functional time series.
method Proposes a new test statistic combining functional CUSUM and power enhancement components, with a clustering algorithm for group structure estimation.
result The proposed techniques have satisfactory performance in finite samples, detecting and estimating breaks effectively.
New robust method for high-dimensional data analysis in imaging studies.
problem Analyzing high-dimensional data with complex dependence and outliers.
method Robust high-dimensional regression with coefficient thresholding and Huber loss.
result Statistical consistency and computational convergence under high-dimensional settings.
Study shows how to approximate and estimate high-dimensional classification functions without the curse of dimensionality.
problem Approximating and estimating classification functions in high-dimensional spaces.
method Modified existing results to show that RBV2 functions can be approximated by neural networks with bounded weights. Proved the existence of a neural network with bounded weights approximating a classification function. Leveraged these bounds to quantify estimation rates. result Neural networks can approximate RBV2 functions without the curse of dimensionality, leading to efficient estimation rates. Scaling Bayesian optimization to high dimensions is challenging task as the global optimization of high-dimensional acquisition function can be expensive and often infeasible. Existing methods depend either on limited active variables or the additive form of the objective function. We propose a new method for high-dime…
The paper tackles high-dimensional Bayesian optimization using tree-structured additive models.
problem Scaling Bayesian Optimization to high-dimensional problems.
method Tree-structured additive models with hybrid graph learning and zooming-based algorithms.
result Demonstrates faster model learning and reduced model complexity in high-dimensional settings.
BO method identifies sparse subspaces for efficient high-dimensional optimization.
problem Efficient optimization of high-dimensional black-box functions.
method Sparse Gaussian process surrogate models on axis-aligned subspaces with Hamiltonian Monte Carlo inference.
result SAASBO achieves excellent performance on synthetic and real-world problems.
R package huge simplifies graph estimation for high-dimensional data.
problem Estimating high-dimensional undirected graphs from data.
method Uses recent results in literature, including recent graph estimation methods.
result Improves on existing package glasso by providing more features and better efficiency.
We provide a way to infer about existence of topological circularity in high-dimensional data sets in Rd from its projection in R2 obtained through a fast manifold learning map as a function of the high-dimensional dataset X and a particular choice of a positive real σ known as band…
Maximizing high-dimensional, non-convex functions through noisy observations is a notoriously hard problem, but one that arises in many applications. In this paper, we tackle this challenge by modeling the unknown function as a sample from a high-dimensional Gaussian process (GP) distribution. Assuming that the unknown…
Deep FPF approximates gain function for high-dimensional particle filtering.
problem Approximating the exact gain function in high-dimensional settings.
method Represent the gain function as a neural network gradient and solve a variational Poisson equation via optimization.
result The approach allows parallel processing of particles and is applicable to high-dimensional problems.
We simplify complex regression coefficients using linearization and feature comparison.
problem Interpreting high-dimensional regression coefficients from nonlinear responses.
method Developed a linearization method to derive feature coefficients and compare them with regression coefficients.
result Shows how regression coefficients relate to linearized feature coefficients and how they change under regularization.
GTBO uses group testing to optimize high-dimensional functions efficiently.
problem Challenges in optimizing high-dimensional, expensive functions due to the curse of dimensionality.
method GTBO combines testing and optimization phases to identify active variables and guide efficient optimization.
result GTBO outperforms state-of-the-art methods on high-dimensional optimization tasks.
This paper tackles high-dimensional Bayesian optimization by projecting a manifold into a lower space.
problem High-dimensional optimization of expensive functions with limited labeled data.
method Random linear projection of a manifold embedded in high-dimensional space, combined with semi-supervised learning of the manifold's geometry.
result Our approach outperforms existing high-dimensional BO methods in various synthetic and real-world applications.
Motivated by the problem of tuning hyperparameters in machine learning, we present a new approach for gradually and adaptively optimizing an unknown function using estimated gradients. We validate the empirical performance of the proposed idea on both low and high dimensional problems. The experimental results demonstr…
New tools explain FRF model predictions in high-dimensional ECG data.
problem Lack of interpretability in Functional Random Forests (FRF) models.
method Introduces FPDPs, FPC Probability Heatmaps, and various FPC importance metrics.
result Enhances transparency of FRF models by revealing FPC contributions.
Tensor Neural Networks improve regression accuracy and efficiency.
problem Nonparametric regression problems with complex, high-dimensional functions.
method Integrates statistical regression and numerical integration within a tensor neural network framework.
result Superior performance in approximation accuracy and generalization capacity compared to FFNs and RBNs.
BOFiP optimizes high-dimensional functions by distributing them into sub-spaces and using game theory.
problem Optimizing high-dimensional black box functions with computational complexity.
method BOFiP decomposes high-dimensional space into sub-spaces, searches within sub-spaces, and updates beliefs using game theory.
result BOFiP outperforms competitors in high-dimensional optimization problems.
A classical result of Milman roughly states that every Lipschitz function on Sn is almost constant on a sufficiently high-dimensional sphere Sm⊂Sn. In this paper we extend the result by proving that any Lipschitz function on a positively curved homogeneous space is almost consta…
Optimization of high-dimensional black-box functions is an extremely challenging problem. While Bayesian optimization has emerged as a popular approach for optimizing black-box functions, its applicability has been limited to low-dimensional problems due to its computational and statistical challenges arising from high…
EGL optimizes complex functions without fitting them, achieving state-of-the-art results.
problem Optimizing high-dimensional, non-convex functions in AI tasks.
method EGL trains a neural network to estimate the objective gradient directly, not fitting the function.
result EGL achieves state-of-the-art results in challenging optimization problems.
Geometric framework detects outliers in high-dimensional data.
problem Detecting outliers in high-dimensional data.
method Geometric framework exploiting manifold structure.
result Significant improvement in outlier detection in high-dimensional data.
Gaussian process regression loses locality in high dimensions, affecting molecular energy surface fitting.
problem Loss of locality in high-dimensional Gaussian process regression.
method Analysis of Matern family kernels and multi-zeta basis functions.
result The property of locality disappears in high dimensions, impacting regression quality.
FAStEN efficiently selects features in high-dimensional functional data.
problem Feature selection in high-dimensional functional regression problems.
method Combines functional data, optimization, and machine learning techniques.
result Significant reduction in computational cost and improved selection accuracy.