This paper describes a versatile method that accelerates multichannel source separation methods based on full-rank spatial modeling. A popular approach to multichannel source separation is to integrate a spatial model with a source model for estimating the spatial covariance matrices (SCMs) and power spectral densities…
This paper deals with a multichannel audio source separation problem under underdetermined conditions. Multichannel Non-negative Matrix Factorization (MNMF) is one of powerful approaches, which adopts the NMF concept for source power spectrogram modeling. This concept is also employed in Independent Low-Rank Matrix Ana…
This paper describes multichannel speech enhancement for improving automatic speech recognition (ASR) in noisy environments. Recently, the minimum variance distortionless response (MVDR) beamforming has widely been used because it works well if the steering vector of speech and the spatial covariance matrix (SCM) of no…
Enhanced FastMNMF for better speech separation.
problem Improving blind source separation for speech.
method Gaussian scale mixture (GSM) for heavy-tailed distributions.
result GSM-FastMNMF outperforms existing methods in speech enhancement.
Paper introduces SMM for forecasting multiple time series with missing values.
problem Forecasting multiple time series with missing and noisy values.
method Sliding Mask Method (SMM) using Non-negative Matrix Factorization (NMF).
result The method outperforms state-of-the-art methods in time series forecasting.
Graphs are a natural abstraction for many problems where nodes represent entities and edges represent a relationship across entities. An important area of research that has emerged over the last decade is the use of graphs as a vehicle for non-linear dimensionality reduction in a manner akin to previous efforts based o…
FAST optimizes additive segmentation for faster, more interpretable models.
problem Efficiently segmenting and interpreting complex datasets.
method Optimization framework for fast piecewise constant shape functions.
result 2 orders of magnitude faster than state-of-the-art methods.
Fast BATLLNN speeds up verification of TLL NNs by 400x.
problem Verifying output constraints for TLL NNs.
method Uses TLL architecture and decoupled box constraints to improve verification performance.
result 400x faster than state-of-the-art verifiers.
Fast-vollib offers high-performance option pricing and IV computation.
problem Efficiently pricing and computing implied volatility for financial models.
method Open-source Python library with PyTorch, JAX, and CUDA backends, implementing Halley and LBR algorithms.
result High-performance option pricing and IV computation with vectorized implementations.
FAST improves fast and stable task adaptation in DNNs.
problem Catastrophic forgetting in fine-tuned pretrained models.
method Introducing FAST, an easy-to-implement fine-tuning algorithm.
result FAST learns target tasks faster and retains source knowledge longer.
Fast matrix algorithms have become the fundamental tools of machine learning in big data era. The generalized matrix regression problem is widely used in the matrix approximation such as CUR decomposition, kernel matrix approximation, and stream singular value decomposition (SVD), etc. In this paper, we propose a fast …
Paper explores fast adversarial training to improve robustness with less computation.
problem Efficiently defending against adversarial examples.
method Integrates simple self-attacks for faster training, focusing on overfitting recovery.
result Shows superior robust accuracy with reduced training time compared to strong adversarial training.
Study the averaging principle for non-autonomous slow-fast systems and apply it to financial local stochastic volatility models.
problem Understanding the behavior of non-autonomous slow-fast systems of stochastic differential equations.
method Prove the averaging principle under specific conditions and apply it to a financial model.
result Prices of derivatives converge to those calculated using the limit model under a risk-neutral measure.
Gradient-based meta-learning has proven to be highly effective at learning model initializations, representations, and update rules that allow fast adaptation from a few samples. The core idea behind these approaches is to use fast adaptation and generalization -- two second-order metrics -- as training signals on a me…
Paper presents a fast algorithm for pricing Bermudan swaptions under the two-factor Hull-White model.
problem Evaluating Bermudan swaption prices under the two-factor Hull-White model with high computational efficiency.
method Discretization of expected value calculation, Gaussian kernel sums, fast Gauss transform, grid rotation for stability.
result Significant reduction in computation time and improved stability for correlation close to -1.
New model captures fast price excursions in finance.
problem Capturing fast price excursions in financial models.
method Heston model with fast-reversion limit.
result Model shows significant hitting probabilities for barrier options.
A fast method for LOOCV in k-NN regression reduces computation time.
problem Efficient computation of LOOCV for k-NN regression.
method Identical LOOCV estimate to (k+1)-NN MSE on training data.
result LOOCV computation can be done with (k+1)-NN regression once.
We accelerate the power method for strong low-rank approximation using fast sketching.
problem Efficiency bottleneck in power method for large target ranks.
method Developed an algorithmic and theoretical framework for accelerating the power method using fast sketching.
result Simple and provably efficient methods for singular value decomposition, low-rank factorization, and Nyström approximation.
A new method slices and sums radial kernels faster.
problem Fast computation of large kernel sums in kernel methods.
method Random projections to 1D subspaces and QMC for selecting projections.
result QMC-slicing outperforms existing methods on test datasets.
Empirical risk minimization (ERM) is a fundamental learning rule for statistical learning problems where the data is generated according to some unknown distribution P and returns a hypothesis f chosen from a fixed class F with small loss ℓ. In the parametric setting, depending upon $(\ell…
The paper studies efficient simulation methods for financial firm values under fast mean-reverting volatility.
problem Estimating the probability of firm default under fast mean-reverting stochastic volatility models.
method Approximations using ergodic averages and central limit theorem corrections for efficient simulation.
result Accuracy of approximations assessed through numerical simulation and payoff function estimation.
FSNet improves online time series forecasting by balancing fast adaptation and old knowledge.
problem Online time series forecasting challenges in handling abrupt and recurring patterns.
method Inspired by CLS theory, FSNet uses a dynamic balance between fast adaptation and old knowledge retrieval.
result FSNet achieves robustness to both new and recurring patterns through dynamic balancing and associative memory.
New framework explains fast transfer of hyperparameters across model scales.
problem Understanding and optimizing hyperparameters for large-scale models.
method Developed a conceptual framework for HP transfer across scale, showing fast transfer is equivalent to useful transfer for compute-optimal grid search.
result Fast transfer of hyperparameters is equivalent to useful transfer for compute-optimal grid search, offering asymptotic computational advantage.
Hierarchical pretraining with slow-fast ODEs
problem Causal self-attention vs. slow-fast ODEs
method Instantiating fast-slow ODE formalism as a concrete neural network
result Equilibrium manifold x=φ(y) is exactly the master-equation (ME) stationary distribution A fast method estimates stability of ensemble feature selectors.
problem Improving stability of ensemble feature selectors for better prediction.
method Simulator of a feature selector to estimate stability.
result Reduces computation time for estimating stability.
Sparse Meta Networks adapt deep neural networks incrementally for fast learning.
problem Training deep neural networks is slow and impractical for complex, changing environments.
method Sparse Meta Networks use a memory layer to learn online sequential adaptation, accumulating fast-weights incrementally.
result Sparse Meta Networks achieve strong performance in various sequential adaptation scenarios.
Symmetric nonnegative matrix factorization (NMF), a special but important class of the general NMF, is demonstrated to be useful for data analysis and in particular for various clustering tasks. Unfortunately, designing fast algorithms for Symmetric NMF is not as easy as for the nonsymmetric counterpart, the latter adm…
In this work we detail the application of a fast convolution algorithm computing high dimensional integrals to the context of multiplicative noise stochastic processes. The algorithm provides a numerical solution to the problem of characterizing conditional probability density functions at arbitrary time, and we applie…
A fast method learns plasma collision kernels from simulations, improving kinetic models.
problem Improving kinetic models for plasma dynamics beyond the weakly coupled regime.
method Data-driven collisional operator, fast spectral separation method.
result Accurately captures plasma dynamics in moderately coupled regime.
This paper shows how to learn variational inequalities fast with strong monotonicity.
problem Learning variational inequalities efficiently.
method Extending convex optimization techniques to variational inequalities with strong monotonicity.
result Fast generalization rates of Θ(1/ε) for learning variational inequalities. We present a fast variational Bayesian algorithm for performing non-negative matrix factorisation and tri-factorisation. We show that our approach achieves faster convergence per iteration and timestep (wall-clock) than Gibbs sampling and non-probabilistic approaches, and do not require additional samples to estimate t…
In this note we consider sampling from (non-homogeneous) strongly Rayleigh probability measures. As an important corollary, we obtain a fast mixing Markov Chain sampler for Determinantal Point Processes.
Efficiently simulates slow dynamics of high-dimensional stochastic systems.
problem Simulating high-dimensional stochastic systems with slow dynamics and fast modes.
method Designs an algorithm to estimate an invariant manifold and its dynamics, averaging out fast modes.
result Efficient simulator of effective dynamics on low-dimensional invariant manifold.
A new SINC method for fast and accurate option pricing.
problem Computing option prices efficiently and accurately.
method SINC approach based on Shannon Sampling Theorem.
result SINC provides the most accurate and fast pricing computation.
Ultra-fast search algorithm for trillion-scale corpora with semantic flexibility.
problem Efficiently searching over large natural language corpora with semantic variations.
method String matching based on suffix arrays, vector representation of words, dynamic corpus-aware pruning, fast exact lookup.
result Substantially lower search latency compared to existing methods on FineWeb-Edu corpus.
This work develops scalable model selection methods with fast update and selection.
problem Efficient model selection for large pools of candidate models.
method Isolated model embedding, which supports asymptotically fast update and selection.
result Standardized Embedder achieves competitive model selection performances.
Efficient CF approach using fast adaptive PCA for recommender systems.
problem Matrix completion problem in recommender systems.
method Fast adaptive randomized singular value decomposition (SVD) and termination mechanism for latent factors.
result The approach achieves near optimal prediction accuracy with high runtime efficiency.
The paper studies invariant complex manifolds in holomorphic slow-fast systems.
problem Existence of invariant complex manifolds in holomorphic systems.
method Geometric singular perturbation theory, Fenichel and Briot-Bouquet theories.
result Conditions are provided to guarantee the existence of one-dimensional invariant complex manifolds.
Fast feature selection for SHM using canonical correlation.
problem Feature selection for structural health monitoring.
method Greedy search of sum of squared canonical correlation coefficients.
result Extremely fast feature selection with good performance.
The speed with which a learning algorithm converges as it is presented with more data is a central problem in machine learning --- a fast rate of convergence means less data is needed for the same level of performance. The pursuit of fast rates in online and statistical learning has led to the discovery of many conditi…
Paper offers a fast convergence theory for offline decision making.
problem Offline decision making problems, including reinforcement learning and off-policy evaluation.
method Introduces a framework (DMOF) and algorithm (EDD) with a fast convergence guarantee.
result Demonstrates a fast convergence guarantee with a lower bound complement.
Study finds conditions for global minimizers on curved manifolds with fast diffusion and nonlocal interactions.
problem Existence of global minimizers for a free energy functional on negatively curved manifolds.
method Investigation of Carlson-Levin type inequalities for Cartan-Hadamard manifolds.
result Establishes necessary and sufficient conditions for the existence of global energy minimizers.
MACE uses higher-order messages to create fast, accurate force fields.
problem Creating fast and accurate force fields in computational chemistry and materials science.
method Introducing MACE, an equivariant MPNN model that uses four-body messages.
result MACE reduces the required number of message passing iterations to just two, achieving state-of-the-art accuracy.
A new supervised tree-Wasserstein distance improves document classification.
problem Measuring document similarity efficiently and accurately.
method Rewriting Wasserstein distance on tree metric, using contrastive loss for optimization.
result The Supervised Tree-Wasserstein (STW) distance improves document classification accuracy.
Study shows convergence rate for empirical minimizer of unbounded functions with fast growth.
problem Convergence rate of empirical minimizer for unbounded functions with fast growth.
method Analyzes L1-distance convergence rate of the empiric minimizer for coercive functions sampled with noise. result Convergence rate is bounded above by ann−1/q, where q is the dimension and an=o(nε) for every ε>0. A new NUFFT method speeds up option pricing for various strikes.
problem Efficiently pricing many options of the same maturity but different strikes.
method Non-uniform fast Fourier transform (NUFFT) applied to the COS method.
result Significantly faster computation of option prices.
A fast Monte Carlo method for additive processes and option pricing.
problem Efficiently pricing path-dependent options with additive processes.
method Developed a fast Monte Carlo scheme for additive processes, analyzing and reducing numerical error sources.
result Shows significant reduction in error (1 bp or below) for pricing path-dependent options.
The developments of Rademacher complexity and PAC-Bayesian theory have been largely independent. One exception is the PAC-Bayes theorem of Kakade, Sridharan, and Tewari (2008), which is established via Rademacher complexity theory by viewing Gibbs classifiers as linear operators. The goal of this paper is to extend thi…