Improved stability for large-scale Bayesian sampling.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
By using numerical simulation, we confirm that Takayasu--Sato--Takayasu (TST) model which leads Pareto's law satisfies the detailed balance under Gibrat's law. In the simulation, we take an exponential tent-shaped function as the growth rate distribution. We also numerically confirm the reflection law equivalent to the…
The paper studies scaling laws for associative memory mechanisms.
This paper tackles ranking-based performance normalization for optimization algorithms.
Novel neural network solves PDEs with multi-scale resolution.
This work studies scaling laws for low-precision training in high-dimensional linear regression.
Deep learning upscales geologic models efficiently.
Extracts coarse-grained PDEs from microscopic simulations.
In this paper, we propose the idea of radial scaling in frequency domain and activation functions with compact support to produce a multi-scale DNN (MscaleDNN), which will have the multi-scale capability in approximating high frequency and high dimensional functions and speeding up the solution of high dimensional PDEs…
Paper proposes MWDE for estimating finite location-scale mixtures.
Efficient kernel methods for large datasets using GPU acceleration.
Boosting is a learning scheme that combines weak prediction rules to produce a strong composite estimator, with the underlying intuition that one can obtain accurate prediction rules by combining "rough" ones. Although boosting is proved to be consistent and overfitting-resistant, its numerical convergence rate is rela…
The effectiveness of Convolutional Neural Networks (CNNs) has been substantially attributed to their built-in property of translation equivariance. However, CNNs do not have embedded mechanisms to handle other types of transformations. In this work, we pay attention to scale changes, which regularly appear in various t…
Spike sorting is a fundamental preprocessing step in neuroscience that is central to access simultaneous but distinct neuronal activities and therefore to better understand the animal or even human brain. But numerical complexity limits studies that require processing large scale datasets in terms of number of electrod…
Celeste is a procedure for inferring astronomical catalogs that attains state-of-the-art scientific results. To date, Celeste has been scaled to at most hundreds of megabytes of astronomical images: Bayesian posterior inference is notoriously demanding computationally. In this paper, we report on a scalable, parallel v…
Classical multidimensional scaling is an important dimension reduction technique. Yet few theoretical results characterizing its statistical performance exist. This paper provides a theoretical framework for analyzing the quality of embedded samples produced by classical multidimensional scaling. This lays the foundati…
We provide a numerically robust and fast method capable of exploiting the local geometry when solving large-scale stochastic optimisation problems. Our key innovation is an auxiliary variable construction coupled with an inverse Hessian approximation computed using a receding history of iterates and gradients. It is th…
A new method solves large-scale sparse group square-root Lasso problems efficiently.
Generative models improve for multiscale scientific data with new noise and interpolation techniques.
Deep neural networks provide meaningful uncertainty estimates for large-scale simulations.
In this paper, we perform registration of noisy curves. We provide an appropriate model in estimating the rotation and scaling parameters to adjust a set of curves through a M-estimation procedure. We prove the consistency and the asymptotic normality of our estimators. Numerical simulation and a real life aeronautic e…
Grokking occurs at numerical stability edge, requiring regularization to prevent.
Proposes a more robust rating scale for banks.
Irregular features disrupt the desired classification. In this paper, we consider aggressively modifying scales of features in the original space according to the label information to form well-separated clusters in low-dimensional space. The proposed method exploits spectral clustering to derive scaling factors that a…
Develops active learning for scale-bridging simulations.
Three methods for tuning HMC diagonal scale matrices compared.
Scalable solver reduces PDE uncertainty with active learning.
Dynamic Vocabulary Pruning stabilizes LLM training by removing low-probability tokens.
This work explores variably scaled kernels to improve non-stationary Gaussian processes.
Machine learning enhances ocean studies by analyzing sparse, multi-scale data.
New phases identified in neural scaling laws with compute limits.
Paper solves robust multi-dimensional scaling with accelerated projections.
Multidimensional scaling is an important dimension reduction tool in statistics and machine learning. Yet few theoretical results characterizing its statistical performance exist, not to mention any in high dimensions. By considering a unified framework that includes low, moderate and high dimensions, we study multidim…
The optimal dividend problem by De Finetti (1957) has been recently generalized to the spectrally negative Lévy model where the implementation of optimal strategies draws upon the computation of scale functions and their derivatives. This paper proposes a phase-type fitting approximation of the optimal strategy. We con…
Developing stable and scalable probabilistic ODE solvers for stiff and high-dimensional problems.
We propose a novel framework to investigate lead-lag relationships between two financial assets. Our framework bridges a gap between continuous-time modeling based on Brownian motion and the existing wavelet methods for lead-lag analysis based on discrete-time models and enables us to analyze the multi-scale structure …
SALSA efficiently approximates leverage scores for big data, improving ARMA model fitting.
Gaussian equivalence fails for simple polynomial embeddings in quadratic scaling RF models.
Encoding the scale information explicitly into the representation learned by a convolutional neural network (CNN) is beneficial for many computer vision tasks especially when dealing with multiscale inputs. We study, in this paper, a scaling-translation-equivariant (ST-equivariant) CNN with joint convolutions across th…
The miltifractal properties and scaling behaviour of the exchange rate variations of the Iranian rial against the US dollar from a daily perspective is numerically investigated. For this purpose the multifractal detrended fluctuation analysis (MF-DFA) is used. Through multifractal analysis, the scaling exponents, gener…
In this paper, we propose and study a Nyström based approach to efficient large scale kernel principal component analysis (PCA). The latter is a natural nonlinear extension of classical PCA based on considering a nonlinear feature map or the corresponding kernel. Like other kernel approaches, kernel PCA enjoys good mat…
Scaling feature values is an important step in numerous machine learning tasks. Different features can have different value ranges and some form of a feature scaling is often required in order to learn an accurate classifier. However, feature scaling is conducted as a preprocessing task prior to learning. This is probl…
Based on the new type of random walk process called the Potentials of Unbalanced Complex Kinetics (PUCK) model, we theoretically show that the price diffusion in large scales is amplified 2/(2 + b) times, where b is the coefficient of quadratic term of the potential. In short time scales the price diffusion depends on …
Stochastic Volatility in Mean models with heavy-tailed distributions using Hidden Markov Models
Unified quadrature framework for large-scale kernel machines.
Develops statistical confidence sets for multidimensional scaling.
Support vector machines (SVMs) are successful modeling and prediction tools with a variety of applications. Previous work has demonstrated the superiority of the SVMs in dealing with the high dimensional, low sample size problems. However, the numerical difficulties of the SVMs will become severe with the increase of t…
Mixed precision training (MPT) is becoming a practical technique to improve the speed and energy efficiency of training deep neural networks by leveraging the fast hardware support for IEEE half-precision floating point that is available in existing GPUs. MPT is typically used in combination with a technique called los…