Sharp analysis of power iteration for tensor PCA, improving convergence and stopping criteria.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Improved analysis of accelerated noisy power method for PCA.
Study non-integer power-law potentials for Schrödinger operators using Lie-Rinehart algebras.
Proposes a regularization approach to model German power derivative market, identifying significant risk spillovers.
Cluster algorithms are increasingly popular in biomedical research due to their compelling ability to identify discrete subgroups in data, and their increasing accessibility in mainstream software. While guidelines exist for algorithm selection and outcome evaluation, there are no firmly established ways of computing a…
Non-availability of reliable and sustainable electric power is a major problem in the developing world. Renewable energy sources like solar are not very lucrative in the current stage due to various uncertainties like weather, storage, land use among others. There also exists various other issues like mis-commitment of…
We study finite sample properties of estimators of power-law cross-correlations -- detrended cross-correlation analysis (DCCA), height cross-correlation analysis (HXA) and detrending moving-average cross-correlation analysis (DMCA) -- with a special focus on short-term memory bias as well as power-law coherency. Presen…
Paper refutes conjecture on tensor power iteration convergence in overcomplete models.
The paper analyzes a private likelihood-ratio test for frequency tables under differential privacy constraints.
We present a novel analysis of the dynamics of tensor power iterations in the overcomplete regime where the tensor CP rank is larger than the input dimension. Finding the CP decomposition of an overcomplete tensor is NP-hard in general. We consider the case where the tensor components are randomly drawn, and show that …
We focus on power-law coherency as an alternative approach towards studying power-law cross-correlations between simultaneously recorded time series. To be able to study empirical data, we introduce three estimators of the power-law coherency parameter based on popular techniques usually utilized for studying pow…
We present new findings in regard to data analysis in very high dimensional spaces. We use dimensionalities up to around one million. A particular benefit of Correspondence Analysis is its suitability for carrying out an orthonormal mapping, or scaling, of power law distributed data. Power law distributed data are foun…
Adaptive Bayesian model for covariate-dependent power spectra analysis.
We consider the noisy power method algorithm, which has wide applications in machine learning and statistics, especially those related to principal component analysis (PCA) under resource (communication, memory or privacy) constraints. Existing analysis of the noisy power method shows an unsatisfactory dependency over …
We extend our previous study of scaling range properties done for detrended fluctuation analysis (DFA) \cite{former_paper} to other techniques of fluctuation analysis (FA). The new technique called Modified Detrended Moving Average Analysis (MDMA) is introduced and its scaling range properties are examined and compared…
A method uses ITD and XGBoost for precise power transformer fault diagnosis.
We respond to the issues discussed by Farmer and Lillo (FL) related to our proposed approach to understanding the origin of power-law distributions in stock price fluctuations. First, we extend our previous analysis to 1000 US stocks and perform a new estimation of market impact that accounts for splitting of large ord…
Optimal sampling reduces power grid data analysis costs.
Solving power flow (PF) equations is the basis of power flow analysis, which is important in determining the best operation of existing systems, performing security analysis, etc. However, PF equations can be out-of-date or even unavailable due to system dynamics and uncertainties, making traditional numerical approach…
New invariants for link analysis include biquandle power brackets.
Graph Neural Networks outperform the Weisfeiler-Lehman algorithm in representation power.
Principal component analysis (PCA) is recognised as a quintessential data analysis technique when it comes to describing linear relationships between the features of a dataset. However, the well-known sensitivity of PCA to non-Gaussian samples and/or outliers often makes it unreliable in practice. To this end, a robust…
New method detects intrinsic cross-correlations in non-stationary time series affected by common factors.
This paper enhances privacy-preserving randomized power method for large datasets.
Common complex diseases are likely influenced by the interplay of hundreds, or even thousands, of genetic variants. Converging evidence shows that genetic variants with low marginal effects (LME) play an important role in disease development. Despite their potential significance, discovering LME genetic variants and as…
This paper analyzes and improves convergence in federated learning with biased client selection.
New analysis shows over-squashing limits GNNs' power.
Paper proposes a new method for PCA using generative models.
Self-organized criticality has been claimed to play an important role in many natural and social systems. In the present work we empirically investigate the relevance of this theory to stock-market dynamics. Avalanches in stock-market indices are identified using a multi-scale wavelet-filtering analysis designed to rem…
We study the statistical properties of volatility---a measure of how much the market is likely to fluctuate. We estimate the volatility by the local average of the absolute price changes. We analyze (a) the S&P 500 stock index for the 13-year period Jan 1984 to Dec 1996 and (b) the market capitalizations of the largest…
The paper analyzes the variance of different shuffling methods in stochastic gradient descent.
The paper proposes a method to identify power system oscillation modes using blind source separation.
This work establishes properties on diffeological structures for set-valued maps and measures.
Data analytics and machine learning techniques are being rapidly adopted into the power system, including power system control as well as electricity market design. In this paper, from an adversarial machine learning point of view, we examine the vulnerability of data-driven electricity market design. More precisely, w…
Method for factor analysis in short panels without assuming sphericity or Gaussianity.
Valid inference from data and predictions.
New analysis shows ROI's predictive power for stock returns weakens significantly.
In a recent Nature paper, Gabaix et al. \cite{Gabaix03} presented a theory to explain the power law tail of price fluctuations. The main points of their theory are that volume fluctuations, which have a power law tail with exponent roughly -1.5, are modulated by the average market impact function, which describes the r…
Style Miner generates stable and significant style factors for time series analysis.
The purpose of this paper is to indicate that the recently proposed Momentum fractional least mean squares (mFLMS) algorithm has some serious flaws in its design and analysis. Our apprehensions are based on the evidence we found in the derivation and analysis in the paper titled: \textquotedblleft \textit{Momentum frac…
Power iteration has been generalized to solve many interesting problems in machine learning and statistics. Despite its striking success, theoretical understanding of when and how such an algorithm enjoys good convergence property is limited. In this work, we introduce a new class of optimization problems called scale …
We study the asymptotic of the spectrum of the \spin Dirac operator on high tensor powers of a line bundle. As application, we get a simple proof of the main result of Guillemin-Uribe, which was originally proved by using the analysis of Toeplitz operators of Boutet de Monvel and Guillemin.
Sharp lower bound on GHHs' representation power of CPWL functions.
In exploratory data analysis, we are often interested in identifying promising pairwise associations for further analysis while filtering out weaker, less interesting ones. This can be accomplished by computing a measure of dependence on all variable pairs and examining the highest-scoring pairs, provided the measure o…
CoNBONet improves reliability analysis of complex systems with fast, energy-efficient predictions.
We study dynamical behavior of the Chinese stock markets by investigating the statistical properties of daily ensemble returns and varieties defined respectively as the mean and the standard deviation of the ensemble daily price returns of a portfolio of stocks traded in China's stock markets on a given day. The distri…
In this paper, we resolve many of the key algorithmic questions regarding robustness, memory efficiency, and differential privacy of tensor decomposition. We propose simple variants of the tensor power method which enjoy these strong properties. We present the first guarantees for online tensor power method which has a…
We consider streaming principal component analysis when the stochastic data-generating model is subject to perturbations. While existing models assume a fixed covariance, we adopt a robust perspective where the covariance matrix belongs to a temporal uncertainty set. Under this setting, we provide fundamental limits on…