Peaking phenomenon in semi-supervised learning observed and explained.
problem The peaking phenomenon in semi-supervised learning.
method Simulation studies and approximation of the learning curve.
result The learning curve in semi-supervised learning has a steeper incline and a more gradual decline.
The paper explains two distinct peaks in generalization error for neural networks and simpler models, each governed by different factors.
problem Understanding the peaks in generalization error for neural networks and simpler models.
method Analysis of random feature models and comparison with numerical experiments involving deep neural networks.
result The peaks at N=P and N=D are distinct and governed by different factors (noise sensitivity vs. initialization noise). This paper explains why double descent sometimes occurs weakly or not at all from an optimization perspective.
problem Understanding the role of optimization in the phenomenon of double descent.
method Investigates model-wise double descent from an optimization perspective, proposing a unified explanation for its occurrence.
result Model-wise double descent is observed if and only if the optimizer can find a sufficiently low-loss minimum.
New insights into overfitting peaks in generalization error for l2 and l1 penalized interpolation.
problem Understanding the phenomenon of overfitting peaks in generalization error for modern machine learning models.
method Introducing a generative and fitting model pair (MiSpaR) and deriving analytical risk curves for l2 and l1 penalties. result The overfitting peak can be dissociated from the point of model flexibility, complicating the interpretation of overfitting as a boundary between classical and modern regimes.
We study the statistical regularities of opening call auction using the ultra-high-frequency data of 22 liquid stocks traded on the Shenzhen Stock Exchange in 2003. The distribution of the relative price, defined as the relative difference between the order price in opening call auction and the closing price of last tr…
We document and analyze the empirical facts concerning one of the clearest evidence of speculation in financial trading as observed in the postage collection stamp market. We unravel some of the mechanisms of speculative behavior which emphasize the role of fancy and collective behavior. In our conclusion, we propose a…
We fill a void in merging empirical and phenomenological characterisation of the dynamical phase transitions in complex systems by identifying three of them on real-life financial markets. We extract and interpret the empirical, numerical, and semi-analytical evidences for the existence of these phase transitions, by c…
Regression models can interpolate noisy data and still perform well, contrary to the bias-variance tradeoff.
problem Understanding why overparametrized models can generalize well despite the bias-variance tradeoff.
method Analysis of minimum norm solutions and ridge regression, focusing on the smallest singular value of the regression matrix.
result Testing error exhibits double descent behavior as model order increases, contrary to the classical bias-variance tradeoff.
A robust method for decomposing spectral peaks robust to distortion and interference.
problem Decomposing spectral peaks in the presence of distortion and interference.
method Optimizing a nonparametric approach using pseudo-symmetric functions with nonincreasing behavior.
result Decomposed spectral peaks show pseudo-orthogonal behavior and power preserving equality.
SPADE improves demand forecasting accuracy by 4.5% for post-promotion periods.
problem Overreacting to peak events in demand forecasting leads to biased forecasts.
method SPADE splits forecasting into two tasks: one for peak events and another for post-peak events, using masked convolution filters and a specialized Peak Attention module.
result Overall PPE improvement of 4.5%, 30% improvement for most affected forecasts after promotions and holidays, and 3.9% improvement in PE accuracy.
This study investigates that a characteristic time scale on an exchange rate market (USD/JPY) is examined for the period of 1998 to 2000. Calculating power spectrum densities for the number of tick quotes per minute and averaging them over the year yield that the mean power spectrum density has a peak at high frequenci…
Bayesian framework estimates noise variance and peak number from noisy spectra.
problem Misunderstanding of physical properties from noisy spectra.
method Bayesian inference with two steps: hyperparameter estimation and peak fitting.
result Framework prevents overfitting and overpenalizing, improving parameter estimation.
Researchers analyze the geometric and statistical properties of transformer model representations.
problem Understanding the semantic structure of large transformer models across various data types.
method Characterization of geometric and statistical properties through analysis of intrinsic dimension and neighbor composition.
result The semantic information of the dataset is better expressed at the end of the first peak in transformer models.
We find empirically a characteristic sharp peak-flat trough pattern in a large set of commodity prices. We argue that the sharp peak structure reflects an endogenous inter-market organization, and that peaks may be seen as local ``singularities'' resulting from imitation and herding. These findings impose a novel strin…
Joint peak detection is a central problem when comparing samples in genomic data analysis, but current algorithms for this task are unsupervised and limited to at most 2 sample types. We propose PeakSegJoint, a new constrained maximum likelihood segmentation model for any number of sample types. To select the number of…
Mass spectrometry (MS) is an important technique for chemical profiling which calculates for a sample a high dimensional histogram-like spectrum. A crucial step of MS data processing is the peak picking which selects peaks containing information about molecules with high concentrations which are of interest in an MS in…
A new method for analyzing high-dimensional data using density peaks.
problem Analyzing complex, high-dimensional data sets.
method Density Peak clustering combined with a non-parametric density estimator.
result Automatic identification of density peaks and valleys in data.
Study on-chain peak shaving to reduce Ethereum transaction costs.
problem Reducing transaction costs in blockchain networks, especially during congested periods.
method Analyzing transaction-level data from multiple firms across various industries to understand scheduling responses and cost management strategies.
result Firms' scheduling responses to congestion vary, leading to different fee savings and residual costs.
Bayesian framework integrates spectral deconvolution with expert reasoning for robust peak estimation.
problem Challenges in extracting meaningful peaks from noisy or complex spectra.
method Bayesian spectral deconvolution coupled with a physical-property regression layer.
result Recovery of weak peaks in poly(lactic acid) IR spectra related to degradation rates.
FLOPART solves peak detection by creating accurate train and test set predictions.
problem Correctly detecting peaks in sequential data.
method Dynamic programming changepoint algorithm with zero train label errors.
result FLOPART provides highly accurate predictions on both train and test sets.
The paper shows how the generalization curve can have multiple peaks, influenced by data and learning algorithm biases.
problem Understanding the generalization behavior of linear regression models under varying parameterizations.
method Analyzes generalization loss in linear regression models with varying parameterizations, both under- and over-parameterized.
result The generalization curve can have an arbitrary number of peaks, and their locations can be controlled.
PEAKS selects key training examples incrementally based on prediction error and kernel similarity.
problem Dynamic data selection in deep learning models.
method Prediction Error Anchored by Kernel Similarity (PEAKS) for incremental data selection.
result PEAKS outperforms existing selection strategies and yields better performance returns as training data size grows.
Paper proposes an extension of Peak criterion for selecting kernel bandwidth in SVDD for large datasets.
problem Selecting optimal kernel bandwidth parameter for SVDD in large datasets.
method Extend Peak criterion method for large datasets, modifying existing methods for comparison.
result Proposed method gives good results and demonstrates advantage over existing methods.
PEAK tests means of multiple data streams with sequential betting.
problem Testing means of multiple data streams with nonparametric methods.
method Sequential, nonparametric testing using a betting scheme.
result PEAK provides up to 85% reduction in samples for stopping.
Finite-time queue peaks in stochastic networks have logarithmic scaling after geometric thresholds.
problem Queue peak laws in stochastic networks with geometric thresholds.
method Self-normalization mechanism
result Logarithmic scaling of queue peaks after geometric thresholds.
LLMs learn peaked distributions slowly due to power-law losses.
problem Slow convergence of loss in training large language models.
method Systematic analysis of toy models and empirical evaluation of LLMs.
result Power-law time scaling with an exponent of 1/3 for learning peaked distributions.
Bayesian Quadrature improves ensembling for neural networks with dispersed likelihood peaks.
problem Ensembling neural networks struggles with dispersed, narrow peaks in likelihood surfaces.
method Uses Bayesian Quadrature to construct weighted ensembles of architectures.
result Empirically outperforms state-of-the-art baselines in test likelihood, accuracy, and expected calibration error.
Statistical mechanics reveals phase transitions in ε-SVR error.
problem Understanding task precision in neural representations with variability.
method Statistical mechanics applied to ε-SVR. result Double-descent phenomenon in generalization error due to ε. During a stock market peak the price of a given stock (i) jumps from an initial level p1(i) to a peak level p2(i) before falling back to a bottom level p3(i). The ratios A(i)=p2(i)/p1(i) and B(i)=p3(i)/p1(i) are referred to as the peak- and bottom-amplitude respectively. The paper show…
A nonparametric method for time series analysis extracts envelopes, detects peaks, and clusters data.
problem Extracting envelopes, detecting peaks, and clustering in time series data.
method Iterative procedure that minimizes L1 drift to create upper and lower bounding signals, using Viterbi-like path tracking and optimal elimination rules. result Efficiently calculated solution with near-linear time complexities for various applications.
In this paper, the fractional order curvature equation (−Δ)γu=(1+εK(x))uN−2γN+2γ in RN is considered. Assuming K(x) has two critical points satisfying certain local conditions, we prove the existence of two-peak solutions.
Quantum models show improved performance in overparameterized regimes.
problem Overfitting in quantum machine learning models.
method Analytical demonstration and numerical experiments on quantum kernel methods.
result Quantum models can operate in the modern, overparameterized regime without overfitting.
Populations of species in ecosystems are often constrained by availability of resources within their environment. In effect this means that a growth of one population, needs to be balanced by comparable reduction in populations of others. In neutral models of biodiversity all populations are assumed to change increment…
Paper proposes a network framework for prosumers to manage peak loads in Iran.
problem Balancing renewable prosumers' self-sufficiency with grid integration under uncertainty.
method Distributed contextual stochastic optimization (DCSO) framework with consensus-based sharing.
result Integration of prediction and optimization reduces peak loads and costs.
New algorithm tackles constrained Markov decision processes with peak constraints.
problem Optimizing dynamic systems with peak constraints.
method Model-free algorithm converting PCMDP to unconstrained problem, applying Q-learning.
result Algorithm achieves (ε,p)-PAC policy under certain conditions. We win EVA2025 by estimating extreme precipitation events using Peaks Over Thresholds and martingale testing.
problem Estimating the probability of extreme precipitation events with limited data.
method Modeling Peaks Over Thresholds with an exponential distribution and using martingale testing for evaluation.
result Our method outperforms other approaches in estimating extreme precipitation events.
Novel algorithm compresses ECG signals with preserved R peaks.
problem Efficiently compressing ECG signals while preserving R peak information.
method Blaschke unwinding AFD for faster convergence and higher fidelity.
result The proposed algorithm outperforms state-of-the-art approaches in ECG signal compression.
Deep networks learn clean structure before memorizing corrupted labels, leaving a spectral signature in gradient centered scatter.
problem Deep networks' transition from learning clean structure to memorizing corrupted labels under label noise.
method Analysis of the centered scatter of per-example last-layer gradients to identify Fisher Rank Inflation.
result Fisher Rank Inflation is a spectral signature of memorization under label noise, with effective rank expanding during memorization.
A new clustering algorithm reduces density peaks clustering's computational complexity.
problem High computational complexity of density peaks clustering.
method Sparse distance matrix, sparse search, K-d tree, second-order difference method.
result Reduced computational complexity from O(n2K) to O(n(n1−1/K+k)). Paper proposes combining GAM and DNN for accurate peak demand estimation from lower-resolution data.
problem Predicting high-resolution peak demand from limited lower-resolution data.
method Combines generalized additive models (GAM) and deep neural networks (DNN) for half-hourly load forecasting.
result Proposed method reduces out-of-sample RMSE by 57.4% compared to benchmark.
We study the dynamics of order flows around large intraday price changes using ultra-high-frequency data from the Shenzhen Stock Exchange. We find a significant reversal of price for both intraday price decreases and increases with a permanent price impact. The volatility, the volume of different types of orders, the b…
Scalable system predicts hot videos for peak VOD service.
problem Improving peak service quality of video on demand.
method Two neural networks: clustering and dispatch policy. Clustering reduces video numbers, dispatch policy ranks videos with probabilities. Networks are trained end-to-end.
result Average prediction accuracy of 17% compared to 3% baseline, for same number of dispatches.
We analyse the dynamics of the Warsaw Stock Exchange index WIG at a daily time horizon before and after its well defined local maxima of the cusp-like shape decorated with oscillations. The rising and falling paths of the index peaks can be described by the Mittag-Leffler function superposed with various types of oscil…
Improved peak detection in ChIP-seq data reduces over-dispersion.
problem Over-dispersion in ChIP-seq data reduces peak detection accuracy.
method Supervised segmentation models with alternative noise assumptions.
result Improved peak detection accuracy compared to natural assumptions.
New model improves volatility forecasting by reducing overestimation and underestimation.
problem SVR-GARCH model overestimates or underestimates volatility, hindering peak or trough behaviors.
method Proposes blending ARCH and augmented blending-ARCH models to improve volatility forecasting.
result Empirical results show improved volatility forecasting ability.
Deep learning aligns GC-MS peaks for biomarker discovery.
problem Aligning retention times of GC-MS peaks across different samples.
method ChromAlignNet, a deep learning model for peak alignment.
result ChromAlignNet outperforms existing methods on complex data sets.
Extracts important peaks from XRD spectra using Attention mechanism.
problem Identifying significant peaks in XRD patterns for material properties.
method Convolutional neural network with Attention mechanism to analyze deep features.
result Selected lattice constant predicts cathodic material cell voltage.
Quantum algorithm improves portfolio optimization quality measured by Wasserstein distance.
problem Optimizing financial asset portfolios using quantum computing.
method Used Quantum Approximate Optimization Algorithm (QAOA) and Normalized and Complementary Wasserstein Distance (η) to benchmark solution quality. result Solution quality increases with QAOA circuit depth p and is influenced by the portfolio budget B.