CoRe method improves time series forecasting coherency without strict constraints.
problem Noisy hierarchical time series data that doesn't perfectly adhere to aggregation constraints.
method Coherency Regularization using neural networks.
result Improved forecast accuracy and coherence, especially in noisy data scenarios.
It is shown that the axioms for coherent risk measures imply that whenever there is an asset in a portfolio that dominates the others in a given sample (which happens with finite probability even for large samples), then this portfolio cannot be optimized under any coherent measure on that sample, and the risk measure …
Low-rank matrix approximations are often used to help scale standard machine learning algorithms to large-scale problems. Recently, matrix coherence has been used to characterize the ability to extract global information from a subset of matrix entries in the context of these low-rank approximations and other sampling-…
Top-H decoding improves text generation by balancing creativity and coherence.
problem Balancing creativity and coherence in text generation.
method Entropy-constrained minimum divergence problem, NP-hard ECMM problem, top-H decoding.
result Top-H decoding outperforms min-p sampling by up to 25.63% on creative writing benchmarks.
New metric m-coherence measures gradient alignment during training, revealing surprising memorization patterns.
problem Measuring and understanding the alignment of per-example gradients during training.
method Introducing m-coherence as a metric to study gradient alignment, showing its advantages over existing metrics. result Training with random labels leads to high m-coherence, indicating common patterns even when generalization is not possible. Improved sample-efficient learning for non-coherent digital jamming.
problem Learning optimal jamming strategies in non-coherent digital modulation schemes without prior knowledge.
method Introduced a linear bandit algorithm that accounts for action similarities and integrates context features.
result Significantly improved convergence behavior compared to prior art.
We give a new, very general, formulation of the compressed sensing problem in terms of coordinate projections of an analytic variety, and derive sufficient sampling rates for signal reconstruction. Our bounds are linear in the coherence of the signal space, a geometric parameter independent of the specific signal and m…
Develops a statistical framework for coherent risk estimation.
problem Constructing coherent risk estimators with sound financial and statistical properties.
method Inspired by axiomatic risk measure theory, defines coherent risk estimators through robust representations linked to L-estimators. result Demonstrates that coherence of a risk measure does not necessarily carry over to its estimators and shows alternative weight structures can lead to different outcomes.
Proposes a new algorithm for efficient probabilistic reconciliation of forecasts.
problem Ensuring coherence in forecasts for hierarchical time series.
method Bottom-Up Importance Sampling algorithm for any type of forecast distribution.
result Significant improvement over base probabilistic forecasts in experiments.
Efficient audio synthesis is an inherently difficult machine learning task, as human perception is sensitive to both global structure and fine-scale waveform coherence. Autoregressive models, such as WaveNet, model local structure at the expense of global latent structure and slow iterative sampling, while Generative A…
Low-rank matrix completion is an important problem with extensive real-world applications. When observations are uniformly sampled from the underlying matrix entries, existing methods all require the matrix to be incoherent. This paper provides the first working method for coherent matrix completion under the standard …
We analyze why some models resist unlearning using linear stability theory.
problem Understanding and predicting when machine learning models resist unlearning.
method Linear stability theory applied to machine learning models, focusing on data coherence and optimization dynamics.
result Data coherence and signal-to-noise ratio (SNR) influence unlearning resistance; lower SNR makes unlearning easier.
Develops non-standard analysis for coherent risk estimation.
problem Estimating coherent risk measures in financial contexts.
method Non-standard analysis, hyperfinite representations, discrete Kusuoka formulae, plug-in asymptotics.
result Uniform almost sure consistency and asymptotic normality of spectral plug-in estimators.
New method for exact matrix completion with reduced observation complexity.
problem Exact recovery of matrices with high coherence.
method Adaptive sampling method and relation to sparsest vector of column and row spaces.
result Exact recovery of μ0-coherent column space matrices with much smaller observation complexity. Diffusion models learn hierarchical composition rules from data.
problem How many samples do generative models need to learn hierarchical composition rules?
method Theoretical and empirical investigation of diffusion models on probabilistic context-free grammars.
result Diffusion models learn hierarchical composition rules with sample complexity scaling polynomially with context size.
ConvNP improves SP prediction with translation equivariance and coherent samples.
problem Predicting stationary stochastic processes with coherent samples.
method Convolutional Neural Processes (ConvNP) with a new maximum-likelihood objective.
result ConvNP outperforms standard NPs and demonstrates strong generalization on various tasks.
We discuss the coherence properties of Expected Shortfall (ES) as a financial risk measure. This statistic arises in a natural way from the estimation of the "average of the 100p % worst losses" in a sample of returns to a portfolio. Here p is some fixed confidence level. We also compare several alternative representat…
We consider the related tasks of matrix completion and matrix approximation from missing data and propose adaptive sampling procedures for both problems. We show that adaptive sampling allows one to eliminate standard incoherence assumptions on the matrix row space that are necessary for passive sampling procedures. Fo…
New coherence parameter for GNNs with Fourier measurements improves signal recovery.
problem Characterizing generative compressed sensing with Fourier measurements.
method Subspace counting arguments and high-dimensional probability theory.
result First known restricted isometry guarantee for generative compressed sensing with subsampled isometries.
A new method uses denoising diffusion models to improve seismic data interpolation.
problem Improving the accuracy of seismic data interpolation to enhance imaging and interpretation.
method The approach combines denoising diffusion probabilistic models with coherence-corrected resampling strategies.
result The proposed method achieves superior performance and generalization to various missing patterns and noise levels.
Study the limits of discrete DPPs to continuous DPPs as set size grows.
problem Characterize the behavior of discrete DPPs as they approach continuous DPPs.
method Non-asymptotic characterization of the limit in terms of weak coherency.
result Sufficient conditions for weak coherency are identified.
CMC method detects causal relationships in time series data.
problem Understanding causal relationships in nonlinear systems.
method Cross-Mapping Coherence method, based on nonlinear state-space reconstruction and coherence metrics.
result CMC accurately identifies causal connections in various systems.
In emerging Internet-of-Nano-Thing (IoNT), information will be embedded and conveyed in the form of molecules through complex and diffusive medias. One main challenge lies in the long-tail nature of the channel response causing inter-symbol-interference (ISI), which deteriorates the detection performance. If the channe…
Improved sampling strategy reduces Fourier measurements for neural network signals.
problem Efficiently sampling signals from neural networks with random Fourier matrices.
method Model-adapted sampling strategy with improved sample complexity.
result Reduced sample complexity from O(kdnα∞²) to O(kdα²₂) measurements.
Proving that next-token prediction makes language models generate coherent long documents.
problem Understanding why language models generate coherent documents despite focusing on next-token prediction.
method Proving the power of next-token prediction in learning longer-range structure using Recurrent Neural Networks (RNN).
result Optimizing next-token prediction in RNNs yields a model that closely approximates the training distribution, even for long-range coherence.
Deep generative model for healthcare data identifies coherent substructures and mutational clusters.
problem Analytical challenges in healthcare data, including sparsity, missingness, and small sample sizes.
method Proposes a deep generative Bayesian model with collapsed Gibbs sampling for multinomial count data.
result Identifies coherent substructures and biologically meaningful mutational clusters in cancer data.
Paper proposes a new method to improve clustering ensemble performance.
problem Improving clustering ensemble performance by refining co-association matrix.
method Low-rank tensor approximation to derive coherent-link matrix and refine co-association matrix.
result The proposed method achieves breakthrough in clustering performance compared to state-of-the-art methods.
Variance-Calibrated Modulation (VCM) addresses the likelihood trap in LLMs by reshaping the probability distribution before truncation.
problem LLMs fall into the likelihood trap, leading to repetitive degeneration and vocabulary dullness.
method VCM reshapes the probability distribution before truncation through Contextual Searchlight and Adaptive Self-Debiasing.
result VCM mitigates the likelihood trap across open-ended generation, factual QA, and mathematical reasoning.
Defines coherent manifolds and their quantum applications.
problem Understanding quantum spaces and coherent states.
method Generalizes quantum field theory and Schrödinger equation solutions.
result Solves Schrödinger equation on coherent manifolds.
In this paper we present a theoretical framework for studying coherent acceptability indices in a dynamic setup. We study dynamic coherent acceptability indices and dynamic coherent risk measures, and we establish a duality between them. We derive a representation theorem for dynamic coherent risk measures in terms of …
A new video prediction model treats videos as continuous processes, reducing sampling steps and improving efficiency.
problem Efficiency and temporal coherence in video prediction models.
method Treats videos as a continuous multi-dimensional process, reducing sampling steps.
result Reduction of 75% sampling steps, state-of-the-art performance on benchmark datasets.
Coherent Multiplex analyzes real-time wavelet coherence among multiple signals.
problem Identifying and visualizing coherence among multiple time series.
method Fast spectral similarity based on cosine similarity metrics of Fourier-transformed signals and sparse time-frequency wavelet coherence.
result Scalable real-time system for low-latency inference and monitoring of inter-signal relationships.
We focus on power-law coherency as an alternative approach towards studying power-law cross-correlations between simultaneously recorded time series. To be able to study empirical data, we introduce three estimators of the power-law coherency parameter Hρ based on popular techniques usually utilized for studying pow…
Autoregressive generative models of images tend to be biased towards capturing local structure, and as a result they often produce samples which are lacking in terms of large-scale coherence. To address this, we propose two methods to learn discrete representations of images which abstract away local detail. We show th…
The transition amplitudes between coherent states on a coherent state manifold are expressed in terms of the embedding of the coherent state manifold into a projective Hilbert space. Consequences for the dimension of projective Hilbert space and a simple geometric interpretation of Calabi's diastasis follows.
We use mathematical induction to prove that the horizontal composition in the class of coherently diagonal complexes is indeed a binary operation. That is to say, the embedding of two coherently diagonal complexes in an alternating planar diagram produces a coherently diagonal complex.
Adaptive contrastive search improves text generation quality and diversity.
problem Decoding high-quality text from language model outputs.
method Adaptive contrastive search incorporating uncertainty-guided degeneration penalty.
result Enhanced text generation quality and diversity across different models and datasets.
Paper constructs Chern character for coherent sheaves.
problem Chern character for coherent sheaves with values in Bott-Chern cohomology.
method Based on Block's fundamental construction, constructs Chern character.
result Proves Riemann-Roch-Grothendieck formula for coherent sheaves.
The paper constructs minimal coherent filling pairs on surfaces.
problem Finding minimal intersecting coherent filling pairs on surfaces.
method Geometric procedure starting from a torus filling pair.
result Construction of minimal intersecting coherent filling pairs on Sg for g≥3. Sparse coding in learned dictionaries has been established as a successful approach for signal denoising, source separation and solving inverse problems in general. A dictionary learning method adapts an initial dictionary to a particular signal class by iteratively computing an approximate factorization of a training …
The study analyzes and mitigates errors in PC-based causal discovery methods.
problem Errors in PC-based causal discovery methods can lead to incorrect graphs.
method The study introduces coherency scores to detect assumption violations and small sample errors in PC-based methods.
result The coherency scores can detect errors that other methods cannot, bridging between global and local error detection.
Paper defines dynamical coherence for flows and proves it under specific conditions.
problem Understanding the dynamics of partially hyperbolic flows.
method Introduces dynamical coherence and proves it for flows with a specific foliation.
result Dynamical coherence proved for flows with a particular foliation.
Develops equivariant Chern characters for coherent sheaves with group actions.
problem Computing Chern characters for coherent sheaves on manifolds with group actions.
method Introduces equivariant Chern characters and proves Riemann-Roch-Grothendieck theorem in Bott-Chern cohomology.
result Establishes a Riemann-Roch-Grothendieck theorem for coherent sheaves with finite group actions.
We present a method for identifying the coherent structures associated with individual Lagrangian flow trajectories even where only sparse particle trajectory data is available. The method, based on techniques in spectral graph theory, uses the Coherent Structure Coloring vector and associated eigenvectors to analyze t…
We study a space of coherent risk measures M_phi obtained as certain expansions of coherent elementary basis measures. In this space, the concept of ``Risk Aversion Function'' phi naturally arises as the spectral representation of each risk measure in a space of functions of confidence level probabilities. We give nece…
Generates coherent storybooks from plain text using diffusion models.
problem Ensuring coherency in a sequence of images for storytelling applications.
method Combines pre-trained LLM and text-guided Latent Diffusion Model for zero-shot generation.
result Outperforms state-of-the-art image editing baselines in generating coherent storybooks.
Study reveals benign overfitting in time series models with over-parameterization.
problem Analyzing over-parameterized linear models with dependent time-series data.
method Developed an estimator using interpolation and derived non-asymptotic risk bounds.
result Risk bound is influenced by the coherence of temporal covariance matrices at different time steps.
A realization of coherent state Lie algebras by first-order differential operators with holomorphic polynomial coefficients on Kähler coherent state orbits is presented. Explicit formulas involving the Bernoulli numbers and the structure constants for the semisimple Lie groups are proved.