Local data coverage governs memorization in diffusion models.
problem Memorization in diffusion models
method Derive a theoretical criterion based on local data coverage
result Predicts memorization based on density of training data in neighborhood and dataset size
The paper identifies patterns in language model weights used for memorizing paragraphs.
problem Locating the specific mechanisms and weights used by language models to memorize paragraphs.
method Examined gradients and attention patterns in language models to identify memorized paragraphs.
result Gradients of memorized paragraphs have a distinguishable spatial pattern, and localized attention heads are involved in paragraph memorization.
Consistency distillation reduces memorization in diffusion models without harming sample quality.
problem Understanding how distillation affects memorization in diffusion models.
method Analysis of consistency distillation in diffusion models using a random feature neural network model.
result Consistency distillation reduces memorization in diffusion models without harming sample quality.
Geometric framework explains memorization in generative models.
problem Memorization in generative models raises legal and privacy concerns.
method Manifold memorization hypothesis (MMH) using manifold geometry.
result Formalizes and categorizes memorization into overfitting and distribution-driven types.
Study shows how deep generative models can memorize data.
problem Understanding and preventing memorization in deep generative models.
method Adapted a memorization measure for unsupervised density estimation and demonstrated its effectiveness.
result Memorization in deep generative models differs from mode collapse and overfitting.
New method reduces memorization in diffusion models without sacrificing image quality.
problem Diffusion models often memorize training data, especially with small datasets.
method Train models using noisy data at large noise scales to reduce memorization.
result Significant reduction in memorization without compromising image quality.
Neural networks memorize exceptions, leading to poor generalization.
problem Memorization of exceptions hinders neural network generalization.
method Formalized memorization-generalization interplay, proposed MAT to shift logits.
result MAT improves generalization by learning robust patterns invariant across distributions.
LLMs can memorize economic data and recall exact values before their training cutoff.
problem Evaluating the trustworthiness of LLMs' economic forecasts during their training period.
method Demonstrated through counterfactual forecasting and analysis of LLMs' recall ability.
result LLMs have memorized economic and financial data, leading to recall-level accuracy before their knowledge cutoff.
Generative diffusion models gradually memorize training data, losing independent dimensions.
problem Understanding how generative diffusion models memorize training data, especially on low-dimensional manifolds.
method Measuring latent dimensionality via the learned score field, proposing a geometric memorization theory.
result Generative diffusion models experience a smooth collapse of their capacity to vary across independent directions as data become scarce, leading to near point-wise replication of salient features.
Memorizing rare examples helps neural networks generalize better.
problem Improving generalization in deep learning models.
method Theoretical analysis and experiments on neural networks with composition capability.
result Memorizing rare examples can help neural networks make correct predictions on rare test examples.
New approach shows data memorization trade-offs in large models.
problem Data memorization in large language models and its privacy implications.
method Developed a new approach using strong data processing inequalities to prove lower bounds on memorization.
result Proved that Ω ( d ) Ω(d) Ω ( d ) bits of training data information must be memorized for O ( 1 ) O(1) O ( 1 ) examples, decaying with example growth. Study shows FL reduces unintended memorization by clustering data and using strong user-level privacy.
problem Unintended memorization in federated learning.
method Examined the effect of clustering data and using strong user-level differential privacy in FL.
result Clustering data and strong user-level differential privacy reduce unintended memorization.
ResMem improves model generalization by explicitly memorizing residuals.
problem Improving model generalization in neural networks.
method ResMem algorithm that augments a model with a k-nearest neighbor based regressor fitted to residuals.
result ResMem consistently improves test set generalization across various benchmarks.
The bias potential model explains how generative models can generalize or memorize samples.
problem Understanding and achieving generalization in generative models like GANs.
method Introducing the bias potential model to analyze the behavior of generative models.
result Dimension-independent generalization accuracy can be achieved with early stopping in the bias potential model.
This paper explores memorization in adversarial training and proposes a mitigation algorithm.
problem Understanding and mitigating robust overfitting in adversarial training.
method Demonstrated the capacity of deep networks to memorize adversarial examples, analyzed convergence and generalization issues, and proposed a new mitigation algorithm.
result Identified robust overfitting as a significant drawback of adversarial training and proposed a mitigation algorithm.
The study uncovers the conditions under which diffusion models memorize or generalize.
problem Understanding the balance between memorization and generalization in diffusion models.
method Theoretical and mathematical framework to investigate memorization and generalization in diffusion models.
result Theoretical crossover point predicts a phase transition in diffusion models, validating the hypothesis.
Diffusion models can memorize training data, limiting their creativity and privacy.
problem Memorization in diffusion models that reproduces training data instead of generating novel outputs.
method Dual-separation approach via statistical estimation and network approximation.
result Pruning-based method reduces memorization while maintaining generation quality.
Introduces Relational Privacy (RP) to control relation memorization in question answering models.
problem Relation memorization in question answering models can lead to privacy issues.
method Formalizes Relational Privacy (RP) and Differential Relational Privacy (DrP), providing bounds on relation memorization.
result DrP allows effective learning of general properties of underlying concepts while preventing relation memorization.
Deep models memorize training data in geophysical inversion, leading to biased posterior distributions.
problem Memorization of training data biases learned priors in geophysical inverse problems.
method Casting generative models' training as maximum likelihood, we show memorization results in a reweighted empirical distribution for diffusion models, leading to Gaussian mixture priors and posteriors.
result Memorization leads to posterior distributions that are likelihood-weighted lookup among stored training examples, affecting full waveform inversion outcomes.
RAF model explains neural networks' dual rule learning and fact memorization.
problem Understanding how neural networks learn rules and memorize facts simultaneously.
method Introduces the Rules-and-Facts (RAF) model to bridge generalization and memorization.
result Characterizes conditions for simultaneous rule learning and fact memorization in neural networks.
Deep networks preferentially learn shared features, avoiding memorization in early layers.
problem Understanding how deep neural networks generalize vs. memorize training data.
method Replica-based mean field geometric analysis of deep neural networks.
result Deep layers predominantly memorize, while early layers are minimally affected.
Diffusion models generalize well until a threshold is reached, preventing memorization.
problem Understanding why diffusion models don't memorize training data.
method Investigation of training dynamics and two timescales: τ g e n τ_\mathrm{gen} τ gen and τ m e m τ_\mathrm{mem} τ mem . result The threshold τ m e m τ_\mathrm{mem} τ mem increases linearly with training set size n n n , preventing memorization. State-of-the-art results on image recognition tasks are achieved using over-parameterized learning algorithms that (nearly) perfectly fit the training set and are known to fit well even random labels. This tendency to memorize the labels of the training data is not explained by existing theoretical analyses. Memorizati…
Learning to solve sequential tasks with recurrent models requires the ability to memorize long sequences and to extract task-relevant features from them. In this paper, we study the memorization subtask from the point of view of the design and training of recurrent neural networks. We propose a new model, the Linear Me…
Early stopping improves generalization in overparameterized diffusion models.
problem Understanding and optimizing generalization in overparameterized diffusion models.
method Revisiting diffusion models, showing generalization occurs before memorization, and developing a phase diagram.
result Generalization time scales with dataset size, supporting early-stopping criteria.
Over-parameterized models can memorize noisy labels and still generalize well, revealing a hidden structure.
problem Understanding how over-parameterized models can simultaneously memorize noisy labels and generalize well.
method Investigated through modular arithmetic tasks with label noise using two-layer neural networks.
result Over-parameterized models can achieve near-perfect test accuracy with 80% label noise by extracting an internal generalization structure.
Data selection boosts fact memorization in language models.
problem Language models struggle to accurately memorize factual knowledge.
method Formalizes fact memorization, proposes data selection schemes based on training loss.
result Data selection boosts fact accuracy to model capacity and improves performance.
Transformers with CoT don't enhance reasoning power across all tasks.
problem Does CoT enhance the reasoning power of transformers?
method Examined the memorization capabilities of fixed-precision transformers with and without CoT.
result Transformers with CoT cannot memorize all reasoning tasks, leading to a negative answer.
We study finite sample expressivity, i.e., memorization power of ReLU networks. Recent results require N N N hidden nodes to memorize/interpolate arbitrary N N N data points. In contrast, by exploiting depth, we show that 3-layer ReLU networks with Ω ( N ) Ω(\sqrt{N}) Ω ( N ) hidden nodes can perfectly memorize most datasets with N N N po…
Optimal ReLU networks can memorize any separable set of points with a small number of parameters.
problem The optimal number of parameters required to memorize a set of points using ReLU networks.
method Construction of ReLU networks with specific bit complexity to memorize points satisfying a mild separability assumption.
result Optimal ReLU networks can memorize any separable set of points with a number of parameters that is i l d e O ( N ) ilde{O}(\sqrt{N}) i l d e O ( N ) . Large learning rates prevent memorization in denoising score matching.
problem Memorization of training data in diffusion-based generative models.
method Investigating the role of large learning rates in the small-noise regime, proving that they prevent convergence to the empirical optimal score.
result Large learning rates prevent memorization by making it impossible for the learned score to be arbitrarily close to the empirical optimal score.
Logarithmic network width suffices for robust memorization.
problem Achieving robust memorization in neural networks.
method Established upper and lower bounds on robust memorization radius.
result Width logarithmic in the number of samples is necessary and sufficient for robust memorization.
The IM effect helps detect anomalies by memorizing inliers early.
problem Challenges in fully unsupervised outlier detection.
method Theoretical study of a simple autoencoder, focusing on early training dynamics.
result Characterization of IM effect emergence, strength, and persistence.
Study compares memorization of SimCLR to supervised and random labels training.
problem Understanding memorization in contrastive learning.
method Investigated SimCLR's memorization properties compared to supervised and random labels training.
result SimCLR's memorization is similar to random labels training in terms of training object complexity distribution.
The paper analyzes how deep models memorize spurious features.
problem Understanding how deep models memorize spurious features in training data.
method Characterizes spurious feature memorization via model stability and feature alignment.
result Memorization of spurious features weakens as generalization capability increases.
Deep networks can memorize random labels; symmetric loss improves this.
problem Deep networks can memorize random labels, ignoring standard regularization.
method Empirical studies with MNIST and CIFAR-10 datasets, formal definition of robustness.
result Symmetric loss function improves network's ability to resist memorization.
Changing initialization scale affects deep model generalization, leading to memorization or improved performance.
problem Understanding how initialization scale impacts deep model generalization and memorization.
method Experimental setup with varying initialization scales, analysis of activation and loss functions, and development of an alignment measure.
result Increasing initialization scale leads to memorization, and decreasing it improves generalization, depending on activation and loss functions.
Framework prevents deep learning models from memorizing noisy labels.
problem Deep learning models memorize noisy labels during early learning phase.
method Develops a technique that exploits early learning phase via regularization.
result Framework achieves robustness to noisy annotations on benchmarks and real-world datasets.
Study interprets neural network generalization and memorization on corrupted data.
problem Understanding when a neural network has memorized corrupted data versus learned the underlying rule.
method Analyzes multi-layer perceptrons and Transformers on modular arithmetic tasks with corrupted labels.
result Regularization methods can force networks to ignore corrupted data, improving accuracy on uncorrupted data.
New experiments show deep networks benefit from memorizing rare data points.
problem Understanding why neural networks perform well on training data.
method Estimating influence and memorization values of training examples.
result Deep networks benefit from memorizing rare data points for good performance.
It can be difficult to tell whether a trained generative model has learned to generate novel examples or has simply memorized a specific set of outputs. In published work, it is common to attempt to address this visually, for example by displaying a generated example and its nearest neighbor(s) in the training set (in,…
Gradient descent memorizes many Gaussians efficiently.
problem Memorizing many Gaussians with minimal parameters.
method Gradient descent on a depth-two neural network.
result One step of gradient descent memorizes $Ω\left(\frac{dq}{\log^4(d)}
ight)$ Gaussians.
The study finds that memorization is necessary or harmful depending on the prior distribution and noise level.
problem The impact of memorization on generalization in overparameterized models.
method An overparameterized linear model with general priors in a Bayesian setup.
result Explicit conditions for optimal generalization based on the prior distribution and noise level.
Solves memorization in diffusion models for manifold data.
problem Memorization effect in diffusion models for manifold data.
method Inertia update at the end of empirical diffusion simulation.
result Approximates true data distribution on a C 2 C^2 C 2 manifold. New training method for ReLU networks achieves optimal weight size for memorization.
problem Approximate memorization of arbitrary real labels with neural networks.
method Complex recombination training procedure for ReLU networks.
result Approximate memorization with nearly optimal weight size and neuron count.
New attack reveals memorization patterns in pre-trained LLMs.
problem Determining if a data point was part of a pre-trained LLM's training set.
method Adapts MIA statistical tests to LLM's perplexity dynamics of subsequences.
result Significantly outperforms prior approaches in membership inference attacks.
Researchers validate ML scenario generators by checking dependencies and detecting memorization effects.
problem Validation of machine learning-based scenario generators differs from classical methods due to data-driven dependencies.
method Two novel validation aspects: checking dependencies and detecting memorization effects. Novel memorization ratio introduced.
result Validation methods successfully detect dependencies and memorization effects in ML-based scenario generators.
New findings show tool-augmented models can recall unlimited facts, outperforming purely memorized models.
problem Limitations of purely memorized models in recalling large amounts of factual information.
method Demonstrated the benefits of in-tool learning (external retrieval) over in-weight learning (memorization) for factual recall.
result Proved that tool-use enables unbounded factual recall via a simple and efficient circuit construction.