This research examines rare spurious correlations in neural networks and their impact on accuracy and privacy.
problem Rare spurious correlations in neural networks and their privacy risks.
method Introducing spurious patterns correlated with a fixed class to a few training examples, analyzing ℓ2 regularization and Gaussian noise. result Rare spurious correlations can significantly impact neural network accuracy and privacy, and specific mitigation methods can be effective.
The study reveals how synaptic correlations promote dimension reduction in neural networks.
problem Understanding how synaptic correlations affect neural correlations and dimension reduction in deep neural networks.
method A simplified model of dimension reduction considering pairwise correlations among synapses, using mathematical self-consistency for both binary and continuous synapses.
result Weakly-correlated synapses encourage dimension reduction compared to orthogonal synapses, and they also slow down the decorrelation process.
Model captures context-dependent neural correlations using Poisson mixtures.
problem Capturing context-dependent noise correlations in neural populations.
method Conditional finite mixtures of Poisson distributions, cross-validation for dimensionality, EM algorithm.
result Model successfully captures stimulus-dependent correlations in V1 neuron responses.
Study shows how correlations between neural activity affect classification capacity.
problem Understanding how correlations between neural activity impact classification performance.
method Calculated the capacity of neural activity on spherical manifolds with and without correlations between centroids and axes.
result Introducing correlations between neural activity centroids pushes spheres closer together, while correlations between axes shrink their radii, revealing a duality between correlations and geometry in classification.
Infinite CNNs lose spatial correlations, but can be restored by correlated weights.
problem Infinite CNNs lose spatial correlations, which are crucial for their performance.
method Introduced correlated weights to restore spatial correlations in infinite CNNs.
result Optimal performance is achieved with a moderate level of weight correlation.
Symmetry of neural network densities can be determined from correlation functions.
problem Determining symmetries of neural network densities without knowing the density itself.
method Symmetry-via-duality approach using invariance properties of correlation functions.
result Symmetries of neural network densities can be determined via dual computations of correlation functions.
Study neural networks by mapping correlations, revealing essential statistics.
problem Understanding information processing in trained neural networks.
method Characterize neural network as distribution transformations, focusing on correlation functions.
result Higher-order correlations are crucial for internal layers, while input layer captures more.
Paper forecasts stock correlations using a hybrid model combining graph neural networks and transformers.
problem Improving stock correlation forecasts for better portfolio management.
method Hybrid model combining Transformer and graph attention networks for forecasting residual deviations from historical data.
result The hybrid model reduces correlation forecasting error compared to rolling-window estimates.
GNP models predictive correlations and outperforms NPs.
problem Training and understanding of Neural Processes.
method Proposed a new model, Gaussian Neural Process (GNP), which incorporates translation equivariance and provides universal approximation guarantees.
result Demonstrates encouraging performance and provides universal approximation guarantees.
We examine Deep Canonically Correlated LSTMs as a way to learn nonlinear transformations of variable length sequences and embed them into a correlated, fixed dimensional space. We use LSTMs to transform multi-view time-series data non-linearly while learning temporal relationships within the data. We then perform corre…
GENN predicts drug interactions by modeling correlations between link labels.
problem Predicting drug-drug interactions with consideration of link type correlations.
method GENN uses graph energy neural networks to model link type correlations in DDI prediction.
result GENN outperforms baseline models by 13.77% and 5.01% in PR-AUC on two real-world datasets.
Neural Shadow-Mapping uncovers causal links in dynamic systems.
problem Discovering causal structures in dynamic systems with mirage correlations.
method Neural network based method embedding high-dimensional data into a shadow representation for causal link estimation.
result Demonstrates performance in discovering causal links from video-representations of dynamic systems.
Proposes a model to detect changes in multivariate time series data.
problem Detect abrupt changes in multivariate time series data considering dependencies and correlations.
method Integrates graph neural networks into an encoder-decoder framework to model correlation structures and dynamics.
result Advantageous performance on CPD tasks over strong baselines, classifying changes as correlation or independent.
CopulaGNN integrates graph representational and correlational roles for better node-level predictions.
problem Graphs encode diverse roles in node-level prediction tasks, but GNNs struggle with correlational information.
method Copula theory to describe multivariate dependence, integrating representational and correlational graph information.
result CopulaGNN improves GNN performance on regression tasks by leveraging both types of graph information.
New method interprets quantum many-body snapshots for phase detection.
problem Classifying phases of matter from quantum simulations.
method Confusion learning with correlation convolutional neural networks.
result Network detects changes in thermodynamic properties of quantum systems.
Neural networks learn faster with correlated latent variables.
problem Efficiently learning from higher-order correlations in neural networks.
method Analytical derivation and simulations of two-layer neural networks.
result Correlations between latent variables speed up learning from higher-order correlations.
Weak correlations explain linear dynamics in deep learning models.
problem Understanding the linear structure in gradient-based learning algorithms.
method Characterization of weak correlations between derivatives and parameters.
result Weak correlations are the underlying principle for linearization in deep learning models.
Neurons in the visual cortex are correlated in their variability. The presence of correlation impacts cortical processing because noise cannot be averaged out over many neurons. In an effort to understand the functional purpose of correlated variability, we implement and evaluate correlated noise models in deep convolu…
Many research fields codify their findings in standard formats, often by reporting correlations between quantities of interest. But the space of all testable correlates is far larger than scientific resources can currently address, so the ability to accurately predict correlations would be useful to plan research and a…
Neural networks can learn Boolean circuits with local correlation.
problem Learning Boolean circuits with neural networks is computationally hard.
method Observing local correlation between input patterns and target labels, focusing on tree-structured Boolean circuits.
result Local correlation determines the success or failure of optimization in learning Boolean circuits.
CaLoNet integrates spatial and local correlations for multivariate time series classification.
problem Ignoring spatial and local correlations in multivariate time series classification.
method Model spatial correlations using causality modeling, extract local correlations, integrate into graph neural network.
result Competitive performance compared to state-of-the-art methods on UEA datasets.
New method uses VAEs to generate financial correlation matrices for credit portfolio VaR analysis.
problem Quantifying credit portfolio sensitivity to asset correlations.
method Employing Variational Autoencoders (VAEs) to generate synthetic financial correlation matrices.
result The VAE latent space captures crucial factors impacting portfolio diversification, especially in credit portfolio sensitivity to asset correlations.
Gradient descent aligns neural feature matrices with pre-activation tangent features.
problem Understanding neural feature learning mechanisms.
method Analytical proof of alignment between weight matrices and pre-activation tangent features.
result Derivative alignment occurs almost surely in high-dimensional settings.
Biological neural network mimics CCA for multi-channel data.
problem Implementing CCA in a biologically plausible neural network.
method Derive an online CCA algorithm with local synaptic updates for multi-compartmental neurons.
result The derived neural network architecture and synaptic updates resemble cortical pyramidal neuron behavior.
CNN detects multipath in GNSS signals using correlator output.
problem Multipath contamination errors in GNSS signals.
method Deep Convolutional Neural Networks (CNN) applied to GNSS correlator output.
result CNN accurately detects multipath in GNSS signals.
Proposes integrating random effects into deep neural networks for better predictive performance.
problem Correlated data in real-life applications are not handled well by traditional deep neural networks.
method Uses mixed models with random effects to handle correlations in deep neural networks, minimizing Gaussian negative log-likelihood with SGD.
result Improves predictive performance over natural competitors in various correlation scenarios.
This paper introduces hierarchical Gaussian process priors for neural networks to capture weight correlations and inductive biases.
problem Capturing weight correlations and inductive biases in neural networks.
method Hierarchical Gaussian process priors with unit embeddings and input-dependent kernels.
result Hierarchical Gaussian process priors provide competitive predictive performance and desirable uncertainty estimates.
Automates machine learning of correlations between knot invariants.
problem Discovering and validating new relationships between knot invariants.
method Trained a neural network on 200,000 sets of knot invariants to predict an output invariant.
result Found novel correlations not explained by known results in knot theory.
MTNPs jointly model multiple correlated tasks from various sources.
problem Naive NPs can only model a single stochastic process and infer tasks independently.
method MTNPs are a hierarchical extension of NPs that jointly infer tasks from multiple stochastic processes, considering inter-task correlation and handling incomplete data.
result MTNPs successfully model multiple tasks jointly, discovering and exploiting their correlations in various real-world data.
A new method scales CCA parameters by input to learn more correlated representations.
problem Limitation of conventional CCA models in learning highly correlated representations.
method Introduces a dynamic scaling method for training input-dependent canonical correlation models.
result Learned representations are more correlated and retrieval results are preferable.
Bayesian priors for neural networks are improved by incorporating weight correlations and tail behavior.
problem Improving Bayesian priors for neural networks to better reflect true beliefs and performance.
method Analyzed summary statistics of neural network weights in different architectures and incorporated these observations into new priors.
result Improved performance on image classification datasets by using new priors that account for weight correlations and tail behavior.
Cyber-physical systems often consist of entities that interact with each other over time. Meanwhile, as part of the continued digitization of industrial processes, various sensor technologies are deployed that enable us to record time-varying attributes (a.k.a., time series) of such entities, thus producing correlated …
A self-supervised debiasing method using rank regularization mitigates spurious correlations in neural networks.
problem Spurious correlations cause biases in deep neural networks, affecting generalization.
method Spectral analysis of latent representations, rank regularization, self-supervised pretraining, debiasing of downstream tasks.
result The proposed framework significantly improves generalization performance and outperforms supervised debiasing approaches.
New neural network captures spatial correlations in wind speed predictions.
problem Uncertainty quantification in neural network predictions for high-dimensional, correlated data.
method Training neural networks with multidimensional Gaussian loss, preserving spatial correlation and computational tractability.
result Demonstrated super-resolution of surface wind speed with explicit correlation modeling.
New method improves convergence of spatial filters in neural networks.
problem Poor convergence behavior of spatial filters in neural networks.
method Correlated initialization for spatial filters.
result Uncorrelated initialization leads to poor convergence and slow training of some parameters.
Proposes Causal Loss to improve machine learning models' causal inference.
problem Machine learning algorithms often fail to capture causal relationships when data is inconsistent.
method Introduces Causal Loss, a model-agnostic loss function that enhances interventional capabilities.
result Causal Loss improves non-causal associative models to have interventional capabilities.
DORA analyzes deep neural networks' internal representations to detect spurious correlations.
problem Detecting spurious correlations in deep neural networks' internal representations.
method DORA uses Extreme-Activation (EA) distance measure to assess representation similarities.
result Identifies internal representations capable of detecting spurious correlations.
QRPNNs use quaternion-valued recurrent correlation neural networks to solve cross-talk issues.
problem Cross-talk problem in QRCNNs.
method Combining non-local projection learning with QRCNNs.
result QRPNNs exhibit greater storage capacity and noise tolerance.
The paper examines how NFT valuations correlate with market data and social trends.
problem Predicting NFT valuations based on market data and social trends.
method Utilizes public market data, NFT metadata, and social trends data; employs linear regression and recurrent neural networks.
result Identifies correlations between NFT valuations and various features.
Graph neural networks often assume vertex labels are independent, but we show this is rarely true and propose a method to improve predictions.
problem Graph neural networks often assume vertex labels are conditionally independent given their neighborhood features, which is rarely true.
method We model the joint distribution of residuals on vertices with a parameterized multivariate Gaussian and estimate parameters by maximizing the marginal likelihood of the observed labels.
result Our method achieves substantially higher accuracy than competing baselines and can be interpreted as the strength of correlation among connected vertices.
New neural network predicts traffic flow across different cities.
problem Forecasting traffic flow across different cities is challenging due to spatio-temporal correlations.
method Proposes a local-spacetime neural network (STNN) that captures universal spatio-temporal correlations.
result Improves prediction accuracy by 4% over state-of-the-art methods.
Study reveals how neural network biases align with adversarial attack frequencies.
problem Correlation between neural network biases and adversarial attacks.
method Fourier transform analysis of network implicit bias and adversarial perturbations.
result Network bias and adversarial attack frequencies are highly correlated.
Extends RCNNs to handle hypercomplex-valued data.
problem Processing high-dimensional data.
method Develops mathematical background and conditions for hypercomplex-valued RCNNs.
result Hypercomplex-valued RCNNs can always settle at an equilibrium.
TCGPN improves stock forecasting by capturing temporal correlation patterns.
problem Stock forecasting with minimal periodicity and large node numbers.
method TCGPN uses Temporal-Correlation fusion encoder and pre-training methods to handle large datasets.
result TCGPN achieves state-of-the-art results on real stock market data.
Study shows LLC correlates with neural network compressibility.
problem Evaluating limits of neural network compression.
method Extended minimum description length principle using singular learning theory.
result Complexity estimates based on LLC are linearly correlated with compressibility.
In this work, we contribute a new multi-layer neural network architecture named ONCF to perform collaborative filtering. The idea is to use an outer product to explicitly model the pairwise correlations between the dimensions of the embedding space. In contrast to existing neural recommender models that combine user em…
Study on MC dropout in wide neural networks and its convergence to Gaussian processes.
problem Understanding the behavior of Monte Carlo dropout in wide neural networks.
method Rigorously studied the limiting distribution of wide untrained NNs under dropout, proving convergence to Gaussian processes. Investigated correlations and non-Gaussian behavior in finite width NNs.
result Wide untrained neural networks under dropout converge to Gaussian processes for fixed sets of weights and biases.
New rationalization method avoids spurious correlations.
problem Spurious correlations in rationalization criteria.
method Invariant rationalization using game theory constraints.
result Rationales generalize better and align with human judgments.