Neural network uses local credit assignment to learn distant cause-effect relationships.
problem Learning distant cause-effect relationships in sequential data.
method Sparse coding in a recurrent neural network memory with local and immediate credit assignment.
result Network can predict partially-observable higher-order sequences and navigate mazes.
Causal inference concerns the identification of cause-effect relationships between variables. However, often only linear combinations of variables constitute meaningful causal variables. For example, recovering the signal of a cortical source from electroencephalography requires a well-tuned combination of signals reco…
New method identifies cause-effect relations in multivariate time series data.
problem Identifying cause-effect relations in multivariate time series data.
method Fictitious vector autoregressive model to identify long-run relations and causality strength.
result High accuracy in identifying true cause-effect relations in simulations and climate change analysis.
Discovering causal relations is fundamental to reasoning and intelligence. In particular, observational causal discovery algorithms estimate the cause-effect relation between two random entities X and Y, given n samples from P(X,Y). In this paper, we develop a framework to estimate the cause-effect relation bet…
DERWENT learns paths for distant transfer learning via deep random walk.
problem Transfer learning between distant domains is challenging.
method DERWENT uses deep random walk to explicitly learn paths between source and target domains.
result DERWENT achieves state-of-the-art performance on benchmark datasets.
Large receptive field CNNs improve distant speech recognition.
problem Degrading performance of ASR systems in noisy environments.
method Investigated large receptive field CNN variants including recursive, dilated, and hourglass networks.
result Stacked hourglass networks show significant improvements in distant speech recognition.
Exploiting the appropriate inductive bias based on the knowledge of data is essential for achieving good performance in statistical machine learning. In practice, however, the domain knowledge of interest often provides information on the relationship of data attributes only distantly, which hinders direct utilization …
Quaternion neural networks improve distant speech recognition.
problem Challenges in distant speech recognition due to noise and reverberation.
method Quaternion neural networks process multi-channel audio signals as quaternion entities, capturing internal and external dependencies.
result QLSTM outperforms real-valued LSTM on multi-channel distant speech recognition tasks.
New method improves cause-effect identification using neural networks.
problem Identifying cause and effect from observational data.
method Variational Bayesian learning of neural networks.
result Improves model fitness and codelengths succinctness.
Graph neural network explainer identifies causal subgraphs ensuring predictions.
problem Spurious correlations in GNN explainers.
method Proposes {
ame}, a GNN causal explainer via causal inference.
result Significantly outperforms existing GNN explainers in exact groundtruth explanation identification.
Paper calculates L-invariant and L*-invariant for complex surface sums.
problem Calculating invariants for complex surface sums.
method Using pants complexes and dual curve complexes.
result First example of arbitrary large invariants for bridge numbers.
NLP tasks are often limited by scarcity of manually annotated data. In social media sentiment analysis and related tasks, researchers have therefore used binarized emoticons and specific hashtags as forms of distant supervision. Our paper shows that by extending the distant supervision to a more diverse set of noisy la…
Framework identifies causal direction from single data setting.
problem Identify causal direction from single observational data.
method VCEI framework based on ICM principle and artificial variation.
result VCEI is competitive to other frameworks in identifying causal direction.
Cluster-DAGs improve causal discovery with prior knowledge.
problem Finding cause-effect relationships from high-dimensional data.
method Cluster-DAGs as prior knowledge framework, modified constraint-based algorithms Cluster-PC and Cluster-FCI.
result Cluster-PC and Cluster-FCI outperform baselines without prior knowledge.
We pose causal inference as the problem of learning to classify probability distributions. In particular, we assume access to a collection {(Si,li)}i=1n, where each Si is a sample drawn from the probability distribution of Xi×Yi, and li is a binary label indicating whether "Xi→Yi" or …
New theorem connects distant points and identical points on manifolds.
problem Continuous maps and distant points on manifolds.
method Qualitative extension of Hopf theorem, using topological 'distant' points.
result Existence of connected component containing both distant and identical points.
Focusing on a small set of proteins that i) fold in a concerted, all-or-none fashion and ii) do not contain knots or slipknots, we show that the Gauss linking integral, the torsion and the number of sequence-distant contacts provide information regarding the folding rate. Our results suggest that the global topology/ge…
New method uses kernel deviance measures to discover causal relationships in heterogeneous data.
problem Discovering causal relationships in complex, heterogeneous datasets.
method KIIM-HT, a novel score measure based on heterogeneous transformations of RKHS embeddings.
result KIIM-HT outperforms previous methods in causal discovery tasks.
Although nonstationary data are more common in the real world, most existing causal discovery methods do not take nonstationarity into consideration. In this letter, we propose a kernel embedding-based approach, ENCI, for nonstationary causal model inference where data are collected from multiple domains with varying d…
Quantum theory challenges traditional cause-effect relations, showing causal influences even without Bell inequality violations.
problem Challenging traditional concepts of cause-effect relations in quantum mechanics.
method Introducing a general framework to estimate causal influences without interventions or classical/quantum assumptions.
result Every pure bipartite entangled state violates classical bounds on causal influence, negating the idea that Bell inequalities are the only signature of incompatibility.
Study on noise models for noisy labels in NLP.
problem Quality of noise models from noisy labels.
method Theoretical analysis and synthetic dataset creation.
result Expected error of noise models derived.
Alternative to likelihood-based LSNM model selection, residual independence testing is more robust to noise misspecification.
problem Cause-effect inference in location-scale noise models with misspecified noise distributions.
method Residual independence testing as an alternative to likelihood-based model selection.
result Residual independence testing is more robust to noise misspecification.
A new MCMC method improves HMC for distant multi-modal sampling.
problem Sampling from multi-modal distributions, especially when modes are far apart.
method Improves Hamiltonian dynamics and uses variational distribution.
result The method can converge to target distributions effectively.
New analysis shows surprising results on adaptation speed of causal models.
problem Investigate the adaptation speed of causal models under interventions.
method Use convergence rates from stochastic optimization to measure adaptation speed.
result Surprising findings: anticausal model can be faster than causal model under certain conditions.
Causal inference concerns the identification of cause-effect relationships between variables, e.g. establishing whether a stimulus affects activity in a certain brain region. The observed variables themselves often do not constitute meaningful causal variables, however, and linear combinations need to be considered. In…
Paper proposes a novel model to improve n-ary cross-sentence relation extraction by addressing noisy data and non-consecutive sentences.
problem Noisy labeled data and non-consecutive sentences in n-ary cross-sentence relation extraction.
method Two-level agent reinforcement learning model and hybrid attention mechanism/PCNN approach.
result The model reduces the impact of noisy data and achieves better performance.
3D RadViz improves 3D data visualization of multidimensional datasets.
problem Tackles the challenge of visualizing multidimensional datasets in 3D.
method Develops RadViz3D, a 3D radial visualization tool with uniform anchor points.
result Improves the display of multidimensional datasets, especially for uncorrelated variables.
A new method improves graph node embeddings by considering both nearby and distant node similarities.
problem Improving graph node embeddings by considering both nearby and distant node similarities.
method Distance-aware Negative Sampling (DNS) which maximizes cohesion at nearby node-pairs and separation at distant node-pairs.
result DNS outperforms baseline methods in downstream node classification tasks on various datasets and GRL algorithms.
Causal inference improves heterophilic graph learning.
problem Capturing asymmetric node dependencies in graph learning.
method Intervention-based causal inference for graph structure learning.
result CausalMP achieves superior link prediction performance.
In this paper we derive variability measures for the conditional probability distributions of a pair of random variables, and we study its application in the inference of causal-effect relationships. We also study the combination of the proposed measures with standard statistical measures in the the framework of the Ch…
Spectral Independence Criterion helps infer cause-effect relationships in time series.
problem Distinguishing cause from effect in time series data.
method Spectral Independence Criterion (SIC) based on PSD and frequency response.
result SIC provides a robust method for causal inference in time series data.
We consider the problem of function estimation in the case where the data distribution may shift between training and test time, and additional information about it may be available at test time. This relates to popular scenarios such as covariate shift, concept drift, transfer learning and semi-supervised learning. Th…
We present Causal Generative Neural Networks (CGNNs) to learn functional causal models from observational data. CGNNs leverage conditional independencies and distributional asymmetries to discover bivariate and multivariate causal structures. CGNNs make no assumption regarding the lack of confounders, and learn a diffe…
Paper introduces new loss functions for Siamese networks using FDA.
problem Training Siamese networks with improved loss functions.
method Proposes Fisher Discriminant Triplet (FDT) and Fisher Discriminant Contrastive (FDC) loss functions based on FDA.
result Shows effectiveness of FDT and FDC on MNIST and histopathology datasets.
A new model improves relation extraction accuracy through relation-gated adversarial learning.
problem Relation extraction from sentences is challenging due to expensive human annotation and noisy distant supervision.
method Proposes relation-gated adversarial learning for relation extraction, extending domain adaptation methods.
result The model outperforms previous domain adaptation methods and improves accuracy of distance supervised relation extraction.
Main mathematical applications of Frobenius manifolds are in the theory of Gromov - Witten invariants, in singularity theory, in differential geometry of the orbit spaces of reflection groups and of their extensions, in the hamiltonian theory of integrable hierarchies. The theory of Frobenius manifolds establishes rema…
This article briefly introduced Arthur and Vassilvitshii's work on \textbf{k-means++} algorithm and further generalized the center initialization process. It is found that choosing the most distant sample point from the nearest center as new center can mostly have the same effect as the center initialization process in…
New method uses SEMs to uncover cause-effect in manufacturing processes.
problem Complex cause-and-effect relationships in manufacturing processes.
method Using Structural Equation Models with non-linear relationships.
result More informative cause-effect relationships derived from data.
Proposes a method to predict stock movements using fine-grained events from finance news.
problem Lack of specific semantic information in coarse-grained events for stock movement prediction.
method Built a finance event dictionary, extracted fine-grained events, combined with stock trade data, and used distant supervision for training.
result Method outperforms all baselines and shows good generalizability.
Traditional relation extraction predicts relations within some fixed and finite target schema. Machine learning approaches to this task require either manual annotation or, in the case of distant supervision, existing structured sources of the same schema. The need for existing datasets can be avoided by using a univer…
Proposes a method to improve graph embedding by removing least frequent nodes.
problem Capturing global graph structure in random walk-based embeddings.
method Extends random walk-based graph embedding by removing least frequent nodes.
result Improves predictive performance slightly, if at all.
Causal Mosaic distinguishes cause from effect using nonlinear ICA and ensemble methods.
problem Distinguishing cause from effect in bivariate settings.
method Nonlinear ICA and ensemble framework (Causal Mosaic).
result Causal Mosaic shows state-of-the-art performance on artificial and real-world datasets.
Survey on negative transfer in machine learning.
problem Negative transfer in transfer learning reduces target domain performance.
method Systematic review of 50+ approaches to mitigate negative transfer.
result Lack of systematic survey on negative transfer.
Novel unsupervised relation extraction framework using BERT.
problem Relation extraction without supervision.
method Syntactic parsing, pre-trained embeddings, distant supervision, fine-tuning BERT.
result Significantly outperforms baselines and matches state-of-the-art in three out of four data sets.
Scarcity of labeled data is one of the most frequent problems faced in machine learning. This is particularly true in relation extraction in text mining, where large corpora of texts exists in many application domains, while labeling of text data requires an expert to invest much time to read the documents. Overall, st…
MPNNs over-squash distant node information, study shows.
problem Over-squashing in MPNNs where node features ignore distant nodes.
method Theoretical analysis of MPNNs' over-squashing, focusing on width, depth, and graph topology.
result Width mitigates over-squashing but makes network more sensitive, depth doesn't help, graph topology is key.
Paper tackles DNN defects by analyzing data flow footprints.
problem Detecting defects in DNN models due to low precision.
method Developed DeepMorph to analyze data flow footprints for root cause identification.
result DeepMorph can guide DNN developers to improve model quality.
Paper proposes a reinforcement learning framework for distant supervision of question parsing.
problem Lack of gold annotations for parsing in QA datasets.
method Reinforcement learning framework based on formal queries to learn mentions of entities and relations.
result Significant improvement in entity and relation linking compared to state of the art.