Motivated by an abstract notion of low-level edge detector filters, we propose a simple method of unsupervised feature construction based on pairwise statistics of features. In the first step, we construct neighborhoods of features by regrouping features that correlate. Then we use these subsets as filters to produce n…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “correlation neighborhoods”
New algorithm learns Markov network structures efficiently.
problem Learning Markov network structures without chordality assumptions.
method Local penalized likelihood ratio tests and two-stage hill-climbing algorithm.
result PLRHC-BIC algorithm compares favorably against state-of-the-art methods.
Neighborhood regression has been a successful approach in graphical and structural equation modeling, with applications to learning undirected and directed graphical models. We extend these ideas by defining and studying an algebraic structure called the neighborhood lattice based on a generalized notion of neighborhoo…
Finding relationships between multiple views of data is essential both for exploratory analysis and as pre-processing for predictive tasks. A prominent approach is to apply variants of Canonical Correlation Analysis (CCA), a classical method seeking correlated components between views. The basic CCA is restricted to ma…
Research examines correlations of complex logarithms of lattice points, showing level repulsion and Poissonian behavior.
problem Analyzing correlations of complex logarithms of lattice points.
method Proving existence of pair correlation functions and examining behavior at various scalings.
result Level repulsion observed at linear scaling, Poissonian behavior at sublinear scalings.
The study examines correlations of logarithms of integers at different scalings.
problem Analyzing pair correlations of logarithms of integers at various scalings.
method Examined correlations of logarithms of positive integers at different scalings, proving the existence of pair correlation functions.
result Level repulsion at linear scaling, total loss of mass at superlinear scalings, and Poissonian behavior at sublinear scalings.
PushNet efficiently and adaptively pushes messages in neural networks, improving performance.
problem Inefficient and inflexible synchronous message passing in neural networks.
method Asynchronous message passing with adaptive receptive fields and multiple scale correlations.
result PushNet outperforms competitors in semi-supervised node classification on multiple datasets.
Graph neural networks often assume vertex labels are independent, but we show this is rarely true and propose a method to improve predictions.
problem Graph neural networks often assume vertex labels are conditionally independent given their neighborhood features, which is rarely true.
method We model the joint distribution of residuals on vertices with a parameterized multivariate Gaussian and estimate parameters by maximizing the marginal likelihood of the observed labels.
result Our method achieves substantially higher accuracy than competing baselines and can be interpreted as the strength of correlation among connected vertices.
Directional Convergence Near Small Initializations and Saddles in Two-Homogeneous Neural Networkscs.LG
The paper studies neural networks' convergence near origin and saddle points.
problem Directional convergence of neural networks near small initializations and saddle points.
method Gradient flow dynamics analysis of two-homogeneous neural networks.
result Neural networks' weights approximately converge in direction to KKT points for small initializations.
Proposes a measure to predict generalization in non-matching environments.
problem Characterizing and comparing generalization of machine learning models in non-matching environments.
method Neighborhood invariance measure, calculating invariance as the largest fraction of transformed points classified into the same class.
result Strong and robust correlation between neighborhood invariance and actual out-of-domain generalization.
GCNs learn by embedding similar nodes within a class and leveraging consistent neighborhood structures.
problem Understanding how GCNs perform semi-supervised node classification on both homophilous and heterophilous graphs.
method Investigated the latent node embeddings and neighborhood structures of GCNs.
result GCNs learn by embedding similar nodes within a class and leveraging consistent neighborhood structures.
A novel feature representation method for non-image based features.
problem Inability of Convolutional Neural Networks for non-image based features or features without spatial correlations.
method REFINED: Representation of Features as Images with Neighborhood Dependencies.
result Higher prediction accuracy compared to existing methodologies.
Efficient algorithm for matching graphs with community structure.
problem Graph matching between correlated stochastic block models with constant correlation.
method Partition trees rooted from each vertex, comparing edge statistics to different communities.
result First low-order polynomial-time algorithm achieving exact matching with high probability in dense graphs.
Derives adjoint formulas for matrix operations and applies them to specific cases.
problem Computing adjoints for matrix operations and specific matrix types.
method Derives adjoint formulas for matrix operations and applies them to specific cases.
result Closed-form expressions for adjoints in specific matrix types.
Neighbor Mixture Model captures node correlations in graphs.
problem Modeling correlations between node labels in graphs.
method Neighbor Mixture Model (NMM) designed for efficient computation and scalability.
result NMM outperforms state-of-the-art models in various graph tasks.
Machine learning electron correlation in a disordered mediumcond-mat.str-el
Learning from data has led to a paradigm shift in computational materials science. In particular, it has been shown that neural networks can learn the potential energy surface and interatomic forces through examples, thus bypassing the computationally expensive density functional theory calculations. Combining many-bod…
We derive an efficient method to perform clustering of nodes in Gaussian graphical models directly from sample data. Nodes are clustered based on the similarity of their network neighborhoods, with edge weights defined by partial correlations. In the limited-data scenario, where the covariance matrix would be rank-defi…
Given a similarity graph between items, correlation clustering (CC) groups similar items together and dissimilar ones apart. One of the most popular CC algorithms is KwikCluster: an algorithm that serially clusters neighborhoods of vertices, and obtains a 3-approximation ratio. Unfortunately, KwikCluster in practice re…
Paper tackles graph matching with partially correct seeds, improving performance guarantees.
problem Graph matching with partially correct seeds.
method Proposes algorithms for matching vertices based on 1-hop and 2-hop neighborhoods, analyzing their performance guarantees.
result New 2-hop algorithm requires fewer correct seeds than the 1-hop algorithm, especially for sparse graphs.
We derive spectral sequences for the intersection homology of stratified fibrations and approximate tubular neighborhoods in manifold stratified spaces. These neighborhoods include regular neighborhoods in PL stratified spaces.
Meta-Neighborhoodscs.LG
Making an adaptive prediction based on one's input is an important ability for general artificial intelligence. In this work, we step forward in this direction and propose a semi-parametric method, Meta-Neighborhoods, where predictions are made adaptively to the neighborhood of the input. We show that Meta-Neighborhood…
Data-driven neighborhood definitions and graph constructions are often used in machine learning and signal processing applications. k-nearest neighbor~(kNN) and -neighborhood methods are among the most common methods used for neighborhood selection, due to their computational simplicity. However, the choice of param…
HKConv learns hyperbolic features by aggregating kernel points.
problem Challenges in learning good hyperbolic representations using Euclidean operations.
method Proposes HKConv, a trainable hyperbolic convolution that correlates local features with kernel points and aggregates them.
result HKConv learns expressive local features according to hyperbolic geometry and enjoys equivariance to permutation and invariance to parallel transport.
Improved anti-cancer drug sensitivity prediction using REFINED CNN ensemble learning.
problem Challenges in predicting anti-cancer drug sensitivity for individual cell lines.
method Using REFINED CNN, which represents high-dimensional vectors as compact 2D images with spatial correlations, and building ensembles of these models.
result Ensemble approaches significantly improve drug sensitivity prediction performance compared to single models.
Study geodesics entering a fixed cusp neighborhood multiple times.
problem Understanding geodesics entering a specific cusp neighborhood multiple times.
method Investigate reciprocal geodesics entering a fixed cusp neighborhood a fixed number of times.
result Characterized the class of reciprocal geodesics entering a fixed cusp neighborhood a fixed number of times.
Urban2Vec: Incorporating Street View Imagery and POIs for Multi-Modal Urban Neighborhood Embeddingcs.LG
Urban2Vec combines street view imagery and POIs for better urban neighborhood embeddings.
problem Lack of comprehensive representation of urban neighborhoods using heterogeneous data.
method Unsupervised multi-modal framework using CNN for visual features and bag-of-words for POI data.
result Urban2Vec achieves better performance than baseline models and comparable to fully-supervised methods.
Inference for GP models with non-Gaussian noises is computationally expensive when dealing with large datasets. Many recent inference methods approximate the posterior distribution with a simpler distribution defined on a small number of inducing points. The inference is accurate only when data points have strong corre…
Skeleta and other pure subsets of manifold stratified spaces are shown to have neighborhoods which are teardrops of stratified approximate fibrations (under dimension and compactness assumptions). In general, the stratified approximate fibrations cannot be replaced by bundles, and the teardrops cannot be replaced by ma…
On the neighborhood of knotsmath.GT
New framework distinguishes knots via neighborhood invariants.
problem Distinguishing knots and knotoids.
method Study of knotoid spectra and neighborhood invariants.
result Neighborhood invariants can distinguish knots of higher Gordian distance.
This paper tackles selection bias in recommender systems by considering the neighborhood effect.
problem Selection bias in recommender systems due to filtering and user selection.
method Formalizes neighborhood effect as interference problem, introduces treatment representation, and proposes ideal loss.
result Proposed methods achieve unbiased learning when both selection bias and neighborhood effect are present.
Maximally hyperbolic solutions contain future neighborhoods of intersecting hypersurfaces.
problem Maximally globally hyperbolic solutions of higher-dimensional vacuum Einstein equations.
method Analyzing intersections of characteristic hypersurfaces.
result Contains a future neighborhood of intersecting hypersurfaces.
Many prediction problems can be phrased as inferences over local neighborhoods of graphs. The graph represents the interaction between entities, and the neighborhood of each entity contains information that allows the inferences or predictions. We present an approach for applying machine learning directly to such graph…
Understanding how housing values evolve over time is important to policy makers, consumers and real estate professionals. Existing methods for constructing housing indices are computed at a coarse spatial granularity, such as metropolitan regions, which can mask or distort price dynamics apparent in local markets, such…
Proposes a new NMF method incorporating neighborhood structure for better anomaly detection.
problem NMF's inability to incorporate neighborhood structure information limits its performance in nonlinear manifold structures.
method Integrates neighborhood structure information using Minimum Spanning Tree (MST) within NMF framework.
result Empirical results show superior performance in anomaly detection using the proposed method.
Study on transverse knots and their neighborhoods, proving unique standard neighborhoods and destabilization results.
problem Understanding the structure and properties of transverse knots and their neighborhoods.
method Proves unique standard neighborhoods and structure theorems for non-loose Legendrian knots through destabilization results.
result Finds a manifold with infinite tight contact structures, up to contactomorphism, without Giroux torsion.
Revises GNN neighborhood aggregation for more accurate node classification.
problem Flaws in benchmark GNN models for node classification.
method Statistical signal processing approach to neighborhood aggregation.
result Novel insights for designing more efficient GNN models.
The study proves a neighborhood theorem for mean curvature flow in higher dimensions.
problem Proving a canonical neighborhood theorem for mean curvature flow in higher dimensions.
method Proved a canonical neighborhood theorem for mean curvature flow of compact submanifolds in with a pinching condition.
result Proved a canonical neighborhood theorem for mean curvature flow in dimensions .
A neighborhood homotopy is an equivalence relation on spatial graphs which is generated by crossing changes on the same component and neighborhood equivalence. We give a complete classification of all 2-component spatial graphs up to neighborhood homotopy by the elementary divisor of a linking matrix with respect to th…
GraphAIR improves graph representation learning by capturing non-linear interactions.
problem Challenges in capturing non-linear interactions in graph data.
method Integrates neighborhood aggregation and interaction modeling.
result Demonstrates improved performance on node classification and link prediction tasks.
Neighborhood sampling affects graph neural network training outcomes.
problem Understanding the impact of neighborhood sampling on graph neural network training.
method Theoretical analysis using neural tangent kernels and Gaussian processes.
result Posterior covariance differs for different neighborhood sampling approaches, indicating no dominant approach.
In this paper, we consider recommender systems with side information in the form of graphs. Existing collaborative filtering algorithms mainly utilize only immediate neighborhood information and have a hard time taking advantage of deeper neighborhoods beyond 1-2 hops. The main caveat of exploiting deeper graph informa…
An efficient algorithm for aligning diffusion trees to networks with information asymmetry.
problem Aligning diffusion trees to networks with information asymmetry.
method Tree correlation tests for extracting alignment information.
result Explicit lower bounds on the probability of correct matches for each vertex on the diffusion tree.
Learning graph-structured data with graph neural networks (GNNs) has been recently emerging as an important field because of its wide applicability in bioinformatics, chemoinformatics, social network analysis and data mining. Recent GNN algorithms are based on neural message passing, which enables GNNs to integrate loc…
This paper explores tradeoffs between standard and adversarial risks in distributionally adversarial training.
problem Understanding the impact of adversarial training on standard risk and adversarial risk.
method Study of distributionally adversarial training with different learning settings and models.
result Derives Pareto-optimal tradeoff curves between standard and adversarial risks.
We present novel graph kernels for graphs with node and edge labels that have ordered neighborhoods, i.e. when neighbor nodes follow an order. Graphs with ordered neighborhoods are a natural data representation for evolving graphs where edges are created over time, which induces an order. Combining convolutional subgra…
We present a new construction of tubular neighborhoods in (possibly infinite dimensional) Riemannian manifolds M, which allows us to show that if G is an arbitrary group acting isometrically on M, then every G-invariant submanifold with locally trivial normal bundle has a G-invariant total tubular neighborhood. We appl…
Deep structured models are widely used for tasks like semantic segmentation, where explicit correlations between variables provide important prior information which generally helps to reduce the data needs of deep nets. However, current deep structured models are restricted by oftentimes very local neighborhood structu…
This article is one of three highly influential articles on the topology of manifolds written by Robert D. Edwards in the 1970's but never published. Organizers of the Workshops in Geometric Topology (http://www.uwm.edu/~craigg/workshopgtt.htm) with the support of the National Science Foundation have facilitated the pr…