New methods predict links in hypergraphs with multiple entities.
problem Link prediction in knowledge hypergraphs with non-binary relations.
method Introduce HSimplE and HypE embedding-based methods for hypergraphs.
result Proposed methods outperform baselines in hypergraph prediction.
The paper discusses building ETF risk models using a multilevel classification taxonomy.
problem Building accurate risk models for ETFs.
method First, build a multilevel classification taxonomy for ETFs. Then, use this taxonomy to define risk factors and build risk models.
result The approach can accurately classify and model ETF risks.
The term "CoRE kernel" stands for correlation-resemblance kernel. In many applications (e.g., vision), the data are often high-dimensional, sparse, and non-binary. We propose two types of (nonlinear) CoRE kernels for non-binary sparse data and demonstrate the effectiveness of the new kernels through a classification ex…
The notion of causality is used in many situations dealing with uncertainty. We consider the problem whether causality can be identified given data set generated by discrete random variables rather than continuous ones. In particular, for non-binary data, thus far it was only known that causality can be identified exce…
This work describes simple and efficient algorithms for interactively learning non-binary concepts in the learning from random counter-examples (LRC) model. Here, learning takes place from random counter-examples that the learner receives in response to their proper equivalence queries. In this context, the learning ti…
Adversarial attacks against neural networks are a problem of considerable importance, for which effective defenses are not yet readily available. We make progress toward this problem by showing that non-negative weight constraints can be used to improve resistance in specific scenarios. In particular, we show that they…
TRP uses tree-based approach for market-neutral portfolios.
problem Creating non-binary, market-neutral portfolios with signed signals.
method Tree-based portfolio construction with minimum-spanning-tree and sector-anchored variants.
result TRP outperforms HRP in preserving signal direction and managing exposures.
Many applications require recovering a ground truth low-rank matrix from noisy observations of the entries, which in practice is typically formulated as a weighted low-rank approximation problem and solved by non-convex optimization heuristics such as alternating minimization. In this paper, we provide provable recover…
We give a simple explicit algorithm for building multi-factor risk models. It dramatically reduces the number of or altogether eliminates the risk factors for which the factor covariance matrix needs to be computed. This is achieved via a nested "Russian-doll" embedding: the factor covariance matrix itself is modeled v…
Framework for fair classification with noisy protected attributes and provable guarantees.
problem Fair classification with noisy protected attributes.
method Optimization framework for linear and linear-fractional fairness constraints, handling multiple non-binary attributes.
result Provably fair classifier with minimal accuracy loss, even with large noise.
MASC balances dataset representation using affinity clustering and distribution discrepancies.
problem Representation bias in datasets due to group imbalance.
method MASC uses affinity clustering and pairwise distribution discrepancies to balance non-protected and protected groups.
result MASC effectively debiases target datasets, comparable to existing methods.
We have developed a strategy for the analysis of newly available binary data to improve outcome predictions based on existing data (binary or non-binary). Our strategy involves two modeling approaches for the newly available data, one combining binary covariate selection via LASSO with logistic regression and one based…
We consider support recovery in the quadratic logistic regression setting - where the target depends on both p linear terms xi and up to p2 quadratic terms xixj. Quadratic terms enable prediction/modeling of higher-order effects between features and the target, but when incorporated naively may involve solvi…
New framework for fair classification in adversarial settings with provable guarantees.
problem Fairness in classification with adversarial perturbations of protected attributes.
method Optimization framework for learning fair classifiers with provable guarantees.
result Near-tightness of accuracy and fairness guarantees for multiple protected attributes and various hypothesis classes.
EBMs trained on discrete data using heat equations on graph structures.
problem Training EBMs on discrete or mixed data.
method Heat equations on graph structures for data perturbation.
result Efficacy demonstrated in various applications.
Designs new functionals for ranking joint probability distributions based on correlations.
problem Ranking joint probability distributions based on their correlations.
method Using first principles from inference, a set of functionals are designed with the Principle of Constant Correlations (PCC) guiding the construction.
result The n-partite information (NPI) uniquely determines whether inferential transformations preserve, destroy, or create correlations. Paper introduces xAUC metric to assess fairness of risk scores in bipartite ranking tasks.
problem Disparate impact of risk scores in non-binary, downstream uses.
method Investigates fairness in bipartite ranking tasks, introduces xAUC metric.
result xAUC metric reveals disparities not seen in binary classification performance.
The true online TD(λ) algorithm has recently been proposed (van Seijen and Sutton, 2014) as a universal replacement for the popular TD(λ) algorithm, in temporal-difference learning and reinforcement learning. True online TD(λ) has better theoretical properties than conventional TD(λ), and the expectation is that it als…
Paper addresses limitations of traditional hierarchical clustering methods.
problem Traditional hierarchical clustering methods face limitations in binary trees and ultrametrics.
method Introduces the notion of a valid hierarchy and a two-step algorithm to construct a binary tree and prune it to enforce validity.
result Proposes a method to recover the finest valid hierarchy, which is not constrained to binary structures.
Random Planted Forest interprets tree-based models by keeping some splits, leading to more interpretable predictions.
problem Estimating the unknown regression function from lower-order interaction terms.
method Modifying the random forest algorithm by keeping certain leaves instead of deleting them, resulting in non-binary trees called planted trees.
result The random planted forest achieves asymptotically optimal convergence rates up to a logarithmic factor when the interaction bound is low.
The min-max kernel is a generalization of the popular resemblance kernel (which is designed for binary data). In this paper, we demonstrate, through an extensive classification study using kernel machines, that the min-max kernel often provides an effective measure of similarity for nonnegative data. As the min-max ker…
Develops a fast BMF approach for binary matrices.
problem Finding patterns in binary matrices for various applications.
method MEBF (Median Expansion for Boolean Factorization) using geometric segmentation and heuristic submatrix identification.
result Superior performance in reconstruction error and computational efficiency compared to existing methods.
Bayesian framework improves LLM evaluation stability and transparency.
problem Pass@k and avg@N are unstable and misleading for LLMs.
method Bayesian evaluation with posterior estimates and credible intervals.
result Posterior-based evaluation yields stable and transparent rankings.
A popular methodology for building binary decision-making classifiers in the presence of imperfect information is to first construct a non-binary "scoring" classifier that is calibrated over all protected groups, and then to post-process this score to obtain a binary decision. We study the feasibility of achieving vari…
Fair Adversarial Networks remove bias from data.
problem Bias in datasets leads to biased outcomes, making analysis illegal and sub-optimal.
method Remove bias from data by altering all proxy variables, ensuring fairness without changing analytical pipelines.
result Fair Adversarial Networks effectively remove bias from data.
A new DP algorithm improves privacy in hashing and sampling for search and learning.
problem Improving privacy in hashing and sampling for large-scale applications.
method Combines differential privacy with one permutation hashing and bin-wise consistent weighted sampling.
result Proposes DP-OPH and DP-BCWS algorithms that enhance privacy while maintaining utility.
Defines relations between Dirac structures and spinors using Courant algebroid relations.
problem Defines relations between Dirac structures and spinors using Courant algebroid relations.
method Uses Courant algebroid relations to define relations between Dirac structures and spinors.
result Proves existence results for T-dual structures and demonstrates compatibility with Type II supergravity equations.
A new model improves relation extraction accuracy through relation-gated adversarial learning.
problem Relation extraction from sentences is challenging due to expensive human annotation and noisy distant supervision.
method Proposes relation-gated adversarial learning for relation extraction, extending domain adaptation methods.
result The model outperforms previous domain adaptation methods and improves accuracy of distance supervised relation extraction.
Method discovers nonlinear relations from time series data.
problem Identifying directional relations from nonlinear interactions in time series.
method Minimum predictive information regularization method for deep learning.
result Substantially outperforms other methods for learning nonlinear relations.
Paper uses knowledge bases to discover new relations from text.
problem Discover new relations from text without annotated data.
method Construct constraints based on knowledge base embeddings and incorporate into variational auto-encoder for relation discovery.
result Improves relation discovery performance significantly.
Abstractor enhances Transformers for relational reasoning, improving sample efficiency and performance.
problem Improving sample efficiency and performance in relational tasks.
method Introduces Abstractor module with relational cross-attention to enable explicit relational reasoning.
result Dramatic improvements in sample efficiency and performance on various relational tasks.
New method improves graph neural networks by considering different types of relations in sampling.
problem Current graph neural networks ignore relation types in biomedical graphs, leading to suboptimal performance.
method Proposes relation-dependent sampling for multi-relational graphs to balance relation frequency and importance.
result State-of-the-art graph neural networks achieve better accuracy and efficiency with relation-dependent sampling.
Temporal networks are ubiquitous and evolve over time by the addition, deletion, and changing of links, nodes, and attributes. Although many relational datasets contain temporal information, the majority of existing techniques in relational learning focus on static snapshots and ignore the temporal dynamics. We propose…
Bayesian meta-learning on relation graphs improves few-shot relation extraction.
problem Predicting relations in sentences with limited labeled examples.
method Bayesian meta-learning on a global relation graph, using graph neural networks and Langevin dynamics.
result Framework effectively learns and generalizes to new relations.
Study improves CI tests for relational data to robustly discover causal structures.
problem Learning causal relationships from relational data.
method Conduct CI tests against relational data to robustly recover causal structure.
result Effective approach demonstrated through experiments.
Proves one-relator groups with negative immersions are hyperbolic and virtually special.
problem One-relator groups with negative immersions.
method Refinement of Magnus--Moldavanskii hierarchy and introduction of Z-stable HNN-extensions and hierarchies.
result One-relator groups with negative immersions are hyperbolic and virtually special, resolving a conjecture.
HIRM models noisy, sparse, heterogeneous relational data using hierarchical clustering and Dirichlet processes.
problem Modeling noisy, sparse, and heterogeneous relational data.
method Hierarchical Chinese restaurant process and Dirichlet process mixture for clustering and modeling relation values.
result HIRM generalizes standard models and discovers relational structure in real-world datasets.
Paper uses AC-GAN to generate high-quality relational sentences for relation extraction.
problem Limited training data for relation extraction models.
method Auxiliary Classifier Generative Adversarial Networks (AC-GANs).
result Significantly improved performance of relation extraction.
R-SQAIR adds relational bias to sequential object attention models for better object interactions.
problem Traditional sequential multi-object attention models struggle with relational inferences.
method Proposes R-SQAIR, a relational extension of SQAIR with a parallel pairwise interaction module.
result Demonstrates gains in object relations and combinatorial generalization over sequential mechanisms.
Introduces Relational Privacy (RP) to control relation memorization in question answering models.
problem Relation memorization in question answering models can lead to privacy issues.
method Formalizes Relational Privacy (RP) and Differential Relational Privacy (DrP), providing bounds on relation memorization.
result DrP allows effective learning of general properties of underlying concepts while preventing relation memorization.
Proposes a new method for predicting missing relations in knowledge graphs.
problem Predicting missing relations between entities in knowledge graphs.
method Relational message passing method considering only edge features without entity IDs.
result PathCon method outperforms state-of-the-art methods significantly.
Enhances social spam detection using multi-level dependency of relational sequences.
problem Social spam detection in multi-relation social networks.
method Developed the Multi-level Dependency Model (MDM) to exploit long-term and short-term dependencies in user relational sequences.
result MDM improves social spam detection accuracy on a real-world multi-relational social network.
The paper explores the pentagon relation and its algebraic forms.
problem Exploring the pentagon relation and its various forms.
method Starting with geometric form, then algebraic form as a family of equations, deriving equivalent forms using 6j-symbols, and extracting solutions from modular categories.
result Extracting a solution of the pentagon relation from any modular category.
In this article, we extend the conventional framework of convolutional-Restricted-Boltzmann-Machine to learn highly abstract features among abitrary number of time related input maps by constructing a layer of multiplicative units, which capture the relations among inputs. In many cases, more than two maps are strongly…
This paper proposes an attention module augmented relational network called SARN(Sequential Attention Relational Network) that can carry out relational reasoning by extracting reference objects and making efficient pairing between objects. SARN greatly reduces the computational and memory requirements of the relational…
New model improves graph attention for relational data.
problem Improving graph attention models for relational data.
method Relational Graph Attention Networks (R-GAT) extending non-relational graph attention to relational data.
result R-GAT performs worse than expected, but some configurations marginally improve molecular property modeling.
Extends coherence results to one-relator products of locally indicable groups.
problem Coherence in one-relator products of locally indicable groups.
method Developed new methods to extend results of Helfer, Wise, Louder, Wilton, and Brodsky.
result New proof of a theorem by Brodsky.
Existing relation classification methods that rely on distant supervision assume that a bag of sentences mentioning an entity pair are all describing a relation for the entity pair. Such methods, performing classification at the bag level, cannot identify the mapping between a relation and a sentence, and largely suffe…