Finding relevant information from large document collections such as the World Wide Web is a common task in our daily lives. Estimation of a user's interest or search intention is necessary to recommend and retrieve relevant information from these collections. We introduce a brain-information interface used for recomme…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
48 results for “Relevance Information”
PRI-VAE learns disentangled representations by optimizing principle-of-relevant-information.
problem Learning disentangled representations under VAE framework remains unknown.
method Proposes PRI-VAE, a novel learning objective to optimize disentanglement.
result Demonstrates effectiveness of PRI-VAE on four benchmark datasets.
Extracts credit-relevant information from earnings calls.
problem Investors do not fully internalize credit-relevant information from earnings calls.
method Develops a novel technique to extract credit-relevant information from earnings call text.
result The extracted information forecasts future credit spread changes and firm profitability.
SURI boosts features with high unique relevant information for better health data analysis.
problem Preserving interpretability in health data analysis.
method Mutual information-based feature selection (MIBFS) method called SURI.
result SURI selects more relevant features leading to higher classification performance.
The paper tackles feature selection for ordinal regression, considering feature redundancies and privileged information.
problem Discovering relevant factors in ranked data with potentially redundant features and privileged information.
method Develops feature relevance bounds for linear ordinal regression, considering feature redundancies and privileged information.
result Identifies all strongly and weakly relevant features and their type of relevance.
In many applications, it is desirable to extract only the relevant aspects of data. A principled way to do this is the information bottleneck (IB) method, where one seeks a code that maximizes information about a 'relevance' variable, Y, while constraining the information encoded about the original data, X. Unfortunate…
Proposes a new hyperprior and predictive criterion for weakly informative hyperprior in relevance vector machine.
problem Capturing non-homogeneous data structure with limited kernel functions.
method Uses inverse gamma hyperprior with a shape parameter close to zero and a scale parameter not close to zero. Applies multiple kernel method with different widths. Proposes extended predictive information criterion for scale parameter selection.
result Obtains a multiple kernel relevance vector regression model with good predictive accuracy.
RID framework quantifies and regularizes task-relevant knowledge in distillation.
problem Distilling irrelevant information can hinder student model performance.
method Partial Information Decomposition to quantify and regularize task-relevant knowledge.
result RID framework leads to more resilient distillation under nuisance teachers.
ELICA helps analysts understand unfamiliar domains by extracting relevant terms.
problem Communication barriers between analysts and stakeholders in unfamiliar domains.
method ELICA uses WFSTs to dynamically extract and label requirements-relevant knowledge from text and non-linguistic cues.
result ELICA supports analysts in understanding and eliciting requirements from unfamiliar domains.
Paper aims to improve relevance of e-commerce search results.
problem Improving relevance of online product search results.
method Combines machine learning, NLP, and IR techniques to predict relevance scores.
result Deep learning models outperform conventional IR models in relevance prediction.
Information bottleneck theory of high-dimensional regression: relevancy, efficiency and optimalitycs.IT
New approach quantifies overfitting in high-dimensional regression.
problem Quantifying and avoiding overfitting in large neural networks.
method Information bottleneck theory to minimize residual information while maximizing relevant bits.
result Characterized the relative information efficiency of randomized regression compared to optimal algorithms.
The muti-layer information bottleneck (IB) problem, where information is propagated (or successively refined) from layer to layer, is considered. Based on information forwarded by the preceding layer, each stage of the network is required to preserve a certain level of relevance with regards to a specific hidden variab…
System detects relevant financial news and predictions from unstructured text.
problem Manual extraction of relevant financial information from news is cumbersome and error-prone.
method Topic modeling with LDA, co-reference resolution, multi-paragraph segmentation, and temporal analysis.
result ROUGE-L values for relevant text and predictions/forecasts were 0.662 and 0.982, respectively.
Sparse GEMINI selects relevant features for clustering without assumptions.
problem Feature selection in clustering with relevant clusters and variables.
method Discriminative clustering model maximizing GEMINI with l1 penalty.
result Sparse GEMINI selects relevant subsets of variables without prior hypotheses.
The relevance of data quantifies learning efficiency.
problem Understanding the statistical nature of high-dimensional, sparse data.
method Defining relevance as information content, and using it to define ideal limits of samples and learning machines.
result Maximally informative samples and optimal learning machines exhibit critical features like power-law frequency distributions and anomalously large susceptibility.
Recommender systems, medical diagnosis, network security, etc., require on-going learning and decision-making in real time. These -- and many others -- represent perfect examples of the opportunities and difficulties presented by Big Data: the available information often arrives from a variety of sources and has divers…
MPRI learns multiscale features for HSI classification.
problem Hyperspectral image classification with limited training samples.
method MPRI combines PRI and regularized LDA for iterative feature learning.
result MPRI outperforms state-of-the-art methods in HSI classification.
This paper improves image retrieval accuracy through novel relevance feedback methods.
problem Improving image retrieval accuracy in Content-Based Image Retrieval (CBIR).
method Novel addition to feature re-weighting and classification techniques, focusing on 0-th iteration improvement.
result Significantly improved retrieval accuracy from relevance feedback.
InfoPrompt improves soft prompt tuning by maximizing mutual information, leading to better performance.
problem High sensitivity of prompt tuning to initial conditions and insufficient task-relevant information.
method Develops an information-theoretic framework to maximize mutual information between prompts and model parameters, using novel loss functions.
result InfoPrompt accelerates convergence and outperforms traditional methods.
Choppy optimizes ranked list truncation using Transformer architecture.
problem Optimal truncation of ranked search results to balance relevance and user cost.
method Assumption-free Transformer model optimizing user-defined IR metrics.
result Choppy improves upon recent state-of-the-art methods.
In many cases, feature selection is often more complicated than identifying a single subset of input variables that would together explain the output. There may be interactions that depend on contextual information, i.e., variables that reveal to be relevant only in some specific circumstances. In this setting, the con…
TCMI assesses mutual dependence of continuous variables without parametric assumptions.
problem Estimating mutual information from continuous distributions.
method TCMI extends mutual information to continuous variables using cumulative distributions.
result TCMI facilitates feature selection and ranking of variable sets.
TRAIL improves robot imitation learning by focusing on task-relevant features.
problem Discriminator networks learn spurious associations, providing poor reward signals.
method Constrained discriminator optimization to learn task-relevant rewards.
result TRAIL outperforms GAIL and behaviour cloning in robotic manipulation tasks.
A new method exposes motion-related relevance in video frames.
problem Deconstructing relevance in spatio-temporal models for video processing.
method Proposes a discriminative method to separate spatial and temporal relevance.
result Demonstrates effectiveness on UCF-101 action recognition dataset.
Generative AI reduces IR evaluation costs but introduces errors; this work provides reliable CIs.
problem Generating relevance annotations using AI introduces errors that affect IR evaluation metrics.
method Proposes two methods: prediction-powered inference and conformal risk control to place reliable CIs around IR metrics.
result Proposed methods accurately capture both variance and bias in evaluation based on AI-generated annotations.
A method to learn distributed representations from multiple sources of information.
problem Learning representations from multiple, separate sources of information.
method Generalization of Tishby's IB method to the distributed setting, using variational bounds and iterative algorithms.
result Explicit characterizations of optimal tradeoffs between complexity and relevance for discrete and Gaussian models.
Model improves email-based conversational agents' ability to extract relevant information.
problem Asynchronous email communication makes it hard for agents to detect intents and extract relevant entities.
method Neural model for scoping relevant information from large queries.
result Improves performance of intent detection and entity extraction tasks by 35% in precision.
Estimates latent dimensionality for prediction tasks using mutual information.
problem Estimating the latent dimensionality needed for accurate prediction.
method Formulates the problem as an Information Bottleneck question and uses neural mutual information estimators with a hybrid critic to preserve latent geometry.
result The hybrid critic method provides a more accurate estimation of task-relevant dimensionality.
Adequate evaluation of an information retrieval system to estimate future performance is a crucial task. Area under the ROC curve (AUC) is widely used to evaluate the generalization of a retrieval system. However, the objective function optimized in many retrieval systems is the error rate and not the AUC value. This p…
New meta-RL method avoids exploration-exploitation trade-off.
problem Learning to explore and exploit simultaneously in meta-RL.
method Developed new objectives for exploration and exploitation.
result DREAM outperforms existing methods on complex tasks.
The paper explains deep learning models for recommendations using layer-wise relevance propagation.
problem Explainable recommendations in deep learning models.
method Layer-wise relevance propagation applied to a Deep Convolutional Neural Network.
result Demonstrates the effectiveness of the method on an Amazon products dataset.
Neural network framework for language recognition considers sequence information and improves accuracy.
problem Challenging task of automatic language identification in noisy conditions.
method Proposes a neural network framework with bidirectional LSTM and attention modeling for relevance weighting.
result Significant improvements over conventional methods in noisy conditions and multi-speaker speech.
New causal measures improve feature selection in AI models.
problem Lack of causal interpretability in AI models.
method Introduces causal entropy and causal information gain to assess feature control.
result Demonstrates superiority of causal information gain in feature selection.
Deep neural networks detect cyberthreats from Twitter.
problem Scalable processing of cybersecurity information from social media.
method Convolutional and bidirectional LSTM networks for tweet classification and named entity recognition.
result Pipeline achieves high true positive and F1-score rates for threat detection.
New method uses information bottleneck to estimate causal effects from missing data.
problem Estimating causal effects from high-dimensional observational data with missing covariates.
method Uses information bottleneck to compress covariates and transfer relevant information.
result Achieves state-of-the-art performance in causal inference benchmarks and real applications.
A new feature selection method using structural correlation between samples.
problem Feature selection in high-dimensional data overlooks structural correlation information.
method Converts features into graph representations, uses fused lasso for feature selection.
result Demonstrates effectiveness of the proposed approach through experiments.
Study examines value relevance of oil and gas reserve disclosures in London Stock Exchange.
problem Uncertainty in oil and gas reserves poses accounting challenges for investors.
method Empirical analysis using archival data and multifactor framework.
result Changes in reserves and their components are associated with share returns, but insignificantly due to oil price and longitudinal effects. Quality of disclosures positively impacts share returns.
Mutual Information-driven Subject-invariant and Class-relevant Deep Representation Learning in BCIcs.LG
Proposes a new framework for EEG-based BCIs without adversarial learning.
problem High intra- and inter-subject variabilities in EEG data.
method Mutual information-driven deep learning approach to learn class-relevant and subject-invariant feature representations.
result Effective in learning class-relevant and subject-invariant feature representations without adversarial learning.
The use of variable selection methods is particularly appealing in statistical problems with functional data. The obvious general criterion for variable selection is to choose the `most representative' or `most relevant' variables. However, it is also clear that a purely relevance-oriented criterion could lead to selec…
Profiling cellular phenotypes from microscopic imaging can provide meaningful biological information resulting from various factors affecting the cells. One motivating application is drug development: morphological cell features can be captured from images, from which similarities between different drug compounds appli…
DEDACT breaks down feature importance into direct and associative components.
problem Lack of clear distinction between direct and associative feature importance.
method DEDACT framework to decompose direct and associative importance measures.
result Provides insight into sources of prediction-relevant information and feature pathways.
This paper investigates a multi-terminal source coding problem under a logarithmic loss fidelity which does not necessarily lead to an additive distortion measure. The problem is motivated by an extension of the Information Bottleneck method to a multi-source scenario where several encoders have to build cooperatively …
Tutorial on information bottleneck problems with connections to coding and learning.
problem Information bottleneck problems and their connections to coding and learning.
method Information theoretic perspective, practical methods, connections to various problems.
result Optimal trade-offs between relevance and complexity in discrete and vector Gaussian frameworks.
Modified BP attribution methods often ignore later layers' information, leading to misleading explanations.
problem Misleading explanations from modified BP methods ignoring later layers' information.
method Analysis of 9 modified BP methods including Deep Taylor Decomposition, LRP, Excitation BP, PatternAttribution, DeepLIFT, Deconv, RectGrad, Guided BP.
result Only DeepLIFT does not ignore later layers' information, providing a faithful explanation.
GIB improves neural network generalization by dynamically selecting task-relevant features across different sequential environments.
problem Poor generalization of deep neural networks to unseen environments.
method Proposes a gated information bottleneck (GIB) approach that dynamically drops spurious correlations and selects task-relevant features.
result GIB outperforms other IB approaches in adversarial robustness and OOD detection.
The paper introduces a statistical test to assess and rank distance measures.
problem Assessing the relative information retained by different distance measures.
method Developed a statistical test to compare distance measures.
result Identifies the most informative distance measure among candidates.
Lost in Diversificationq-fin.GN
The abstract discusses how diversification and securitization lead to information losses in financial risk optimization.
problem Information loss in financial risk optimization practices.
method Information theoretic concepts to quantify information losses in financial transformations and portfolios.
result Diversification and securitization increase information sensitivity, leading to maximal information losses when assets are uncorrelated.
Improves relevancy of black-box anomaly detectors with user feedback.
problem Users often ignore many detected anomalies, requiring a method to identify and prioritize relevant ones.
method Uses user feedback to adjust anomaly selection process based on identified anomaly types.
result Significant improvements in precision and recall over various anomaly detectors.