Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

64128191255 · Jun 202019922001200920172026
48 results for aggregate supervision

A new procedure aggregates models to predict data from multiple clusters.

problem Predicting data from multiple clusters with different underlying models.
method Three-step procedure: clustering, model fitting, and aggregation.
result The method outperforms existing models in various prediction problems.

Simpler GNNs with low-rank non-parametric aggregators perform well on graph benchmarks.

problem Over-engineering in GNN architectures for common semi-supervised node classification datasets.
method Replacing feature aggregation with a non-parametric learner to streamline GNN design.
result Non-parametric regression is effective for semi-supervised learning on sparse, directed networks.

This paper addresses the problem of rank aggregation, which aims to find a consensus ranking among multiple ranking inputs. Traditional rank aggregation methods are deterministic, and can be categorized into explicit and implicit methods depending on whether rank information is explicitly or implicitly utilized. Surpri…

2013-09-26abs ↗pdf ↗

We address the problem of aggregating an ensemble of predictors with known loss bounds in a semi-supervised binary classification setting, to minimize prediction loss incurred on the unlabeled data. We find the minimax optimal predictions for a very general class of loss functions including all convex and many non-conv…

2015-10-01abs ↗pdf ↗

FABLE incorporates instance features into PWS label models for improved performance.

problem Lack of instance features in existing label models limits their performance.
method FABLE uses a mixture of Bayesian label models and a Gaussian Process classifier to incorporate instance features.
result FABLE achieves the highest averaged performance across nine baselines on benchmark datasets.

SADA safely combines predictions from various models for semi-supervised learning.

problem Combining uncertain quality predictions from multiple models in semi-supervised learning.
method Safe and adaptive aggregation of black-box predictions.
result The method guarantees better performance than using labeled data alone and adapts to perfect predictions.

The paper introduces a new loss function to prevent overfitting in semi-supervised graph networks.

problem Overfitting in semi-supervised graph networks trained with cross-entropy loss.
method Proposes an unsupervised manifold smoothness loss to regularize the graph convolutional networks.
result Adding the proposed loss consistently improves performance of graph networks.

A variety of graph neural networks (GNNs) frameworks for representation learning on graphs have been recently developed. These frameworks rely on aggregation and iteration scheme to learn the representation of nodes. However, information between nodes is inevitably lost in the scheme during learning. In order to reduce…

2019-05-21abs ↗pdf ↗

The study improves sentiment analysis of 10-K filings, revealing aggregation effects on accuracy and correlation with market outcomes.

problem Lack of sentiment analysis for 10-K filings, particularly for risk disclosures.
method Supervised lexicon-learning approach applied to 10-K filings and Item 1A risk-factor sections, trained against return and volatility labels at different levels of aggregation.
result Sentiment analysis of Item 1A sections performs better at the individual-firm level, while full-filing text is more accurate at sector and portfolio levels.

Aggregates diverse zero-shot LLM outputs for better corporate disclosure classification.

problem Combining varied zero-shot LLM predictions for improved stock return prediction.
method Multi-prompt framework with three fixed zero-shot LLM classifiers, logistic meta-classifier aggregation.
result Aggregated model outperforms single classifiers and baseline models, increasing balanced accuracy from 0.566 to 0.606.

AdaCAD improves semi-supervised classification by focusing on intra-class nodes.

problem Improving semi-supervised classification by addressing inter-class connections in graphs.
method AdaCAD uses a class-attentive diffusion process to adaptively aggregate nodes based on their class similarity.
result AdaCAD significantly outperforms state-of-the-art methods in semi-supervised classification.

Sharp-SSL uses random projections to identify important variables for semi-supervised learning.

problem High-dimensional semi-supervised learning problems.
method Careful aggregation of low-dimensional results from many axis-aligned random projections.
result Sharp-SSL algorithm can recover signal coordinates with high probability.

Different types of training data have led to numerous schemes for supervised classification. Current learning techniques are tailored to one specific scheme and cannot handle general ensembles of training data. This paper presents a unifying framework for supervised classification with general ensembles of training dat…

2019-01-24abs ↗pdf ↗

Paper proposes a new model for fine-grained review classification using weak supervision.

problem Fine-grained analysis of reviews is challenging due to segment-level labels.
method Employed Multiple Instance Learning (MIL) with sigmoid attention mechanism for weak supervision.
result Proposed model outperforms state-of-the-art models in segment-level sentiment classification.

Paper proposes a supervised similarity framework for corporate bonds using RF proximities.

problem Challenges in measuring similarity for corporate bonds due to noisy data and lack of ground truth.
method Proposes a supervised similarity framework using Random Forest for corporate bonds, introducing a novel metric to evaluate similarities.
result Random Forest outperforms other methods in evaluating similarities for corporate bonds.

While a typical supervised learning framework assumes that the inputs and the outputs are measured at the same levels of granularity, many applications, including global mapping of disease, only have access to outputs at a much coarser level than that of the inputs. Aggregation of outputs makes generalization to new in…

2018-05-22abs ↗pdf ↗

Learning algorithms that aggregate predictions from an ensemble of diverse base classifiers consistently outperform individual methods. Many of these strategies have been developed in a supervised setting, where the accuracy of each base classifier can be empirically measured and this information is incorporated in the…

2018-02-13abs ↗pdf ↗

Trajectory-level supervision allows efficient offline reinforcement learning.

problem Offline reinforcement learning
method Developing a statistical theory for offline policy optimization from trajectory-level labels
result Proving a high-probability guarantee of order O~(H2Csa(π)/n)\widetilde O(H^2\sqrt{C_{sa}(\pi^\star)/n})

U-aggregation combines multiple models without labels for better risk prediction.

problem Challenges in selecting best model for new populations due to limited data and lack of true labels.
method U-aggregation, an unsupervised model aggregation method that integrates pre-trained models without observed labels.
result U-aggregation improves genetic risk prediction of complex traits using publicly available models.

This paper proposes a method to learn graph representations by partitioning edges into communities.

problem Graph neural networks ignore how edges are formed, leading to suboptimal representation learning.
method Introduces a generative model to partition edges into community-specific weighted edges, then uses these for GNN-based inference and classification.
result The method learns discriminative representations for both node-level and graph-level classification tasks.

Graph convolutional network (GCN) is an emerging neural network approach. It learns new representation of a node by aggregating feature vectors of all neighbors in the aggregation process without considering whether the neighbors or features are useful or not. Recent methods have improved solutions by sampling a fixed …

2018-11-30abs ↗pdf ↗

Optimal and safe semi-supervised learning estimator for high-dimensional data.

problem Improving regression parameter estimation with unlabeled data in high-dimensional settings.
method Established minimax lower bound, proposed optimal and safe semi-supervised estimators.
result Optimal semi-supervised estimator achieves the minimax lower bound.

Bayesian algorithms improve crowdsourcing with label and instance constraints.

problem Efficiently labeling large datasets with additional human annotator information.
method Developed Bayesian algorithms for semi-supervised crowdsourced classification under label and instance constraints.
result Improved performance compared to unsupervised crowdsourcing on various datasets.

The paper extends multiple instance learning to multiclass and regression problems.

problem Learning from aggregate observations where supervision is given to sets of instances.
method Probabilistic framework for various aggregate observations, including classification and regression.
result The proposed estimator has nice convergence properties under mild assumptions.

Framework fine-tunes foundation models with semi-supervised learning for downstream tasks and latent spaces.

problem Training foundation models with limited labelled data.
method Mutual information decomposition for downstream and latent spaces, semi-supervised fine-tuning.
result Significant improvements in classification tasks under low-labelled conditions.

GNNs improve semi-supervised node regression, but why? We explain.

problem Understanding when and why GNNs succeed in semi-supervised node regression.
method Aggregate-and-readout model encompassing message passing architectures, least-squares estimation over GNNs with linear graph convolutions and a deep ReLU readout.
result Sharp non-asymptotic risk bound separating approximation, stochastic, and optimization errors.

End-to-end approach for weak supervision improves downstream model performance.

problem Data-labeling bottleneck in machine learning applications.
method Directly learning the downstream model by maximizing its agreement with probabilistic labels generated from weak supervision sources.
result Improved performance over prior work in terms of downstream model performance and robustness.

PhyDNN uses physics knowledge to improve drag force prediction models.

problem Complex physical processes in fluid dynamics are hard to model accurately.
method Physics-guided structural priors and aggregate supervision for deep learning.
result PhyDNN achieves a significant 8.46% improvement in drag force prediction.

New analysis reveals masked self-supervised learning's effectiveness in extracting data structure.

problem Analyzing masked self-supervised learning in high-dimensional data.
method Developed precise high-dimensional analysis of masked modeling objectives.
result Identified phase transitions and structured regimes for masked self-supervised learning.

Contrastive regularization improves semi-supervised learning by better propagating confident pseudo-labels.

problem Consistency regularization's limitation in high performance and efficiency.
method Proposes contrastive regularization to update model features, pushing confident labels into unlabeled samples.
result Improves semi-supervised learning tasks with fewer training iterations and robust performance.

Boosting weak learners to strong ones from aggregate labels is possible for LLP but not for MIL.

problem Boosting weak learners to strong ones from aggregate labels in learning from label proportions (LLP).
method Using a weak learner on large enough bags to obtain a strong learner for small bags in polynomial time.
result Boosting is possible for LLP but not for MIL.

Improves understanding of PWS by calculating influence of sources and data.

problem Understanding the influence of each component in PWS.
method Proposes source-aware Influence Function (IF) to decompose and calculate influence.
result Improves end model's generalization performance and identifies mislabeling.

Deep Partition Aggregation defends against poisoning attacks with provable certificates.

problem Adversarial poisoning attacks corrupt classifier test-time behavior.
method Deep Partition Aggregation (DPA) is an ensemble method using hash partitions and base models trained on these partitions.
result DPA can certify >= 50% of test images against over 500 poison image insertions on MNIST, and nine insertions on CIFAR-10.

Unsupervised method learns hierarchical graph representations without labels.

problem Lack of hierarchical graph representations and need for labeled data in GNNs.
method Maximizes mutual information between local and global graph representations.
result Comparable performance to supervised methods on graph classification benchmarks.

New financial dataset and model detect claims affecting market returns.

problem Detecting analyst claims' impact on financial markets.
method Constructed new dataset, used weak-supervision model with SME knowledge.
result Outperformed existing models in claim detection and market analysis.