Non-linear filter aggregation improves image denoising.
problem Efficiently denoise images with complex noise patterns.
method Non-linear aggregation of preliminary filters using a new proximity metric.
result The aggregated filters outperform individual filters in denoising.
Augments GNNs with diversification to preserve node identity.
problem Current GNNs filter node information, potentially losing node identity.
method Integrates diversification operators with aggregation to enrich node representations.
result Significant performance boost on 9 node classification tasks.
New algorithm for aggregate inference in HMMs with continuous observations.
problem Inference in large populations with indistinguishable individuals and continuous measurements.
method Continuous observation collective forward-backward algorithm extending existing discrete case algorithm.
result Efficacy demonstrated through numerical experiments.
This paper tackles hidden state inference for HMMs using particle filtering.
problem Inference for hidden states under HMMs is challenging due to unavailable true labels.
method Adaptive conformal inference framework using particle filtering.
result The framework produces prediction sets with specific aggregated coverage levels.
New algorithm for collective Gaussian hidden Markov models inference.
problem Inference of collective Gaussian hidden Markov models from aggregate data.
method Collective Gaussian forward-backward algorithm, extending Sinkhorn belief propagation.
result Convergence guarantee and applicability to single individual Kalman filter.
Proposes KDA to protect deep nets from adversarial attacks.
problem Machine learning system vulnerability to adversarial attacks.
method Key based diversified aggregation with pre-filtering.
result Demonstrates high robustness and universality against various attacks.
A new algorithm estimates aggregate marginals from noisy data in an online manner.
problem Estimating aggregate marginals of a Markov chain from noisy aggregate observations.
method Sliding window Sinkhorn belief propagation (SW-SBP) algorithm.
result Demonstrated improved performance on inferring population flow.
MoE-F combines LLMs online for better time-series prediction.
problem Combining multiple LLMs for online time-series prediction.
method Time-adaptive stochastic filtering techniques to combine experts.
result MoE-F achieves 17% absolute and 48.5% relative F1 measure improvement.
Two architectures that generalize convolutional neural networks (CNNs) for the processing of signals supported on graphs are introduced. We start with the selection graph neural network (GNN), which replaces linear time invariant filters with linear shift invariant graph filters to generate convolutional features and r…
LiuBei is a resilient ML algorithm that tolerates Byzantine workers and servers without trusting any component.
problem Byzantine failures in distributed ML solutions.
method Byzantine-resilient ML algorithm that aggregates gradients and replicates parameter servers, using a filtering mechanism and scatter/gather protocol.
result LiuBei achieves Byzantine resilience to both servers and workers and guarantees convergence, with an accuracy loss of around 5% and a 24% convergence overhead.
One of the classical problems in machine learning and data mining is feature selection. A feature selection algorithm is expected to be quick, and at the same time it should show high performance. MeLiF algorithm effectively solves this problem using ensembles of ranking filters. This article describes two different wa…
RGCF improves collaborative filtering by refining graph convolution embeddings.
problem GCN-based recommendation models introduce noise and redundancy, limiting high-order connectivity capture.
method Developed RGCF, a new GCN-based Collaborative Filtering model with redesigned embeddings.
result RGCF significantly outperforms state-of-the-art models on public datasets.
MFCNs use sparse graphs to approximate manifold convergence.
problem Understanding manifold neural networks (MNNs).
method Sparse graph approximation for manifold convergence.
result Method converges to continuum limit as data points increase.
DETOX improves distributed training resilience with redundancy and robust aggregation.
problem Byzantine node failures in distributed training.
method Combines redundancy and robust aggregation methods.
result Substantial increase in robustness with nearly linear runtime.
Introduces MFCNs for better understanding manifold neural networks.
problem Understanding manifold neural networks (MNNs).
method Filter-combine framework on high-dimensional point clouds, approximating manifold by sparse graph.
result Method converges to continuum limit as data points increase.
Dynamic defense against Byzantine poisoning in federated learning.
problem Byzantine poisoning attacks on federated learning models.
method Dynamic federated aggregation operator to filter out adversarial clients.
result Dynamic selection of clients improves global learning model performance.
Filters on order flow improve short-term market directionality.
problem Improving directional signals from order flow in financial markets.
method Structural filters on order lifetime, modification count, and timing applied to BankNifty index futures.
result Filters on parent orders of executed trades show stronger directional association with returns.
The proliferation of fake news and filter bubbles makes it increasingly difficult to form an unbiased, balanced opinion towards a topic. To ameliorate this, we propose 360° Stance Detection, a tool that aggregates news with multiple perspectives on a topic. It presents them on a spectrum ranging from support to opposit…
The paper studies how to improve language model inference using particle filtering.
problem Understanding the accuracy-cost tradeoffs of inference-time methods for large language models.
method Introduces particle filtering algorithms like Sequential Monte Carlo (SMC) to study language model inference.
result Identifies criteria enabling non-asymptotic guarantees for SMC and fundamental limits faced by all particle filtering methods.
A new federated learning framework for handling device heterogeneity.
problem Handling device heterogeneity in federated learning.
method Superquantile-based objective with parameterized levels of conformity, optimized using secure aggregation.
result The optimization algorithm converges to a stationary point.
A new linear GCN model improves recommendation performance for large graphs.
problem Training difficulties and over-smoothing in GCN-based CF models.
method Proposes a linear residual graph convolutional network (LRGCCF) to address training difficulties and over-smoothing issues.
result The proposed model yields better efficiency and effectiveness on real datasets.
Suitability filter detects model performance degradation in real-world deployment.
problem Ensuring model reliability in safety-critical domains without access to ground truth labels.
method Uses suitability signals to evaluate classifier performance on unlabeled user data.
result The suitability filter reliably detects performance deviations due to covariate shift.
Novel convex risk measures aggregate multiple uncertain sources for insurance firms.
problem Managing risk from multiple uncertain sources in insurance.
method Proposes convex risk measures based on Fréchet mean.
result Allows for robust risk characterization and closed-form expressions.
Improved local explainer aggregation for interpretable machine learning models.
problem Improving the interpretability of black box machine learning models.
method Non-convex optimization and integer optimization framework for local explainer aggregation.
result Our method outperforms existing methods in terms of coverage and fidelity, particularly in multi-class settings.
A new model predicts dynamic O-D matrices using graph neural networks and Kalman filters.
problem Predicting dynamic O-D demand matrices from traffic flow data.
method Combines graph neural networks and Kalman filters to recognize spatial and temporal patterns.
result The proposed model outperforms other methods in various prediction scenarios.
Paper proposes knockoff-based methods to simplify deep neural networks by controlling false discovery rates.
problem High-dimensional deep neural networks with many irrelevant parameters and inputs.
method Knockoff methods combined with regularized neural networks for variable screening.
result Proposed algorithms show satisfactory performance in controlling false discovery rates.
New algorithm for efficient inference over tree-structured graphs.
problem Inference over probabilistic graphical models with aggregate data.
method Optimal transport theory, Sinkhorn/iterative scaling algorithm, belief propagation.
result Global convergence and polynomial computational complexity.
Graphon autoencoder generates graphs with arbitrary sizes using Chebyshev filters.
problem Generating graphs with arbitrary sizes and arbitrary structures.
method Induces graphons from observed graphs, uses Chebyshev filters for latent representation, and learns encoder and decoder to minimize Wasserstein distance.
result Graphon autoencoder provides a new paradigm for graph generation with good generalizability and transferability.
Improved financial network predictability using LLM for edge filtering.
problem Spurious edges in financial networks from textual similarity.
method Two-stage framework: sparse candidate graph + LLM edge classification.
result LLM-based edge filtering improves Sharpe ratio and reduces drawdown.
DFMR improves robustness of learning finite mixture models in distributed settings.
problem Learning finite mixture models in distributed settings with Byzantine failures.
method DFMR leverages pairwise L2 distances to filter and retain local estimates, ensuring robust aggregation.
result DFMR achieves optimal convergence rate and asymptotic equivalence to global maximum likelihood estimate.
ML-KFHE improves multi-label classification performance using Kalman filter fusion.
problem Lack of effective multi-label ensemble classification methods.
method Exploits Kalman filter sensor fusion properties for multi-label classification.
result Significantly improved predictive performance on multi-label datasets.
Bayesian CNN improves MRI stroke diagnosis accuracy and uncertainty quantification.
problem Uncertainty quantification in automated image analysis for medical decision-making.
method Bayesian Convolutional Neural Network (CNN) with aggregation methods for patient-level diagnoses.
result Bayesian CNN achieved 95.33% accuracy on 511 patients, 2% higher than non-Bayesian.
A federated learning framework using superquantile aggregation for robust performance across heterogeneous data.
problem Robust predictive performance across clients with heterogeneous data.
method Superquantile-based learning objective and stochastic training algorithm with differential privacy.
result Proves finite time convergence guarantees and demonstrates competitive performance with tail statistics improvement.
Numerous kinds of uncertainties may affect an economy, e.g. economic, political, and environmental ones. We model the aggregate impact by the uncertainties on an economy and its associated financial market by randomised mixtures of Lévy processes. We assume that market participants observe the randomised mixtures only …
Simpler GNNs perform well on graph classification tasks.
problem Understanding what Graph Neural Networks (GNNs) learn and their complexity.
method Dissected GNNs into graph filtering and set function, linearizing them separately.
result Linear graph filtering with non-linear set function is efficient and powerful.
The increasing interest in user privacy is leading to new privacy preserving machine learning paradigms. In the Federated Learning paradigm, a master machine learning model is distributed to user clients, the clients use their locally stored data and model for both inference and calculating model updates. The model upd…
Study market efficiency under partial information using SDEs and optimization.
problem Market efficiency under partial information constraints.
method McKean-Vlasov-type SDEs, Wasserstein barycenters, KL divergence, convex optimization, optimal control, nonlinear filtering.
result Convergence of reduced-information market price processes to true price process under increasing information flow.
FLANDERS detects and blocks extreme model poisoning in federated learning.
problem Resilience against large-scale model poisoning attacks in federated learning.
method FLANDERS treats client updates as matrix-valued time series and identifies outliers using autoregressive forecasting.
result FLANDERS significantly improves robustness in federated learning across various attacks.
New composite indicators reveal hidden relationships between indicators.
problem Subjective aggregation of indicators leads to missed information.
method Used dimensionality reduction techniques (PCA, filtering, clustering) to reveal hidden relationships.
result Cluster-driven composite indicators outperform traditional ones in data reconstruction.
A new graph classification method using persistent homology.
problem Graph classification with graph connectivity structure.
method Learnable filter function for persistent homology computation.
result Empirically, the method compares favorably to previous techniques.
The false discovery rate (FDR)---the expected fraction of spurious discoveries among all the discoveries---provides a popular statistical assessment of the reproducibility of scientific studies in various disciplines. In this work, we introduce a new method for controlling the FDR in meta-analysis of many decentralized…
We propose dynamical systems trees (DSTs) as a flexible class of models for describing multiple processes that interact via a hierarchy of aggregating parent chains. DSTs extend Kalman filters, hidden Markov models and nonlinear dynamical systems to an interactive group scenario. Various individual processes interact a…
PMD measures user distances using optimal transportation, improving recommendation accuracy.
problem Sparse data and lack of co-rated items in collaborative filtering.
method PMD is an Earth Mover's Distance-based user distance measure that utilizes all ratings.
result PMD achieves superior recommendation accuracy, especially in sparse data scenarios.
Semantic segmentation of land cover classes is fundamental for agricultural and economic development work, from sustainable forestry to urban planning, yet existing training datasets have significant limitations. To generate an open and comprehensive training library of high resolution Earth imagery and high quality la…
New p-Laplacian GNN model tackles heterophilic graphs by improving node classification.
problem Heterophilic graphs where node labels differ, leading to poor GNN performance.
method Proposes p-Laplacian GNN model with a new message passing mechanism derived from discrete regularization. result Significantly outperforms state-of-the-art GNNs on heterophilic benchmarks.
Triangulation filters spurious circuits in multilingual models.
problem Unreliable explanations of multilingual models across languages.
method Formalizes reference families and introduces triangulation as a causal acceptance rule.
result Triangulation provides a falsifiable standard for mechanistic claims.
Improved neural model for social recommendation by integrating social and interest networks.
problem Data sparsity and lack of higher-order relationships in social recommendation.
method DiffNet++ models neural influence diffusion and interest diffusion in a unified framework using a multi-level attention network.
result Extensive experiments on real-world datasets show the effectiveness of DiffNet++.
Proposes a framework to optimize complex data constraints effectively.
problem Challenges in optimizing high-dimensional, noisy data with constraints.
method Multi-stage Constrained Optimization Framework (MCOF) with EC-VAE, UT, and CPM.
result Validated on synthetic and real-world problems, achieving feasible solutions.