New algorithm for aggregate inference in HMMs with continuous observations.
problem Inference in large populations with indistinguishable individuals and continuous measurements.
method Continuous observation collective forward-backward algorithm extending existing discrete case algorithm.
result Efficacy demonstrated through numerical experiments.
A new algorithm estimates aggregate marginals from noisy data in an online manner.
problem Estimating aggregate marginals of a Markov chain from noisy aggregate observations.
method Sliding window Sinkhorn belief propagation (SW-SBP) algorithm.
result Demonstrated improved performance on inferring population flow.
The article studies aggregating algorithms for long-term forecasting.
problem Improving long-term forecasting accuracy using aggregating algorithms.
method Examines classic and generalized Vovk's aggregating algorithms, provides modifications for practical use.
result Provides algorithms with time-independent and O ( T ) O(\sqrt{T}) O ( T ) regret bounds for long-term forecasting. Federated learning is protected against adversarial attacks with residual-based reweighting.
problem Adversarial attacks on federated learning's aggregation process.
method Residual-based reweighting combined with iteratively reweighted least squares.
result Our aggregation algorithm outperforms other methods in label-flipping and backdoor attacks.
We propose a clustering-based iterative algorithm to solve certain optimization problems in machine learning, where we start the algorithm by aggregating the original data, solving the problem on aggregated data, and then in subsequent steps gradually disaggregate the aggregated data. We apply the algorithm to common m…
New federated learning algorithms improve model aggregation robustness.
problem Improving model aggregation in federated learning.
method Complete mathematical convergence analysis and novel aggregation algorithms.
result Derived novel algorithms that modify model architecture based on client contributions.
New algorithm for recommending best arms with aggregated feedback.
problem Finding the best arm under aggregated feedback when precise rewards are unavailable.
method Gaussian Process Optimistic Optimisation (GPOO) algorithm with adaptive tree construction.
result The proposed algorithm achieves new simple regret bounds with aggregated feedback.
BOA improves financial forecasting by combining expert models.
problem Challenges in choosing between multiple machine learning models for financial forecasting.
method Online aggregation of expert models using Bernstein Online Aggregation (BOA) procedure.
result BOA leads to better portfolio performance, higher Sharpe Ratio, and lower shortfall.
LSA minimizes aggregate regret in thresholding bandit with optimal performance.
problem Finding arms with mean rewards above a threshold within a fixed budget.
method LSA, a simple and anytime algorithm aiming to minimize aggregate regret.
result LSA is instance-wise asymptotically optimal in minimizing aggregate regret.
Paper improves convergence rates and step sizes for gradient algorithms.
problem Limited convergence rates and step sizes in existing algorithms.
method General proximal incremental aggregated gradient algorithm.
result Better and novel convergence results under general scheme.
Paper proposes an algorithm to estimate state aggregation from Markov transition data.
problem Estimating probabilistic aggregation map from system's trajectory.
method Two-step algorithm: spectral decomposition and linear transformation of singular vectors.
result Sharp error bounds for estimating aggregation and disaggregation distributions.
In this paper, we consider the problem of "hyper-sparse aggregation". Namely, given a dictionary F = { f 1 , . . . , f M } F = \{f_1, ..., f_M \} F = { f 1 , ... , f M } of functions, we look for an optimal aggregation algorithm that writes f ~ = ∑ j = 1 M θ j f j \tilde f = \sum_{j=1}^M θ_j f_j f ~ = ∑ j = 1 M θ j f j with as many zero coefficients θ j θ_j θ j as possible. This problem is of particular interest when…
New algorithm for XMC from aggregated labels.
problem Finding relevant labels for inputs from a large label universe.
method Developed a scalable algorithm to impute individual labels from group labels.
result Advantages over existing approaches in XMC and MIML tasks.
New algorithm for collective Gaussian hidden Markov models inference.
problem Inference of collective Gaussian hidden Markov models from aggregate data.
method Collective Gaussian forward-backward algorithm, extending Sinkhorn belief propagation.
result Convergence guarantee and applicability to single individual Kalman filter.
Unified framework for Byzantine robust gossip algorithms with guaranteed performance.
problem Vulnerability of decentralized machine learning to misbehaving devices.
method Introduces F-RG framework and CS+ robust aggregation rule for Byzantine resilience.
result CS+-RG has near-optimal breakdown tolerance and outperforms existing methods.
A new fast algorithm for crowd labeling of sentiment data.
problem Crowd labeling of sentiment data with limited labeled data.
method A fast EM-based algorithm that converges linearly.
result Significant speedup in time taken for aggregation (up to 8x over DS).
Proposes HTM for aggregating ranked data considering user accuracy.
problem Aggregating ranked data from heterogeneous users with varying accuracy levels.
method Heterogeneous Thurstone Model (HTM) with alternating gradient descent algorithm.
result Algorithm converges linearly and outperforms existing methods.
New algorithm predicts piecewise regular functions online.
problem Online prediction of piecewise regular functions.
method Modified sleeping experts aggregation algorithm.
result Oracle risk bounds for all local regions.
The ability to adequately model risks is crucial for insurance companies. The method of "Copula-based hierarchical risk aggregation" by Arbenz et al. offers a flexible way in doing so and has attracted much attention recently. We briefly introduce the aggregation tree model as well as the sampling algorithm proposed by…
Proposes MamBO for efficient high-dimensional large-scale optimization.
problem High-dimensional and large-scale optimization problems in machine learning and simulation.
method Combines subsampling and subspace embeddings with model aggregation to address uncertainty in surrogate models.
result Improves robustness of Bayesian optimization algorithm and achieves superior performance.
We prove a lower bound for feature dimension in linear MDPs and propose a novel dynamics aggregation framework.
problem The limitation of feature dimension in linear MDPs and the need for efficient hierarchical reinforcement learning.
method We propose a novel dynamics aggregation framework based on structural dynamics and design a provably efficient hierarchical reinforcement learning algorithm.
result Our algorithm achieves a regret of i l d e O ( d ψ 3 / 2 H 3 / 2 N T ) ilde{O} ( d_ψ^{3/2} H^{3/2}\sqrt{ N T} ) i l d e O ( d ψ 3/2 H 3/2 N T ) and meets the condition d ψ 3 N ≪ d 3 d_ψ^3 N \ll d^{3} d ψ 3 N ≪ d 3 in most real-world environments. Data aggregation improves HAC for resource-constrained systems.
problem Resource constraints in embedded systems limit HAC's applicability.
method Data aggregation with BETULA algorithm reduces memory and runtime requirements.
result HAC can be applied to large datasets on resource-constrained systems.
New algorithm for efficient inference over tree-structured graphs.
problem Inference over probabilistic graphical models with aggregate data.
method Optimal transport theory, Sinkhorn/iterative scaling algorithm, belief propagation.
result Global convergence and polynomial computational complexity.
NEAR improves graph classification by aggregating edge information.
problem Loss of local structure and relationships in 1-hop neighborhood GNNs.
method Proposes NEAR, a framework that aggregates edge information between nodes in the neighborhood.
result NEAR improves graph classification tasks over existing 1-hop based GNN algorithms.
We introduce a new family of minmax rank aggregation problems under two distance measures, the Kendall τ and the Spearman footrule. As the problems are NP-hard, we proceed to describe a number of constant-approximation algorithms for solving them. We conclude with illustrative applications of the aggregation methods on…
The article improves prediction by aggregating Kalman recursions online.
problem Improving expert aggregation in prediction models.
method Using exponential weights and state-space models to aggregate Kalman recursions.
result New algorithms outperform existing methods in Kalman recursion expert aggregation.
UAIL uses uncertainty estimation to improve control systems in safety-critical tasks.
problem Improving control systems in safety-critical domains like autonomous driving.
method UAIL applies Monte Carlo Dropout to estimate uncertainty in control output and selectively acquire new training data.
result UAIL can reliably predict infractions and outperforms existing algorithms.
Learning the true ordering between objects by aggregating a set of expert opinion rank order lists is an important and ubiquitous problem in many applications ranging from social choice theory to natural language processing and search aggregation. We study the problem of unsupervised rank aggregation where no ground tr…
The paper develops a method for forecasting power consumption at various levels of aggregation.
problem Forecasting power consumption at different levels of household aggregation.
method Three-step process: feature generation, aggregation, and projection.
result The method provides theoretical guarantees on prediction error and performs well on real data.
Unified approach for federated learning using MM optimization.
problem Scaling stochastic optimization to federated learning.
method Unified Majorize-Minimize (MM) framework for stochastic optimization, extended to federated learning.
result Unified algorithm \QSMM\ for federated learning that aggregates surrogate majorizing functions.
We consider the problem of learning convex aggregation of models, that is as good as the best convex aggregation, for the binary classification problem. Working in the stream based active learning setting, where the active learner has to make a decision on-the-fly, if it wants to query for the label of the point curren…
Non-affine aggregation rules cannot preserve monotonicity in convex learning.
problem Designing non-affine aggregation rules that maintain monotonicity in convex learning.
method Proving that monotonicity of aggregated gradients is preserved only if the aggregation rule is positively affine.
result Non-affine aggregation prevents steady convergence and substantially degrades algorithmic stability.
FedBuff improves federated learning scalability with asynchronous updates.
problem Limited scalability of federated learning with synchronous updates.
method Introduces asynchronous updates (staleness) in federated learning.
result Theoretical analysis shows improved convergence rate with boundedness removed.
Proposes a novel MTL approach based on bias-variance analysis.
problem Improving multi-task learning performance through shared knowledge.
method Two-phase iterative aggregation of targets and features using bias-variance analysis.
result Validation on synthetic and real-world datasets demonstrates the effectiveness of the proposed method.
Study online learning in MDPs with aggregate bandit feedback, achieving low regret in both stochastic and adversarial settings.
problem Online learning in finite-horizon episodic MDPs with aggregate bandit feedback.
method Best-of-both-worlds (BOBW) algorithms using FTRL over occupancy measures, self-bounding techniques, and new loss estimators.
result First BOBW algorithms for episodic tabular MDPs with aggregate bandit feedback achieving O ( log T ) O(\log T) O ( log T ) regret in stochastic and O ( T ) {O}(\sqrt{T}) O ( T ) regret in adversarial settings. Paper presents a novel approach for global feature aggregation in Graph Neural Networks.
problem Graphs lack a straightforward way to perform non-local feature aggregation like images and texts.
method Utilizes Latent Fixed Data Structure (LFDS) to aggregate feature vectors from local extraction.
result Proposed methods achieve competitive or better results with linear computational complexity.
Two new algorithms reduce feature space while preserving non-linear relationships.
problem High-dimensional data and overfitting issues.
method Bias-variance analysis for non-linear transformations and generalized linear models.
result Competitive performance on regression and classification tasks.
The paper introduces a method to control false splits in tree-based data aggregation.
problem Identifying the correct subgroups to treat as a single entity in tree-based data.
method Introduces the 'false split rate' and proposes a multiple hypothesis testing algorithm for tree-based aggregation.
result The proposed algorithm controls the false split rate, demonstrating its effectiveness on stock volatility and taxi fare data.
Bayesian method corrects bias in class-aggregated values.
problem Bias in aggregated values from classification algorithms.
method Bayesian inference with constraints on model parameters.
result Outperforms existing methods in mean squared error.
Improved local explainer aggregation for interpretable machine learning models.
problem Improving the interpretability of black box machine learning models.
method Non-convex optimization and integer optimization framework for local explainer aggregation.
result Our method outperforms existing methods in terms of coverage and fidelity, particularly in multi-class settings.
PREMA recovers detailed data from aggregated views.
problem Reconstructing detailed data from aggregated views.
method Low-rank tensor factorization.
result Recovery guarantees under certain conditions.
FedBE aggregates local models into a robust global model via Bayesian inference.
problem Challenges in aggregating non-i.i.d. local models into a global model in federated learning.
method FedBE uses Bayesian inference to sample and combine higher-quality global models from local models.
result FedBE leads to more robust aggregation of local models into a global model, especially when data is non-i.i.d.
MEVA aggregates model predictions to improve accuracy without needing model details.
problem Improving model accuracy by combining multiple models.
method Non-intrusive, data-driven framework that treats models as black boxes and optimizes aggregation methods.
result MVA outperforms MEA in estimating aggregated predictions, enhancing robustness and accuracy.
SUMMA aggregates predictions without labeled data.
problem Lack of labeled data limits ensemble methods.
method Developed SUMMA framework for unlabeled data.
result Estimates base classifier performances and optimal ensemble strategy.
Paper presents a framework to infer individual data from aggregate data.
problem Inference of individual-level data from aggregate data due to privacy concerns.
method End-to-end pipeline for processing aggregate data, novel algorithm for reconstruction, machine learning models.
result Valid and usable answers derived from machine learning models using multiple candidate datasets.
A simple algorithm improves model generalization in expert advice settings.
problem Improving model generalization in expert advice settings.
method A naive aggregation algorithm for point estimations of high-dimensional nonlinear functions.
result Conditions for optimal parameter estimates through sequential mixing distribution strategies.
Federated edge learning improves with CSIT-free model aggregation using RIS.
problem Lack of CSIT in federated edge learning systems.
method Use RIS to align channel coefficients for model aggregation without CSIT, optimize RIS and receiver jointly.
result Achieves similar learning accuracy as CSIT-based methods without CSIT.
A fast aggregation technique boosts classifier performance without re-training.
problem Boosting algorithms require re-training, making deep learning impractical.
method Formulate aggregation problem using a mixture model fitted to classifier outputs.
result Boosted performance by 12% using less expensive training stage.