Local SGD outperforms minibatch SGD for quadratic objectives.
problem Theoretical foundations of local SGD are lacking.
method Proved local SGD strictly dominates minibatch SGD for quadratic objectives and accelerated local SGD is minimax optimal.
result Local SGD does not dominate minibatch SGD in general convex objectives.
This paper presents a simple but effective density-based outlier detection approach with the local kernel density estimation (KDE). A Relative Density-based Outlier Score (RDOS) is introduced to measure the local outlierness of objects, in which the density distribution at the location of an object is estimated with a …
SpeechYOLO detects and locates speech objects in audio signals.
problem Detecting and localizing speech in audio signals.
method Inspired by YOLO, SpeechYOLO uses a convolutional neural network with a least-mean-squares loss function.
result SpeechYOLO performs well on keyword spotting tasks, including read and spontaneous speech.
Improves manifold learning by identifying and fixing stuck points.
problem Local minima in nonlinear embedding methods lead to poor data structure visualization.
method Introduces a method to temporarily allow pressured points to use an extra dimension in the embedding space.
result Significantly improves the objective function value of existing methods even after getting stuck in a poor local minimum.
Improves multi-objective learning by adapting to local subintervals.
problem Learning a predictor satisfying multiple objectives in an online, changing data setting.
method Adapting an existing multi-objective learning method with an adaptive online algorithm.
result Improves predictions over subgroups and remains robust under distribution shift.
Local-HDP learns independent topics for each 3D object category in real-time.
problem Learning independent topics for each 3D object category in real-time.
method Local-Hierarchical Dirichlet Process (Local-HDP) with online variational inference.
result Local-HDP outperforms other approaches in accuracy, scalability, and memory efficiency.
A new algorithm optimizes local objectives in federated learning with heterogeneous clients.
problem Optimizing local objectives in federated learning with heterogeneous client data.
method Proposes PF-PNE algorithm with double elimination strategy.
result PF-PNE algorithm optimizes local objectives with arbitrary heterogeneity and protects client data confidentiality.
Deep learning improves automatic image segmentation.
problem Automatic object localization and boundary delineation in images and medical scans.
method Proposed and evaluated novel dilated dense encoder-decoder architectures for salient object segmentation and lesion localization in medical images.
result Proposed architectures outperform state-of-the-art models in accuracy and efficiency.
Local surrogate explainers vary in objectives, leading to incomparable explanations.
problem Variability in objectives among local surrogate explainers.
method Review of multiple local surrogate explainers, focusing on extracted information.
result Diverse explanations from similar methods due to differing objectives.
Proposes a method for weakly-supervised object localization to improve few-shot learning.
problem Challenges of few-shot learning, especially with fine-grained categories.
method Introduces a Self-Attention Based Complementary Module (SAC Module) for weakly-supervised object localization.
result Significantly outperforms state-of-the-art methods on benchmark datasets, especially for fine-grained few-shot tasks.
The study explores how different Grothendieck topologies and functors between categories preserve locality.
problem Exploring relationships between different Grothendieck topologies and functors.
method Using Grothendieck topologies and functors to relate categories and geometric objects.
result Objects like sheaves, groupoids, and functors are invariant under equivalences of Grothendieck topologies and certain functors.
3D convolutional neural networks (3D-CNN) have been used for object recognition based on the voxelized shape of an object. In this paper, we present a 3D-CNN based method to learn distinct local geometric features of interest within an object. In this context, the voxelized representation may not be sufficient to captu…
LRSAO uses RL to dynamically select and unlearn auxiliary objectives for EA optimization.
problem Optimizing complex landscapes with evolutionary algorithms.
method Local Reinforcement Learning (RL) to dynamically select and unlearn auxiliary objectives.
result Improved optimization complexity from O(n2log(n)/ℓ) to Θ(n2/ℓ2+nlog(n)). This paper tackles objective inconsistency in federated optimization with heterogeneous clients.
problem Objective inconsistency due to heterogeneity in clients' datasets and computation speeds.
method General framework for analyzing federated heterogeneous optimization algorithms, including FedAvg and FedProx, and proposing FedNova.
result FedNova eliminates objective inconsistency while preserving fast error convergence.
Improved Local SGD convergence for general convex objectives with bounded second-order heterogeneity.
problem Understanding when and why Local SGD outperforms alternatives in distributed optimization.
method Established improved convergence guarantees for Local SGD on general convex objectives under bounded second-order heterogeneity.
result Upper bounds for Local SGD are nearly tight, providing a sharper convergence theory.
Novel CE-method variants reduce local minima convergence with fewer function evaluations.
problem Local minima and expensive function evaluations in optimization.
method Surrogate model-based CE-method variants to reduce local minima convergence.
result Surrogate model-based approach reduces local minima convergence using fewer function evaluations.
Robots detect and recognize objects in real-time for better manipulation.
problem Real-time object detection and recognition for humanoid robots.
method Modified YOLOv3 algorithm, quantization, and re-arrangement of layers for low-compute NAO robots.
result Robots can perform real-time detection, recognition, and localization of objects.
We study locally compact contractive local groups, that is, locally compact local groups with a contractive pseudo-automorphism. We prove that if such an object is locally connected, then it is locally isomorphic to a Lie group. We also prove a related structure theorem for locally compact contractive local groups whic…
Minibatch SGD outperforms Local SGD in heterogeneous distributed learning.
problem Optimizing a combined convex objective with stochastic gradient estimates from different machines.
method Analysis of Minibatch SGD and Local SGD in a heterogeneous distributed setting.
result Minibatch SGD dominates Local SGD in the heterogeneous distributed setting.
AGGLIO optimizes non-convex functions with local convexity guarantees.
problem Optimizing non-convex functions with local convexity.
method Stage-wise, graduated optimization technique for locally convex functions.
result Global convergence to the global optimum for non-convex and locally convex objectives.
The object of the present paper is to study the locally φ- semisymmetric Kenmotsu manifolds along with the characterization of such notion.
In many safety-critical applications such as autonomous driving and surgical robots, it is desirable to obtain prediction uncertainties from object detection modules to help support safe decision-making. Specifically, such modules need to estimate the probability of each predicted object in a given region and the confi…
Paper explores supervised learning methods to approximate ideal observer for joint signal detection and localization.
problem Optimizing medical imaging systems by assessing their performance using the Ideal Observer model.
method Uses supervised learning methods, specifically convolutional neural networks, to approximate the Ideal Observer for joint signal detection and localization tasks.
result Supervised learning-based methods can approximate the Ideal Observer for joint signal detection and localization tasks, as shown by comparisons to MCMC and analytical methods.
Local network community detection is the task of finding a single community of nodes concentrated around few given seed nodes in a localized way. Conductance is a popular objective function used in many algorithms for local community detection. This paper studies a continuous relaxation of conductance. We show that con…
LSB is a new MCMC method for discrete spaces that reduces target evaluations.
problem Sampling in discrete domains with high efficiency and adaptability.
method Local self-balancing proposals, mutual information objective, self-balancing learning.
result LSB converges with fewer target evaluations compared to existing methods.
New method makes CP intervals locally adaptive using trainable transformations.
problem Making Conformal Prediction intervals locally adaptive.
method Defining a trainable change of variables φX(A) that depends on object attributes X. result Locally adaptive prediction intervals with guaranteed marginal validity and variable sizes.
LoCo learns local representations without end-to-end synchronization, improving performance on complex tasks.
problem Learning local representations without end-to-end synchronization constraints.
method Overlap local blocks to increase decoder depth and allow feedback from upper to lower layers.
result LoCo closes the performance gap between local learning and end-to-end contrastive learning.
Algorithm optimizes collaborative learning among distributed clients using kernel-based bandits.
problem Optimizing personalized objectives in a distributed system with limited global information.
method Kernel-based bandit framework with surrogate Gaussian process models, sparse approximations.
result Order-optimal regret performance (up to polylogarithmic factors) and reduced communication overhead.
3D Convolutional Neural Networks (3D-CNN) have been used for object recognition based on the voxelized shape of an object. However, interpreting the decision making process of these 3D-CNNs is still an infeasible task. In this paper, we present a unique 3D-CNN based Gradient-weighted Class Activation Mapping method (3D…
Cactus doodles are geometric objects derived from cactus groups.
problem Understanding geometric structures related to algebraic groups.
method Defining cactus doodles via local moves on plane curves and relating them to cactus groups.
result Established properties of cactus doodles and their connection to cactus groups.
Local mass perspective on Bayesian inference
problem Measuring distributional discrepancy in Bayesian inference
method Introducing Mass Index and Regularised Extended KL
result Proving inequalities for comparing local small-ball masses
New approach learns neural network parameters by balancing local objectives and data propagation constraints.
problem Learning neural network parameters with trade-offs between local objectives and data propagation.
method Introduces nonlinear transforms and local propagation constraints to balance learning objectives.
result Validated approach on image recognition tasks with improved learning time and network size.
We consider a set of learning agents in a collaborative peer-to-peer network, where each agent learns a personalized model according to its own learning objective. The question addressed in this paper is: how can agents improve upon their locally trained model by communicating with other agents that have similar object…
This work addresses local fairness in machine learning models.
problem Ensuring fairness within subregions of feature space, not just global averages.
method Introduces ROAD, a Distributionally Robust Optimization (DRO) approach with adversarial learning.
result Achieves Pareto dominance in local fairness and accuracy across datasets.
Langevin dynamics (LD) has been proven to be a powerful technique for optimizing a non-convex objective as an efficient algorithm to find local minima while eventually visiting a global minimum on longer time-scales. LD is based on the first-order Langevin diffusion which is reversible in time. We study two variants th…
GraLSP improves graph neural networks by incorporating local structural patterns.
problem GNNs struggle with identifying common structural patterns in graphs.
method GraLSP uses random anonymous walks to capture local graph structures and incorporates these into feature aggregation mechanisms.
result GraLSP outperforms other models in various prediction tasks on multiple datasets.
Supervised object detection and semantic segmentation require object or even pixel level annotations. When there exist image level labels only, it is challenging for weakly supervised algorithms to achieve accurate predictions. The accuracy achieved by top weakly supervised algorithms is still significantly lower than …
Local study of foliation deformation cohomology.
problem Understanding deformations of singular foliations.
method Introducing and studying local deformation cohomology.
result Local deformation cohomology for singular foliations and related structures.
Novel method for high-dimensional BO using CMA to define local regions.
problem Challenges in applying BO to high-dimensional optimization problems.
method CMA strategy to learn search distribution and define local regions.
result Our method outperforms existing techniques on various benchmarks.
SVH-PSL uses Stein Variational Gradient Descent and Hypernetworks to improve Pareto set learning for expensive MOO.
problem Fragmented surrogate models and pseudo-local optima in expensive multi-objective optimization problems.
method SVH-PSL integrates Stein Variational Gradient Descent (SVGD) with Hypernetworks to address fragmentation and pseudo-local optima.
result SVH-PSL significantly improves the quality of the learned Pareto set, offering a promising solution for expensive MOO.
Delta-AI speeds up inference in sparse PGMs by local credit assignment.
problem Efficient inference in sparse probabilistic graphical models.
method Local credit assignment in agent's policy learning objective.
result Trained sampler recovers marginals and conditional distributions.
We present a distributed proximal-gradient method for optimizing the average of convex functions, each of which is the private local objective of an agent in a network with time-varying topology. The local objectives have distinct differentiable components, but they share a common nondifferentiable component, which has…
Optimizers find approximate global minima in non-convex problems.
problem Understanding why local methods solve non-convex optimization problems.
method Formalizing the hypothesis that many local minima are approximately global minima.
result Most local minima of practical non-convex objectives are approximately global minima.
In the present paper, we consider local moves on classical and welded diagrams: (self-)crossing change, (self-)virtualization, virtual conjugation, Delta, fused, band-pass and welded band-pass moves. Interrelationship between these moves is discussed and, for each of these move, we provide an algebraic classification. …
Local adaptive methods in FL can accelerate convergence but introduce bias, which is corrected.
problem The effect of using adaptive optimization methods for local updates in federated learning.
method Proposed correction techniques to overcome the bias introduced by local adaptive methods.
result Correction techniques can achieve faster convergence and higher test accuracy than baseline methods.
A Jet groupoid R_q over a manifold X is a special Lie groupoid consisting of q-jets of local diffeomorphisms from X to X. As a subbundle of the q-th order jet bundle of the trivial bundle X times X, a jet groupoid can be considered as a nonlinear system of partial differential equations (PDE). This leads to the concept…
New computational methods improve clustering of objects.
problem Clustering objects based on their joint occurrence in sets.
method Genetic algorithm with renumbering, local search, and simplified model.
result Improvements enhance computational performance of genetic algorithm.
Paper presents a WiFi-based indoor sensor localization technique.
problem Indoor localization in wireless sensor networks.
method Zoning-based localization using statistical learning.
result Efficient sensor zone determination in indoor environments.