New algorithms for learning from sensor data in networks with limited communication.
problem Learning from high-rate data streams in networked systems with limited communication.
method Distributed stochastic approximation mirror descent (D-SAMD) and accelerated distributed stochastic approximation mirror descent (AD-SAMD) algorithms.
result Order-optimum convergence of distributed learning schemes even with small communication rates in well-connected networks.
Paper studies deep learning attacks on online APIs with limited data.
problem Adversarial machine learning threats on online APIs with strict rate limitations.
method Develops an active learning approach to build adversarial classifiers with limited training data.
result Active learning can build adversarial classifiers with small statistical difference from target classifiers using limited data.
Sharp theory of neural network scaling laws for hierarchical targets.
problem Learning hierarchical multi-index models in neural networks.
method Sharp information-theoretic scaling laws derived for two-layer neural networks.
result Optimal rates achieved by a simple spectral estimator.
The purpose of this paper is to study the property of the resolvent of the Laplace-Beltrami operator on a noncompact complete Riemannian manifold with various ends each of which has a different limit of the growth rate of the Riemannian measure at infinity, in particular, focusing on the limiting absorption principle. …
Accelerates data loading in deep neural network training by 30x.
problem Data loading is a bottleneck in deep neural network training.
method Locality-aware data loading method using software caches.
result More than 30x speedup in data loading.
Natural gradient descent is a robust optimization method for machine learning.
problem Training poorly parameterized networks efficiently.
method Optimization algorithms with natural transformation properties.
result Optimization algorithms with natural transformation properties are more efficient for poorly parameterized networks.
This paper explores collaborative information bottleneck for multi-source scenarios.
problem Fundamental limits of collaborative information extraction in multi-source scenarios.
method Two-way Collaborative Information Bottleneck (TW-CIB) and Collaborative Distributed Information Bottleneck (CDIB) problems.
result Derivation of inner and outer bounds to the complexity-relevance region for TW-CIB and CDIB.
Infinitesimal boosting converges to a deterministic process in large sample limit.
problem Characterizing the asymptotic behavior of infinitesimal gradient boosting in large sample sizes.
method Proving convergence to a deterministic process using large sample theory and differential equations.
result The test error decreases over time in the population limit.
Paper confirms Thom's conjecture for nonlinear evolutions on manifolds.
problem Thom's gradient conjecture for nonlinear evolution equations.
method Extending and settling the conjecture in infinite dimensional problems using Łojasiewicz, L. Simon, and Kurdyka-Mostowski-Parusinski's foundational works.
result Uniqueness of the limiting direction and characterization of convergence rates for both classical and infinite dimensional settings.
Generative GAN improves classifier performance with limited training data.
problem Limited training data for black-box API attacks.
method Generative adversarial network (GAN) to generate synthetic training data.
result Improves classifier performance with synthetic data.
GTNs generate training data to accelerate AI learning.
problem Speeding up AI learning through better training data.
method Generative Teaching Networks (GTNs) learn to generate synthetic training data.
result GTNs accelerate AI learning and NAS evaluations.
MARLA uses deep reinforcement learning for multi-agent AHT, reducing Bayes risk.
problem Decentralized active hypothesis testing among multiple agents.
method MARLA algorithm using deep multi-agent reinforcement learning.
result MARLA outperforms single-agent learning in AHT problems.
Study on costs of manipulating AMM-based price oracles.
problem Cost of manipulation in AMM-based on-chain price oracles.
method Analyzes the robustness of AMM-based oracles to strategic manipulation, considering different aggregation methods and market conditions.
result Manipulation costs depend on the total quote depth and can be minimized by optimal liquidity weights.
UVeQFed tackles FL model compression over limited channels.
problem Efficiently transmitting trained models over rate-constrained channels.
method Universal vector quantization for FL (UVeQFed).
result UVeQFed minimizes distortion and converges to optimal model.
Paper uses RL to optimize insurance pricing on PCWs, improving efficiency and adaptability.
problem Optimizing pricing on price comparison websites while balancing competitiveness and profitability.
method Integrates model-based and model-free reinforcement learning methods for dynamic pricing.
result Hybrid RL agent outperforms existing methods in sample efficiency and cumulative reward.
Tail-Safe hedging uses reinforcement learning with a safety layer to manage financial risks.
problem Managing financial risks in derivatives trading with robustness and explainability.
method Combines distributional reinforcement learning with a CBF-QP safety layer to enforce financial constraints.
result Improves risk management without degrading central performance and avoids hard constraint violations.
Differentially quantized gradient methods improve convergence in noisy communication channels.
problem Optimizing distributed learning with limited communication bandwidth and noise.
method Introduces Differential Quantization (DQ) to compensate for quantization errors in gradient descent.
result DQ-GD achieves the same contraction factor as unquantized GD at high bitrates, proving asymptotic optimality.
Optimal buying and selling times for homes in fluctuating interest rates.
problem Maximizing profit from buying and selling homes in a market with variable interest rates.
method Nested optimal stopping problem solved using a nonnegative concave majorant approach.
result Investor's optimal buying and selling strategies derived for CIR interest rates.
Survey on deep learning for social network analysis.
problem Encoding social network data into useful low-dimensional representations.
method Review of neural network models for node and subgraph embeddings in various network types.
result Advancements in deep learning for complex network analysis.
RFN improves GCNs for road networks, outperforming state-of-the-art by 21%-40%.
problem Leveraging the structure of road networks effectively in machine learning tasks.
method Introducing RFN, a novel GCN specifically designed for road networks.
result RFN outperforms state-of-the-art GCNs by 21%-40% on road network tasks.
New model reconstructs networks by identifying regular components.
problem Uncovering the complexity of network structures.
method Low-rank pursuit based self-representation network model.
result Reconstructs networks and measures their regulability.
Algorithm reconstructs conserved networks from flow data.
problem Network reconstruction from flow data.
method Polynomial time algorithm exploiting graph theoretic properties and learning techniques.
result Exact network reconstruction possible for arborescence networks.
This survey clarifies dynamic network terminology and reviews GNN models for dynamic networks.
problem Ambiguity in dynamic network terminology and lack of GNN models for dynamic networks.
method Established consistent terminology and notation for dynamic networks, reviewed GNN models.
result Comprehensive survey of dynamic graph neural network models.
DCNs mimic neuronal networks for improved neural classification.
problem Lack of topological similarity between DNNs and biological neural networks.
method Developed DCNs with topologies inspired by real-world neuronal networks.
result High classification accuracy achieved by DCNs.
Study 986 diverse networks to reveal structural diversity across domains.
problem Understanding structural diversity in networks across various domains.
method Machine learning techniques (random forest, confusion matrix) on 986 real-world networks and 575 generated networks.
result Networks in the same partition have similar underlying functions, constraints, and generative mechanisms, regardless of their origins.
Network recasting transforms network architecture for faster inference.
problem Accelerate inference process through network transformation.
method Block-wise recasting of source blocks in a teacher network to target blocks in a student network.
result Transforms network architecture while preserving accuracy and reducing inference time.
Highly accurate classification of network categories achieved.
problem Distinguishing between different types of networks (e.g., social vs. web graphs).
method Used a random forest classifier on both real-world and synthetic networks.
result Achieved a 94.2% classification accuracy.
Network Lens identifies node behaviors in heterogeneous networks with high accuracy.
problem Identifying different behaviors in various parts of large heterogeneous networks.
method Zoom into network using different-sized lenses to capture local structure, weight signatures to predict node labels.
result Achieved a peak accuracy of ~42% on two networks with ~100,000 and ~1,000,000 nodes, significantly better than random.
DANE adapts network embeddings across multiple domains.
problem Learning embeddings for multiple networks without transferability.
method Graph Convolutional Network with adversarial learning.
result DANE achieves superior performance in cross-network domain adaptation.
Capsule networks are vulnerable to adversarial attacks, similar to convolutional neural networks.
problem Vulnerability of capsule networks to adversarial attacks.
method Compared capsule networks to convolutional neural networks using various adversarial attacks.
result Capsule networks are vulnerable to adversarial attacks, similar to convolutional neural networks.
Chemical networks outperform spiking neural networks in classification tasks.
problem Learning tasks with spiking neural networks require hidden layers, which are computationally expensive.
method Used deterministic mass-action kinetics to prove chemical reaction networks without hidden layers can solve tasks previously solved by spiking neural networks.
result A chemical reaction network without hidden layers outperforms a spiking neural network with hidden layers in a handwritten digit classification task.
Deep ReLU networks can be simplified to a three-layer model.
problem Understanding the behavior of deep neural networks.
method Constructive proof and algorithm to transform deep networks into shallow ones.
result Deep ReLU networks can be represented by a simpler three-layer structure.
Tackles network structure inference from time series data using GNN.
problem Inferring network structure from incomplete or no information.
method Gumbel Graph Network (GGN) model for network reconstruction and completion.
result GGN can reconstruct up to 100% network structure and infer missing parts with up to 90% accuracy.
Paper proposes algorithms for embedding directed networks with text associated nodes.
problem Learning embeddings for directed networks with text associated nodes.
method PCTADW-1 and PCTADW-2 neural network algorithms.
result Embeddings improve node classification quality on software package dependency networks.
Evolutionary synthesis of deep neural networks improves efficiency and performance.
problem Creating highly efficient deep neural networks.
method Evolutionary process using synaptic probability models and random mutation.
result Synthesized networks achieve state-of-the-art performance with 48-fold fewer synapses.
Network embedding helps predict speed limits on incomplete Danish road network.
problem Incomplete speed limit data on Danish roads limits machine learning applications.
method Applied node2vec network embedding to Danish road network.
result Network embedding can derive useful features for predicting speed limits.
New method identifies common organizational principles in networks.
problem Challenging to cluster networks of different size and density.
method Introduces a new network comparison methodology.
result Identifies common organizational principles in networks.
This paper explores loss landscapes of sparse neural networks, finding unique characteristics compared to dense networks.
problem Understanding the loss landscape of sparse neural networks, especially one-hidden-layer networks.
method Analyzes sparse networks with dense and sparse final layers, focusing on linear and non-linear models.
result Sparse networks can have no spurious valleys under certain conditions, but spurious valleys and minima can exist for wide sparse networks.
New approach learns latent motifs in networks for mesoscale structure analysis.
problem Understanding large-scale behavior in complex systems through mesoscale structures.
method Network dictionary learning (NDL) combining network sampling and nonnegative matrix factorization.
result Networks can be approximated using a small set of latent motifs.
The paper surveys network methods for understanding economic and financial systems.
problem Understanding interconnectedness among economic and financial entities.
method Survey of network theory, measures, and structures for economic and financial networks.
result Network methods provide tools to quantify structural properties of economic systems.
Researchers develop a method to count and analyze motifs in temporal networks.
problem Understanding the role of network motifs in temporal networks.
method Developed a notion of temporal network motifs and designed fast algorithms for counting them.
result Different motifs occur at different time scales, providing insights into temporal network structure and function.
Paper links network Lasso to network flow optimization.
problem Joint clustering and optimization of networked data.
method Exploration of duality between network Lasso and network flow optimization.
result nLasso is equivalent to a minimum-cost flow problem on the data network structure.
SyNGLER generates synthetic networks efficiently while preserving key structural properties.
problem Efficiently generating realistic synthetic networks with preserved structural properties.
method SyNGLER uses latent space network models to learn and reconstruct node embeddings, then generates synthetic networks.
result SyNGLER produces synthetic networks that better preserve key network characteristics than existing approaches.
Paper introduces method to make neural networks symmetrical.
problem Creating symmetrical neural networks for data with inherent symmetries.
method Introduces a method for modifying neural networks to enforce equivariance.
result Group convolutional neural networks are a special case of the introduced framework.
Deep networks better approximate functions with compositional structure.
problem Approximating functions with complex structures.
method Design deep networks with compositional structure, leveraging the blessing of compositionality.
result Deep networks can approximate functions better than shallow networks when the function has a compositional structure.
Secret neural networks hidden within trained models.
problem Excess capacity in neural networks allows embedding secret models.
method Novel framework for hiding secret neural networks within carrier networks.
result Detection of hidden networks is computationally infeasible.
Survey on learning network representations to simplify complex data analysis.
problem Complex relationships in large-scale networks are hard to analyze computationally.
method Network representation learning embeds vertices into a low-dimensional vector space to preserve topology and content.
result Improved analysis of network data through embedding techniques.
DeepMNE learns multi-network node features for better classification.
problem Learning node features across multiple networks.
method Semisupervised autoencoder for multi-network topology.
result DeepMNE outperforms state-of-the-art methods in node classification.