Graph-Structured Cache improves code completion and variable naming tasks.
problem Learning open vocabulary in source code.
method Graph-Structured Cache for handling new words in code.
result Improves code completion and variable naming tasks by over 100%.
RLCache uses reinforcement learning to optimize cache management decisions.
problem Optimizing cache hit rate and storage size in computer systems.
method Designing three reinforcement learning agents for cache manager tasks and two advanced architectures.
result Reinforcement learning agents achieve higher cache hit rates and minimize storage space compared to heuristics.
A deep learning model predicts future cache accesses with high accuracy.
problem Improving cache management and performance through better prediction of future data accesses.
method Proposed a LSTM-based recurrent neural network model to predict future cache accesses using only a cache trace as input.
result The proposed model achieves high prediction accuracy and outperforms state-of-the-art practical policies.
Method learns software resource usage from snapshots.
problem Challenges in learning time-varying, correlated resource usage.
method Graph structured Schrödinger bridge problem for nonparametric learning.
result Predicts most-likely resource distributions.
Parrot learns optimal cache replacement policies using imitation learning.
problem Improving cache hit rates in complex access patterns.
method Imitation learning approach using Belady's oracle policy.
result Parrot increases cache hit rates by 61% on a web search benchmark.
Adaptive caching strategy improves SVM training efficiency.
problem Expensive SVM training for large datasets.
method Proposed EFU and HCST caching strategies for kernel value reuse.
result HCST achieves 20% more reduction in training time.
Proposes a method to predict content preferences for mobile users in decentralized caching networks.
problem Determining caching schemes for decentralized caching networks with mobile traffic.
method Formulates content preference learning as a DRMTL problem, integrates mobility prediction, and uses ADMM for optimization.
result Mobility-aware content preference learning provides more accurate predictions and improved hit ratios.
DEAP Cache learns prefetching, eviction, and admission using machine learning.
problem Improving cache performance through better prefetching, eviction, and admission strategies.
method End-to-end pipeline using machine learning, inspired by pretraining on large corpora and online reinforcement learning.
result Optimal policy distribution between two orthogonal eviction strategies based on frequency and recency.
KVCOMM optimizes multi-agent LLM systems by reusing KV-caches, reducing redundant processing.
problem Substantial overhead from reprocessing overlapping contexts across multi-agent systems.
method KVCOMM reuses KV-caches and adjusts offsets for shared content using a pool of cached examples (anchors).
result Achieves over 70% reuse rate across diverse multi-agent tasks, up to 7.8x speedup.
Freezing intermediate layers reduces DNN inference latency.
problem High latency in deep learning inference due to computationally expensive models.
method Introduce approximate caching at each intermediate layer to avoid running all layers for many inference requests.
result Reduces the number of effective layers by half for 91.58% of CIFAR-10 requests.
New MAB model for online caching costs.
problem Learning costs of cached items online.
method Synchronization bandits, MirrorSync algorithm.
result Adversarial regret of O(T2/3) for MirrorSync. We developed a caching method to speed up concept learning in complex knowledge bases.
problem Complex concept learning requires many instance retrieval calls, increasing runtime.
method Semantics-aware caching that links concepts to instances via crisp set operations.
result Our cache reduces concept retrieval and learning runtime by an order of magnitude.
Training large-scale image recognition models is computationally expensive. This raises the question of whether there might be simple ways to improve the test performance of an already trained model without having to re-train or fine-tune it with new data. Here, we show that, surprisingly, this is indeed possible. The …
Paper tackles caching in fog radio access networks using RL.
problem Distributed edge caching in fog radio access networks with fluctuating traffic demands.
method Q-learning framework for optimal caching policy, value function approximation.
result Proposed method outperforms traditional methods in simulations.
New algorithm improves cache management with delayed feedback and decaying costs.
problem Improving cache replacement policies with delayed and decaying costs feedback.
method Proposed EXP4-DFDC adaptive reinforcement learning algorithm.
result Expected regret is a vanishing quantity as a function of time.
New method speeds up diffusion models without sacrificing quality.
problem Slow inference in diffusion models.
method Adams-Bashforth method for caching and acceleration.
result Achieved nearly 3x speedup with maintained quality.
This paper optimizes caching and model multiplexing for large model inference.
problem Resource consumption and latency challenges in large model deployment.
method Jointly optimizing a caching algorithm (GDSF or LEC) and a model multiplexer for large model inference.
result Achieves optimal rates in offline and online settings with up to 50x improvement over baseline.
A new method for energy-efficient file delivery in small cell networks.
problem Efficient resource management in femto-caching with time-variant statistical properties.
method Formulates a resource allocation problem as a stochastic knapsack problem and a multi-armed bandit problem, developing solutions for each.
result The proposed method maximizes the accumulated utility over the horizon, especially suitable for networks with time-variant statistical properties.
Bandana stores deep learning models using NVM with DRAM caching.
problem Reducing memory footprint of deep learning models stored on DRAM.
method Uses NVM as primary storage, DRAM as cache, hypergraph partitioning, and cache simulation.
result Significantly reduces the cost of ownership for storing deep learning models.
LATM framework uses LLMs to create and reuse tools for efficient problem-solving.
problem Improving problem-solving capabilities of LLMs with external tools.
method Closed-loop framework with two phases: tool making and tool using. LLMs act as both tool makers and users. Resource-intensive model for tool making, lightweight model for tool using.
result LATM framework achieves performance equivalent to using a powerful LLM for both roles but with significantly reduced costs.
FibQuant improves KV-cache compression for long-context inference.
problem Memory traffic bottleneck in long-context inference due to KV cache growth.
method Introduces FibQuant, a universal vector quantizer that combines Beta-quantile radii, Fibonacci/Roberts-Kronecker directions, and Lloyd-Max refinement.
result FibQuant achieves high compression rates with minimal loss in attention cosine similarity.
Optimizes parallel training of linear models, improving convergence.
problem Improving convergence of parallel training of linear models.
method Data partitioning scheme across threads to improve convergence.
result Achieved up to 42x speedup in convergence compared to state of the art implementations.
We address challenges of active learning under scarce informational resources in non-stationary environments. In real-world settings, data labeled and integrated into a predictive model may become invalid over time. However, the data can become informative again with switches in context and such changes may indicate un…
Research optimizes C++ patterns for HFT, reducing latency and improving profitability.
problem Optimizing latency-critical code for high-frequency trading systems.
method Creation of a Low-Latency Programming Repository, optimisation of trading strategy, implementation of Disruptor pattern.
result Significant performance improvements in speed and profitability.
This paper is about metric data structures in high-dimensional or non-Euclidean space that permit cached sufficient statistics accelerations of learning algorithms. It has recently been shown that for less than about 10 dimensions, decorating kd-trees with additional "cached sufficient statistics" such as first and sec…
Unified architecture for multi-modal multi-task learning using transformer.
problem Training multiple tasks concurrently with varying modalities.
method Spatio-temporal cache mechanism for multi-modal learning.
result Training multiple tasks together reduces model size by about three times.
Efficient DSP features reduce speech recognition memory usage.
problem Limited memory on DSPs for speech recognition.
method Developed efficient bottleneck features (BNFs) for DSPs.
result Reduced speech recognition memory usage by 10x with minimal accuracy loss.
Generating logical form equivalents of human language is a fresh way to employ neural architectures where long short-term memory effectively captures dependencies in both encoder and decoder units. The logical form of the sequence usually preserves information from the natural language side in the form of similar token…
In this paper, we propose several improvements on the block-coordinate Frank-Wolfe (BCFW) algorithm from Lacoste-Julien et al. (2013) recently used to optimize the structured support vector machine (SSVM) objective in the context of structured prediction, though it has wider applications. The key intuition behind our i…
Eigen-GNN enhances GNNs by preserving graph structures.
problem Existing shallow GNNs fail to effectively preserve graph structures.
method Integrates eigenspace of graph structures into GNNs as a dimensionality reduction module.
result Eigen-GNN boosts GNNs' ability to preserve graph structures without increasing depth.
Accelerates data loading in deep neural network training by 30x.
problem Data loading is a bottleneck in deep neural network training.
method Locality-aware data loading method using software caches.
result More than 30x speedup in data loading.
Graph attention auto-encoder reconstructs graph structure and attributes.
problem Lack of methods to reconstruct graph structure and node attributes in graph auto-encoders.
method Stacked encoder/decoder layers with self-attention mechanisms, regularized node representations to reconstruct graph structure.
result Competitive performance on node classification benchmarks, including inductive learning.
GraphTSNE visualizes graph data by integrating graph structure and node features.
problem Lack of suitable visualization techniques for graph-structured data.
method GraphTSNE combines t-SNE with graph convolutional networks to visualize graph data.
result GraphTSNE produces better visualizations of graph data compared to existing methods.
Proposes DIAL-GNN for joint graph structure and embedding learning.
problem Joint learning of graph structure and embeddings.
method Adapted graph regularization, iterative method for graph structure learning.
result Consistently outperforms state-of-the-art baselines in downstream tasks and computational time.
A new online learning algorithm for graph-structured sparsity.
problem Efficiently handling graph-structured sparsity constraints in online learning settings.
method Proposes extsc{GraphDA} algorithm that projects gradients and variables onto subspaces.
result Improves classification performance and captures graph-structured features effectively.
Paper accelerates K-means clustering for large sparse document data.
problem Efficiently clustering large-scale sparse document data.
method Designs an AFM algorithm leveraging UCs and inverted-index structure.
result Significantly improves clustering speed for large-scale documents.
Pipeline-aware hyperparameter tuning speeds up machine learning pipelines by reusing intermediate computations.
problem High computational burden in hyperparameter tuning of multi-stage pipelines.
method Proposes a hybrid hyperparameter tuning method and a caching problem formulated as an ILP to maximize reuse.
result Pipeline-aware approach offers over an order-of-magnitude speedup over independent evaluations.
Developing efficient and scalable algorithms for Latent Dirichlet Allocation (LDA) is of wide interest for many applications. Previous work has developed an O(1) Metropolis-Hastings sampling method for each token. However, the performance is far from being optimal due to random accesses to the parameter matrices and fr…
Investigates how neural network graph structure impacts predictive performance.
problem Lack of understanding between neural network graph structure and predictive performance.
method Developed relational graph representation to analyze neural networks, identifying a 'sweet spot' for improved performance.
result Identified a 'sweet spot' in relational graph structure that significantly improves neural network predictive performance.
This paper improves GNN robustness by aligning feature and adjacency matrix learning.
problem Improving robustness of graph neural networks (GNN) in noisy graph data.
method Proposes a novel regularized GSL approach that aligns feature information and graph information, incorporating sparse dimensional reduction.
result Demonstrates superior performance in noisy graph structures compared to competitive baselines.
Two new methods improve graph embedding without needing a complete graph structure.
problem Graph autoencoders' performance depends on the adjacency matrix quality.
method BAGE and VBAGE: unsupervised graph embedding via adaptive graph learning.
result The methods expand GAEs' applicability to datasets without graph structure.
Graph Convolutional Neural Networks (Graph CNNs) are generalizations of classical CNNs to handle graph data such as molecular data, point could and social networks. Current filters in graph CNNs are built for fixed and shared graph structure. However, for most real data, the graph structures varies in both size and con…
Efficiently combines autoregressive and set-based models for joint distributions.
problem Joint distributions over multiple predictions from set-based models.
method Causal autoregressive buffer that caches context and captures dependencies.
result Up to 20x faster joint sampling and density evaluation, up to 7x lower memory usage.
New method solves graph-structured sparsity problems efficiently.
problem Graph-structured sparsity optimization in complex models.
method Stochastic gradient-based approach for non-convex graph-structured sparsity.
result Linear convergence up to a constant error.
IVF k-means algorithm improves performance on large sparse data sets.
problem Efficiently clustering large-scale sparse data sets with numerous classes.
method Sparse data representation and inverted-file structure for high-speed and low-memory clustering.
result IVF achieves better performance than other algorithms on real document data sets.
Paper details Hilbert-curve for high-performance data mining.
problem Efficiently mapping multi-dimensional data to one dimension.
method Defines Hilbert-curve using finite automaton and context-free grammar.
result Cache-oblivious algorithms for matrix operations and clustering.
IDGL learns better graph structure and embeddings iteratively.
problem Improving graph neural network node embeddings and graph structure.
method Iterative Deep Graph Learning framework that dynamically stops when graph structure optimizes for downstream tasks.
result IDGL consistently outperforms state-of-the-art baselines on nine benchmarks.
Processes such as disease propagation and information diffusion often spread over some latent network structure which must be learned from observation. Given a set of unlabeled training examples representing occurrences of an event type of interest (e.g., a disease outbreak), our goal is to learn a graph structure that…