CuLE accelerates reinforcement learning on GPUs.
problem Limited CPU-GPU communication bandwidth in Atari Learning Environment.
method CUDA port of ALE, leveraging GPU parallelization and direct frame rendering.
result Up to 155M frames per hour on a single GPU, accelerating reinforcement learning.
A Python package for GPU-accelerated signature kernel computation.
problem Efficient computation of signature kernels for sequential data.
method GPU-accelerated algorithms and tensor sketches.
result New algorithm outperforms existing methods.
RFX accelerates and compresses Random Forests for large datasets.
problem Memory bottleneck in proximity matrices limits Random Forest analysis.
method QLORA compression, CPU TriBlock storage, GPU batch sizing, 3D MDS visualization.
result Proximity-based Random Forest analysis on larger datasets is feasible.
UMAP speeds up significantly with GPU acceleration.
problem Efficient GPU implementation of UMAP.
method Various techniques to optimize UMAP for GPU, including data partitioning and parallelization.
result Up to 100x speedup in practice.
XGBoost accelerates machine learning on GPUs.
problem Training large datasets efficiently on GPUs.
method Multi-GPU gradient boosting with data compression and end-to-end GPU parallelism.
result Processed 115 million instances in 3 minutes.
In this work, we present an extension of Gaussian process (GP) models with sophisticated parallelization and GPU acceleration. The parallelization scheme arises naturally from the modular computational structure w.r.t. datapoints in the sparse Gaussian process formulation. Additionally, the computational bottleneck is …
SparseRT accelerates sparse computations on GPUs for deep learning inference.
problem Efficiently handling unstructured sparsity patterns on GPUs for deep learning.
method SparseRT, a code generator that leverages unstructured sparsity for accelerating sparse linear algebra operations.
result Geometric mean speedups of 3.4x at 90% sparsity and 5.4x at 95% sparsity for 1x1 convolutions and fully connected layers.
New GPU kernels boost deep learning speed and memory efficiency.
problem Sparse deep learning matrices are not well-suited for existing sparse kernels.
method Identified favorable properties of sparse matrices from deep learning, developed high-performance GPU kernels for sparse matrix operations.
result 27% of single-precision peak performance on Nvidia V100 GPUs achieved with new kernels.
This paper accelerates sparse CNN layers on GPUs by using unstructured sparsity.
problem Efficiency of sparse CNN layers on GPUs.
method Direct sparse operation and reduced precision.
result Achieving up to 90% sparsity in deep CNN models improves efficiency.
Nested Slice Sampling accelerates Nested Sampling for GPU acceleration.
problem Challenging inference for complex, multimodal targets.
method Vectorized Nested Slice Sampling using Hit-and-Run Slice Sampling.
result NSS maintains accurate evidence estimates and high-quality posterior samples, robust on multimodal problems.
Differentiable voxelization for 3D meshes with GPU acceleration.
problem Efficient and accurate voxelization of 3D meshes.
method Differentiable voxelization using winding number and solid angles, with GPU acceleration and neural network deformation.
result State-of-the-art performance in accuracy and efficiency on the ShapeNet dataset.
GPU-accelerates multiuser detection for 5G URLLC systems.
problem Efficiently detecting payloads in OFDM frames with ultra-low latency.
method Implemented partially linear multiuser detection in RKHSs on a GPU-accelerated platform.
result Sub-millisecond latency detection in 5G URLLC systems.
TorchKM: A GPU-Oriented Library for Kernel Learning and Model Selection
problem Kernel learning and model selection
method GPU acceleration
result Competitive predictive performance with speedups
GPyTorch accelerates GP inference using GPU hardware.
problem Inefficient GP inference tools on modern hardware.
method Blackbox Matrix-Matrix (BBMM) inference with GPU acceleration.
result Significant speedup in GP inference and approximations.
GPU-accelerated particle methods outperform neural samplers in LFT benchmarks.
problem High-dimensional multimodal sampling problems in lattice field theory.
method GPU-accelerated particle Monte Carlo methods (Sequential Monte Carlo and nested sampling).
result These methods match or outperform neural samplers in sample quality and wall-clock time.
A new optimizer combines Newton and ADMM for faster classification.
problem Slower convergence of first-order methods in distributed learning.
method Integrates GPU-accelerated Newton solver with ADMM for multiclass classification.
result Significantly reduces the time to solution and generalization error.
FPGAs accelerate DNNs with binarized weights, improving power and speed.
problem Power and speed limitations of GPU-accelerated DNNs.
method Binarized neural networks on FPGAs using OpenCL.
result Near state-of-the-art performance with >16x power savings.
Efficient kernel methods for large datasets using GPU acceleration.
problem Handling large-scale nonparametric learning problems efficiently.
method Preconditioned gradient solver, GPU acceleration, parallelization, out-of-core linear algebra, numerical precision optimization.
result Dramatic speedups on datasets with billions of points, maintaining state-of-the-art performance.
torchsom simplifies SOMs in PyTorch with GPU acceleration and scikit-learn API.
problem Efficient implementation and usability of SOMs in PyTorch.
method PyTorch backend, GPU acceleration, scikit-learn API, 90% test coverage.
result Ease of use and scalability for SOMs in PyTorch.
Framework optimizes cloud container sizing for ML tasks.
problem Challenges in cloud container configuration for ML services.
method Autonomous scaling using nested-loop Monte Carlo simulation.
result Reduces compute cost and accelerates ML algorithms.
GPU acceleration speeds up i-vector extraction 3000x, enabling new research.
problem Speeding up i-vector extraction for speaker verification.
method GPU acceleration for i-vector extraction, including re-computing UBM and frame alignments.
result Significant speed-up allows rigorous study of i-vector variations.
New GPU algorithm boosts machine learning with larger datasets.
problem Limited GPU memory restricts training data size.
method Out-of-core GPU gradient boosting algorithm.
result Training larger datasets on GPUs without accuracy loss.
This paper benchmarks and optimizes GBDT algorithms using GPU acceleration.
problem Maximizing predictive power of GBDT models through efficient hyper-parameter tuning.
method Evaluation of GPU acceleration in XGBoost, LightGBM, and Catboost; comparison of hyper-parameter optimization.
result GPU acceleration significantly speeds up hyper-parameter optimization and generalization performance.
t-SNE-CUDA accelerates visualization of large datasets on GPUs.
problem Efficiently visualizing high-dimensional datasets and models.
method GPU-accelerated t-SNE implementation.
result Significant speedups (50-700x) on large datasets.
In this paper, we present a novel massively parallel algorithm for accelerating the decision tree building procedure on GPUs (Graphics Processing Units), which is a crucial step in Gradient Boosted Decision Tree (GBDT) and random forests training. Previous GPU based tree building algorithms are based on parallel multi-…
The paper optimizes neural network inference on mobile GPUs.
problem Limited computing power and thermal constraints on mobile CPUs.
method Leverage mobile GPUs for neural network inference.
result Real-time inference of deep neural networks on Android and iOS devices.
cuRegOT accelerates GPU-based entropic OT solving.
problem Slow convergence and high computational cost of optimal transport on GPUs.
method High-performance GPU solver with algorithmic and architectural optimizations.
result Significant speedups over state-of-the-art solvers.
Extends GENO framework for GPU optimization of constrained ML problems.
problem Constrained optimization in classical machine learning.
method Extends GENO framework to GPU optimization, specifying problems in a modeling language.
result Solvers on GPU outperform state-of-the-art approaches by several orders of magnitude.
aweSOM accelerates SOM clustering for large datasets.
problem Scalability issues in existing SOM implementations for large, multidimensional data.
method CPU/GPU-accelerated Self-organizing Maps (SOM) with ensemble stacking.
result 10-100x speed up and improved memory efficiency for large datasets.
CytonRL is an open-source toolkit for reinforcement learning.
problem Improving efficiency and performance in reinforcement learning.
method Implemented four deep Q-learning algorithms in C++ with GPU acceleration.
result Achieves competitive performance on Atari games.
Efficiently trains large models on limited-memory accelerators.
problem Training large-scale machine learning models on limited-memory accelerators.
method Novel algorithmic building block using primal-dual coordinate methods and duality gap information.
result Order-of-magnitude speedup for training generalized linear models on large datasets.
GPU acceleration speeds up financial machine learning training time.
problem Time-intensive classifier training in financial machine learning.
method Deployed NVIDIA GPUs for parallel high-speed arithmetic operations.
result Significantly faster training time achieved.
DANCE optimizes neural network and accelerator design for faster, more efficient DNN execution.
problem Challenges in optimizing neural network and accelerator design for efficient DNN execution.
method Differentiable approach to co-exploration of accelerator and network architecture design.
result Significantly shorter time to achieve superior accuracy and hardware cost metrics.
MIOpen optimizes deep learning operators for GPUs, accelerating research.
problem Optimizing deep learning operators for efficient GPU execution.
method Highly optimized implementations, fusion, auto-tuning, bfloat16 support.
result Accelerates time to discovery in deep learning research.
GPU speeds up Monte Carlo simulations for large time steps.
problem Slow convergence and inaccurate solutions with large time steps in Monte Carlo simulations.
method Generalizes the Seven League scheme for GPU acceleration.
result Significantly improved computational speed.
GPU-optimized ES-RNN boosts time series forecasting speed by 322x.
problem Efficiently forecasting time series data.
method Vectorized GPU implementation of ES-RNN.
result Up to 322x speedup in training time.
BlosSOM improves data visualization for large datasets.
problem Insufficient performance of dimensionality reduction methods for large datasets.
method GPU-accelerated semi-supervised EmbedSOM algorithm.
result Produces high-quality visualizations with user control.
74.7 seconds to train ResNet-50 on ImageNet with 2,048 GPUs.
problem Training deep learning models on large mini-batches efficiently.
method Optimization methods applied to distributed deep learning.
result Top-1 validation accuracy of 75.08% with training time of 74.7 seconds.
New ML-based sorting algorithm for big data.
problem Sorting large datasets efficiently.
method Machine Learning approach to achieve O(N⋅M) complexity. result Significantly faster sorting for big data.
A GPU framework speeds up BnB for discrete optimization problems.
problem Optimizing large-scale discrete problems with GPU limitations.
method Parallel BnB nodes in GPU batches, using padding and custom kernels.
result One to two orders of magnitude speedup and zero optimality gap.
JAX-LOB simulates thousands of LOBs for RL training.
problem Efficient simulation of large LOBs for RL training.
method GPU-accelerated JAX implementation of LOB simulator.
result JAX-LOB processes thousands of LOBs in parallel with reduced processing time.
KineticSim accelerates financial market simulations 3406x over CPU.
problem Simulating financial markets at scale with multi-agent models is bottlenecked by sequential processing and GPU kernel overhead.
method Formalized and implemented a reusable parallel design pattern for iterative multi-agent reductions in thread-block shared memory.
result Achieved a peak throughput of over 54.7 billion agent-events per second, delivering 3406x speedup over CPU.
The graphics processing unit (GPU) has emerged as a powerful and cost effective processor for general performance computing. GPUs are capable of an order of magnitude more floating-point operations per second as compared to modern central processing units (CPUs), and thus provide a great deal of promise for computation…
Central bank influence in Wikipedia analyzed by largest world banks.
problem Analyzing influence and interactions of world banks in Wikipedia.
method Reduced Google matrix algorithm applied to English Wikipedia network.
result Goldman Sachs identified as central bank in Wikipedia network.
TensorNetwork speeds up quantum spin chain calculations using GPU.
problem Efficiently approximating ground states of quantum spin chains.
method Tree tensor network (TTN) algorithm implemented in TensorNetwork.
result Significant computational speed-ups using GPUs (up to 100x faster).
KataGo accelerates Go self-play learning by 50x.
problem Efficiently learning in large state spaces like Go.
method Improved AlphaZero process and architecture.
result 50x reduction in computation time.
Novel framework identifies pump-specific deterioration rates using Bayesian hierarchical hazard modeling and causal discovery.
problem Challenges in asset management due to heterogeneous deterioration rates in pump equipment.
method Bayesian hierarchical hazard modeling with causal discovery, GPU-accelerated No-U-Turn Sampling (NUTS), and DirectLiNGAM.
result Identified striking heterogeneity in deterioration rates, with negative effects 400 times larger than positive effects.
GPU-accelerated BART speeds up Bayesian regression.
problem Long running time of BART makes it impractical for large datasets.
method GPU-enabled implementation of BART.
result BART is now 200x faster on GPUs.