Ithemal predicts processor throughput from instructions, outperforming existing tools.
problem Accurately predicting processor throughput from instructions is challenging and time-consuming.
method Uses a hierarchical LSTM-based approach to predict throughput based on opcodes and operands of instructions in a basic block.
result Ithemal predicts throughput more accurately and faster than existing tools.
Improves matrix multiplication throughput for asymmetric bit-width operands.
problem Matrix multiplications between asymmetric bit-width operands, especially 8- and 4-bit, are not efficiently handled by existing SIMD instructions.
method Proposes a new SIMD matrix multiplication instruction that uses mixed precision on inputs (8- and 4-bit) and accumulates into 16-bit output, improving throughput.
result Offers 2x improvement in throughput compared to existing symmetric-operand-size instructions, with negligible overflow.
We propose a method for downlink coordinated multipoint (DL CoMP) in heterogeneous fifth generation New Radio (NR) networks. The primary contribution of our paper is an algorithm to enhance the trigger of DL CoMP using online machine learning. We use support vector machine (SVM) classifiers to enhance the user downlink…
Proposes a model for identifying 4G cells with network throughput problems.
problem Challenges in identifying 4G cells with network throughput issues due to network complexity and privacy concerns.
method Data-driven model using clustering and Deep Neural Networks (DNNs). Model parameters are learned from a small number of expert-labeled data. Multiple clustering models capture common features for problematic cells.
result The proposed model outperforms a simple classifier in identifying cells with network throughput problems.
New neural network models predict molecular properties without 3D geometry, speeding up high-throughput screening.
problem Predicting molecular properties for large, complex molecules without computationally expensive 3D geometry.
method Message-passing neural networks trained with and without 3D structural information.
result Message-passing neural networks achieve similar accuracy to state-of-the-art methods without 3D geometry.
Paper introduces OARF benchmark suite for federated learning systems.
problem Limited diversity in federated learning benchmarks.
method Characterizes OARF benchmark suite with diverse data and applications.
result Federated learning can effectively increase end-to-end throughput.
New algorithms speed up learning from large screens of proteins.
problem Lack of scaled data hampers biological machine learning.
method Optimized high throughput screens and generative models.
result Maximized information gain with consistent estimates of p(y∣x). High-throughput 3D control training system achieves 100,000 FPS.
problem Lack of efficient, single-machine reinforcement learning systems.
method Sample Factory combines asynchronous sampling and off-policy correction.
result Achieves 100,000 FPS on 3D control problems without sacrificing sample efficiency.
PRETZEL optimizes machine learning prediction serving systems for better performance.
problem Low latency, high throughput, and graceful performance degradation under heavy load in prediction serving systems.
method Introducing a novel white box architecture enabling both end-to-end and multi-model optimizations.
result Average 5.5x reduction in 99th percentile latency, 25x reduction in memory footprint, and 4.7x increase in throughput compared to state-of-the-art approaches.
New method classifies reticulocytes from red blood cells without labels.
problem Classifying reticulocytes from mature red blood cells without fluorescent labels.
method Unsupervised machine learning on morpho-rheological markers.
result Promising results in classifying reticulocytes from mature red blood cells.
Deep reinforcement learning boosts throughput in RF-powered cognitive radio networks.
problem Maximizing throughput in large-scale, decentralized RF-powered cognitive radio networks.
method Proposes deep reinforcement learning to find optimal policies for network throughput maximization.
result Deep reinforcement learning outperforms existing techniques in large-scale RF-CRN environments.
The paper optimizes LLM inference systems through queueing theory.
problem Efficient LLM inference for AI agents under various routing topologies.
method Developed a fluid-limit framework for multi-class batched processing networks under K-FCFS scheduling.
result Proved that work-conserving scheduling algorithms maximize throughput for LLM inference.
Paper proposes a deep Gaussian process for predicting formation energy of inorganic compounds.
problem High computational cost of quantum chemistry calculations for material design.
method Develops a deep Gaussian process emulator for quantum calculations using a novel molecular descriptor.
result Demonstrates that the approach can be implemented using a small dataset for prediction of formation energy.
Enhances high-throughput imaging of microtubule networks, improving clarity and consistency.
problem Fluorescence noise obscures microtubule structures in high-throughput imaging.
method CycleGAN learning to enhance low-resolution images of microtubule networks.
result CycleGAN effectively identifies microtubules with high accuracy (0.93+ AUC-ROC).
As Machine Learning (ML) applications increase in data size and model complexity, practitioners turn to distributed clusters to satisfy the increased computational and memory demands. Unfortunately, effective use of clusters for ML requires considerable expertise in writing distributed code, while highly-abstracted fra…
High-throughput machine learning predicts thousands of diagnosis codes with high accuracy.
problem Predicting disease risk for thousands of diagnosis codes at various time points.
method Training machine learning algorithms on EHR data to predict diagnosis risks.
result Achieved AUCs of 0.803 and 0.758 for 1 and 6-month predictions, respectively.
A new method selects inducing points to optimize high-throughput Bayesian optimisation.
problem Current inducing point selection methods sacrifice high-fidelity modeling of promising regions.
method Information-theoretic criterion to select inducing points maximizing global and maximum value uncertainties.
result Surrogate models support high-precision high-throughput Bayesian optimisation.
A central problem in neuroscience is reconstructing neuronal circuits on the synapse level. Due to a wide range of scales in brain architecture such reconstruction requires imaging that is both high-resolution and high-throughput. Existing electron microscopy (EM) techniques possess required resolution in the lateral p…
As high-throughput biological sequencing becomes faster and cheaper, the need to extract useful information from sequencing becomes ever more paramount, often limited by low-throughput experimental characterizations. For proteins, accurate prediction of their functions directly from their primary amino-acid sequences h…
High-speed model accurately simulates neuromorphic devices.
problem Accurately modeling stochastic synapses in large-scale neuromorphic systems.
method Generative vector autoregressive model based on resistive memory cell data.
result Fast, high-throughput model reproduces synaptic parameters and correlations.
Bayesian method improves hit identification in compound screening.
problem Identifying candidate hits from thousands to millions of compounds.
method Bayesian nonparametric modeling for cross-plate correlation and statistical strength.
result Significant improvements in hit identification sensitivity and specificity.
EB improves asset pricing by mining large strategies without lookahead bias.
problem Lack of unbiased asset pricing models with out-of-sample performance.
method Empirical Bayes applied to 136,000 long-short strategies.
result EB provides unbiased predictions with transparent intuition.
This paper evaluates quantization techniques for deep learning inference.
problem Reducing the size and improving inference of deep neural networks.
method Review and empirical evaluation of quantization parameters for various neural network models.
result 8-bit quantization maintains accuracy within 1% of floating-point models.
This paper improves neural network training performance by optimizing concurrency and operation scheduling.
problem Managing and scheduling fine-grained operations in neural network training for high performance.
method Extending TensorFlow runtime to enable automatic concurrency control and scheduling, using performance modeling.
result Achieved 33% average performance improvement on neural network models, up to 49%.
Small batch training improves deep neural network performance and stability.
problem Improving deep neural network performance and stability with limited computational resources.
method Experimental comparison of test performance for different mini-batch sizes, focusing on learning rate scaling and training duration.
result Best performance achieved for mini-batch sizes between 2 and 32, contrasting recent work advocating larger batch sizes.
New algorithm boosts deep learning training speed.
problem Efficiently train deep neural networks on large clusters.
method Synchronous distributed SGD with amortized inference model.
result Dynamic cutoff improves convergence and training time.
New algorithm tackles resource allocation in multi-armed bandits to balance speed and throughput.
problem Balancing speed and throughput in stochastic multi-armed bandits with limited resources.
method Proposes an algorithm that trades off between information accumulation and throughput.
result Upper bounds the time taken to find the best arm with a given target success probability.
KANEL combines models for early hit enrichment in virtual screening.
problem Assessing model accuracy in chemical bioactivity predictions.
method Ensemble workflow using Kolmogorov-Arnold Networks (KANs) and other models.
result Improves early hit enrichment metrics like PPV@N.
Automatically computes reference ranges for UK Biobank cardiac data.
problem Improving healthcare by discovering patterns in large-scale population data.
method Fully automatic pipeline for 3D cardiac MR image analysis.
result Statistically significant agreement between manual and automatic indexes.
Deep learning improves decoding of constrained sequence codes, reducing errors and increasing throughput.
problem Errors during transmission of constrained sequence codes.
method Deep learning, specifically MLP and CNN networks.
result Achieved low bit error rates close to MAP decoding and improved system throughput.
Many modern data sets are sampled with error from complex high-dimensional surfaces. Methods such as tensor product splines or Gaussian processes are effective/well suited for characterizing a surface in two or three dimensions but may suffer from difficulties when representing higher dimensional surfaces. Motivated by…
Hydra boosts efficiency for long-context reasoning in resource-constrained settings.
problem Quadratic complexity of transformers limits long-context reasoning in resource-constrained systems.
method Hydra uses a modular architecture with adaptive routing between sparse global attention, mixture-of-experts, and dual memories.
result Hydra achieves significant throughput and accuracy improvements for long-context reasoning.
CoinTossX is a low-latency, open-source matching engine for financial trading.
problem Efficiently matching orders in financial markets with low latency and high throughput.
method Developed in Java, orders submitted via UDP SBE, low-latency message transport (Aeron Media Driver). Separates order generation and matching.
result Demonstrated low-latency, high-throughput performance in various deployment scenarios.
Hi-RES framework extracts medical relations from articles and EHRs.
problem Manual annotation bottleneck in relation extraction.
method Labeling sentences, creating improved negative samples, using pretrained language models, and combining EHR embeddings.
result Significant accuracy increases in relation extraction, up to 0.998 for disorder-location relations.
IMPACT improves RL training speed without sacrificing sample efficiency.
problem Limited sample efficiency in scalable RL architectures.
method Proposes IMPACT, extending IMPALA with target networks, circular buffers, and truncated importance sampling.
result IMPACT achieves higher rewards and significantly reduces training time compared to IMPALA.
Safe autonomous decisions made with machine learning predictions using Conformal Decision Theory.
problem Safe decisions from imperfect machine learning predictions.
method Conformal Decision Theory framework for producing safe decisions.
result Safe decisions with provable statistical guarantees of low risk.
BSBO optimizes constraints for high-throughput experiments.
problem Optimizing high-throughput experiments with combinatorial constraints.
method Stochastic Bayesian optimization with submodular decomposition.
result BSBO outperforms heuristics in real-world protein datasets.
Recent advances in high-throughput cDNA sequencing (RNA-Seq) technology have revolutionized transcriptome studies. A major motivation for RNA-Seq is to map the structure of expressed transcripts at nucleotide resolution. With accurate computational tools for transcript reconstruction, this technology may also become us…
FPGA speeds up ICA by orders of magnitude.
problem Slow convergence of adaptive ICA algorithms.
method Equivariant adaptive separation via independence algorithm.
result FPGA implementation improves clock frequency and throughput.
The study explores statistical methods to interpret radiological models and identify key features.
problem Interpreting complex radiological models for clinical use.
method Exploration of statistical techniques to assess relationships between radiomic features.
result Identification of key relationships and features for improved interpretability.
Con-TS optimizes wireless link throughput with latency constraints.
problem Optimizing rate selection for wireless links with latency constraints.
method Proposes Con-TS, a constrained Thompson sampling algorithm for stochastic MAB problems.
result Con-TS achieves upper bounds on expected constraint violations and throughput loss.
MLPerf benchmarks ML training to drive performance improvements.
problem Unique challenges in ML training benchmarks.
method Developed MLPerf to overcome ML training's specific challenges.
result Quantitatively evaluated MLPerf's effectiveness.
Hybrid BFP-FP improves DNN training accuracy with 8.5x higher throughput.
problem Limited dynamic range of fixed-point arithmetic for DNN training convergence.
method Introducing HBFP, a hybrid BFP-FP approach.
result HBFP matches floating point's accuracy while delivering up to 8.5x higher throughput.
Elucidating the genetic basis of human diseases is a central goal of genetics and molecular biology. While traditional linkage analysis and modern high-throughput techniques often provide long lists of tens or hundreds of disease gene candidates, the identification of disease genes among the candidates remains time-con…
Deep learning models can take weeks to train on a single GPU-equipped machine, necessitating scaling out DL training to a GPU-cluster. However, current distributed DL implementations can scale poorly due to substantial parameter synchronization over the network, because the high throughput of GPUs allows more data batc…
BCAE-2D compresses 3D data from a time projection chamber at high speed.
problem Compressing high-speed, sparse 3D data from a time projection chamber.
method 2D Bicephalous Convolutional Autoencoder (BCAE-2D) approach.
result 3x speedup in compression throughput with improved reconstruction accuracy.
Paper discusses optimizing deep learning models for supercomputers.
problem Training deep learning models at high petaFLOPS scale.
method Three systems-related optimizations: distributed batch normalization, input pipeline, and 2-D torus all-reduce.
result Trained ResNet-50 on ImageNet to 76.3% accuracy in 2.2 minutes.
Deep learning predicts tissue properties from cell-laden hydrogels.
problem Predicting tissue properties from cell-laden hydrogels.
method Developed a process for generating mould designs, created a training set of 6500 cases, trained a deep learning model (pix2pix).
result Deep learning makes excellent predictions and is significantly faster than biophysical methods.