arXiv research

Galen algorithm compresses neural networks for specific hardware with reduced latency.

Reduces policy space complexity for reinforcement learning.

Compressed imitation learning uses simplicity priors for efficient expert behavior copying.

Option Encoder compresses reinforcement learning options into a policy basis.

While bigger and deeper neural network architectures continue to advance the state-of-the-art for many computer vision tasks, real-world adoption of these networks is impeded by hardware and speed constraints. Conventional model compression methods attempt to address this problem by modifying the architecture manually …

Real-time policy distillation speeds up and improves reinforcement learning.

TOCO framework compresses neural networks based on tolerance analysis.

Meta learning optimizes neural network quantization for efficient inference.

Image compression is an essential approach for decreasing the size in bytes of the image without deteriorating the quality of it. Typically, classic algorithms are used but recently deep-learning has been successfully applied. In this work, is presented a deep super-resolution work-flow for image compression that maps …

Unified strategy for efficient data compression and model estimation.

NAC-FL optimizes model updates in FL systems by adapting compression to network congestion.

A generative recurrent neural network is quickly trained in an unsupervised manner to model popular reinforcement learning environments through compressed spatio-temporal representations. The world model's extracted features are fed into compact and simple policies trained by evolution, achieving state of the art resul…

While deep reinforcement learning has successfully solved many challenging control tasks, its real-world applicability has been limited by the inability to ensure the safety of learned policies. We propose an approach to verifiable reinforcement learning by training decision tree policies, which can represent complex p…

Joint replacement is the most common inpatient surgical treatment in the US. We investigate the clinical pathway optimization for knee replacement, which is a sequential decision process from onset to recovery. Based on episodic claims from previous cases, we view the pathway optimization as an intelligence crowdsourci…

Novel algorithms for multi-agent reinforcement learning reduce sample complexity.

We explore building generative neural network models of popular reinforcement learning environments. Our world model can be trained quickly in an unsupervised manner to learn a compressed spatial and temporal representation of the environment. By using features extracted from the world model as inputs to an agent, we c…

This work proposes ACTC for adaptive distributed learning under communication constraints.

Prototype for adaptive electron microscopy scans reduces dose and time.

Improved deep learning model deployment on tiny MCUs with mixed-precision quantization.

Many problems in sequential decision making and stochastic control often have natural multiscale structure: sub-tasks are assembled together to accomplish complex goals. Systematically inferring and leveraging hierarchical structure, particularly beyond a single level of abstraction, has remained a longstanding challen…

Signed compression progress on a sealed audit is goodhart-resistant.

In this paper we study a model-based approach to calculating approximately optimal policies in Markovian Decision Processes. In particular, we derive novel bounds on the loss of using a policy derived from a factored linear model, a class of models which generalize numerous previous models out of those that come with s…

A new method for solving complex sequential decision-making problems by decomposing them into multiple levels.

Random layer-wise pruning profiles are as effective as metric-based ones for various datasets.

AgensFlow learns multi-agent coordination policies from experience.

Flexible framework compresses models using LC algorithm.

Reduces multiclass and regression compression schemes to binary ones.

Proposes a link between randomness and compression in deep learning.

Unified framework for non-compressed networks from compression bounds.

Paper introduces a new adaptive gradient method with gradient compression for distributed training.

The (isothermic) compressibility of lattice knots can be examined as a model of the effects of topology and geometry on the compressibility of ring polymers. In this paper, the compressibility of minimal length lattice knots in the simple cubic, face centered cubic and body centered cubic lattices are determined. Our r…

HiLLoC compresses large images losslessly using VAEs.

Large-scale computational experiments, often running over weeks and over large datasets, are used extensively in fields such as epidemiology, meteorology, computational biology, and healthcare to understand phenomena, and design high-stakes policies affecting everyday health and economy. For instance, the OpenMalaria f…

Neural NCD reveals LLMs don't compress well for classification.

BDC compresses both sample size and dimensionality of large datasets.

Reinforcement Patching optimizes dynamic sequence patching for efficient time series forecasting.

DoCoFL compresses model updates for cross-device federated learning.

Compressing neural nets is an active research problem, given the large size of state-of-the-art nets for tasks such as object recognition, and the computational limits imposed by mobile devices. We give a general formulation of model compression as constrained optimization. This includes many types of compression: quan…

New taxonomy and evaluation of neural network compression methods.

Proposes a method to train neural networks directly on compressed text data.

Study shows LLC correlates with neural network compressibility.

Gradient descent with compressed iterates reduces model size for federated learning.

Paper proposes SCALLION and SCAFCOM for compressed FL with reduced communication.

New uncertainty principle limits compression in distributed learning, suggesting optimal methods.

Recurrent Neural Networks (RNN) can be difficult to deploy on resource constrained devices due to their size.As a result, there is a need for compression techniques that can significantly compress RNNs without negatively impacting task accuracy. This paper introduces a method to compress RNNs for resource constrained e…

Proposes a new RL method to fine-tune flow-based models with arbitrary rewards.

Proposes a new linearity-based neural network compression method.

Paper compresses RNNs for resource-constrained devices.