Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

237474710947 · Jun 202019922001200920182026
48 results for portable networks

This paper proposes a method to embed teacher knowledge into a student network without increasing parameters.

problem The need for portable neural networks on mobile devices with limited resources.
method Feature embedding approach to distill knowledge from a teacher network to a student network without introducing new parameters.
result The proposed method maintains the performance of the teacher network while significantly reducing computational and storage complexity.

A method distills GANs for mobile devices, reducing computation and storage.

problem Heavy computation and storage cost of GANs on mobile devices.
method Knowledge distillation to train a smaller generator with inherited information from a larger teacher generator, including a discriminator.
result Portable GAN models with strong performance achieved.

CodeReef enables sharing ML models across platforms efficiently.

problem Sharing and deploying ML models across different systems efficiently.
method Developed an open platform to share ML components, automate deployment, and benchmark models.
result Demonstrated efficient deployment and benchmarking of ML models across diverse platforms.

Many efforts have been made to use various forms of domain knowledge in malware detection. Currently there exist two common approaches to malware detection without domain knowledge, namely byte n-grams and strings. In this work we explore the feasibility of applying neural networks to malware detection and feature lear…

2017-09-05abs ↗pdf ↗

Improved malware detection by adding auxiliary loss terms to a neural network.

problem Malware detection accuracy with a single label.
method Fit deep neural networks to multiple auxiliary prediction targets derived from metadata.
result Significant improvement in detection performance, reducing false negatives by 42.6% at a low false positive rate.

Currently, deep neural networks are deployed on low-power portable devices by first training a full-precision model using powerful hardware, and then deriving a corresponding low-precision model for efficient inference on such systems. However, training models directly with coarsely quantized weights is a key step towa…

2017-06-07abs ↗pdf ↗

Deep neural networks bring in impressive accuracy in various applications, but the success often relies on the heavy network architecture. Taking well-trained heavy networks as teachers, classical teacher-student learning paradigm aims to learn a student network that is lightweight yet accurate. In this way, a portable…

2018-07-30abs ↗pdf ↗

Improved particle-flow event reconstruction for future colliders using scalable neural networks.

problem Efficient and accurate particle reconstruction in future particle detectors.
method Comparative study of scalable machine learning models (graph neural network and kernel-based transformer) for event reconstruction.
result Graph neural network model improves jet transverse momentum resolution by up to 50%.

We provide complete source code for building a fundamental industry classification based on publically available and freely downloadable data. We compare various fundamental industry classifications by running a horserace of short-horizon trading signals (alphas) utilizing open source heterotic risk models (https://ssr…

2017-06-13abs ↗pdf ↗

Research explores how to make models more robust to adversarial attacks.

problem Vulnerability of convolutional neural networks to adversarial examples and their transferability.
method Investigates the impact of lpl_p regularization, SVM top layer, and ensemble models on robustness and transferability.
result Models trained with different regularizers and ensemble models exhibit barriers to transferability.

A simple encoder and complex decoder for secure image encryption and decryption.

problem Secure and efficient image encryption and decryption.
method Uses a shallow encoder neural network for encryption and a deep decoder for decryption, trained independently.
result Decrypted images are nearly identical to the original, demonstrating the effectiveness of the framework.

Deep learning has delivered its powerfulness in many application domains, especially in image and speech recognition. As the backbone of deep learning, deep neural networks (DNNs) consist of multiple layers of various types with hundreds to thousands of neurons. Embedded platforms are now becoming essential for deep le…

2017-12-13abs ↗pdf ↗

New method reduces fine-tuning cost for reused models.

problem Repeating fine-tuning costs with outdated foundation models.
method Portable Reward Tuning (PRT) trains a reward model to maximize the same loss function as fine-tuning.
result PRT achieves comparable accuracy to inference-time tuning with less inference cost.

Recurrent neural networks have achieved excellent performance in many applications. However, on portable devices with limited resources, the models are often too large to deploy. For applications on the server with large scale concurrent requests, the latency during inference can also be very critical for costly comput…

2018-02-01abs ↗pdf ↗

In portable, 3-D, or ultra-fast ultrasound (US) imaging systems, there is an increasing demand to reconstruct high quality images from limited number of data. However, the existing solutions require either hardware changes or computationally expansive algorithms. To overcome these limitations, here we propose a novel d…

2017-10-27abs ↗pdf ↗

It is shown that certain diffeomorphism or homeomorphism groups with no restriction on support of an open manifold with finite number of ends are bounded. It follows that these groups are uniformly perfect. In order to characterize the boundedness several conditions on automorphism groups of an open manifold are introd…

2009-12-23abs ↗pdf ↗

Forward inference techniques such as sequential Monte Carlo and particle Markov chain Monte Carlo for probabilistic programming can be implemented in any programming language by creative use of standardized operating system functionality including processes, forking, mutexes, and shared memory. Exploiting this we have …

2014-03-03abs ↗pdf ↗

CK simplifies ML model deployment and reproducibility with open APIs and DevOps.

problem Making ML models reproducible and deployable across different environments.
method Decompose complex systems into reusable sub-components with unified APIs and DevOps principles.
result Automatically co-design and optimize ML models for speed, accuracy, energy, and size.

ECC compresses DNNs for energy-constrained devices like UAVs and smartphones.

problem Energy-constrained deep neural networks in vision applications.
method ECC uses a bilinear regression model to estimate DNN energy consumption and optimizes compression to meet energy constraints.
result ECC achieves higher accuracy under the same or lower energy budget compared to state-of-the-art techniques.

As the Portable Document Format (PDF) file format increases in popularity, research in analysing its structure for text extraction and analysis is necessary. Detecting headings can be a crucial component of classifying and extracting meaningful data. This research involves training a supervised learning model to detect…

2018-08-31abs ↗pdf ↗

Deep learning models accurately recognize and estimate physical activity types and energy expenditure from wrist accelerometer data.

problem Rigorous evaluation of wrist-worn accelerometers for assessing physical activity across the lifespan.
method Built deep learning networks to extract spatial and temporal representations from time-series data, recognizing physical activity types and estimating energy expenditure.
result Deep learning models achieved high performance: F1 scores of 0.82, 0.81, and 95 for sedentary, locomotor, and lifestyle activities, respectively; root mean square error of 1.1 for EE estimation.

SWALP averages SGD iterates for low-precision training, improving scalability and performance.

problem Improving scalability and performance in low-precision training.
method Averages low-precision SGD iterates with a modified learning rate schedule.
result SWALP matches full-precision SGD performance with 8-bit quantization and converges to optimal solutions.

SOL is an open-source library for scalable online learning algorithms, and is particularly suitable for learning with high-dimensional data. The library provides a family of regular and sparse online learning algorithms for large-scale binary and multi-class classification tasks with high efficiency, scalability, porta…

2016-10-28abs ↗pdf ↗

A simple CNN architecture outperforms complex ones in P300 detection.

problem Efficiently detecting P300 component from EEG signals.
method Used a simple CNN architecture with a single depthwise separable 1D convolutional layer followed by a fully connected Sigmoid neuron.
result A single depthwise separable 1D convolutional layer with four filters achieved competitive performance.

This work proposes a complete 8-bit quantization framework for large-scale deep neural networks.

problem Training large-scale deep neural networks with high performance and low memory footprint.
method WAGEUBN framework that quantizes all data paths including weights, activations, gradients, errors, updates, and batch normalization.
result Achieves competitive accuracy on the ImageNet dataset using only 8-bit integers.

We introduce an innovative theoretical framework to model derivative transactions between defaultable entities based on the principle of arbitrage freedom. Our framework extends the traditional formulations based on Credit and Debit Valuation Adjustments (CVA and DVA). Depending on how the default contingency is accoun…

2011-12-07abs ↗pdf ↗

AR-GANs learn depth and DoF from unlabeled images using aperture rendering and focus cues.

problem Learning depth and DoF from unlabeled natural images with diverse viewpoints and shapes.
method Aperture rendering and focus cues to learn depth and DoF from unlabeled images.
result AR-GANs effectively learn depth and DoF from various datasets, including flower, bird, and face images.