Convolutional Neural Network (CNN) based Deep Learning (DL) has achieved great progress in many real-life applications. Meanwhile, due to the complex model structures against strict latency and memory restriction, the implementation of CNN models on the resource-limited platforms is becoming more challenging. This work…
Unified framework for accelerating DNNs on resource-limited platforms.
problem Accelerating DNN execution on resource-limited platforms.
method Block-based pruning framework with reweighted regularization.
result First universal framework for both CNNs and RNNs with real-time acceleration and no accuracy compromise.
This paper investigates compression techniques for deep neural networks to reduce their size without sacrificing performance.
problem Compression of large deep neural networks for resource-limited platforms.
method Weight pruning, quantization, and lossless weight matrix representations based on source coding.
result Achieved up to 165 times compression rate while maintaining or improving model performance.
Proposes a new framework for resource-limited recommendation.
problem Resource constraints affect user choices in recommendation tasks.
method Interest-behavior multiplicative network with MRRNNs and resource-limited branch.
result Framework effectively predicts user interactions considering resource limitations.
Caratheodory's axiom limits arbitrage in resource-limited systems.
problem Non-arbitrage constraints in resource-limited financial systems.
method Preserving Caratheodory's axiom in resource-limited systems.
result Exponential family is the necessary geometric structure for both thermodynamics and finance.
A new algorithm for resource-aware multi-armed bandits minimizes regret.
problem Optimizing resource usage in a multi-armed bandit problem with censored observations.
method UCB-inspired online learning algorithm with theoretical regret analysis.
result The proposed algorithm outperforms standard multi-armed bandit algorithms in simulations.
Survey of knowledge distillation for resource-limited devices.
problem Deploying large deep learning models on resource-limited devices.
method Knowledge distillation using a smaller model trained with information from a larger model.
result A new metric (distillation metric) for comparing different knowledge distillation algorithms.
OpTorch optimizes deep learning for resource-limited environments.
problem Resource constraints in deep learning training.
method Optimized deep learning pipelines in training time and memory.
result Achieved similar accuracy to existing libraries with reduced memory usage.
Although the convolutional neural networks (CNNs) have become popular for various image processing and computer vision task recently, it remains a challenging problem to reduce the storage cost of the parameters for resource-limited platforms. In the previous studies, tensor decomposition (TD) has achieved promising co…
Paper proposes a new binary quantization method for faster DNN inference.
problem Accelerating deep neural network inference on resource-limited devices.
method Quantized Compressed Sensing (QCS) for binary quantization.
result The proposed method preserves benefits of standard methods while reducing quantization error.
The paper examines efficient algorithms for linear regression over resource-limited networks.
problem Efficient communication in distributed learning over resource-limited networks.
method Developed algorithms for communication-efficient learning of linear regression tasks.
result The algorithms enable a tradeoff between communication and learning with theoretical performance guarantees.
We develop model free PAC performance guarantees for multiple concurrent MDPs, extending recent works where a single learner interacts with multiple non-interacting agents in a noise free environment. Our framework allows noisy and resource limited communication between agents, and develops novel PAC guarantees in this…
A new RNN architecture reduces model size and improves performance.
problem Overparameterization and resource limitations in RNNs.
method Jointly encodes weight matrices using tensor-train factorization.
result Reduces model size by several orders of magnitude without sacrificing performance.
A lightweight FPGA-based reinforcement learning approach for edge devices.
problem Resource constraints and inefficiency of DQN on edge devices.
method OS-ELM based training algorithm and L2 regularization for stability.
result 29.77x and 89.40x faster than conventional DQN-based approach for CartPole-v0 task.
Modeling alignment as resource-limited cognitive processes, researchers derive performance bounds.
problem Systematic deviations in feedback-based alignment of large language models.
method Modeling alignment as a two-stage cascade UoHoY given S, with cognitive and total capacities. result Capacity-coupled Alignment Performance Interval derived from Fano and PAC-Bayes bounds.
GeneCAI optimizes DNN compression hyper-parameters for mobile devices.
problem Efficient deployment of complex DNNs on resource-limited devices.
method GeneCAI uses genetic algorithm to learn optimal hyper-parameters.
result GeneCAI finds models with better accuracy-complexity trade-off.
IntraLayer connects digital finance platforms efficiently.
problem Inefficient interconnectivity in digital finance.
method Core infrastructure and adaptive fiscal policy.
result Optimised transactional efficiency for various agents.
ApolloRL offers a platform for RL research in autonomous driving.
problem Improving reinforcement learning for autonomous driving.
method Open platform with training, simulation, and evaluation components.
result Baseline agents perform well in the ApolloRL environment.
Privacy-preserving deep learning for medical data across distributed platforms.
problem Data leakage in medical platforms.
method Separates hidden layers; first layer local, others centralized for training.
result Improved learning performance with all data used during training.
Consider a platform that wants to learn a personalized policy for each user, but the platform faces the risk of a user abandoning the platform if she is dissatisfied with the actions of the platform. For example, a platform is interested in personalizing the number of newsletters it sends, but faces the risk that the u…
Proposes a model to incentivize exploration in web platforms with payments.
problem Learning and social welfare goals of web platforms with myopic users.
method Contextual bandit model with payments to incentivize exploration.
result Achieves sublinear regret while maximizing cumulative social welfare.
Federated learning platform for drug discovery without sharing data.
problem Lack of secure collaboration in drug discovery.
method Industry-scale federated learning platform using cryptographic aggregation.
result Generated new scientific discoveries in drug discovery.
Robotics: Rolling robots on a moving platform can be controlled.
problem Controlling the motion of rolling robots atop a moving platform.
method Developed a mathematical model and demonstrated simulations.
result Platform acceleration can control robot's heading and motion.
Method generates resource-optimized ML models for different platforms.
problem Deployment of deep learning models on edge platforms requires model reduction and retraining.
method Conditional Neural Architecture Search using Generative Adversarial Networks (GAN)
result Successfully generates resource-optimized ML models for different platforms.
PAMS is a Python-based platform for simulating artificial markets.
problem Simulating complex market behaviors for research and education.
method Developed as a Python-based simulator with deep learning integration.
result Demonstrated effectiveness through agent price prediction studies.
Collectives can manipulate learning platforms by coordinated data submission, requiring strategic assessments and algorithms.
problem Collectives can influence learning platforms by altering data, posing risks and requiring strategic planning.
method Developed a theoretical and algorithmic framework to understand and mitigate collective manipulation of learning platforms.
result Demonstrated the need for strategic assessments and implementable coordination algorithms to prevent collective manipulation.
AI platforms disrupt investment by personalizing deal sourcing and insights.
problem Lack of scalable, personalized, and privacy-compliant deal sourcing and insights solutions.
method Development of in-house AI platforms that interact directly with funds and learn from interactions.
result AI platforms provide smarter, personalized use cases for funds, offering a competitive advantage.
Simulates DeLend Platform behavior to optimize operational parameters.
problem Optimizing the DeLend Platform's operational parameters.
method Agent-based simulations to connect and test different agent sets.
result Estimates how key variables respond to different policies.
Recent advances in artificial intelligence have been driven by the presence of increasingly realistic and complex simulated environments. However, many of the existing environments provide either unrealistic visuals, inaccurate physics, low task complexity, restricted agent perspective, or a limited capacity for intera…
A method for fast, accurate cross-temporal forecasts using machine learning.
problem Inconsistent forecasts across different levels of platform data.
method Non-linear hierarchical forecast reconciliation using machine learning.
result Automated direct production of reconciled forecasts for high-frequency decision making.
Training deep learning models is compute-intensive and there is an industry-wide trend towards hardware specialization to improve performance. To systematically benchmark deep learning platforms, we introduce ParaDnn, a parameterized benchmark suite for deep learning that generates end-to-end models for fully connected…
In this paper we present Horizon, Facebook's open source applied reinforcement learning (RL) platform. Horizon is an end-to-end platform designed to solve industry applied RL problems where datasets are large (millions to billions of observations), the feedback loop is slow (vs. a simulator), and experiments must be do…
The aim of this work is to address the question of whether we can in principle design rational decision-making agents or artificial intelligences embedded in computable physics such that their decisions are optimal in reasonable mathematical senses. Recent developments in rare event probability estimation, recursive ba…
Dynamic assortment problem on two-sided platform with unknown parameters
problem Optimizing assortment display in an online platform with incomplete information and heterogeneous customers
method Data-driven algorithm that learns choice parameters while optimizing revenue
result Worst-case regret grows polylogarithmically over time
For the last two decades, most financial markets have undergone an evolution toward electronification. The market for corporate bonds is one of the last major financial markets to follow this unavoidable path. Traditionally quote-driven i.e., dealer-driven) rather than order-driven, the market for corporate bonds is st…
Secure social recommendation framework using secret sharing.
problem Privacy concerns and reluctance to share social data in recommender systems.
method Secret Sharing based Matrix Multiplication (SSMM) protocol for secure data sharing and collaborative recommendation.
result SeSoRec framework improves recommendation performance and is secure.
DFKI Cabin Simulator tests visual monitoring functions in vehicles.
problem Validating novel human-vehicle interfaces and driver assistance systems.
method Driving simulator with in-cabin mock-up and camera system.
result Validation of in-cabin monitoring functions for advanced driver assistance and automated driving.
A new method prunes neural networks faster and more efficiently.
problem Reducing training time and memory usage for neural networks.
method Set-based Task-Adaptive Meta Pruning (STAMP) that meta-learns a pruning mask.
result Significantly improved compression rates and faster training speed.
Unified platform for statistical and machine learning in bioinformatics.
problem Workflow inefficiencies in using multiple tools for data analysis.
method Automated hyperparameter optimization, feature importance analysis, statistical tests.
result Accelerates biological discovery workflows with methodological soundness.
CodeReef enables sharing ML models across platforms efficiently.
problem Sharing and deploying ML models across different systems efficiently.
method Developed an open platform to share ML components, automate deployment, and benchmark models.
result Demonstrated efficient deployment and benchmarking of ML models across diverse platforms.
Study optimizes crowdfunding platform offerings based on customer behavior.
problem Maximizing crowdfunding platform revenue through optimal product assortment.
method Multinomial logit model and machine learning methods (multivariate regression, classification) for revenue prediction.
result Optimal assortments can significantly increase platform revenue.
fintech-kMC simulates financial platforms for AI/ML model validation.
problem Validation of AI/ML models in real-world financial applications.
method Agent-based model with kinetic Monte Carlo engine.
result Generates realistic synthetic data for testing AI/ML models.
Study predicts P2P lending platform failures using machine learning.
problem Predicting failures of P2P lending platforms in China.
method Used machine learning models with filter and wrapper methods, forward selection, and backward elimination.
result Identified robust variables for predicting platform failures with high AUC and F1 scores.
OpenML is an online machine learning platform where researchers can easily share data, machine learning tasks and experiments as well as organize them online to work and collaborate more efficiently. In this paper, we present an R package to interface with the OpenML platform and illustrate its usage in combination wit…
In a large E-commerce platform, all the participants compete for impressions under the allocation mechanism of the platform. Existing methods mainly focus on the short-term return based on the current observations instead of the long-term return. In this paper, we formally establish the lifecycle model for products, by…
In an economy with asymmetric information, the smart contract in the blockchain protocol mitigates uncertainty. Since, as a new trading platform, the blockchain triggers segmentation of market and differentiation of agents in both the sell and buy sides of the market, it recomposes the asymmetric information and genera…
Study personalizes user experience to maximize rewards with patience budget.
problem Maximizing rewards for a platform while respecting user patience.
method Proposes bandit algorithms for sequential choice with feedback models.
result Upper and lower bounds on regret of order O(N2/3) and Ω(N2/3). A monitoring procedure improves machine learning forecasts for digital platforms.
problem Maintaining accurate and stable forecasts for data streams at digital platforms.
method Developed a monitoring procedure to determine when to retrain machine learning algorithms.
result Monitor-based retraining produces accurate forecasts compared to benchmarks.