This study investigates the use of reinforcement learning to guide a general purpose cache manager decisions. Cache managers directly impact the overall performance of computer systems. They govern decisions about which objects should be cached, the duration they should be cached for, and decides on which objects to ev…
Framework for managing cyber risks in networks.
problem Managing systemic cyber risks in digital networks.
method Three components: acceptable configurations, risk mitigation interventions, and cost function.
result Effective decision-making for network resilience.
This research develops a dynamic risk management system for industrial companies.
problem Risk assessment and management in industrial enterprises.
method Qualitative and quantitative analysis, systematic risk classification, dynamic system development.
result Effective risk management strategies formed through dynamic risk management system and risk assessment methods.
DeepFair improves fairness in recommender systems without sacrificing accuracy.
problem Lack of bias management in recommender systems leads to unfair recommendations for minority groups.
method Deep Learning based Collaborative Filtering algorithm that balances fairness and accuracy.
result It is possible to make fair recommendations without losing significant accuracy.
Adversarial attacks degrade DRL-based EV energy management systems.
problem Adversarial attacks on DRL-based energy management systems of electric vehicles.
method Generated adversarial examples to degrade DRL performance using low-dimensional state representations.
result Adversarial attacks can significantly degrade DRL-based EV energy management systems.
The area of building energy management has received a significant amount of interest in recent years. This area is concerned with combining advancements in sensor technologies, communications and advanced control algorithms to optimize energy utilization. Reinforcement learning is one of the most prominent machine lear…
Study predicts online procrastination using machine learning.
problem Predicting procrastination in eLearning to prevent drop-outs.
method Comparison of multiple machine learning models with subjective and objective predictors.
result Models with objective predictors outperform those with subjective predictors.
New insights into RL efficiency from managing time discretization.
problem The impact of time discretization on RL methods in continuous-time systems.
method Analysis of Monte-Carlo policy evaluation for LQR systems.
result An optimal choice of temporal resolution for a given data budget improves policy evaluation efficiency.
Paper introduces balanced payment systems to improve liquidity and risk management.
problem Managing liquidity in payment systems and economy is a persistent challenge.
method Introduces interbank balancing method to private payment systems and others.
result Demonstrates effects of balancing on a small example and constructs a balanced subsystem.
CryptoRLPM uses on-chain data to improve crypto portfolio management performance.
problem Lack of effective use of on-chain data in RL-based crypto portfolio management.
method Developed CryptoRLPM, an RL-based system that incorporates on-chain data for crypto PM, consisting of five units.
result CryptoRLPM outperforms baselines in ARR, DRR, and SR, especially for Bitcoin.
Paper introduces reinforcement learning for managing power grids.
problem Balancing power flows and maintaining grid stability in real-time.
method Reinforcement Learning applied to power network operations.
result Demonstrates feasibility of machine learning in power grid management.
Gradient boosting decision tree (GBDT) is a widely-used machine learning algorithm in both data analytic competitions and real-world industrial applications. Further, driven by the rapid increase in data volume, efforts have been made to train GBDT in a distributed setting to support large-scale workloads. However, we …
In industrial environments, an increasing amount of wireless devices are used, which utilize license-free bands. As a consequence of these mutual interferences of wireless systems might decrease the state of coexistence. Therefore, a central coexistence management system is needed, which allocates conflict-free resourc…
Traditional centralized energy systems have the disadvantages of difficult management and insufficient incentives. Blockchain is an emerging technology, which can be utilized in energy systems to enhance their management and control. Integrating token economy and blockchain technology, token economic systems in energy …
A multi-agent system improves crypto portfolio management by processing diverse data types.
problem Managing cryptocurrency portfolios requires processing various data types under high volatility.
method A multi-agent system with three specialized agents for market dynamics, news sentiment, and signal fusion.
result The best configuration, Hierarchical (Skill), achieved a 133.52% cumulative return and 1.502 Sharpe ratio.
Deep learning has enabled major advances in the fields of computer vision, natural language processing, and multimedia among many others. Developing a deep learning system is arduous and complex, as it involves constructing neural network architectures, managing training/trained models, tuning optimization process, pre…
Reinforcement learning approaches have long appealed to the data management community due to their ability to learn to control dynamic behavior from raw system performance. Recent successes in combining deep neural networks with reinforcement learning have sparked significant new interest in this domain. However, pract…
Paper uses deep reinforcement learning for optimal stock portfolio management.
problem Optimizing stock portfolio choices in complex market environments.
method Direct deep reinforcement learning to learn factor representations and make optimal decisions.
result Deep learning outperforms average market performance in portfolio allocation.
The basic financial purpose of a firm is to maximize its value. An inventory management system should also contribute to realization of this basic aim. Many current asset management models currently found in financial management literature were constructed with the assumption of book profit maximization as basic aim. H…
Paper uses deep learning for systemic risk measures.
problem Computing optimal capital allocations for systemic risk.
method Deep learning algorithms to solve primal and dual problems.
result Deep learning provides fair risk allocations.
Adaptive financial dataflow system improves model robustness in dynamic markets.
problem Static historical data leads to poor performance in dynamic financial markets.
method Drift-aware dataflow system with adaptive control and optimization.
result Enhanced model robustness and improved risk-adjusted returns.
Regshock visualizes financial risks to help regulators manage systemic shocks.
problem Managing systemic risks in financial networks.
method Risk-island visualization algorithm and regshock visual exploration approach.
result Demonstrated improved risk management and control capabilities.
ARMS automates fraud detection rules to improve efficiency and accuracy.
problem Maintaining effective fraud detection rules over time and reducing manual review.
method ARMS uses heuristic search and a user-defined loss-function to optimize and manage rules.
result ARMS can maintain original systems' performance with only a fraction of the rules.
Machine learning improves wildfire science and management, but requires expert knowledge.
problem Improving wildfire science and management through AI.
method Review of popular ML approaches and their application in six wildfire science domains.
result Opportunities exist for applying more advanced ML methods in wildfire science.
CPAS uses machine learning to plan hospital resources for COVID-19.
problem Forecasting hospital resource demands during the COVID-19 pandemic.
method Combining machine learning algorithms with diverse data sources.
result CPAS successfully managed hospital resource planning in the UK.
In e-commerce, content quality of the product catalog plays a key role in delivering a satisfactory experience to the customers. In particular, visual content such as product images influences customers' engagement and purchase decisions. With the rapid growth of e-commerce and the advent of artificial intelligence, tr…
This research improves DeFi interest rates using a PID control system.
problem Lack of adaptive interest rates in DeFi money markets.
method Introduces a time-weighted PID control system for interest rate management.
result Adaptive interest rates improve risk mitigation and market utilization.
In this chapter the complex systems are discussed in the context of economic and business policy and decision making. It will be showed and motivated that social systems are typically chaotic, non-linear and/or non-equilibrium and therefore complex systems. It is discussed that the rapid change in global consumer behav…
In statistical dialogue management, the dialogue manager learns a policy that maps a belief state to an action for the system to perform. Efficient exploration is key to successful policy optimisation. Current deep reinforcement learning methods are very promising but rely on epsilon-greedy exploration, thus subjecting…
TDA improves cryptocurrency portfolio management.
problem Traditional methods fail to manage cryptocurrencies effectively.
method Topological Data Analysis (TDA) for identifying investment opportunities.
result TDA-based portfolio management outperforms traditional methods.
MSPM uses modular agents to manage financial portfolios efficiently.
problem Scalability and reusability issues in RL-based financial portfolio management.
method Modular design with Evolving Agent Module (EAM) and Strategic Agent Module (SAM).
result MSPM improves profit accumulation by at least 186.5% compared to CRP.
SUPAID automates vehicle rollout decisions for fleet managers.
problem Automating supervisor's vehicle rollout decisions to prevent costly mistakes.
method Rule mining approach based on 'one-way efficiency' assumption.
result SUPAID significantly reduces costs in a real transit agency setting.
Machine learning techniques have recently received significant attention as promising approaches to deal with the optical channel impairments, and in particular, the nonlinear effects. In this work, a machine learning-based classification technique, known as the Parzen window (PW) classifier, is applied to mitigate the…
The introduction of automated flight control and management systems have made possible aircraft designs that sacrifice arodynamic stability in order to incorporate stealth technology intro their shape, operate more efficiently, and are highly maneuverable. Therefore, modern flight management systems are reliant on mult…
Proposes a new method to learn meta-priors from data.
problem Improving learning systems with domain knowledge and controlling parameter learning rates.
method Hierarchical Empirical Bayes approach to decouple learning rates of features.
result Meta-prior learning improves performance and convergence time in various applications.
Paper introduces RiskEmbed, a finetuned model for financial risk management.
problem Improving retrieval accuracy in financial question-answering systems.
method Curated dataset and finetuned BERT model for financial domain.
result RiskEmbed significantly outperforms general-purpose and financial embedding models.
Order dispatching and driver repositioning (also known as fleet management) in the face of spatially and temporally varying supply and demand are central to a ride-sharing platform marketplace. Hand-crafting heuristic solutions that account for the dynamics in these resource allocation problems is difficult, and may be…
Machine learning categorizes mutual funds for better investment strategies.
problem Identifying similar mutual funds for diversified investment applications.
method Machine learning to learn and reproduce a well-regarded categorization system.
result Machine learning can learn and reproduce a categorization system that is widely regarded.
A new approach integrates inventory prediction and routing optimization for better supply chain management.
problem Optimizing efficient route selection in supply chain management with uncertain inventory demand.
method Decision-focused learning approach using neural networks to directly integrate inventory prediction and routing optimization.
result Direct integration of inventory prediction and routing optimization leads to better supply chain decisions.
Paper adapts causal analysis for time-dependent systems, especially energy management.
problem Challenges in root-cause analysis for systems with lagged time-dependencies, particularly in energy management.
method Adapts causal root-cause analysis method to time-dependent systems, discusses two truncation approaches.
result Extension effectively localizes root-causes in feature and time domain with enough lags.
Paper tackles inventory management with deep learning, improving performance and adherence to constraints.
problem Managing inventory with limited resources and constraints.
method Proposes a novel method to sample from a distribution of possible constraint paths, extends exo-IDP formulation, introduces neural coordinator, and uses modified DirectBackprop algorithm.
result Deep reinforcement learning policies with a neural coordinator outperform classic baselines in terms of performance and adherence to constraints.
Machine learning risks in finance pricing and hedging
problem Understanding and managing risks in financial models
method Analyzing machine learning applications in finance, focusing on pricing and hedging of financial options
result Identifies various sources of risk and potential mitigation strategies
We propose a real-time context-aware learning system along with the architecture that runs on the mobile devices, provide services to the user and manage the IoT devices. In this system, an application running on mobile devices collected data from the sensors, learned about the user-defined context, made predictions in…
Paper tackles AI risks by customizing metrics and models.
problem AI risks are multidimensional and immaturely managed.
method Decomposes AI risks into data protection, fairness, etc., and develops metrics and models.
result Customized metrics and models reduce AI risk uncertainty.
Unsupervised clustering can reproduce categorization systems if features and metrics are correctly selected.
problem Reproducing expert-provided categorization systems using unsupervised clustering.
method Investigated using toy datasets and real-world fund categorization. Used appropriate feature selection and a supervised Random Forest-based distance metric.
result Unsupervised clustering can reproduce ground truth classes if features and metrics are correctly selected.
The potential of machine learning to automate and control nonlinear, complex systems is well established. These same techniques have always presented potential for use in the investment arena, specifically for the managing of equity portfolios. In this paper, the opportunity for such exploitation is investigated throug…
Proposes a Big Data framework for SC forecasting, including data preprocessing and machine learning.
problem Improving SC forecasting accuracy and efficiency.
method Data collection, preprocessing, machine learning model training, hyperparameter tuning, performance evaluation.
result Optimized SC forecasting models enhance workforce, inventory, and overall SC performance.
Proposes efficient algorithm for system-level I&M decisions under uncertainty.
problem Optimal management strategies for deteriorating civil engineering systems.
method Factored partially observable Markov decision process with Bayesian networks and DDMAC reinforcement learning.
result DDMAC policies offer substantial benefits over heuristic approaches in system-level cost optimization.