Stable Hadamard Memory improves reinforcement learning by efficiently managing memory.
problem Memory models struggle in partially observable reinforcement learning environments.
method Introduces a novel memory model using the Hadamard product for efficient memory management and updates.
result Significantly outperforms state-of-the-art memory-based methods on challenging benchmarks.
In this paper, we propose a dual memory structure for reinforcement learning algorithms with replay memory. The dual memory consists of a main memory that stores various data and a cache memory that manages the data and trains the reinforcement learning agent efficiently. Experimental results show that the dual memory …
D-CBRS manages memory for continual learning by accounting for intra-class diversity.
problem Forgetting in continual learning, especially with class-imbalanced data.
method D-CBRS introduces a novel approach to store instances in memory, considering intra-class diversity.
result D-CBRS outperforms existing methods on data sets with intra-class diversity.
GPU (graphics processing unit) has been used for many data-intensive applications. Among them, deep learning systems are one of the most important consumer systems for GPU nowadays. As deep learning applications impose deeper and larger models in order to achieve higher accuracy, memory management becomes an important …
Replicates and improves a deep learning framework for financial portfolio management.
problem Financial portfolio optimization problem
method Deep Reinforcement Learning Framework with EIIE topology, PVM, OSBL, and reward function
result Framework performs well in cryptocurrency market but less so in stock market
Bilevel Continual Learning improves continual learning by transferring knowledge effectively.
problem Catastrophic forgetting and poor generalization in continual learning.
method Bilevel optimization and dual memory management strategies.
result BCL achieves effective knowledge transfer and alleviates catastrophic forgetting.
Accurate volatility modelling is paramount for optimal risk management practices. One stylized feature of financial volatility that impacts the modelling process is long memory explored in this paper for alternative risk measures, observed absolute and squared returns for high frequency intraday UK futures. Volatility …
mGRN improves multivariate time series prediction by managing marginal and joint memories.
problem Extracting dependencies in multivariate sequential data with strong serial and cross-sectional dependencies.
method Developed a novel recurrent network architecture, Memory-Gated Recurrent Networks (mGRN), with gates for marginal and joint memories.
result mGRN consistently outperforms state-of-the-art architectures on various public datasets.
Compact Recurrent Transformer (CRT) improves Transformer efficiency for long sequences.
problem Efficiently scaling Transformer architecture to long sequences with limited compute resources.
method Combines shallow Transformer models with recurrent neural networks and persistent memory.
result CRT achieves comparable or superior performance to full-length Transformers with shorter segments and reduced FLOPs.
New method constructs graphs from data efficiently, suitable for large datasets.
problem Memory and runtime limitations of traditional TMFG for large datasets.
method Uses k-Nearest Neighbors Graphs and memory management for scalable graph construction.
result Provides a parsimonious way to construct graphs for learning tasks.
New solver avoids memory issues for long differential equations.
problem Memory constraints in adaptive probabilistic ODE solvers.
method Fixed memory demands adaptive probabilistic solver using robust state estimation.
result Eliminates memory issues for long time series simulations.
A new algorithm reduces memory usage for deep learning models.
problem Training deep learning models requires significant memory.
method Dynamic Tensor Rematerialization (DTR) is a greedy online algorithm that dynamically plans recomputations.
result DTR achieves comparable performance to optimal static checkpointing with only a small memory budget.
Global Memory Augmentation (GMAT) improves Transformer performance on long documents.
problem Large memory requirements of Transformer pairwise dot-product attention for long sequences.
method Integrates a dense global memory of length M into sparse Transformer blocks.
result Significant improvement on various tasks, including synthetic tasks, masked language modeling, and reading comprehension.
Financial portfolio management is the process of constant redistribution of a fund into different financial products. This paper presents a financial-model-free Reinforcement Learning framework to provide a deep machine learning solution to the portfolio management problem. The framework consists of the Ensemble of Ide…
Embedding representations power machine intelligence in many applications, including recommendation systems, but they are space intensive -- potentially occupying hundreds of gigabytes in large-scale settings. To help manage this outsized memory consumption, we explore mixed dimension embeddings, an embedding layer arc…
NEST optimizes deep learning training by placing devices efficiently across networks and memory.
problem Inefficient device placement in distributed deep learning leads to high communication and memory overhead.
method NEST uses network-, compute-, and memory-aware dynamic programming to optimize device placement.
result NEST achieves up to 2.43 times higher throughput and better memory efficiency.
Paper uses deep reinforcement learning for network slicing and traffic prediction.
problem Managing dynamic network slices while maintaining QoS in a 5G environment.
method Integrates LSTM for traffic prediction and DDRL for distributed decision-making.
result Significant improvements in network performance, reducing QoS violations.
The study improves load forecasting for electricity consumers using advanced machine learning models.
problem Improving short-term load forecasting for effective scheduling and decision-making.
method Proposes and evaluates statistical nonlinear models, including LSTM and GRU, for 15-min frequency electricity load forecasting.
result Advanced models outperform other models in out-of-sample forecasting accuracy, as shown by the Diebold-Mariano test.
SRG improves optimization efficiency with reduced memory and computation overhead.
problem Limited applicability of variance-reduced optimization algorithms.
method SRG (stochastic reweighted gradient) using importance sampling.
result SRG outperforms SGD and provably improves convergence in strongly-convex cases.
Interbank markets are fundamental for bank liquidity management. In this paper, we introduce a model of interbank trading with memory. Our model reproduces features of preferential trading patterns in the e-MID market recently empirically observed through the method of statistically validated networks. The memory mecha…
A deep learning strategy outperforms traditional methods in stocks portfolio management.
problem Optimizing stock portfolio performance using machine learning.
method Deep Deterministic Policy Gradient framework with neural networks.
result Compound annual return rate of 14.12% compared to 7 other strategies.
Hopfield networks outperform deep-learning methods in portfolio optimization.
problem Optimizing portfolios and managing asset allocation efficiently.
method Application of Hopfield networks to portfolio optimization, using combinatorial purged cross-validation.
result Modern Hopfield Networks perform on par or better than deep-learning methods, with faster training times and better stability.
RSmote improves PINNs accuracy with less memory usage.
problem Imbalanced learning in Physics-Informed Neural Networks (PINNs).
method Residual-based Smote (RSmote) for local adaptive sampling.
result RSmote achieves or exceeds accuracy of state-of-the-art methods while reducing memory usage.
The paper examines how long-memory dynamics, rough-volatility, and persistence affect equity volatility forecasting.
problem The study investigates how long-memory dynamics, rough-volatility, and persistence impact equity volatility forecasting.
method The paper combines semiparametric long-memory estimation, rough-volatility diagnostics, and structured forecasting regressions.
result Persistence measures improve out-of-sample volatility forecasts, particularly during periods of elevated market volatility and in volatility-managed portfolio applications.
In an end-to-end dialog system, the aim of dialog state tracking is to accurately estimate a compact representation of the current dialog status from a sequence of noisy observations produced by the speech recognition and the natural language understanding modules. This paper introduces a novel method of dialog state t…
Research develops a water quality prediction model using LSTM.
problem Global degradation of water resources and need for optimal water quality monitoring.
method Developed a multivariate water quality prediction model using LSTM and historical data.
result Multiple step LSTM model achieved RMSE of 0.227 mg/L.
LSTMs improve bond yield forecasting with unique signals.
problem Improving bond yield forecasting accuracy.
method Long short-term memory (LSTM) networks with sequence-to-sequence architectures and LSTM-LagLasso methodology.
result Univariate LSTM models with additional memory can achieve similar results as multivariate MLP models using exogenous information.
Paper adapts causal analysis for time-dependent systems, especially energy management.
problem Challenges in root-cause analysis for systems with lagged time-dependencies, particularly in energy management.
method Adapts causal root-cause analysis method to time-dependent systems, discusses two truncation approaches.
result Extension effectively localizes root-causes in feature and time domain with enough lags.
Optimizes cash management in ATM networks to reduce costs and increase revenue.
problem Minimizing cash costs while ensuring adequate funds in a network of ATMs.
method Developed a discrete optimal control model using forecasting techniques and control theory.
result The proposed model outperforms classical inventory management models, earning 30% more revenue.
Deep learning predicts baseball home runs with better accuracy.
problem Predicting player performance in baseball.
method Long Short-Term Memory (LSTM) neural network.
result LSTM outperformed other models in predicting home runs.
A new text classification method using separable convolution reduces memory consumption.
problem Manual categorization of documents is inefficient and resource-intensive.
method Introducing a new architecture based on separable convolution for text classification.
result Achieved a drastic reduction in trainable parameters without compromising accuracy.
Spatio-temporal data compression method reduces memory usage.
problem Efficiently storing and analyzing large spatio-temporal datasets.
method Adaptive sampling of tensor slices to compress and preserve structure.
result SkeTenSmooth outperforms other sampling methods in retaining patterns.
LSTMs promise much to financial time-series analysis, temporal and cross-sectional inference, but we find that they do not deliver in a real-world financial management task. We examine an alternative called Continual Learning (CL), a memory-augmented approach, which can provide transparent explanations, i.e. which memo…
Optimizes investment model using LSTM for better risk control.
problem Enhancing risk control in multi-factor investment models.
method Combines LSTM with multi-factor investment model for factor selection and weight determination.
result LSTM model outperforms benchmark in risk control metrics.
Automated process discovery is a class of process mining methods that allow analysts to extract business process models from event logs. Traditional process discovery methods extract process models from a snapshot of an event log stored in its entirety. In some scenarios, however, events keep coming with a high arrival…
A framework for analyzing financial systems under scenario constraints.
problem Quantifying worst-case and best-case performance in financial systems.
method Quantitative automata-based framework integrating event history automata and weighted finance finite automata.
result Exact calculation of upper and lower payoff bounds with interpretable witness event histories.
A deep learning model predicts future cache accesses with high accuracy.
problem Improving cache management and performance through better prediction of future data accesses.
method Proposed a LSTM-based recurrent neural network model to predict future cache accesses using only a cache trace as input.
result The proposed model achieves high prediction accuracy and outperforms state-of-the-art practical policies.
Many different classification tasks need to manage structured data, which are usually modeled as graphs. Moreover, these graphs can be dynamic, meaning that the vertices/edges of each graph may change during time. Our goal is to jointly exploit structured data and temporal information through the use of a neural networ…
Enhanced multivariate GARCH model using LSTM for better volatility forecasting.
problem Limitations of traditional multivariate GARCH in capturing persistent volatility and co-movement.
method Integrates deep learning (LSTM) into multivariate GARCH models to capture nonlinear and dynamic dependence structures.
result Superior out-of-sample portfolio risk forecast compared to traditional methods.
Value-at-Risk (VaR) and Expected Shortfall (ES) are widely used in the financial sector to measure the market risk and manage the extreme market movement. The recent link between the quantile score function and the Asymmetric Laplace density has led to a flexible likelihood-based framework for joint modelling of VaR an…
Understanding the statistical properties of recurrence intervals of extreme events is crucial to risk assessment and management of complex systems. The probability distributions and correlations of recurrence intervals for many systems have been extensively investigated. However, the impacts of microscopic rules of a c…
Graph database outperforms in filtering ESG stocks efficiently.
problem Efficiently filtering ESG stocks from large lists of equities.
method Compared SQL, No-SQL, and graph databases; used Python for database interactions; collected data from stock price and financial news.
result Graph database is more efficient for ESG stock filtering.
Can machines trace human knowledge like humans? Knowledge tracing (KT) is a fundamental task in a wide range of applications in education, such as massive open online courses (MOOCs), intelligent tutoring systems, educational games, and learning management systems. It models dynamics in a student's knowledge states in …
Study improves electricity price forecasting accuracy using a hybrid model.
problem Accurate short-term electricity price forecasting is challenging due to social and natural factors.
method Hybrid model combining GARMA, G-GARCH, Wavelet, LLWNN, and optimization algorithms.
result The hybrid model outperforms other models in Nord Pool Electricity markets.
Develops a bi-variate stochastic framework to model mortality and interest rates with long-range dependence.
problem Captures long-range dependence and instantaneous correlation in mortality and interest rates.
method Mixed fractional Brownian motions, analytical solutions, risk-neutral measure, sequential parameter estimation.
result Explicit pricing of zero-coupon bonds and extreme mortality bonds, practical implications for pricing and risk management.
This paper introduces a new classification tool named Silas, which is built to provide a more transparent and dependable data analytics service. A focus of Silas is on providing a formal foundation of decision trees in order to support logical analysis and verification of learned prediction models. This paper describes…
To know the statistical distribution of a variable is an important problem in management of resources. Distributions of the power law type are observed in many real systems. However power law distributions have an infinite variance and thus can not be used as a standard distribution. Normally professionals in the area …
Land use classification of low resolution spatial imagery is one of the most extensively researched fields in remote sensing. Despite significant advancements in satellite technology, high resolution imagery lacks global coverage and can be prohibitively expensive to procure for extended time periods. Accurately classi…