In this paper we consider an energy storage optimization problem in finite time in a model with partial information that allows for a changing economic environment. The state process consists of the storage level controlled by the storage manager and the energy price process, which is a diffusion process the drift of w…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
48 results for “information storage”
SER tool predicts storage capacity risk with probabilistic accuracy.
problem Managing data storage growth to avoid financial losses.
method Stochastic Estimated Risk (SER) using Brownian motion with drift model.
result Probabilistic approach is more accurate for non-linear storage patterns.
gLSTM improves graph neural networks by increasing storage capacity to prevent over-squashing.
problem Over-squashing in GNNs collapses information from a large receptive field into a single vector, creating an information bottleneck.
method Introduced a new synthetic task to measure over-squashing and adapted ideas from sequence modeling to develop gLSTM, a novel GNN architecture with improved capacity.
result gLSTM architecture demonstrates strong performance on synthetic and real-world graph benchmarks, mitigating over-squashing.
Develops a deep RL algorithm for ESS control in electricity markets.
problem Controlling ESSs for arbitrage in real-time electricity markets under price uncertainty.
method Formulated as a Markov decision process, developed a deep RL algorithm using a recurrent neural network.
result Effectiveness of the algorithm verified using real-time PJM electricity prices.
Game theory models storage investment to balance market competition and profits.
problem Strategic storage investment impacts electricity market prices and revenues.
method Formulated a non-cooperative game between investors to model strategic storage decisions.
result Increasing storage capacity reduces individual profits but increases total investment.
High-frequency trading strategy boosts battery storage profits.
problem Maximizing revenue for battery energy storage systems in intraday markets.
method Adapted dynamic programming for continuous intraday markets, considering limit order book dynamics.
result Dynamic programming strategy outperforms standard re-optimization methods, increasing profits by 58% and 14% respectively.
Language models allocate information storage, not collapsing into uniform representations.
problem Incomplete neural collapse in language model representations.
method Analyzing variance and information sharing across 14 models, proving an information floor.
result Within-class variance is allocated information storage, not collapsed into uniform representations.
Framework optimizes battery storage for markets by separating long-term degradation from short-term market dynamics.
problem Intractable computation due to timescale mismatch between battery degradation and market dynamics.
method Approximate dynamic programming with value function approximation and pseudo-time encoding.
result Policy outperforms benchmarks in real-time market scenarios.
QABBA improves time series storage efficiency while preserving shape information.
problem Efficient storage and shape preservation of time series data.
method Quantized symbolic time series approximation (QABBA) using ABBA technique.
result QABBA achieves a new state-of-the-art on Monash regression dataset.
Statistical Mechanics of Learning via Reverberation in Bidirectional Associative Memoriescond-mat.dis-nn
Study neural networks learning from noisy examples via reverberation.
problem Learning from noisy examples in neural networks.
method Adapted Guerra's interpolation technique to provide statistical mechanics of supervised and unsupervised learning.
result Full phase diagrams and thresholds for learning are analytically obtained.
New method assesses energy storage value beyond cost reduction.
problem Improving energy storage value beyond cost reduction.
method Market potential method to evaluate and compare energy storage technologies.
result High-cost hydrogen storage can be more valuable than low-cost hydrogen storage.
Study on energy storage's impact on electricity prices and profitability.
problem Analyzing the profitability of energy storage in electricity markets.
method Characterized optimal operating strategy for storage systems, determined equilibrium price in a market with storage, renewables, and conventional producers, and characterized price process using stochastic differential equations.
result Increased average revenues and interquantile ranges for storage assets in energy transition scenarios.
Paper provides a method to price electricity storage contracts using COS technique.
problem Valuation of electricity storage contracts considering physical and operational constraints.
method Uses Fourier-based COS method to price contracts based on stochastic polynomial process.
result The COS method accurately and efficiently prices electricity storage contracts.
Generative models improve carbon storage site prediction using Bayesian inversion.
problem Predicting suitable geologic sites for long-term carbon dioxide storage.
method Generative adversarial networks and Bayesian inversion to condition models on physical measurements and historic data.
result Improved resolution of carbon dioxide storage capacity forecasts.
Paper proposes a risk-averse approach to energy storage price arbitrage using conformal uncertainty quantification.
problem Inherent volatility and uncertainty of real-time electricity prices create financial risks for storage arbitrage.
method Two-layer prediction model with conformal uncertainty quantification for high coverage of real-time price uncertainty.
result The framework achieves good profit margins with minimal losses, demonstrating effectiveness in real-time market.
It has been known for a long time that the classical spherical perceptrons can be used as storage memories. Seminal work of Gardner, \cite{Gar88}, started an analytical study of perceptrons storage abilities. Many of the Gardner's predictions obtained through statistical mechanics tools have been rigorously justified. …
Framework uses RL and simulation for optimal microgrid energy storage planning.
problem Optimal investment in diverse energy storage technologies for microgrids.
method Combines reinforcement learning with simulation-based optimization for long-term planning.
result Derives better engineering solutions for future microgrid applications.
Paper proposes a new model to assess risks in energy storage systems considering both exogenous and endogenous uncertainties.
problem Current risk assessment ignores the stochastic nature of energy storage availability.
method Data-driven unified model with exogenous and endogenous uncertainty description for four types of generic energy storage.
result Comparative results show more severe risks for endogenous uncertainty, suggesting new strategies for system operators.
Memory-Augmented Recurrent Networks improve dialogue coherence by expanding conversation history storage.
problem Fixed-size vectors limit dialogue coherence; attention mechanisms are computationally expensive.
method Introduce Neural Turing Machines (NTMs) to provide flexible and permanent storage for dialogue history.
result Improved perplexity performance compared to existing baselines.
Study shows changes in information sharing between Bitcoin markets during 2017 crash.
problem Understanding information dynamics in Bitcoin markets during the 2017 crash.
method Analysis of high-frequency market-microstructure observables using information theoretic measures.
result Temporal changes in information sharing across markets, including predictability, memory, and synchronous coupling.
Study estimates risks of nuclear waste storage projects.
problem Cost and schedule risks in nuclear waste storage projects.
method Reference class of 216 past projects for cost risk, 200 for schedule risk.
result Cost and schedule risks are substantial for nuclear waste storage projects.
AppStreamer reduces mobile game storage by predicting needed files.
problem Expanding storage needs of mobile games and apps.
method Predictive streaming of app files from cloud or edge servers.
result Reduces storage by 87% for Dead Effect 2 and 86% for Fire Emblem Heroes.
Deep learning optimizes gas storage operations.
problem Optimizing underground natural gas storage operations.
method Reinforcement learning techniques applied to high-dimensional forward markets with constraints.
result Performance of deep learning method superior to least-squares Monte-Carlo approach.
A Critical Review of Physics-Informed Machine Learning Applications in Subsurface Energy Systemscs.LG
PIML enhances machine learning for subsurface energy systems.
problem Lack of interpretability and domain-specific knowledge in machine learning models.
method Integrates physics principles into data-driven models using deep learning.
result PIML improves model generalization and adherence to physical laws.
RL agent learns to save costs by managing household energy storage.
problem Maximizing cost savings in smart grids with household energy storage.
method Data-driven RL agent learns from tariff structures and storage capacity.
result RL agent explains its learning process and strategies.
DMs emerge from DenseAMs, transitioning from memorization to generalization.
problem Hindered memory retrieval in DenseAMs due to spurious states.
method Examined diffusion models through the lens of DenseAMs, focusing on their generative process.
result Identified a critical phase in DMs transitioning from memorization to generalization.
Solution space and storage capacity of fully connected two-layer neural networks with generic activation functionscond-mat.dis-nn
Study on neural networks' storage capacity and solution space structure.
problem Understanding the storage capacity and solution space structure of neural networks.
method Replica method from statistical physics.
result Storage capacity per parameter remains finite even with infinite width and weights exhibit negative correlations.
New approach for feature evolution in streaming data with limited storage.
problem Rarely-provided labels in feature evolving streams.
method Incorporates manifold regularization and a buffer to adapt to different storage budgets.
result Preserves the performance of feature evolving learning across different storage budgets.
This study optimizes energy storage scheduling under price uncertainty, balancing risk and reward.
problem Optimizing energy storage operation under price uncertainty and risk.
method Two-stage stochastic risk-constrained approach using conditional value-at-risk.
result Increasing risk aversion leads to substantial benefits in terms of risk reduction and expected reward.
Unifying the theory of storage and the risk premium by an unobservable intrinsic electricity priceq-fin.MF
Introduces an unobservable intrinsic electricity price to link storage theory with risk premium.
problem Connecting storage theory with risk premium in electricity markets.
method Introduces an unobservable intrinsic electricity price and derives prices for various contracts.
result Finds an overall negative risk premium in empirical analysis.
New framework predicts future shipments with less error and saves labor.
problem Optimizing storage assignment in warehouses under uncertainty.
method Introduces a new framework that combines neural networks to predict future shipments and integrates it into a storage assignment system.
result Achieves up to 29% decrease in MAPE compared to CNN-LSTM on unseen future shipments.
Deep learning reconstructs pressure fields and classifies leakage rates in CCS storage sites.
problem Monitoring CO2 leakage in CCS storage sites.
method Variational auto-encoder tailored for pressure field reconstruction and leakage rate classification.
result Uncertainty estimates of predictions illustrated on synthetic data.
Paper introduces a new volatility model for natural gas markets and discusses swing option pricing.
problem Modeling price and storage dynamics in natural gas markets with path-dependent volatility.
method Developed a novel stochastic path-dependent volatility model and used deep learning for swing option pricing.
result Proposed a deep learning method for numerical approximations of swing option pricing.
We consider solution of stochastic storage problems through regression Monte Carlo (RMC) methods. Taking a statistical learning perspective, we develop the dynamic emulation algorithm (DEA) that unifies the different existing approaches in a single modular template. We then investigate the two central aspects of regres…
Transformers learn to recall with non-orthogonal embeddings in realistic settings.
problem Understanding how transformers store and retrieve knowledge in practical scenarios.
method Analyzing a single-layer transformer with random embeddings trained on a token-retrieval task.
result Explicit formulas for the model's storage capacity reveal a multiplicative dependence on sample size, embedding dimension, and sequence length.
A method distills GANs for mobile devices, reducing computation and storage.
problem Heavy computation and storage cost of GANs on mobile devices.
method Knowledge distillation to train a smaller generator with inherited information from a larger teacher generator, including a discriminator.
result Portable GAN models with strong performance achieved.
The idea of reusing information from previously learned tasks (source tasks) for the learning of new tasks (target tasks) has the potential to significantly improve the sample efficiency reinforcement learning agents. In this work, we describe an approach to concisely store and represent learned task knowledge, and reu…
Estimating Dynamic Conditional Spread Densities to Optimise Daily Storage Trading of Electricitystat.AP
The paper optimizes daily storage trading of electricity using dynamic spread densities.
problem Optimizing daily storage trading of electricity based on price spreads.
method Formulated dynamic density functions based on skewed-t representations to model hourly electricity price spreads. Selected the best specification for each spread using the Pinball Loss function and calculated risk associated with spread arbitrages.
result Optimal daily operation of a battery storage facility determined from spread densities.
User and item features of side information are crucial for accurate recommendation. However, the large number of feature dimensions, e.g., usually larger than 10^7, results in expensive storage and computational cost. This prohibits fast recommendation especially on mobile applications where the computational resource …
Economic Optimal Operation of Community Energy Storage Systems in Competitive Energy Marketsphysics.soc-ph
Distributed, controllable energy storage devices offer several benefits to electric power system operation. Three such benefits include reducing peak load, providing standby power, and enhancing power quality. These benefits, however, are only realized during peak load or during an outage, events that are infrequent. T…
Extends DAMs to Gaussian distributions for efficient pattern storage and retrieval.
problem Limited storage capacity and retrieval methods for non-vector pattern representations.
method Introduces a log-sum-exp energy function over Gaussian distributions, using optimal transport maps for retrieval dynamics.
result Proves exponential storage capacity and provides quantitative retrieval guarantees.
We describe a project, called the "Discretization in Geometry and Dynamics Gallery", or DGD Gallery for short, whose goal is to store geometric data and to make it publicly available. The DGD Gallery offers an online web service for the storage, sharing, and publication of digital research data.
Holographic Invariant Storage: Design-Time Safety Contracts via Vector Symbolic Architecturesstat.ML
Holographic Invariant Storage uses vector architectures to ensure LLM safety at design time.
problem Mitigating context drift in large language models (LLMs) during deployment.
method Introduces Holographic Invariant Storage (HIS) protocol that combines known properties of bipolar Vector Symbolic Architectures into a design-time safety contract.
result Closed-form guarantees for single-signal recovery fidelity, continuous-noise robustness, and multi-signal capacity degradation are provided and validated.
Predict and explain storage failures using RNNs with event extraction.
problem Predict and explain failures in storage environments from time series data.
method Extract anomalous spikes as events, then build an RNN classifier with attention mechanisms.
result Comparable accuracy to traditional RNNs with improved explainability.
Study shows how activation functions impact the storage capacity of treelike neural networks.
problem Understanding the role of activation functions in neural network expressive power.
method Analysis of treelike two-layer networks with various activation functions in the infinite-width limit.
result Activation functions affect storage capacity and robustness, with nonlinearity increasing capacity and decreasing robustness.
The mathematical problem of the static storage optimisation is formulated and solved by means of a variational analysis. The solution obtained in implicit form is shedding light on the most important features of the optimal exercise strategy. We show how the solution depends on different constraint types including carr…
We focus in this paper on dataset reduction techniques for use in k-nearest neighbor classification. In such a context, feature and prototype selections have always been independently treated by the standard storage reduction algorithms. While this certifying is theoretically justified by the fact that each subproblem …
FPC tackles big data challenges with polynomial kernels and ADMM.
problem Efficiently classify massive data with scalability and storage challenges.
method Polynomial feature mapping and ADMM for non-smooth convex optimization.
result FPC significantly reduces computational burden and storage memory without sacrificing generalization ability.