A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Paper uses polar field data to improve solar flare prediction accuracy.
Enhances solar flare prediction with advanced preprocessing and contrastive learning.
We conduct a post hoc analysis of solar flare predictions made by a Long Short Term Memory (LSTM) model employing data in the form of Space-weather HMI Active Region Patches (SHARP) parameters calculated from data in proximity to the magnetic polarity inversion line where the flares originate. We train the the LSTM mod…
Study evaluates deep learning models for solar flare prediction with interpretability analysis.
The study predicts solar flare productivity using magnetic data from SDO/HMI.
SG-PALM learns interpretable tensor models for high-dimensional data.
In analyses of rare-events, regardless of the domain of application, class-imbalance issue is intrinsic. Although the challenges are known to data experts, their explicit impact on the analytic and the decisions made based on the findings are often overlooked. This is in particular prevalent in interdisciplinary resear…
Do two data samples come from different distributions? Recent studies of this fundamental problem focused on embedding probability distributions into sufficiently rich characteristic Reproducing Kernel Hilbert Spaces (RKHSs), to compare distributions by the distance between their embeddings. We show that Regularized Ma…
This paper describes a fast algorithm for recovering low-rank matrices from their linear measurements contaminated with Poisson noise: the Poisson noise Maximum Likelihood Singular Value thresholding (PMLSV) algorithm. We propose a convex optimization formulation with a cost function consisting of the sum of a likeliho…
We study sequential change-point detection procedures based on linear sketches of high-dimensional signal vectors using generalized likelihood ratio (GLR) statistics. The GLR statistics allow for an unknown post-change mean that represents an anomaly or novelty. We consider both fixed and time-varying projections, deri…
High-velocity streams of high-dimensional data pose significant "big data" analysis challenges across a range of applications and settings. Online learning and online convex programming play a significant role in the rapid recovery of important or anomalous information from these large datastreams. While recent advance…
We extend the theory of matrix completion to the case where we make Poisson observations for a subset of entries of a low-rank matrix. We consider the (now) usual matrix recovery formulation through maximum likelihood with proper constraints on the matrix , and establish theoretical upper and lower bounds on the rec…
A new R package for high-dimensional regression and precision matrix estimation.
Avalanches, or Avalanche-like, events are often observed in the dynamical behaviour of many complex systems which span from solar flaring to the Earth's crust dynamics and from traffic flows to financial markets. Self-organized criticality (SOC) is one of the most popular theories able to explain this intermittent char…
We consider first order gradient methods for effectively optimizing a composite objective in the form of a sum of smooth and, potentially, non-smooth functions. We present accelerated and adaptive gradient methods, called FLAG and FLARE, which can offer the best of both worlds. They can achieve the optimal convergence …
Improve exposition and explain metric bundle equivalence.
Paper proposes a uniqueness Shapley measure to compare variable importance.
A scalable Bayesian additive model for stellar flare detection using Gaussian process inference and hidden Markov models.
New method isolates epistemic uncertainty in diffusion models, improving plausibility scores.
Modeling solar ramping events with spatio-temporal point processes.
The study finds solar terms significantly impact China's stock market returns and volatility.
DA improves solar wind forecasts by updating model boundary conditions.
Improved probabilistic solar irradiance forecasting models for grid integration.
Study evaluates post-processing methods for improving solar power forecasts.
We study the cascading dynamics immediately before and immediately after 219 market shocks. We define the time of a market shock T_{c} to be the time for which the market volatility V(T_{c}) has a peak that exceeds a predetermined threshold. The cascade of high volatility "aftershocks" triggered by the "main shock" is …
Solar algorithm selects variables faster and more accurately in high-dimensional data.
PERCEPT detects changes in high-dimensional data streams using topological data analysis.
Solar improves variable selection in high-dimensional data with complicated dependence structures.
The increased usage of solar energy places additional importance on forecasts of solar radiation. Solar panel power production is primarily driven by the amount of solar radiation and it is therefore important to have accurate forecasts of solar radiation. Accurate forecasts that also give information on the forecast u…
We define metric bundles/metric graph bundles which provide a purely topological/coarse-geometric generalization of the notion of trees of metric spaces a la Bestvina-Feighn in the special case that the inclusions of the edge spaces into the vertex spaces are uniform coarsely surjective quasi-isometries. We prove the e…
Using artificial neural network for the prediction of heat demand has attracted more and more attention. Weather conditions, such as ambient temperature, wind speed and direct solar irradiance, have been identified as key input parameters. In order to further improve the model accuracy, it is of great importance to und…
Python tool creates machine-learning-ready solar dataset.
Study optimizes SREC generation and trading in solar energy markets.
Power supply from renewable resources is on a global rise where it is forecasted that renewable generation will surpass other types of generation in a foreseeable future. Increased generation from renewable resources, mainly solar and wind, exposes the power grid to more vulnerabilities, conceivably due to their variab…
Unified NICEk metrics improve solar forecasting accuracy.
We consider multi-task regression models where the observations are assumed to be a linear combination of several latent node functions and weight functions, which are both drawn from Gaussian process priors. Driven by the problem of developing scalable methods for forecasting distributed solar and other renewable powe…
For short-term solar irradiance forecasting, the traditional point forecasting methods are rendered less useful due to the non-stationary characteristic of solar power. The amount of operating reserves required to maintain reliable operation of the electric grid rises due to the variability of solar energy. The higher …
GPRNs accurately model stellar activity affecting RV measurements of exoplanets.
Study uses machine learning to analyze solar emissions.
Due to the increasing integration of solar power into the electrical grid, forecasting short-term solar irradiance has become key for many applications, e.g.~operational planning, power purchases, reserve activation, etc. In this context, as solar generators are geographically dispersed and ground measurements are not …
As renewable distributed energy resources (DERs) penetrate the power grid at an accelerating speed, it is essential for operators to have accurate solar photovoltaic (PV) energy forecasting for efficient operations and planning. Generally, observed weather data are applied in the solar PV generation forecasting model w…
The non-stationarity characteristic of the solar power renders traditional point forecasting methods to be less useful due to large prediction errors. This results in increased uncertainties in the grid operation, thereby negatively affecting the reliability and increased cost of operation. This research paper proposes…
Non-availability of reliable and sustainable electric power is a major problem in the developing world. Renewable energy sources like solar are not very lucrative in the current stage due to various uncertainties like weather, storage, land use among others. There also exists various other issues like mis-commitment of…
In this work, a new approach for Sun tracking systems is presented. Due to the current system limitations regarding costs and operational problems, a new approach based on low cost, computer vision open hardware and deep learning has been developed. The preliminary tests carried out successfully in Plataforma solar de …
Electricity production via solar energy is tackled via short-term forecasts and risk management. Our main tool is a new setting on time series. It allows the definition of "confidence bands" where the Gaussian assumption, which is not satisfied by our concrete data, may be abandoned. Those bands are quite convenient an…
Quantum kernel improves solar irradiance forecasting.
The study improves solar irradiance forecasts for Chile using machine learning.
Variable renewables can avoid market value decline with policy changes.