Versatile model for High Energy Physics events.
problem Modeling complex interactions in high-energy physics data.
method Energy-based probabilistic model with multi-purpose architecture.
result Achieves success in diverse applications like simulation, anomaly detection, and particle identification.
Derives energy-momentum tensor from Standard Model, examines energy conditions.
problem Validating energy conditions in the context of the Standard Model.
method Geometric variational problem on globally hyperbolic manifold, deriving energy-momentum tensor.
result Validates various energy conditions in general relativity.
Improved diffusion models using energy distillation and sequential Monte Carlo.
problem Training instability and inferior performance in energy parameterized diffusion models.
method Introduced a novel training regime for energy functions through distillation of pre-trained diffusion models, and cast the sampling procedure as a Feynman Kac model.
result Demonstrated improved performance and new sampling techniques.
Discrete geometry model approximates Willmore energy.
problem Approximating the Willmore energy for triangulated surfaces.
method A discrete energy defined in the spirit of discrete differential geometry converges to the Willmore energy.
result The discrete energy converges to the Willmore energy in the sense of Γ-convergence. CityTFT models urban building energy using a data-driven approach.
problem Current UBEM methods are time-consuming and based on physics.
method CityTFT uses a TFT framework with an augmented loss function.
result CityTFT predicts energy demands with high accuracy.
Proposes linking energy and force uncertainty in deep learning potentials.
problem Uncertainty in predicted energies and forces in machine learning models.
method Introduces a spatially correlated noise process to link energy and force uncertainty.
result Demonstrates the approach on molecular datasets, linking energy and force uncertainties.
Extends denoising and score estimation to energy models via Tweedie's formula.
problem Linking denoising and score estimation for a wider range of distributions.
method Derives a fundamental identity connecting energy score derivatives and scores.
result Establishes a new identity for energy scores analogous to Tweedie's formula.
Paper models uncertainty in electricity and gas markets to assess its impact.
problem Addressing uncertainties in coupled electricity and gas markets.
method Integrated and stochastic optimisation approaches for large-scale energy systems.
result Quantifies the value of encoding uncertainty in models.
Energy Transformer integrates attention, energy models, and associative memory.
problem Lack of clear theoretical foundations in attention mechanisms and straightforward design of energy functions in energy-based models.
method Proposes Energy Transformer, a sequence of attention layers with a specifically engineered energy function.
result Obtained strong results on graph anomaly detection and classification tasks.
Quantum computing offers energy savings over classical computing.
problem Energy efficiency in computing services.
method Cournot competition model constrained by energy usage.
result Quantum computing firms can outperform classical counterparts in energy efficiency.
EDCompress optimizes energy efficiency of CNN models on edge devices.
problem Low energy consumption for edge devices with diverse dataflow types.
method Energy-aware model compression using reinforcement learning.
result Improves energy efficiency by 20X, 17X, 37X in various networks.
Enhanced tabular benchmarks for energy-efficient neural architecture search.
problem Energy consumption in deep learning models.
method Introducing EC-NAS, an enhanced tabular benchmark with energy consumption data.
result EC-NAS reveals a balance between energy usage and accuracy in neural architecture search.
Improves sample quality of generative models using energy-based methods.
problem Low sample quality in generative models.
method Constructs an energy function on latent space, trains an energy-based model, and generates improved samples.
result Significant improvement in sample quality with minimal computational overhead.
Energy Matching unifies flow matching and energy-based models for generative modeling.
problem Inability of flow-based models to integrate partial observations and priors.
method Energy Matching framework that integrates flow matching and energy-based models.
result Substantially outperforms existing EBMs on CIFAR-10 and ImageNet generation.
TPBS models improve robustness to overfitting with localized Dirichlet energy regularization.
problem Global Dirichlet energy-based regularization fails for TPBS models due to perfect interpolation.
method Propose local Dirichlet energy regularization and two inference estimators.
result TPBS models outperform neural networks in overfitting regimes and maintain competitive performance otherwise.
Energy-efficient DL inference for IoT devices reduces power consumption and improves performance.
problem Energy inefficiency in deep learning models for IoT devices.
method Energy-aware early exiting policy to balance energy consumption and inference accuracy.
result Accuracy and service rate improved up to 25% and 35% respectively.
A neural network model minimizes region-based free energy for faster inference in MRFs.
problem Efficient inference in complex Markov random fields (MRFs).
method Region-based Energy Neural Network (RENN) that directly minimizes region-based free energy.
result RENN outperforms other methods in marginal distribution estimation, partition function estimation, and MRF learning.
A new method trains discrete EBMs without sampling.
problem Training EBMs on discrete spaces is hard.
method Energy Discrepancy (ED), a contrastive loss.
result ED offers theoretical guarantees for various perturbation types.
A new loss function ED simplifies training energy-based models without scores.
problem Training energy-based models is computationally expensive.
method Energy Discrepancy (ED) loss function that does not rely on scores or MCMC.
result ED effectively interpolates between score matching and negative log-likelihood.
GEBM combines energy function and base distribution for better generative modeling.
problem Improving generative models with better quality samples and performance.
method Alternating training between energy function and base distribution, using MCMC for sampling.
result GEBMs produce higher quality samples and better performance than GANs.
Introduces Causal Energy Minimization to understand Transformer layers.
problem Empirical parameterization of Transformer blocks remains largely unexplored.
method Causal Energy Minimization framework that recasts Transformer layers as optimization steps on conditional energy functions.
result Identifies design space for Transformer layers including weight sharing and energy-based interpretations.
EBR improves NMT by re-ranking samples drawn from MLE-trained models.
problem Discrepancy between MLE and BLEU score in neural machine translation.
method Train an energy-based model to mimic BLEU score, then use it for re-ranking.
result EBR consistently improves NMT performance by +4 BLEU points on IWSLT'14 German-English.
Modern Hopfield networks help prevent forgetting in generative models after task changes.
problem How to prevent forgetting in generative models after task changes.
method Introduce intrinsic forgetting as an increase in Hopfield energy after task change, analyze memory replay effectiveness, and validate predictions in experiments.
result High-energy, outlier-like samples are more forgettable than cluster-like samples, and energy-based selection of replay samples mitigates forgetting.
ELS framework improves safety alignment by dynamically steering LLMs towards helpful responses.
problem Over-Refusal in Aligned Large Language Models
method Fine-tuning free framework using an Energy-Based Model (EBM) to dynamically steer LLMs during inference.
result Extensive experiments show a significant reduction in false refusals (from 57.3% to 82.6%) while maintaining safety performance.
EBM predicts protein conformations at atomic scale using crystallized data.
problem Predicting the conformation of a side chain from its context within a protein structure.
method Energy-based model trained on crystallized protein data, evaluating performance on rotamer recovery task.
result EBM achieves performance close to state-of-the-art methods, including Rosetta energy function.
The present chapter gives an overview on results for discrete knot energies. These discrete energies are designed to make swift numerical computations and thus open the field to computational methods. Additionally, they provide an independent, geometrically pleasing and consistent discrete model that behaves similarly …
Inference problems in graphical models can be represented as a constrained optimization of a free energy function. It is known that when the Bethe free energy is used, the fixedpoints of the belief propagation (BP) algorithm correspond to the local minima of the free energy. However BP fails to converge in many cases o…
Probabilistic models can be defined by an energy function, where the probability of each state is proportional to the exponential of the state's negative energy. This paper considers a generalization of energy-based models in which the probability of a state is proportional to an arbitrary positive, strictly decreasing…
This paper tackles risk-aware energy scheduling for MEC networks with microgrids.
problem Risk in energy demand and supply for MEC networks powered by microgrids.
method Formulated an optimization problem with CVaR for energy consumption and generation, analyzed using a multi-agent stochastic game, derived solution with MADRL-based A3C algorithm.
result Significant performance gain by considering CVaR for high accuracy energy scheduling.
Graph Energy Matching improves generation quality for molecular graphs.
problem Discrete energy-based models struggle with efficient and high-quality sampling for graph generation.
method Inspired by transport-map optimization, Graph Energy Matching learns a permutation-invariant potential energy to guide sampling.
result GEM matches or surpasses discrete diffusion baselines on molecular graph benchmarks.
Optimizes energy efficiency in wireless sensor networks with limited information.
problem Maximizing energy efficiency in energy harvesting wireless sensor networks with limited channel state information.
method Modeling as a Multi-Armed Bandits problem and developing an Upper Confidence Bound algorithm.
result Significant gains in energy efficiency compared to benchmark schemes.
Bayesian model for energy-efficient EV navigation.
problem Limited battery capacity in electric vehicles.
method Bayesian modeling and online learning framework with exploration strategies.
result Established rigorous regret bounds for Thompson Sampling.
Paper proposes energy objective for training normalizing flows without determinants.
problem Challenges in training normalizing flows due to Jacobian determinants.
method Introduces energy objective based on proper scoring rules, determinant-free.
result Energy objective supports novel model families and competitive performance.
Hybrid models forecast EPEC energy spot prices.
problem Forecasting energy spot prices in EPEC markets.
method Combining Naive, Fourier, ARMA/GARCH, mean-reversion, jump-diffusion, and RNN models.
result Improved accuracy in forecasting compared to individual models.
ERM uses energy-based selection to improve recursive reasoning.
problem Lack of principled inference mechanism in recursive models.
method Energy-guided Recursive Model (ERM) introduces Hopfield energies for trajectory selection.
result ERM achieves optimal solutions on various puzzles.
Modeling wind dynamics in Saudi Arabia using deep learning and stochastic PDEs.
problem Accurately modeling spatio-temporal wind patterns in a large, diverse, and understudied region.
method Energy distance-based spatial reduction, sparse stochastic Echo State Network, non-stationary stochastic PDE reconstruction.
result Produces more accurate wind speed and energy forecasts, saving $1 million annually.
New method learns latent energy models using particle algorithms.
problem Learning latent variable models with energy priors.
method Continuous-time SDEs for MMLE, particle-based discretization.
result Practical algorithm converges to solve MMLE problem.
New model predicts energy prices under different scenarios.
problem Complex causal relationships in energy markets with continuous regime changes.
method Augmented Time Series Structural Causal Models (ATSCM) integrating neural causal discovery.
result Enables novel counterfactual queries in energy markets.
Paper proposes an alternative to MCMC for sampling in energy-based models.
problem Difficulty in generating samples from the current energy function in contrastive approaches.
method Viewing the evolution of the modeling distribution as the evolution of the energy function and samples from this distribution along a time-dependent vector field.
result The proposed method efficiently matches the current distribution in a finite time, unlike MCMC.
Adversarial attacks can fool ML energy theft detection models.
problem Vulnerability of ML-based energy theft detection models to adversarial attacks.
method Design of an adversarial measurement generation algorithm.
result ML models can be significantly fooled by adversarial attacks, reducing their detection accuracy.
Neural density estimators are flexible families of parametric models which have seen widespread use in unsupervised machine learning in recent years. Maximum-likelihood training typically dictates that these models be constrained to specify an explicit density. However, this limitation can be overcome by instead using …
STOIC improves energy demand forecasting with reliable uncertainty estimates.
problem Accurate point forecasts alone are insufficient for energy systems; reliable uncertainty estimates are needed.
method Integrates graph-based forecasting with tabular foundation models for zero-shot calibration of spatial-temporal residuals.
result STOIC delivers more reliable and robust uncertainty estimates for complex graph-structured energy time series.
mAIS improves free energy evaluation efficiency.
problem Computational infeasibility of exact free energy evaluation.
method mAIS, a marginalized version of AIS.
result mAIS is more efficient under certain conditions.
Global demographic and economic changes have a critical impact on the total energy consumption, which is why demographic and economic parameters have to be taken into account when making predictions about the energy consumption. This research is based on the application of a multiple linear regression model and a neura…
New sampler tackles complex discrete energy landscapes efficiently.
problem Stagnation in gradient-based discrete samplers for non-convex settings.
method DREXEL sampler with Replica Exchange and Adjusted Metropolis.
result Proves samplers satisfy detailed balance and converge to target distribution.
Case study shows impact of co-optimizing energy and reserve for wind energy.
problem Impact of lack of co-optimization of energy and reserve in high wind penetration scenarios.
method Developed two models with and without co-optimization, calibrated with Spanish market parameters.
result Models show significant differences in energy and reserve management.
Bayesian model for energy consumption helps electric vehicles navigate efficiently.
problem Limited battery capacity in electric vehicles makes energy efficient navigation challenging.
method Developed an online learning framework using Bayesian models and exploration strategies like Thompson Sampling.
result Established rigorous regret bounds for Thompson Sampling in both single-agent and multi-agent settings.
New method assesses energy storage value beyond cost reduction.
problem Improving energy storage value beyond cost reduction.
method Market potential method to evaluate and compare energy storage technologies.
result High-cost hydrogen storage can be more valuable than low-cost hydrogen storage.