Symplectic discretization accelerates optimization of smooth convex functions.
problem Optimizing smooth convex functions efficiently.
method Discretizing Nesterov's and Polyak's methods using Euler and symplectic schemes.
result Symplectic discretization achieves accelerated optimization for smooth convex functions.
Gradient-based optimization algorithms can be studied from the perspective of limiting ordinary differential equations (ODEs). Motivated by the fact that existing ODEs do not distinguish between two fundamentally different algorithms---Nesterov's accelerated gradient method for strongly convex functions (NAG-SC) and Po…
New ODE models show saddle-point optimization methods converge differently, with last-iterate convergence for OGDA.
problem Analyzing convergence properties of saddle-point optimization methods.
method High-Resolution Differential Equations (HRDEs) to design differential equation models for saddle-point optimization methods.
result HRDEs reveal last-iterate convergence for Optimistic Gradient Descent Ascent (OGDA) in bilinear games.
This research accelerates sampling methods using Nesterov's Acceleration.
problem Improving sampling efficiency in MCMC methods.
method Developed a Hessian-Free High-Resolution ODE reformulation of NAG-SC, injected noise, and discretized the diffusion process.
result Quantified acceleration beyond underdamped Langevin in W2 distance for log-strongly-concave targets. CT-OT Flow estimates continuous-time dynamics from discrete snapshots.
problem Estimating continuous-time dynamics from temporally aggregated snapshots with noisy or uncertain timestamps.
method Two-stage framework: aligning neighboring intervals via partial optimal transport (POT) and reconstructing a continuous-time distribution through temporal kernel smoothing.
result Reduces distributional and trajectory errors compared with existing methods across synthetic and real datasets.
This paper simplifies diffusion models for high resolution images.
problem Applying diffusion models to high resolution images is challenging.
method Adjust noise schedule, scale specific parts, add dropout, and use downsampling.
result Achieved state-of-the-art image generation performance.
Study proposes CNN for reconstructing high-res urban DEMs.
problem Lack of high-res urban DEM datasets for flood modeling.
method Multi-scale CNN model trained on urban DEMs of varying resolutions.
result CNN-based method produces superior high-res urban DEMs.
StyleNeRF generates high-resolution images with 3D consistency and style control.
problem Generating high-resolution images with fine details and 3D consistency.
method Integrates NeRF into a style-based generator for efficient high-resolution image synthesis.
result Synthesizes high-resolution images at interactive rates with high 3D consistency and style control.
Method fuses low and high-resolution data for better health estimates.
problem Improving high-resolution health estimates from mixed data sources.
method Fusion of unbiased low-resolution and potentially biased high-resolution data, learning a distribution consistent with sampling bias.
result Significant reduction in bias in high-resolution estimates.
SR-NAM maps low-res images to multiple high-res images realistically.
problem Mapping low-resolution images to multiple high-resolution images realistically.
method SR-NAM using Non-Adversarial Mapping (NAM) technique and a degradation model.
result Realistic degradation and down-sampling of high-resolution images.
The paper presents a method to recover high-resolution signals from low-resolution measurements.
problem Recovering high-resolution signals from low-resolution indirect measurements.
method Combining generalized sampling and functional principal component analysis.
result High-resolution recovery is possible under certain conditions and with a sufficiently large training set.
Paper generates high-resolution fashion images based on body pose.
problem Limited variety of outfit images for shopping.
method Generative model trained on body pose and style transfer.
result Realistic high-resolution images of models in custom outfits.
Pixel-space diffusion models outperform latent models on high-resolution image synthesis.
problem Efficiency and quality trade-off in high-resolution image synthesis.
method Sigmoid loss-weighting, simplified architecture, and resolution scaling.
result Achieved 1.5 FID on ImageNet512, new SOTA results on other datasets.
We present a method of generating high resolution 3D shapes from natural language descriptions. To achieve this goal, we propose two steps that generating low resolution shapes which roughly reflect texts and generating high resolution shapes which reflect the detail of texts. In a previous paper, the authors have show…
Augmented Neural ODEs improve stability and expressiveness of ODEs.
problem Limitations of Neural ODEs in representing complex functions.
method Introducing Augmented Neural ODEs that are more expressive and stable.
result Augmented Neural ODEs outperform Neural ODEs in stability, generalization, and computational efficiency.
HRFA generates high-resolution, realistic adversarial examples for DNNs.
problem Revealing vulnerabilities of DNNs with imperceptible, semantic attacks.
method Modifies latent feature representation, backpropagating through generative model.
result Generates adversarial examples with up to 1024x1024 resolution, evading denoising defenses.
Deep learning for Venus images uses high-res hyperspectral data to simulate ground truth.
problem Lack of accurate ground truth data for training deep neural networks in remote sensing.
method Unmixing high-resolution hyperspectral images to simulate ground truth for training a CNN.
result The model can classify mid-resolution Venus images successfully.
We propose Progressive Structure-conditional Generative Adversarial Networks (PSGAN), a new framework that can generate full-body and high-resolution character images based on structural information. Recent progress in generative adversarial networks with progressive training has made it possible to generate high-resol…
This study shows why training Neural ODEs is hard and proposes a new method.
problem Training Neural ODEs is challenging, especially in practice.
method Proposed a new stabilization method and provided an analytical convergence analysis.
result Insights and techniques for researchers starting work on Neural ODEs.
Obtaining magnetic resonance images (MRI) with high resolution and generating quantitative image-based biomarkers for assessing tissue biochemistry is crucial in clinical and research applications. How- ever, acquiring quantitative biomarkers requires high signal-to-noise ratio (SNR), which is at odds with high-resolut…
Paper proposes combining GAM and DNN for accurate peak demand estimation from lower-resolution data.
problem Predicting high-resolution peak demand from limited lower-resolution data.
method Combines generalized additive models (GAM) and deep neural networks (DNN) for half-hourly load forecasting.
result Proposed method reduces out-of-sample RMSE by 57.4% compared to benchmark.
New model handles uneven time intervals better than traditional methods.
problem Irregularly-sampled time series data.
method Generalizes RNNs to ODE-RNNs, explicitly modeling observation gaps.
result ODE-RNNs outperform traditional models on irregular data.
Climate projections continue to be marred by large uncertainties, which originate in processes that need to be parameterized, such as clouds, convection, and ecosystems. But rapid progress is now within reach. New computational tools and methods from data assimilation and machine learning make it possible to integrate …
Minimal surfaces in third-order ODEs identified for linear second-order ODEs.
problem Characterizing minimal surfaces in third-order ODEs.
method Analyzing submanifolds of third-order ODEs as Riemannian manifolds.
result Linear second-order ODEs with y′′=±y+β(x) are the only minimal surfaces and totally geodesic. ODE2VAE learns latent dynamics for sequential data.
problem Learning latent dynamics for high-dimensional sequential data.
method Deep generative second order ODE model with Bayesian neural networks.
result State-of-the-art performance in long-term motion prediction and imputation.
DALTON improves ODE parameter estimation by learning from noisy data.
problem High sensitivity to parameters in ODEs produces unreliable parameter estimates.
method Data-adaptive probabilistic likelihood approximation for ODEs.
result DALTON produces more accurate parameter estimates than existing methods.
Improved neural-ODE for faster convergence and stability.
problem Stability, consistency, and convergence issues in neural-ODE solvers.
method Proposed a first-order Nesterov's accelerated gradient (NAG) based ODE-solver.
result Efficacy demonstrated in three tasks: supervised classification, density estimation, and time-series modelling.
New method uses Gaussian ODE filtering to approximate likelihoods for fast ODE inverse problems.
problem Intractable forward models in likelihood-free inference, especially for ODEs.
method Gaussian ODE filtering to construct local Gaussian likelihood approximations.
result New solvers outperform standard likelihood-free approaches on benchmark systems.
Faster training of neural ODEs using Gauß-Legendre quadrature.
problem Training neural ODEs is slow due to solving ODEs numerically.
method Use Gauß-Legendre quadrature to solve integrals faster than ODE-based methods.
result Faster training of neural ODEs, especially for large models.
ANODEV2 extends Neural ODEs to include evolving parameters.
problem Training and accuracy of neural networks.
method Coupled ODE-based framework for evolving neural network parameters.
result ANODEV2 achieves higher accuracy than baseline models and Neural ODEs.
Paper analyzes convergence of ODE samplers in Wasserstein distances.
problem Limited theoretical understanding of convergence properties of probability flow ODEs.
method Convergence analysis for general probability flow ODEs in 2-Wasserstein distance.
result First non-asymptotic convergence analysis for probability flow ODE samplers.
First-order ODEs linked to flat surfaces, leading to integrability.
problem Integrating first-order ODEs.
method Defined Riemannian metrics on variable spaces, studied surface properties, and established connections between Jacobi fields and Lie point symmetries.
result Flat associated surfaces lead to integrable first-order ODEs.
This paper uses ODE to improve RNN models for time series data.
problem Improving RNN models for irregularly sampled time series data.
method Extending RNNs with Neural Ordinary Differential Equations (ODEs).
result New ODE-based RNN models reduce training and evaluation time.
A new Fourier model improves ODE prediction.
problem Improving the accuracy of ODE solutions, especially for periodic functions.
method Constructing a Fourier state space model and a hybrid model combining Taylor and Fourier methods.
result The hybrid model can predict ODE solutions more accurately, especially for periodic functions.
New ODE solvers improve training efficiency and accuracy.
problem Training Neural ODEs requires efficient and accurate gradient calculation.
method Presented algebraically reversible ODE solvers that are time and memory efficient, calculate exact gradients, and are numerically stable.
result Reversible solvers strictly improve upon previous architectures in efficiency and accuracy.
The study identifies exceptions to fiber-preserving symmetry in ODEs and systems.
problem Identifying exceptions to fiber-preserving symmetry in ODEs and systems.
method Lie's classification of Lie algebras of vector fields, absolute and relative scalar differential invariants, conditional and vector-valued relative invariants, prolongations of actions.
result Examples of scalar ODEs and systems with symmetry groups not fiber-preserving.
Deep learning speeds up whole heart MRI to 30 seconds.
problem Long acquisition times in whole heart MRI.
method Deep learning, specifically a 3D residual U-Net, to reconstruct high-resolution images from low-resolution data.
result Super-resolution images show better edge sharpness and fewer artefacts than low-resolution images.
New method combines ODE filters and numerical quadrature to propagate model uncertainty.
problem Propagation of model uncertainty in ODE solutions with uncertain parameters.
method Combining ODE filters with numerical quadrature.
result Effective propagation of both numerical and parametric uncertainty.
New symmetry dimensions for higher order ODEs are identified.
problem Determining the maximal and submaximal symmetry dimensions for higher order ODEs.
method Cartan-geometric approach to classify symmetry dimensions.
result Next largest realizable symmetry dimensions for scalar ODEs of order ≥ 4 and vector ODEs of order ≥ 3 are determined.
The aim of this paper is to construct a Riemann-Lagrange geometry on 1-jet spaces, in the sense of d-connections, d-torsions, d-curvatures, electromagnetic d-field and geometric electromagnetic Yang-Mills energy, starting from a given linear ODEs system or a given superior order ODE. The case of a non-homogenous linear…
Enhanced Neural ODEs outperform traditional models in image classification and video prediction.
problem Efficiently modeling time-varying dynamics in neural networks.
method Proposed a novel family of non-autonomous Neural ODEs with time-varying weights.
result Outperformed previous Neural ODE variants in speed and representational capacity.
Paper improves neural ODEs for forecasting non-Markovian processes.
problem Forecasting irregularly observed time series with incomplete data.
method Path-dependent Neural Jump ODEs with signature transform.
result Path-dependent NJ-ODE outperforms original framework in non-Markovian data.
This paper explores normalization in neural ODEs, achieving high accuracy in CIFAR-10.
problem Understanding the role of normalization in neural ODEs.
method Investigated different normalization techniques and their impact on neural ODEs performance.
result Achieved 93% accuracy in CIFAR-10 classification task.
This work combines GANs and A3C for high-resolution image compression.
problem Image compression for high-resolution images without loss of quality.
method Hybrid approach using GANs and A3C for end-to-end learning.
result Improves PSNR for high-resolution images through end-to-end learning.
Derives PF-ODE for infinite-dimensional functions, improving function generation tasks.
problem Efficient inference in infinite-dimensional diffusion models.
method Derives PF-ODE in infinite-dimensional function spaces.
result Reduces function evaluations while maintaining sample quality.
CESAR improves wind speed and power forecasting for high-resolution simulations.
problem Accurate high-resolution wind forecasting for efficient power grid management.
method A spatio-temporal neural network model using deep convolutional autoencoder and echo state network.
result CESAR provides up to 17% improvement in wind speed and power forecasting compared to best alternatives.
We analyze high-resolution foreign exchange data consisting of 20 million data points of USD-JPY for 13 years to report firm statistical laws in distributions and correlations of exchange rate fluctuations. A conditional probability density analysis clearly shows the existence of trend-following movements at time scale…
Neural ODEs' performance varies with numerical method, requiring adaptive step size control.
problem Neural ODEs' performance depends on the numerical method used during training.
method Proposes an adaptive step size control algorithm to ensure a valid ODE without increasing computational cost.
result Valid Neural ODEs require careful numerical method selection and step size adaptation.