Proposes continuous convolution layers for flexible feature map resizing.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Shape adaptor learns flexible resizing factors for neural networks.
New methods improve prediction intervals across multiple environments.
The most straightforward method to accelerate Stochastic Gradient Descent (SGD) computation is to distribute the randomly selected batch of inputs over multiple processors. To keep the distributed processors fully utilized requires commensurately growing the batch size. However, large batch training often leads to poor…
Determining the appropriate batch size for mini-batch gradient descent is always time consuming as it often relies on grid search. This paper considers a resizable mini-batch gradient descent (RMGD) algorithm based on a multi-armed bandit for achieving best performance in grid search by selecting an appropriate batch s…
We propose a novel method to train deep convolutional neural networks which learn from multiple data sets of varying input sizes through weight sharing. This is an advantage in chemometrics where individual measurements represent exact chemical compounds and thus signals cannot be translated or resized without disturbi…
Bayesian optimization has recently emerged as a popular and efficient tool for global optimization and hyperparameter tuning. Currently, the established Bayesian optimization practice requires a user-defined bounding box which is assumed to contain the optimizer. However, when little is known about the probed objective…
More and more companies have deployed machine learning (ML) clusters, where deep learning (DL) models are trained for providing various AI-driven services. Efficient resource scheduling is essential for maximal utilization of expensive DL clusters. Existing cluster schedulers either are agnostic to ML workload characte…
Most existing GANs architectures that generate images use transposed convolution or resize-convolution as their upsampling algorithm from lower to higher resolution feature maps in the generator. We argue that this kind of fixed operation is problematic for GANs to model objects that have very different visual appearan…
Synthesizing high resolution photorealistic images has been a long-standing challenge in machine learning. In this paper we introduce new methods for the improved training of generative adversarial networks (GANs) for image synthesis. We construct a variant of GANs employing label conditioning that results in 128x128 r…
Gradient boosted decision trees (GBDT) is the leading algorithm for many commercial and academic data applications. We give a deep analysis of this algorithm, especially the histogram technique, which is a basis for the regulized distribution with compact support. We present three new modifications. 1) Share memory tec…
New algorithm improves dataset distillation with 108% improvement on ImageNet.
Deep learning accelerators efficiently train over vast and growing amounts of data, placing a newfound burden on commodity networks and storage devices. A common approach to conserve bandwidth involves resizing or compressing data prior to training. We introduce Progressive Compressed Records (PCRs), a data format that…
In aircraft industry, market needs evolve quickly in a high competitiveness context. This requires adapting a given aircraft model in minimum time considering for example an increase of range or the number of passengers (cf A330 NEO family). The computation of loads and stress to resize the airframe is on the critical …
SVMs improve forest fire detection accuracy on challenging datasets.
Aggregation defenses improve deep learning models' robustness against data poisoning attacks.
This paper examines how labeling error affects contrastive learning and proposes data dimensionality reduction methods to mitigate its impact.
Recent studies have shown that adversarial examples in state-of-the-art image classifiers trained by deep neural networks (DNN) can be easily generated when the target model is transparent to an attacker, known as the white-box setting. However, when attacking a deployed machine learning service, one can only acquire t…
Study on 2-valued dynamics on complex plane, showing some dynamics can't be group actions.
The paper studies dynamic star-shaped risk measures and their representation.
Study circles to understand dynamics and rigidity in homogeneous spaces.
A Riemmanian foliated dynamical system of 3-dimension is a closed Riemannian 3-manifold with additional structures: foliation, dynamical system. In the context of arithmetic topology, it is a geometric/analytic analogue of an arithmetic scheme with a conjectural dynamical system suggested by C. De…
Paper connects dynamics of mechanical systems to Reeb dynamics.
Two heuristics solve dynamic multiple travelling salesmen problems.
In this paper we present a theoretical framework for studying coherent acceptability indices in a dynamic setup. We study dynamic coherent acceptability indices and dynamic coherent risk measures, and we establish a duality between them. We derive a representation theorem for dynamic coherent risk measures in terms of …
DOODL learns shared spectral dynamics across related dynamical systems.
We propose a new class of mappings, called Dynamic Limit Growth Indices, that are designed to measure the long-run performance of a financial portfolio in discrete time setup. We study various important properties for this new class of measures, and in particular, we provide necessary and sufficient condition for a Dyn…
In this paper we present a theoretical framework for determining dynamic ask and bid prices of derivatives using the theory of dynamic coherent acceptability indices in discrete time. We prove a version of the First Fundamental Theorem of Asset Pricing using the dynamic coherent risk measures. We introduce the dynamic …
Dynamical-VAE learns causal dynamics from POMDPs using future information.
Most real world phenomena such as sunlight distribution under a forest canopy, minerals concentration, stock valuation, exhibit nonstationary dynamics i.e. phenomenon variation changes depending on the locality. Nonstationary dynamics pose both theoretical and practical challenges to statistical machine learning algori…
Unified analysis of DLNs using DMFT reveals dynamics of loss convergence and generalization trade-offs.
dLDS models neural dynamics as sparse combinations of simpler components.
Reinforcement learning would enjoy better success on real-world problems if domain knowledge could be imparted to the algorithm by the modelers. Most problems have both hidden state and unknown dynamics. Partially observable Markov decision processes (POMDPs) allow for the modeling of both. Unfortunately, they do not p…
We consider trivializations of second iterated bundles of a Lie group that preserve lifted group structures. With such a trivialization, we elaborate Hamiltonian dynamics on cotangent, Lagrangian dynamics on tangent bundles and, both Hamiltonian and Lagrangian dynamics on Tulczyjew's symplectic space which is tangent o…
Framework for quantifying uncertainty in dynamic processes.
This survey clarifies dynamic network terminology and reviews GNN models for dynamic networks.
Framework infers Langevin dynamics from stochastic observations of latent systems.
The paper introduces a dynamic MVP model using high-frequency financial data.
The paper extends Vlasov kinetic theory to time-dependent dynamics using cosymplectic and cocontact manifolds.
NDS learns dynamical models with prior knowledge, improving accuracy and efficiency.
New method learns population dynamics from snapshots, outperforming existing models.
Paper uses Chebyshev Tensors for accurate dynamic sensitivities and ISDA SIMM computation.
Model dynamic customer sensitivities across categories.
Survey on computational models in dynamical systems, including new universality concepts.
FNSDA adapts to new dynamics via Fourier space adaptation.
Study on geometry and dynamics of transverse subgroups.
Dynamic risk assessment method for WUI fires improves upon static frameworks.
Develops a method to model neural dynamics with flexible yet interpretable latent states.