New method predicts wind farm power and wakes using weather patterns.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
The paper rethinks the use of exponential averaging in machine learning optimization.
NRWS improves training of SBNs and HMs using natural gradient.
A new method for training generative models with sparse supervision.
New method improves variational inference for better posterior approximation.
We propose a practical approach based on federated learning to solve out-of-domain issues with continuously running embedded speech-based models such as wake word detectors. We conduct an extensive empirical study of the federated averaging algorithm for the "Hey Snips" wake word based on a crowdsourced dataset that mi…
Proves global existence and uniqueness of solutions for Einstein-scalar-field equations.
Fluctuations in heart rate are intimately tied to changes in the physiological state of the organism. We examine and exploit this relationship by classifying a human subject's wake/sleep status using his instantaneous heart rate (IHR) series. We use a convolutional neural network (CNN) to build features from the IHR se…
Deep learning detects microsleep episodes in EEG data.
Stochastic control-flow models (SCFMs) are a class of generative models that involve branching on choices from discrete random variables. Amortized gradient-based learning of SCFMs is challenging as most approaches targeting discrete variables rely on their continuous relaxations---which can be intractable in SCFMs, as…
Framework for lifelong learning using eigentasks to avoid forgetting and transfer knowledge.
Models that employ latent variables to capture structure in observed data lie at the heart of many current unsupervised learning algorithms, but exact maximum-likelihood learning for powerful and flexible latent-variable models is almost always intractable. Thus, state-of-the-art approaches either abandon the maximum-l…
The study optimizes wind farm yaw control using Gaussian process regression and high-fidelity simulations.
DDVI uses diffusion models for variational inference, improving latent variable model performance.
NAS-X improves inference and model learning for SLVMs.
A new approach to learning in brain-like networks using adversarial algorithms.
Massively parallel RWS improves inference in complex models.
We give a parametrization of test configurations in the sense of Donaldson via spherical buildings, and show the existence of "optimal" destabilizing test configurations for unstable varieties, in the wake of Mumford and Kempf. We also give an account of the recent slight amendment to definition of K-stability after Li…
The paper finds new inequalities for convex polygons.
QEM uses parallel importance weighting for fast approximate Bayesian inference.
This is a revised version of the notes from the week-long course I gave at the Centre de Recerca Matematica, Barcelona, in September of 2010. The aim is to give a working overview of recent methods and results in "Blaschkean integral geometry" (i.e. the subject revolving around the kinematic formulas of Blaschke) in th…
Koopman decomposition is a non-linear generalization of eigen-decomposition, and is being increasingly utilized in the analysis of spatio-temporal dynamics. Well-known techniques such as the dynamic mode decomposition (DMD) and its linear variants provide approximations to the Koopman operator, and have been applied ex…
We introduce the implicit processes (IPs), a stochastic process that places implicitly defined multivariate distributions over any finite collections of random variables. IPs are therefore highly flexible implicit priors over functions, with examples including data simulators, Bayesian neural networks and non-linear tr…
Penrose's conjecture links black holes and gravitational singularities.
Survey of stablecoins to reduce cryptocurrency volatility.
This article propounds, in the wake of influential work of Fefferman and Graham about Poincaré extensions of conformal structures, a definition of a (Poincaré-)Schrödinger manifold whose boundary is endowed with a conformal Bargmann structure above a non-relativistic Newton-Cartan spacetime. Examples of such manifolds …
Geographic diversification is fundamental to risk mitigation among investors and insurers of housing, mortgages, and mortgage-related derivatives. To characterize diversification potential, we provide estimates of integration, spatial correlation, and contagion among US metropolitan housing markets. Results reveal a hi…
We introduce the thermodynamic variational objective (TVO) for learning in both continuous and discrete deep generative models. The TVO arises from a key connection between variational inference and thermodynamic integration that results in a tighter lower bound to the log marginal likelihood than the standard variatio…
We analyze a proprietary dataset of trades by a single asset manager, comparing their price impact with that of the trades of the rest of the market. In the context of a linear propagator model we find no significant difference between the two, suggesting that both the magnitude and time dependence of impact are univer…
I sketch a program for a microeconomic theory of the main component of the business cycle as a recurring disequilibrium, driven by incompleteness of the financial market and by information asymmetries between borrowers and lenders. This proposal seeks to incorporate five distinct but connected processes that have been …
In this paper, we present Neural Phrase-based Machine Translation (NPMT). Our method explicitly models the phrase structures in output sequences using Sleep-WAke Networks (SWAN), a recently proposed segmentation-based sequence modeling method. To mitigate the monotonic alignment requirement of SWAN, we introduce a new …
New method speeds up generative modeling without requiring diffusion steps.
The study finds significant financial sector volatility and tail risk spillovers to real economy sectors.
The Markov Theorem Without Stabilization (MTWS) established the existence of a calculus of braid isotopies that can be used to move between closed braid representatives of a given oriented link type without having to increase the braid index by stabilization. Although the calculus is extensive there are three key isoto…
This paper proposes the divergence triangle as a framework for joint training of generator model, energy-based model and inference model. The divergence triangle is a compact and symmetric (anti-symmetric) objective function that seamlessly integrates variational learning, adversarial learning, wake-sleep algorithm, an…
The Markov Theorem Without Stabilization (MTWS) (see math.GT/0310279) established the existence of a calculus of braid isotopies that can be used to move between closed braid representatives of a given oriented link type without having to increase the braid index by stabilization. Although the calculus is extensive the…
Highly expressive directed latent variable models, such as sigmoid belief networks, are difficult to train on large datasets because exact inference in them is intractable and none of the approximate inference methods that have been applied to them scale well. We propose a fast non-iterative approximate inference metho…
This paper describes InfoGAN, an information-theoretic extension to the Generative Adversarial Network that is able to learn disentangled representations in a completely unsupervised manner. InfoGAN is a generative adversarial network that also maximizes the mutual information between a small subset of the latent varia…
In the wake of the still ongoing global financial crisis, bank interdependencies have come into focus in trying to assess linkages among banks and systemic risk. To date, such analysis has largely been based on numerical data. By contrast, this study attempts to gain further insight into bank interconnections by tappin…
We introduce a new approach to learning in hierarchical latent-variable generative models called the "distributed distributional code Helmholtz machine", which emphasises flexibility and accuracy in the inferential process. In common with the original Helmholtz machine and later variational autoencoder algorithms (but …
We explore the application of end-to-end stateless temporal modeling to small-footprint keyword spotting as opposed to recurrent networks that model long-term temporal dependencies using internal states. We propose a model inspired by the recent success of dilated convolutions in sequence modeling applications, allowin…
Deep generative models have achieved impressive success in recent years. Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs), as emerging families for generative model learning, have largely been considered as two distinct paradigms and received extensive independent studies respectively. This pa…
Valuation of Credit Valuation Adjustment (CVA) has become an important field as its calculation is required in Basel III, issued in 2010, in the wake of the credit crisis. Exposure, which is defined as the potential future loss of a default event without any recovery, is one of the key elementsfor pricing CVA. This pap…
We study a variant of decision-theoretic online learning in which the set of experts that are available to Learner can shrink over time. This is a restricted version of the well-studied sleeping experts problem, itself a generalization of the fundamental game of prediction with expert advice. Similar to many works in t…
Corporate venture capital is in the midst of a renaissance. The end of 2015 marked all-time highs both in the number of corporate firms participating in VC deals and in the amount of capital being deployed by corporate VCs. This paper explores, rather than defines, how these firms find success in the wake of this sudde…
In the wake of recent advances in experimental methods in neuroscience, the ability to record in-vivo neuronal activity from awake animals has become feasible. The availability of such rich and detailed physiological measurements calls for the development of advanced data analysis tools, as commonly used techniques do …
Study automates detection of visitation disruptions in ICU patients.
Any surface can be foliated into equipotential hypersurfaces of the level sets. A current result is that the contours are the progressing wave fronts of a certain hyperbolic partial differential equation, a wave equation. It is connected with the gradient lines, as well as with a corresponding eikonal equation. The lev…