A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Attention mechanism combines bottom-up and top-down signals in neural networks.
Bottom-up algorithms outperform top-down in hierarchical community detection at intermediate levels.
Efficient unsupervised training and inference in deep generative models remains a challenging problem. One basic approach, called Helmholtz machine, involves training a top-down directed generative model together with a bottom-up auxiliary model used for approximate inference. Recent results indicate that better genera…
We propose a top-down model for cash CLO. This model can consistently price cash CLO tranches both within the same deal and across different deals. Meaningful risk measures for cash CLO tranches can also be defined and computed. This method is self-consistent, easy to implement and computationally efficient. It has the…
In the top-down approach to multi-name credit modeling, calculation of singe name sensitivities appears possible, at least in principle, within the so-called random thinning (RT) procedure which dissects the portfolio risk into individual contributions. We make an attempt to construct a practical RT framework that enab…
Decision tree learning is a popular approach for classification and regression in machine learning and statistics, and Bayesian formulations---which introduce a prior distribution over decision trees, and formulate learning as posterior inference given data---have been shown to produce competitive performance. Unlike c…
Top-down information plays a central role in human perception, but plays relatively little role in many current state-of-the-art deep networks, such as Convolutional Neural Networks (CNNs). This work seeks to explore a path by which top-down information can have a direct impact within current deep networks. We explore …
A new method to learn EBM in latent space for better data modeling.
Paper introduces algorithms for private decision tree learning.
CNT leverages noisy targets to guide model learning.
End-to-end deep model for coherent probabilistic forecasts in hierarchical time series.
Large-scale classification of data where classes are structurally organized in a hierarchy is an important area of research. Top-down approaches that exploit the hierarchy during the learning and prediction phase are efficient for large scale hierarchical classification. However, accuracy of top-down approaches is poor…
Efficient algorithm for evaluating hierarchical classification methods at multiple operating points.
Study improves forecasting of aggregated curves in electricity markets.
Paper uses LLMs for sector allocation, showing better returns.
Unified determinants via a single equation.
As the range of tasks performed by a general vision system expands, executing multiple tasks accurately and efficiently in a single network has become an important and still open problem. Recent computer vision approaches address this problem by branching networks, or by a channel-wise modulation of the network feature…
A new method for feature fusion in U-Net decoders using difference-based gating.
Study explores robust Orlicz spaces in finance, showing separability implications.
The quality of data representation in deep learning methods is directly related to the prior model imposed on the representations; however, generally used fixed priors are not capable of adjusting to the context in the data. To address this issue, we propose deep predictive coding networks, a hierarchical generative mo…
Hierarchical clustering is a popular unsupervised data analysis method. For many real-world applications, we would like to exploit prior information about the data that imposes constraints on the clustering hierarchy, and is not captured by the set of features available to the algorithm. This gives rise to the problem …
A generative model is developed for deep (multi-layered) convolutional dictionary learning. A novel probabilistic pooling operation is integrated into the deep model, yielding efficient bottom-up (pretraining) and top-down (refinement) probabilistic learning. Experimental results demonstrate powerful capabilities of th…
We show that a generative random field model, which we call generative ConvNet, can be derived from the commonly used discriminative ConvNet, by assuming a ConvNet for multi-category classification and assuming one of the categories is a base category generated by a reference distribution. If we further assume that the…
The development of algorithms for hierarchical clustering has been hampered by a shortage of precise objective functions. To help address this situation, we introduce a simple cost function on hierarchies over a set of points, given pairwise similarities between those points. We show that this criterion behaves sensibl…
In this paper, we propose a novel generative model named Stacked Generative Adversarial Networks (SGAN), which is trained to invert the hierarchical representations of a bottom-up discriminative network. Our model consists of a top-down stack of GANs, each learned to generate lower-level representations conditioned on …
We derive a convex optimization problem for the task of segmenting sequential data, which explicitly treats presence of outliers. We describe two algorithms for solving this problem, one exact and one a top-down novel approach, and we derive a consistency results for the case of two segments and no outliers. Robustness…
A new multi-phase approach improves supply chain forecasting accuracy.
Extends PCVM for multi-class classification with improved accuracy.
NFM improves deep learning by selectively processing hidden states.
Distribution feeder long-term load forecast (LTLF) is a critical task many electric utility companies perform on an annual basis. The goal of this task is to forecast the annual load of distribution feeders. The previous top-down and bottom-up LTLF methods are unable to incorporate different levels of information. This…
Study finds almost contact structures in thermal QCD-like theories at intermediate coupling.
Several real problems ranging from text classification to computational biology are characterized by hierarchical multi-label classification tasks. Most of the methods presented in literature focused on tree-structured taxonomies, but only few on taxonomies structured according to a Directed Acyclic Graph (DAG). In thi…
Reduces high granularity and dimensionality in hierarchical categorical variables.
We present a new model for credit index derivatives, in the top-down approach. This model has a dynamic loss intensity process with volatility and jumps and can include counterparty risk. It handles CDS, CDO tranches, Nth-to-default and index swaptions. Using properties of affine models, we derive closed formulas for t…
Extractive compression is a challenging natural language processing problem. This work contributes by formulating neural extractive compression as a parse tree transduction problem, rather than a sequence transduction task. Motivated by this, we introduce a deep neural model for learning structure-to-substructure tree …
New method for summarizing ranking distributions using consensus ranking distributions.
This paper considers the modelling of collateralized debt obligations (CDOs). We propose a top-down model via forward rates generalizing Filipović, Overbeck and Schmidt (2009) to the case where the forward rates are driven by a finite dimensional Lévy process. The contribution of this work is twofold: we provide condit…
Develops a new method to recover large latent tree models efficiently.
Natural language processing (NLP) can be done using either top-down (theory driven) and bottom-up (data driven) approaches, which we call mechanistic and phenomenological respectively. The approaches are frequently considered to stand in opposition to each other. Examining some recent approaches in deep learning we arg…
New VAE models reveal hierarchical visual cortex computations.
New learning rules from information bottleneck improve deep learning without precise labels.
The goal of this paper is to specify dynamic term structure models with discrete tenor structure for credit portfolios in a top-down setting driven by time-inhomogeneous Lévy processes. We provide a new framework, conditions for absence of arbitrage, explicit examples, an affine setup which includes contagion and prici…
A new method learns latent space normalizing flow for approximate inference in generator models.
A generative Bayesian model is developed for deep (multi-layer) convolutional dictionary learning. A novel probabilistic pooling operation is integrated into the deep model, yielding efficient bottom-up and top-down probabilistic learning. After learning the deep convolutional dictionary, testing is implemented via dec…
Automated pavement distresses detection using road images remains a challenging topic in the computer vision research community. Recent developments in deep learning has led to considerable research activity directed towards improving the efficacy of automated pavement distress identification and rating. Deep learning …
This paper describes a flexible and tractable bottom-up dynamic correlation modelling framework with a consistent stochastic recovery specification. The stochastic recovery specification only models the first two moments of the spot recovery rate as its higher moments have almost no contribution to the loss distributio…
We propose a new framework to value employee stock options (ESOs) that captures multiple exercises of different quantities over time. We also model the ESO holder's job termination risk and incorporate its impact on the payoffs of both vested and unvested ESOs. Numerical methods based on Fourier transform and finite di…
Future predictions on sequence data (e.g., videos or audios) require the algorithms to capture non-Markovian and compositional properties of high-level semantics. Context-free grammars are natural choices to capture such properties, but traditional grammar parsers (e.g., Earley parser) only take symbolic sentences as i…