The paper improves dropout's utility by reducing interactions in deep neural networks.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Loss Data Analytics is an interactive, online, freely available text. The idea behind the name Loss Data Analytics is to integrate classical loss data models from applied probability with modern analytic tools. In particular, we seek to recognize that big data (including social media and usage based insurance) are here…
Paper proposes self-supervised method for accurate speaker diarization.
Feature selection is a technique to screen out less important features. Many existing supervised feature selection algorithms use redundancy and relevancy as the main criteria to select features. However, feature interaction, potentially a key characteristic in real-world problems, has not received much attention. As a…
Framework for systemic risk modeling using jointly exchangeable arrays.
We present an approach for building an active agent that learns to segment its visual observations into individual objects by interacting with its environment in a completely self-supervised manner. The agent uses its current segmentation model to infer pixels that constitute objects and refines the segmentation model …
We study a credit risk model which captures effects of economic interactions on a firm's default probability. Economic interactions are represented as a functionally defined graph, and the existence of both cooperative, and competitive, business relations is taken into account. We provide an analytic solution of the mo…
A simple banking network model is proposed which features multiple waves of bank defaults and is analytically solvable in the limiting case of an infinitely large homogeneous network. The model is a collection of nodes representing individual banks; associated with each node is a balance sheet consisting of assets and …
In this paper, we study the Empirical Risk Minimization problem in the non-interactive local model of differential privacy. In the case of constant or low dimensionality (), we first show that if the ERM loss function is -smooth, then we can avoid a dependence of the sample complexity, to achieve e…
Study predicts doubling of U.S. maize insurance claims due to climate change.
Paper addresses ERM in LDP, reducing sample complexity for smooth and convex losses.
New method learns particle system potentials from unlabeled data.
We propose an interacting particle system to model the evolution of a system of banks with mutual exposures. In this model, a bank defaults when its normalized asset value hits a lower threshold, and its default causes instantaneous losses to other banks, possibly triggering a cascade of defaults. The strength of this …
Loss to followup is a significant issue in healthcare and has serious consequences for a study's validity and cost. Methods available at present for recovering loss to followup information are restricted by their expressive capabilities and struggle to model highly non-linear relations and complex interactions. In this…
Latent factor models for Recommender Systems with implicit feedback typically treat unobserved user-item interactions (i.e. missing information) as negative feedback. This is frequently done either through negative sampling (point--wise loss) or with a ranking loss function (pair-- or list--wise estimation). Since a ze…
Study identifies unique minimizers for interaction kernels in particle systems.
Recent advances in neural networks have inspired people to design hybrid recommendation algorithms that can incorporate both (1) user-item interaction information and (2) content information including image, audio, and text. Despite their promising results, neural network-based recommendation algorithms pose extensive …
Operational risk is the risk relative to monetary losses caused by failures of bank internal processes due to heterogeneous causes. A dynamical model including both spontaneous generation of losses and generation via interactions between different processes is presented; the efforts made by the bank to avoid the occurr…
The paper extends a neural model to estimate uncertainty in multi-interaction trajectory reconstruction.
The paper analyzes how to combine self-protection and self-insurance for risk reduction.
New regularization scheme for FMs improves feature interaction selection.
It is well-known from the work of Schönbucher (2005) that the marginal laws of a loss process can be matched by a unit increasing time inhomogeneous Markov process, whose deterministic jump intensity is called local intensity. The Stochastic Local Intensity (SLI) models such as the one proposed by Arnsdorf and Halperin…
Feature selection can efficiently identify the most informative features with respect to the target feature used in training. However, state-of-the-art vector-based methods are unable to encapsulate the relationships between feature samples into the feature selection process, thus leading to significant information los…
Deep learning dynamics exhibit anomalous superdiffusion initially, aiding escape from local minima.
We propose a dynamical model for the estimation of Operational Risk in banking institutions. Operational Risk is the risk that a financial loss occurs as the result of failed processes. Examples of operational losses are the ones generated by internal frauds, human errors or failed transactions. In order to encompass t…
HGNet improves GNNs' ability to handle long-range interactions in graphs.
Attributing forecast gaps to component models in complex model suites
CAN approximates explicit feature interactions for CTR prediction.
The paper tackles attributing forecast gaps in complex model suites.
We study prediction and estimation problems using empirical risk minimization, relative to a general convex loss function. We obtain sharp error rates even when concentration is false or is very restricted, for example, in heavy-tailed scenarios. Our results show that the error rate depends on two parameters: one captu…
Improved learning to reweight using deep interactions between student and teacher models.
Drug-drug interactions (DDIs) are a major cause of preventable hospitalizations and deaths. Predicting the occurrence of DDIs helps drug safety professionals allocate investigative resources and take appropriate regulatory action promptly. Traditional DDI prediction methods predict DDIs based on the similarity between …
Processing data collected by a network of agents often boils down to solving an optimization problem. The distributed nature of these problems calls for methods that are, themselves, distributed. While most collaborative learning problems require agents to reach a common (or consensus) model, there are situations in wh…
DeepLight accelerates CTR predictions in ad serving by 46X.
ESE-FN improves elderly activity recognition accuracy.
Robust real-world learning should benefit from both demonstrations and interactions with the environment. Current approaches to learning from demonstration and reward perform supervised learning on expert demonstration data and use reinforcement learning to further improve performance based on the reward received from …
Deviance Voronoi residuals improve earthquake insurance risk assessment.
The paper examines how risk reduction and insurance choices interact under convex premium principles.
Study shows gain-loss asymmetry in stock indices using a q-spin Potts model.
BSLP is a two-dimensional dynamic model of interacting portfolio-level loss and spread (more exactly, loss intensity) processes. The model is similar to the top-down HJM-like frameworks developed by Schonbucher (2005) and Sidenius-Peterbarg-Andersen (SPA) (2005), however is constructed as a Markovian, short-rate intens…
The study combines social interaction data into a single network, identifying stable groups of chimpanzees.
The goal of this paper is to study organized flocking behavior and systemic risk in heterogeneous mean-field interacting diffusions. We illustrate in a number of case studies the effect of heterogeneity in the behavior of systemic risk in the system, i.e., the risk that several agents default simultaneously as a result…
This work refines grid size selection for non-interactive private -means clustering.
Post-hoc model-agnostic interpretation methods such as partial dependence plots can be employed to interpret complex machine learning models. While these interpretation methods can be applied regardless of model complexity, they can produce misleading and verbose results if the model is too complex, especially w.r.t. f…
The ability of overparameterized deep networks to generalize well has been linked to the fact that stochastic gradient descent (SGD) finds solutions that lie in flat, wide minima in the training loss -- minima where the output of the network is resilient to small random noise added to its parameters. So far this observ…
Many scientific and engineering fields involve analyzing network data. For document networks, relational topic models (RTMs) provide a probabilistic generative process to describe both the link structure and document contents, and they have shown promise on predicting network structures and discovering latent topic rep…
We consider the problem of unveiling the implicit network structure of node interactions (such as user interactions in a social network), based only on high-frequency timestamps. Our inference is based on the minimization of the least-squares loss associated with a multivariate Hawkes model, penalized by and t…
Proposes PER loss to regularize neural network activations to normal distribution.