Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

25.0%50.0%75.0%100.0% · Feb 199419922001200920172026
48 results for novel inputs

Framework detects novel inputs in neural networks by monitoring hidden layers.

problem Novel inputs not classified by neural networks during training.
method Abstraction-based monitoring of hidden layers using 'boxes' to identify novel behaviors.
result Framework efficiently detects novel inputs with a balance between false warnings and true positives.

CLUE method interprets uncertainty from BNNs by showing how inputs change to increase confidence.

problem Lack of work on interpreting uncertainty estimates from probabilistic models.
method CLUE method uses counterfactual explanations to interpret uncertainty from BNNs.
result CLUE outperforms baselines and helps practitioners understand predictive uncertainty.

In this paper, we propose a method that disentangles the effects of multiple input conditions in Generative Adversarial Networks (GANs). In particular, we demonstrate our method in controlling color, texture, and shape of a generated garment image for computer-aided fashion design. To disentangle the effect of input at…

2018-06-20abs ↗pdf ↗

Exact Gaussian Process (GP) regression has O(N^3) runtime for data size N, making it intractable for large N. Many algorithms for improving GP scaling approximate the covariance with lower rank matrices. Other work has exploited structure inherent in particular covariance functions, including GPs with implied Markov st…

2012-09-18abs ↗pdf ↗

ISAAC Newton uses input-based curvature for efficient training.

problem Efficient training in small-batch stochastic regimes.
method ISAAC Newton conditions gradients using selected second-order information based on input.
result Effective training even in small-batch stochastic regimes, competitive to first-order and second-order methods.

Novel Bayesian prior for neural networks encodes amplitude and lengthscale.

problem Lack of user-friendly priors for specifying basic properties in Bayesian neural networks.
method Introduced Poisson Process Radial Basis Function Networks (PP-RBFN) as a novel prior.
result PP-RBFN allows decoupled specification of amplitude and lengthscale, and estimated function is consistent.

CcGAN tackles conditional image generation for continuous labels.

problem Mathematical challenges in conditioning on continuous, scalar labels.
method Proposes novel empirical losses and label input methods for continuous conditional GANs.
result CcGAN generates diverse, high-quality images from continuous labels.

SpinSVAR estimates SVAR models with sparse input, improving accuracy and scalability.

problem Estimating SVAR models with sparse input assumptions.
method SpinSVAR models input as independent Laplacian variables, enforcing sparsity and using least absolute error regression.
result SpinSVAR outperforms state-of-the-art methods in accuracy and runtime, identifying significant structural shocks.

We present a novel nonnegative tensor decomposition method, called Legendre decomposition, which factorizes an input tensor into a multiplicative combination of parameters. Thanks to the well-developed theory of information geometry, the reconstructed tensor is unique and always minimizes the KL divergence from an inpu…

2018-02-13abs ↗pdf ↗

Aux-Net model handles dynamic systems with inconsistent inputs.

problem Inconsistent or unreliable input data in real-world scenarios.
method Aux-Net uses a weighted ensemble of classifiers and online gradient descent.
result Aux-Net provides scalable and agile online learning for dynamic systems.

Neural networks are vulnerable to adversarially-constructed perturbations of their inputs. Most research so far has considered perturbations of a fixed magnitude under some lpl_p norm. Although studying these attacks is valuable, there has been increasing interest in the construction of (and robustness to) unrestricted…

2019-05-07abs ↗pdf ↗

Deep Gaussian processes (DGP) have appealing Bayesian properties, can handle variable-sized data, and learn deep features. Their limitation is that they do not scale well with the size of the data. Existing approaches address this using a deep random feature (DRF) expansion model, which makes inference tractable by app…

2019-05-16abs ↗pdf ↗

We propose a novel deep learning paradigm of differential flows that learn a stochastic differential equation transformations of inputs prior to a standard classification or regression function. The key property of differential Gaussian processes is the warping of inputs through infinitely deep, but infinitesimal, diff…

2018-10-09abs ↗pdf ↗

New framework interprets deep neural networks through input structure.

problem Limited understanding of how input structure, network parameters, and optimization algorithms work together.
method Introducing a novel theoretical framework based on the compositional structure of piecewise linear activation functions.
result Shows that input instances can be grouped based on their similarity in the internal representation of the neural network.

For the efficient execution of deep convolutional neural networks (CNN) on edge devices, various approaches have been presented which reduce the bit width of the network parameters down to 1 bit. Binarization of the first layer was always excluded, as it leads to a significant error increase. Here, we present the novel…

2018-12-09abs ↗pdf ↗

Many random processes can be simulated as the output of a deterministic model accepting random inputs. Such a model usually describes a complex mathematical or physical stochastic system and the randomness is introduced in the input variables of the model. When the statistics of the output event are known, these input …

2012-11-20abs ↗pdf ↗

Paper extends Bayes Theorem for interval probability estimates.

problem Real-world input probabilities are often interval estimates, not precise.
method Developed IT2 version of Bayes Theorem and a novel algorithm for encoding intervals.
result Conservative method avoids invalid output results from inconsistent input.

Proposes a method to optimize budget allocation for collecting and analyzing streaming data.

problem Optimizing resource allocation for collecting and analyzing streaming data.
method Formulates optimization problems to allocate budgets for collecting input data and running simulations, characterizes asymptotic behavior of performance estimators, and develops a multi-stage simultaneous budget allocation procedure.
result Demonstrates competitive performance of the proposed procedure through numerical studies.

This research investigates reliable local explanations for machine listening models.

problem Generating reliable local explanations for machine listening models.
method Investigates the sensitivity of SoundLIME explanations to input perturbations and proposes a novel method for identifying suitable content types.
result SoundLIME explanations are sensitive to the content in occluded input regions, and the average magnitude of input mel-spectrogram bins is the most suitable content type for temporal explanations.

We propose a novel approach for loss reserving based on deep neural networks. The approach allows for joint modeling of paid losses and claims outstanding, and incorporation of heterogeneous inputs. We validate the models on loss reserving data across lines of business, and show that they improve on the predictive accu…

2018-04-24abs ↗pdf ↗

Worldsheet wraps a 3D mesh sheet onto a single image to synthesize novel views.

problem Synthesizing novel views from a single image with large viewpoint changes.
method Shrink-wrapping a planar mesh sheet onto the input image, consistent with learned depth.
result Worldsheet consistently outperforms prior methods on single-image view synthesis.

NullSpaceNet maps inputs to a joint-nullspace for clearer class separability.

problem Class separability and interpretability in image classification.
method NullSpaceNet maps inputs to a joint-nullspace, collapsing same-class inputs and separating different classes.
result NullSpaceNet achieves superior performance with reduced parameters and time.

FANNet analyzes noise tolerance and training bias in neural networks.

problem Low noise tolerance and input sensitivity in neural networks lead to failures on unseen inputs.
method Formal analysis using model checking under different noise ranges.
result Noise tolerance of ±11%\pm 11\% for the trained network, sensitive input nodes identified, and biasness confirmed.

Paper introduces a new model to handle multi-task learning across different input domains.

problem Learning correlated tasks across varying input domains.
method Develops a novel heterogeneous stochastic variational linear model of coregionalization (HSVLMC) for multi-task learning.
result The proposed model outperforms existing models in diverse multi-task scenarios.

In this paper, we present a novel and principled approach to learn the optimal transport between two distributions, from samples. Guided by the optimal transport theory, we learn the optimal Kantorovich potential which induces the optimal transport map. This involves learning two convex functions, by solving a novel mi…

2019-08-28abs ↗pdf ↗

We present a novel framework for specifying and verifying correctness globally for neural networks on perception tasks. Most previous works on neural network verification for perception tasks focus on robustness verification. Unlike robustness verification, which aims to verify that the prediction of a network is stabl…

2019-06-03abs ↗pdf ↗

The paper analyzes the role of ReLU gates in deep learning networks.

problem Understanding the role of gates in deep learning networks.
method Developed neural path features (NPF) and neural path values (NPV) to characterize the active sub-networks during training.
result The neural path kernel associated with NPFs is a fundamental quantity that characterizes the information stored in the gates of a DNN.

Model captures system input variations in latent space for actionable dynamics.

problem Learning dynamical systems from data without prescribing a mathematical model.
method Structured latent ODE model with stochastic factors of variation for each input.
result Improves generation of time-series data and inference of system inputs over baselines.