arXiv research

Improved Kalman filter for Stiefel manifold measurements.

Improves comparison of F-measures for imbalanced datasets.

Improves risk and variability measures continuity and consistency.

We propose a modification that corrects for split-improvement variable importance measures in Random Forests and other tree-based methods. These methods have been shown to be biased towards increasing the importance of features with more potential splits. We show that by appropriately incorporating split-improvement as…

Logistic regression is a widely used method in several fields. When applying logistic regression to imbalanced data, for which majority classes dominate over minority classes, all class labels are estimated as `majority class.' In this article, we use an F-measure optimization method to improve the performance of logis…

Investor sentiment improves model accuracy but complexity doesn't always boost predictive power.

Improved MoM estimator enhances classical shadows protocol for quantum measurements.

Improved measure of predictive uncertainty for machine learning models.

This paper improves support recovery in universal one-bit compressed sensing.

Task-specific scores are often used to optimize for and evaluate the performance of conditional text generation systems. However, such scores are non-differentiable and cannot be used in the standard supervised learning paradigm. Hence, policy gradient methods are used since the gradient can be computed without requiri…

Measuring uncertainty is a promising technique for detecting adversarial examples, crafted inputs on which the model predicts an incorrect class with high confidence. But many measures of uncertainty exist, including predictive en- tropy and mutual information, each capturing different types of uncertainty. We study th…

Over the last decade there has been increasing concern about the biases embodied in traditional evaluation methods for Natural Language Processing/Learning, particularly methods borrowed from Information Retrieval. Without knowledge of the Bias and Prevalence of the contingency being tested, or equivalently the expecta…

In order to be useful, visualizations need to be interpretable. This paper uses a user-based approach to combine and assess quality measures in order to better model user preferences. Results show that cluster separability measures are outperformed by a neighborhood conservation measure, even though the former are usua…

Deep ROC analysis improves model selection and interpretation in medical and AI applications.

Method identifies low-dimensional structure in high-dimensional probability measures.

New multivariate risk measures improve on univariate OCE methods.

This paper improves confidence measurement in deep metric learning models.

The increasing role of recommender systems in many aspects of society makes it essential to consider how such systems may impact social good. Various modifications to recommendation algorithms have been proposed to improve their performance for specific socially relevant measures. However, previous proposals are often …

Improved statistical inference for expensive data using machine learning predictions.

Confidence intervals improve evaluation of binary prediction rules in data mining.

Improved binning technique boosts nUV measure performance.

A new perfectly truthful calibration measure improves prediction reliability.

New stability measures for similar features improve feature selection accuracy.

Low-cost sensors improve air quality prediction accuracy significantly.

Despite existing work on ensuring generalization of neural networks in terms of scale sensitive complexity measures, such as norms, margin and sharpness, these complexity measures do not offer an explanation of why neural networks generalize better with over-parametrization. In this work we suggest a novel complexity m…

Bayesian framework improves robustness in nonlinear regression models.

The deep Q-network (DQN) and return-based reinforcement learning are two promising algorithms proposed in recent years. DQN brings advances to complex sequential decision problems, while return-based algorithms have advantages in making use of sample trajectories. In this paper, we propose a general framework to combin…

Improved nested simulation for financial risk measurement.

Improved time series causal discovery with bootstrap aggregation and confidence measures.

We present the Procrustes measure, a novel measure based on Procrustes rotation that enables quantitative comparison of the output of manifold-based embedding algorithms (such as LLE (Roweis and Saul, 2000) and Isomap (Tenenbaum et al, 2000)). The measure also serves as a natural tool when choosing dimension-reduction …

Improved 3D LiDAR data classification using product coefficients.

New algorithms improve boosting by optimizing chance-corrected measures.

The restricted isometry property (RIP) is a universal tool for data recovery. We explore the implication of the RIP in the framework of generalized sparsity and group measurements introduced in the Part I paper. It turns out that for a given measurement instrument the number of measurements for RIP can be improved by o…

Fourier representation improves KSD for infinite-dimensional data.

MASF improves score-based filters for high-dimensional nonlinear systems with spatially sparse measurements.

Develops a logifold structure for understanding datasets.

Deep kernel learning refers to a Gaussian process that incorporates neural networks to improve the modelling of complex functions. We present a method that makes this approach feasible for problems where the data consists of line integral measurements of the target function. The performance is illustrated on computed t…

SGLBO optimizes quantum circuits with fewer measurements, improving accuracy and noise resilience.

In this note we show that in metric measure spaces satisfying the reduced curvature-dimension condition CD*(K,N) we always have geodesics in the Wasserstein space of probability measures that satisfy the critical convexity inequality of CD*(K,N) also for intermediate times and in addition the measures along these geode…

Compressed sensing (CS) provides an elegant framework for recovering sparse signals from compressed measurements. For example, CS can exploit the structure of natural images and recover an image from only a few random measurements. CS is flexible and data efficient, but its application has been restricted by the strong…

Agent decides when to measure latent states in RL to improve efficiency.

Improved persistence spheres map measures to functions, stable under partial transport.

We present a coupled Variational Auto-Encoder (VAE) method that improves the accuracy and robustness of the probabilistic inferences on represented data. The new method models the dependency between input feature vectors (images) and weighs the outliers with a higher penalty by generalizing the original loss function t…

Decisions by Machine Learning (ML) models have become ubiquitous. Trusting these decisions requires understanding how algorithms take them. Hence interpretability methods for ML are an active focus of research. A central problem in this context is that both the quality of interpretability methods as well as trust in ML…

Active learning improves neutron spectroscopy experiments by automating measurement selection.

A non-vector-based dissimilarity measure is proposed by combining vector-based distance metrics and set operations. This proposed compound dissimilarity measure (CDM) is applicable to quantify similarity of collections of attribute/feature pairs where not all attributes are present in all collections. This is a typical…

We develop correlated random measures, random measures where the atom weights can exhibit a flexible pattern of dependence, and use them to develop powerful hierarchical Bayesian nonparametric models. Hierarchical Bayesian nonparametric models are usually built from completely random measures, a Poisson-process based c…

Study shows cooperation can improve everyone's market efficiency.