Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,694 papers · 148 categories

Trend · papers per month

9182736 · Jun 202019922001200920172026
48 results for ignorability

Estimates disease prevalence using non-ignorable missing data in health surveys.

problem Estimating disease prevalence in non-representative samples with non-ignorable missing data.
method Connects auxiliary proxy variable framework to label shift setting, uses high-dimensional covariates without generative models.
result Fails to account for non-ignorable missingness can lead to significant misestimations.

The paper clarifies the distinction between CATE and ITE under ignorability assumptions.

problem Confusion between CATE and ITE hinders personalized effect estimation.
method Clarifies the distinction between CATE and ITE under ignorability assumptions.
result CATE and ITE are not necessarily the same under ignorability assumptions.

Estimates CATE under hidden confounding, accounting for bias and ignorance.

problem Learning CATE from high-dimensional data with unobserved confounders introduces bias and ignorance.
method Parametric interval estimator that accounts for hidden confounding and underrepresented samples.
result Estimator converges to tight bounds on CATE when there may be unobserved confounding.

Ranked data appear in many different applications, including voting and consumer surveys. There often exhibits a situation in which data are partially ranked. Partially ranked data is thought of as missing data. This paper addresses parameter estimation for partially ranked data under a (possibly) non-ignorable missing…

2019-02-28abs ↗pdf ↗

Noise-ignorant empirical risk minimization achieves state-of-the-art performance on noisy data.

problem Learning with noisy labels in multi-class classification problems.
method Introducing relative signal strength (RSS) to quantify transferability and applying Noise Ignorant Empirical Risk Minimization (NI-ERM).
result NI-ERM achieves state-of-the-art performance on CIFAR-N data challenge.

Study estimates heterogeneous principal causal effects with binary treatments and intermediate variables.

problem Estimating subgroup effects within strata defined by potential values of an intermediate variable.
method Proposes a framework for estimating and forming confidence intervals for heterogeneous principal causal effects under principal ignorability assumption. Develops several estimators with varying robustness properties.
result Established large-sample theory and analyzed bias contributions of each approach.

Thompson Sampling with bilateral uncertainty improves performance in Bayesian Optimization.

problem Twin difficulties of modeling and searching complex functions in high dimensions.
method Exploiting conditional independence, Thompson Sampling respecting bilateral uncertainty (BU).
result Thompson Sampling with BU is more effective than the additive approximation in small budgets.

The study aims to prevent unfair content presentation in recommender systems.

problem Over- and under-presentation of content leads to biased user preference estimates.
method Two models are considered: one that ignores systematic and limited exposure, and another that conditions on limited exposure.
result Ignoring systematic presentations overestimates promoted options and underestimates censored alternatives.

Bayes predictor remains robust to ignorable missingness shifts.

problem Challenges in prediction with missing covariates and shifts in missingness reasons.
method Bayesian approach and different prediction methods.
result Bayes predictor remains unchanged by ignorable shifts, but robust prediction requires disregarding missingness for non-ignorable shifts.

Two methods use BART to model missing data in leaf photosynthetic trait data.

problem Handling missing data in multivariate outcomes with non-ignorable mechanisms.
method Bayesian Additive Regression Trees (BART) for joint modeling of data and missingness indicators.
result Both methods effectively recover various missingness mechanisms and outperform existing approaches.

Privacy preserving mechanisms such as differential privacy inject additional randomness in the form of noise in the data, beyond the sampling mechanism. Ignoring this additional noise can lead to inaccurate and invalid inferences. In this paper, we incorporate the privacy mechanism explicitly into the likelihood functi…

2015-11-24abs ↗pdf ↗

(This comment has been updated to respond to Wang and Blei's rejoinder [arXiv:1910.07320].) The premise of the deconfounder method proposed in "Blessings of Multiple Causes" by Wang and Blei [arXiv:1805.06826], namely that a variable that renders multiple causes conditionally independent also controls for unmeasured mu…

2019-10-11abs ↗pdf ↗

We speed up marginal inference by ignoring factors that do not significantly contribute to overall accuracy. In order to pick a suitable subset of factors to ignore, we propose three schemes: minimizing the number of model factors under a bound on the KL divergence between pruned and full models; minimizing the KL dive…

2012-03-15abs ↗pdf ↗

We note a simple mechanism that may at least partially resolve several outstanding economic puzzles, including why the cyclically adjusted price to earnings ratio of the S&P 500 index has been oddly high for the past two decades, why gains to capital have outpaced gains to wages, and the persistence of the equity premi…

2016-10-25abs ↗pdf ↗

For text analysis, one often resorts to a lossy representation that either completely ignores word order or embeds each word as a low-dimensional dense feature vector. In this paper, we propose convolutional Poisson factor analysis (CPFA) that directly operates on a lossless representation that processes the words in e…

2019-05-14abs ↗pdf ↗

A new model synthesizes population with fewer structural and sampling zeros.

problem Synthesizing a feasible and diverse synthetic population from limited data.
method A deep generative model with two regularizations to minimize structural zeros and preserve sampling zeros.
result The model significantly improves feasibility and diversity of synthetic populations.

Study functional confounders in causal inference, enabling estimable effects.

problem Causal inference challenges with functional confounders violating positivity.
method Functional interventions, functional positivity, gradient fields, Level-set Orthogonal Descent Estimation (LODE).
result Valid causal effect estimation under certain conditions.

A standard recipe for spoken language recognition is to apply a Gaussian back-end to i-vectors. This ignores the uncertainty in the i-vector extraction, which could be important especially for short utterances. A recent paper by Cumani, Plchot and Fer proposes a solution to propagate that uncertainty into the backend. …

2017-09-29abs ↗pdf ↗

Fueled by massive amounts of data, models produced by machine-learning (ML) algorithms, especially deep neural networks, are being used in diverse domains where trustworthiness is a concern, including automotive systems, finance, health care, natural language processing, and malware detection. Of particular concern is …

2018-04-19abs ↗pdf ↗

We give a covering number bound for deep learning networks that is independent of the size of the network. The key for the simple analysis is that for linear classifiers, rotating the data doesn't affect the covering number. Thus, we can ignore the rotation part of each layer's linear transformation, and get the coveri…

2017-11-02abs ↗pdf ↗

New algorithm for differentially private distributed optimization of smooth, non-convex problems.

problem No differentially private distributed method for smooth, non-convex optimization problems.
method Smoothed normalization integrated with an error-feedback mechanism.
result Achieves superior convergence rate and first differentially private distributed optimization algorithm with provable convergence guarantees.

We study an asynchronous online learning setting with a network of agents. At each time step, some of the agents are activated, requested to make a prediction, and pay the corresponding loss. The loss function is then revealed to these agents and also to their neighbors in the network. Our results characterize how much…

2019-01-23abs ↗pdf ↗

Co-TSFA improves time series forecasting by distinguishing between short-lived and persistent anomalies.

problem Standard forecasting models fail to distinguish between short-lived and persistent anomalies, leading to overreaction or underreaction.
method Co-TSFA learns to ignore forecast-irrelevant anomalies and respond to forecast-relevant ones through input-only and input-output augmentations and a latent-output alignment loss.
result Co-TSFA improves performance under anomalous conditions while maintaining accuracy on normal data.

The paper examines challenges in achieving fair predictions using causal counterfactuals.

problem Achieving fair predictions using causal counterfactuals in fairness settings.
method Analyzes the limitations of causal models in fairness settings and the challenges of selecting counterfactuals.
result Causal models that capture counterfactuals are outside the class commonly considered in fairness literature.

The paper proposes methods to estimate positive examples and learn classifiers from mixed data.

problem Estimating the proportion of positive examples and learning classifiers from a mixture of positive and unlabeled data.
method Best Bin Estimation (BBE) for Mixture Proportion Estimation and Conditional Value Ignoring Risk (CVIR) for PU-learning.
result The proposed methods significantly improve both mixture proportion estimation and classifier learning.

Causal inference often relies on the counterfactual framework, which requires that treatment assignment is independent of the outcome, known as strong ignorability. Approaches to enforcing strong ignorability in causal analyses of observational data include weighting and matching methods. Effect estimates, such as the …

2020-01-09abs ↗pdf ↗

In this paper we construct a new class of surfaces whose geodesic flow is integrable (in the sense of Liouville). We do so by generalizing the notion of tubes about curves to 3-dimensional manifolds, and using Jacobi fields we derive conditions under which the metric of the generalized tubular sub-manifold admits an ig…

2017-12-19abs ↗pdf ↗

This paper studies an entropy-based multi-objective Bayesian optimization (MBO). The entropy search is successful approach to Bayesian optimization. However, for MBO, existing entropy-based methods ignore trade-off among objectives or introduce unreliable approximations. We propose a novel entropy-based MBO called Pare…

2019-06-01abs ↗pdf ↗

Theoretical study on how model architecture affects contrastive learning performance.

problem Understanding the role of model architecture in self-supervised learning.
method Theoretical analysis of contrastive learning, focusing on model capacity and clustering structures.
result Contrastive representations have lower dimensionality than the number of clusters in the data distribution.

New MRI method maps tissue parameters more accurately by ignoring voxel independence.

problem Voxel independence assumption limits model fitting reliability and repeatability.
method Self-supervised deep variational approach with Gaussian mixture prior.
result Our method outperforms current techniques in dMRI simulations and real data.

Proposes a copula-based model for multi-view clustering with directional dependency.

problem Challenges in integrating multi-source datasets with directional dependency.
method Copula-based multi-view clustering model accounting for directional dependence.
result Ignoring directional dependence negatively impacts clustering performance.