Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,291 papers · 148 categories

Trend · papers per month

2845688521,136 · Jun 202019922001200920182026
48 results for External Data

A method for logistic regression inference using both internal and external data.

problem Inability to estimate intercept and marginal case proportion in case-control logistic regression.
method Empirical likelihood approach integrating internal and external data.
result Intercept parameter becomes identifiable with external information, and all parameters are estimable consistently.

Study identifies negative data externalities affecting model performance on specific groups.

problem Negative data externalities on group performance in machine learning models.
method Characterized and detected data-model inefficiencies, focusing on specific types of externalities.
result Negative data externalities can lower model performance on specific sub-groups, even with larger datasets.

New estimator improves ATT estimation efficiency with external controls.

problem Reduced efficiency when incorporating external controls into ATT estimation.
method Proposes a novel doubly robust estimator for ATT that maintains higher efficiency than standard approaches.
result Demonstrates improved efficiency of the new estimator compared to standard approaches, even under model misspecification.

Method estimates model performance on external samples from limited statistical characteristics.

problem Limited access to multiple datasets due to privacy and commercial restrictions.
method Search for weights that match external statistics and are closest to uniform, using model performance on weighted internal sample as an estimation.
result Estimated external performance is closer to actual performance than internal performance.

Estimates non-parametric logistic model using case-control data and external summary info.

problem Imbalanced binary data in case-control studies.
method Two-step estimation procedure with deep neural network for functional approximation.
result Proposed estimator achieves optimal convergence rate in non-parametric regression.

Proposes a method to use external machine-learning predictions in multinomial logistic regression.

problem Improving statistical inference using summary-level external machine-learning predictions.
method Empirical-likelihood framework incorporating moment constraints from external nonparametric machine-learning predictions.
result Fused estimator achieves strict efficiency gain over primary-only estimator under mild conditions.

Framework for estimating treatment effects using external control data.

problem Improving efficiency in estimating average treatment effects (ATE) in hybrid trials.
method Developed a formal causal inference framework based on exchangeability assumptions and graphical criteria. Proposed estimators and efficient doubly-robust methods.
result Established finite-sample performance and demonstrated application to spinal muscular atrophy trial.

QR-learner estimates individual treatment effects using external data.

problem Limited power to detect individual treatment effects in randomized trials.
method Model-agnostic learner that estimates conditional average treatment effects (CATE) using external data.
result QR-learner reduces mean squared error and can recover true CATE.

Study explores how exploration in online learning can unfairly burden certain users.

problem The unfairness of exploration in online learning algorithms.
method Introduced the concept of group externality and studied its impact under the linear contextual bandits model.
result Greedy algorithms can almost match the best possible Bayesian regret rate and eliminate negative group externalities under certain data diversity conditions.

This paper evaluates and validates cluster results using external and internal evaluation methods.

problem Evaluating and validating the quality of clustering results.
method External evaluation using Homogeneity, Correctness, and V-measure scores; internal evaluation using Silhouette Index and Sum of Square Errors.
result Validation of the number of clusters using dendrogram and statistical frequency distribution.

Enhances clustering by using external categorical data.

problem Improving clustering outcomes using external categorical evidence.
method Evidence transfer method that manipulates autoencoder latent representations based on external categorical data.
result Our method effectively manipulates latent representations with real evidence and remains robust with low quality evidence.

Survey of methods to incorporate external knowledge into stock price prediction.

problem Challenges in predicting stock prices due to market volatility and non-linearity.
method Survey of methods for acquiring and incorporating external knowledge into stock price prediction models.
result Systematic synthesis of previous studies on external knowledge types and their application in stock price prediction.

Bayesian inference reconstructs external potentials in DFT for many-particle systems.

problem Reconstructing external potentials in classical density-functional theory (DFT) for many-particle systems.
method Combines Bayesian inference with classical DFT to probabilistically reconstruct external potentials.
result Accurately infers external potentials and density profiles with uncertainty quantification.

This paper addresses external validity bias in causal inference.

problem Estimating causal effects in a target population.
method Synthesis of approaches for generalizability and transportability, including tests for heterogeneity of treatment effects and differences between study and target populations.
result Framework for addressing external validity bias in causal inference.

Study examines remittances in Nepal, linking external demand and domestic monetary conditions.

problem Understanding the dynamics of remittances in Nepal's economy.
method Constructed composite indices via PCA for external demand and domestic monetary conditions. Used ARDL, cointegration, DOLS, ECM, and machine learning for analysis.
result Strong positive long-run effect of external demand on remittances, significant negative impact of tighter domestic monetary conditions.

New algorithms improve privacy-preserving data release using external predictions.

problem Privacy-preserving data release with improved utility using external information.
method Learning-augmented algorithms for multiple quantile release.
result Error guarantees scale with prediction quality, almost recovering state-of-the-art guarantees.

HERMES model predicts nonstationary fashion trends using social media data.

problem Forecasting nonstationary fashion time series for optimal inventory decisions.
method Hybrid model combining parametric models, seasonal components, and recurrent neural networks with external signals.
result State-of-the-art results on fashion dataset and M4 competition time series.

This paper evaluates a method to improve representations using incomplete external evidence across tasks.

problem Increasing labelled data quality and quantity is challenging due to manual labelling errors and noise.
method Evidence Transfer method using incomplete categorical external evidence.
result Evidence Transfer proves effective and robust against different levels of incompleteness.

BaTFLED predicts tensor responses using Bayesian factorization with external data.

problem Predicting multi-dimensional responses with shared characteristics.
method Probabilistic Bayesian framework for tensor factorization with Tucker decomposition and sparsity priors.
result BaTFLED outperforms other models on cold start tasks and DREAM challenge.

Optimized model tackles global industrial externalities in non-OECD countries.

problem Analyzing and mitigating externalities from pollution, agriculture, and energy industries in non-OECD countries.
method Integrated systems modeling approach combining fiscal, monetary policies and incentives for cooperative behavior.
result Proposes an optimized solution to internalize externalities in non-OECD countries.

engGNN combines external and generated graphs to improve disease classification and biomarker discovery.

problem Challenges in integrating omics data due to high dimensionality and small sample sizes.
method Dual-graph framework that integrates external biological networks with data-driven generated graphs.
result engGNN outperforms state-of-the-art methods in disease classification and biomarker discovery.

We discuss social network analysis from the perspective of economics. We organize the presentaion around the theme of externalities: the effects that one's behavior has on others' well-being. Externalities underlie the interdependencies that make networks interesting. We discuss network formation, as well as interactio…

2016-08-29abs ↗pdf ↗

The study assesses external validity by evaluating worst-case treatment effects across subpopulations.

problem Underrepresentation of marginalized groups and limited study populations.
method Develops a semiparametrically efficient estimator for worst-case treatment effects (WTE) and uses cross-fitting to guard against brittle findings.
result The proposed framework guards against invalid findings due to unanticipated population shifts.

StockAgent uses AI to simulate real-world stock trading, analyzing external factors and profitability.

problem Investors need to understand how external factors affect stock trading.
method Developed StockAgent, a multi-agent system driven by large language models.
result Identified how external factors impact trading behavior and profitability.

New measure of policy regret shows compatibility with traditional external regret in adversarial games.

problem Incompatibility between traditional and new policy regret measures in adaptive adversaries.
method Revisited policy regret and compared it with external regret; introduced policy equilibrium.
result Policy regret and external regret are compatible in adversarial games.

The study analyzes Bitcoin market volatility using GARCH models and external information.

problem Modeling time-varying volatility in Bitcoin market.
method Combines GARCH models with a mixture of distribution hypothesis using external information.
result The simplest GARCH(1,1) model performs best in predicting volatility with external signal.

New algorithm BE reduces regret in bandit learning with positive externalities.

problem Self-reinforcing user preferences in platforms lead to suboptimal performance in bandit learning.
method Developed Balanced Exploration (BE) algorithm and an adaptive variant.
result BE and adaptive BE achieve optimal asymptotic regret in bandit learning with positive externalities.

Algorithm learns RBMs with arbitrary external fields, improving on previous constraints.

problem Learning RBMs with arbitrary external fields, improving on previous constraints.
method Greedy algorithm that maximizes covariance between observed nodes sharing latent neighbors.
result Algorithm can learn RBMs with arbitrary external fields, improving on previous constraints.

Causal ML methods failed to validate their personalized treatment effects in two large trials.

problem Validating causal machine learning methods for personalized treatment effects in precision medicine.
method Assessed 17 mainstream causal heterogeneity ML methods using two large randomized controlled trials.
result None of the ML methods reliably validated their performance, internal or external, showing significant discrepancies between training and test data.

New algorithms improve semantic similarity in mobile datasets by incorporating context.

problem Traditional models fail to capture external context in mobile datasets.
method Developed new algorithms to integrate external features into sentence embeddings and semantic similarity scores.
result Applying PCA with eight components and appending multimodal features improves semantic understanding in tweets.

Develops a regression model for partially observed dynamic tensor data.

problem Characterizing the relationship between dynamic tensor data and external covariates when data is only partially observed.
method Introduces low-rank, sparsity, and fusion structures on the regression coefficient tensor, and uses a loss function projected over observed entries. Developed an efficient non-convex alternating updating algorithm.
result Derived finite-sample error bounds for the estimator.

The importance of nodes in a network constantly fluctuates based on changes in the network structure as well as changes in external interest. We propose an evolving teleportation adaptation of the PageRank method to capture how changes in external interest influence the importance of a node. This framework seamlessly g…

2012-03-27abs ↗pdf ↗

The paper improves NLI models' robustness by adding external knowledge to the attention mechanism.

problem NLI models' performance drops significantly on simple adversarial examples.
method Proposes a method to enhance NLI models' robustness by incorporating external knowledge into the attention mechanism.
result The method significantly improves the robustness of NLI models, achieving human-level performance on adversarial data.

UAMM uses external market prices to improve AMM efficiency and reduce liquidity provider risk.

problem Traditional AMMs lack consideration of external markets and risk management.
method UAMM calculates prices by incorporating external market prices and impermanent loss, maintaining constant product curve properties.
result UAMM eliminates arbitrage opportunities when external market prices are efficient, reducing liquidity provider risk.

The paper develops an economic foundation for multi-agent learning in markets.

problem Learning dynamics in markets with strategic externalities.
method A two-phase incentive mechanism that estimates and uses implementable transfers to steer long-run dynamics.
result The mechanism achieves sublinear social-welfare regret and asymptotically optimal welfare under mild rationality and exploration conditions.