Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

132264395527 · Jun 202019922001200920172026
48 results for context-set specific independence

Method discovers local independence in systems with continuous variables.

problem Applying Context-Specific Independence (CSI) to continuous variables is impractical.
method Neural contextual decomposition (NCD) learns partition of joint outcome space.
result NCD successfully discovers local independence in synthetic and real-world systems.

Enhances neural processes for better context handling.

problem Real-world context sets are complex, requiring richer prior distributions.
method Introduces a graphical model for a richer prior on latent variables, enabling end-to-end optimization.
result Improves function modeling and test-time robustness with mixture and Student-t assumptions.

Neural Processes (NPs) (Garnelo et al 2018a;b) approach regression by learning to map a context set of observed input-output pairs to a distribution over regression functions. Each function models the distribution of the output given an input, conditioned on the context. NPs have the benefit of fitting observed data ef…

2019-01-17abs ↗pdf ↗

X-Trend quickly adapts to new financial regimes, increasing Sharpe ratio by 18.9%.

problem Adapting to rapidly changing financial market conditions.
method Few-shot learning and cross-attention mechanism.
result X-Trend increases Sharpe ratio by 18.9% over a neural forecaster and 10-fold over a conventional strategy.

Framework allows systems to defer difficult decisions to unknown experts.

problem Ensuring safety and robustness in autonomous systems with unknown human experts.
method Meta-learning approach that adapts to new experts at test-time using optimization and model-based attention mechanisms.
result Framework can quickly adapt deferral policies to new experts without re-training.

We consider the problem of stochastic KK-armed dueling bandit in the contextual setting, where at each round the learner is presented with a context set of KK items, each represented by a dd-dimensional feature vector, and the goal of the learner is to identify the best arm of each context sets. However, unlike the …

2020-02-20abs ↗pdf ↗

Hydra boosts efficiency for long-context reasoning in resource-constrained settings.

problem Quadratic complexity of transformers limits long-context reasoning in resource-constrained systems.
method Hydra uses a modular architecture with adaptive routing between sparse global attention, mixture-of-experts, and dual memories.
result Hydra achieves significant throughput and accuracy improvements for long-context reasoning.

Neural Processes (NPs) are a class of models that learn a mapping from a context set of input-output pairs to a distribution over functions. They are traditionally trained using maximum likelihood with a KL divergence regularization term. We show that there are desirable classes of problems where NPs, with this loss, f…

2019-10-01abs ↗pdf ↗

We consider a novel formulation of the multi-armed bandit model, which we call the contextual bandit with restricted context, where only a limited number of features can be accessed by the learner at every iteration. This novel formulation is motivated by different online problems arising in clinical trials, recommende…

2017-05-10abs ↗pdf ↗

Neural processes approximate Gaussian process inference, revealing three key costs.

problem Approximating Gaussian process inference with neural processes.
method Bounding KL divergence into three components: label contamination, information bottleneck, and amortization error.
result Characterization of three costs of amortizing Gaussian process inference with neural processes.

Efficiently fine-tunes patient-independent seizure detection models with tensor kernel machine.

problem Improving seizure detection accuracy for wearable devices.
method Transfer learning with tensor kernel machine using canonical polyadic decomposition.
result Patient fine-tuned model achieves high performance with smaller model size.

We introduce a stochastic contextual bandit model where at each time step the environment chooses a distribution over a context set and samples the context from this distribution. The learner observes only the context distribution while the exact context realization remains hidden. This allows for a broad range of appl…

2019-06-06abs ↗pdf ↗

Attention learns PCA on Gaussian data, proving its connection to principal component analysis.

problem Principal component analysis on Gaussian data.
method Analysis of attention mechanisms through PCA, covering finite and infinite prompt regimes.
result Attention aligns with principal eigenvectors of covariance matrices, converging to optimal solutions in the infinite-prompt limit.

Neural processes (NPs) learn stochastic processes and predict the distribution of target output adaptively conditioned on a context set of observed input-output pairs. Furthermore, Attentive Neural Process (ANP) improved the prediction accuracy of NPs by incorporating attention mechanism among contexts and targets. In …

2019-10-17abs ↗pdf ↗

Learning the Markov network structure from data is a problem that has received considerable attention in machine learning, and in many other application fields. This work focuses on a particular approach for this purpose called independence-based learning. Such approach guarantees the learning of the correct structure …

2013-07-15abs ↗pdf ↗

Log-linear models are the popular workhorses of analyzing contingency tables. A log-linear parameterization of an interaction model can be more expressive than a direct parameterization based on probabilities, leading to a powerful way of defining restrictions derived from marginal, conditional and context-specific ind…

2014-09-09abs ↗pdf ↗

IndiSeek learns disentangled representations by balancing independence and completeness.

problem Learning disentangled representations with mutual information in multi-modal data.
method Combines independence-enforcing objective with a reconstruction loss that bounds conditional mutual information.
result Demonstrates effectiveness on synthetic data, CITE-seq, and real-world multi-modal benchmarks.

A new test for conditional independence in discretized data.

problem Testing conditional independence when only discretized observations are available.
method Proposes a conditional independence test designed for discretized observations, using bridge equations to recover latent variables' information.
result Demonstrates the effectiveness of the proposed test through theoretical and empirical validation.

TCRI improves domain generalization by enforcing conditional independence constraints.

problem Limitations of existing domain generalization methods due to incomplete constraints.
method TCRI implements regularizers motivated by conditional independence constraints.
result TCRI achieves cross-domain stability and outperforms baselines in worst-domain accuracy.

Introduces CStrees for modeling context-specific causal models from observational and interventional data.

problem Modeling context-specific causal relationships from mixed data types.
method Introduces CStrees with a novel factorization criterion and graphical characterization for context-specific conditional independence models.
result Derives a graphical characterization of model equivalence for observational CStrees and extends it to CStree models under context-specific interventions.

Study uses LLMs to improve financial forecasting by integrating textual and numerical data.

problem Challenges in fusing multimodal information and measuring qualitative outputs from LLMs.
method Created context sets by segmenting daily securities reports into key factors and combining them with numerical data. Used dynamic updates and crafted prompts to assign scores to qualitative insights.
result LLMs outperform time-series models in market forecasting, though challenges remain.

Extracts the finest pattern of mutual independence from data.

problem Inferring the finest mutual independence pattern from data.
method Estimate the set of valid patterns of dichotomic independence and use their intersection to infer the finest pattern.
result The method can estimate the finest mutual independence pattern from i.i.d. realizations of a multivariate normal distribution.

We present a framework for autonomously learning a portable representation that describes a collection of low-level continuous environments. We show that these abstract representations can be learned in a task-independent egocentric space specific to the agent that, when grounded with problem-specific information, are …

2019-05-28abs ↗pdf ↗

New method detects causal relationships from noisy measurements.

problem Discover causal relationships from noisy, imperfect measurements.
method Transformed Independent Noise (TIN) condition and ordered group decomposition.
result Identifies causal graph structure without over-complete ICA.

The paper explores how semantic independence can be captured in text embeddings using partial orthogonality.

problem Capturing semantic independence in text embeddings.
method Developed a theory and methods based on partial orthogonality to demonstrate semantic independence.
result Partial orthogonality captures semantic independence in text embeddings.

This work develops a non-parametric test for relational independence in non-i.i.d. data.

problem Testing independence in relational systems where data samples are not i.i.d.
method Kernel mean embedding for relational variables, consistent non-parametric scalable kernel test.
result Empirically validated effectiveness compared to state-of-the-art tests.

New algorithms for private generalized linear contextual bandits.

problem Private estimation and optimization for generalized linear models under differential privacy.
method Developed algorithms for stochastic and adversarial contexts under shuffle and joint differential privacy.
result Achieved private regret bounds for generalized linear models, differing from non-private rates by factors of d/ε\sqrt{d/\varepsilon} and d/ε\sqrt{d/\varepsilon} respectively.

This paper aims at justifying LWF and AMP chain graphs by showing that they do not represent arbitrary independence models. Specifically, we show that every chain graph is inclusion optimal wrt the intersection of the independence models represented by a set of directed and acyclic graphs under conditioning. This impli…

2013-12-10abs ↗pdf ↗

Optimal reinsurance contracts for multiple dependent risks are derived without specific dependency assumptions.

problem Finding optimal reinsurance contracts for multiple dependent risks without assuming their dependency structure.
method Assumes maximal expected utility criterion and independent negotiation of reinsurance for each risk. Derives optimality conditions and shows that under mild assumptions, optimal contracts are classical (non-randomized) type.
result Optimal reinsurance contracts exist and can be classical (non-randomized) type under mild assumptions.

It has been postulated that a good representation is one that disentangles the underlying explanatory factors of variation. However, it remains an open question what kind of training framework could potentially achieve that. Whereas most previous work focuses on the static setting (e.g., with images), we postulate that…

2017-08-03abs ↗pdf ↗

The group membership prediction (GMP) problem involves predicting whether or not a collection of instances share a certain semantic property. For instance, in kinship verification given a collection of images, the goal is to predict whether or not they share a {\it familial} relationship. In this context we propose a n…

2015-09-16abs ↗pdf ↗

Maximum mean discrepancy (MMD), also called energy distance or N-distance in statistics and Hilbert-Schmidt independence criterion (HSIC), specifically distance covariance in statistics, are among the most popular and successful approaches to quantify the difference and independence of random variables, respectively. T…

2017-08-28abs ↗pdf ↗

Parallel score matching accelerates DPM training and improves density estimation.

problem Extended training periods and limited modeling flexibility in DPMs.
method Partitioning the learning task into independent time sub-intervals and modeling the score at each time point separately.
result Significant acceleration of training process and improved density estimation performance.

In this paper, we extend Meek's conjecture (Meek 1997) from directed and acyclic graphs to chain graphs, and prove that the extended conjecture is true. Specifically, we prove that if a chain graph H is an independence map of the independence model induced by another chain graph G, then (i) G can be transformed into H …

2011-09-25abs ↗pdf ↗

The n-dimensional torus is uniquely characterized by specific harmonic forms.

problem Characterizing the n-dimensional torus via harmonic forms.
method Analyzing closed 1-forms on the torus to determine unique properties.
result The n-dimensional torus is the unique manifold supporting a linearly independent set of (n-1) closed 1-forms whose product determines a non-zero cohomological class.

Writing the article-Time independent pricing of options in range bound markets; the question in the title came naturally to my mind. It is stated, in the above article, that in certain market conditions the stock price is subjected to an equation that exactly matches a time independent Schrodinger equation. The time in…

2013-05-07abs ↗pdf ↗