Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

4488132176 · Jun 202019922001200920172026
48 results for context engineering

A new framework uses directed information to efficiently select context chunks.

problem Efficiently selecting relevant context chunks for query understanding.
method Directed Information γγ-covering framework, formulated as a γγ-cover problem, with a greedy algorithm for context selection.
result The γγ-covering algorithm provides clear advantages in hard-decision regimes like context compression and single-slot prompt selection.

Framework for optimizing search engine rankings using observational data.

problem Optimizing ranking policies for search engines using limited observational data.
method Formulated expected reward optimization problem, estimated context value distribution, trained ranking policy via Bayesian inference.
result Demonstrated trade-offs in ranking policies trained on empirical reward estimates.

Tabular in-context learners perform well on biomolecular tasks, but performance depends on the representation used.

problem Predicting biomolecular properties from limited labeled data.
method Evaluating tabular in-context learners on protein fitness regression and small-molecule classification tasks.
result Tabular in-context learners are competitive for protein fitness regression but not for small-molecule classification.

TL-ANDI distills context from source data to improve transfer learning for TFMs.

problem Limited transfer learning due to context-size constraints and distribution shifts.
method TL-ANDI uses posterior-aware distillation to construct a compact source context and locally distills labels.
result Improves transfer performance by addressing context-size and distribution shifts.

New estimator uses clustering to improve off-policy evaluation accuracy.

problem Improving off-policy evaluation accuracy when logging and evaluation policies differ.
method Proposes an estimator that shares information across similar contexts using clustering.
result Clustering contexts improves estimation accuracy, especially in deficient information settings.

Recent studies have introduced end-to-end TTS, which integrates the production of context and acoustic features in statistical parametric speech synthesis. As a result, a single neural network replaced laborious feature engineering with automated feature learning. However, little is known about what types of context in…

2018-11-04abs ↗pdf ↗

Text segmentation plays an important role in various Natural Language Processing (NLP) tasks like summarization, context understanding, document indexing and document noise removal. Previous methods for this task require manual feature engineering, huge memory requirements and large execution times. To the best of our …

2018-08-29abs ↗pdf ↗

Bayesian framework uses context trees for efficient time series modeling.

problem Building flexible and interpretable mixture models for real-valued time series.
method Hierarchical Bayesian modelling with context trees and autoregressive models.
result The methods outperform state-of-the-art techniques on simulated and real-world experiments.

Machine learning algorithms are increasingly influencing our decisions and interacting with us in all parts of our daily lives. Therefore, just like for power plants, highways, and myriad other engineered sociotechnical systems, we must consider the safety of systems involving machine learning. In this paper, we first …

2016-01-16abs ↗pdf ↗

Interpretation of a machine learning induced models is critical for feature engineering, debugging, and, arguably, compliance. Yet, best of breed machine learning models tend to be very complex. This paper presents a method for model interpretation which has the main benefit that the simple interpretations it provides …

2018-02-26abs ↗pdf ↗

Paper improves Tm prediction of protein fragments using sparsity and probabilistic models.

problem Improving accuracy of melting temperature prediction for protein fragments.
method Promoting sparsity in pre-trained transformer models and adopting probabilistic frameworks.
result Mean absolute error of 0.23C for predicting melting temperature.

Enhances mobile context prediction using weakly supervised learning.

problem Power consumption and limited training data for always-on context prediction.
method Weakly supervised learning framework for multi-modal sensing.
result Personalized context prediction model with improved accuracy.

Concurrent engineering taking into account product life-cycle factors seems to be one of the industrial challenges of the next years. Cost estimation and management are two main strategic tasks that imply the possibility of managing costs at the earliest stages of product development. This is why it is indispensable to…

2010-11-26abs ↗pdf ↗

This paper reviews Gaussian process-based multi-fidelity techniques for different fidelity relationships.

problem Combining accurate and cheap models for complex system design.
method Gaussian process-based multi-fidelity modeling techniques for varying fidelity relationships.
result Comparison of techniques on analytical and aerospace engineering problems.

Many processes in science and engineering can be described by partial differential equations (PDEs). Traditionally, PDEs are derived by considering first principles of physics to derive the relations between the involved physical quantities of interest. A different approach is to measure the quantities of interest and …

2018-08-31abs ↗pdf ↗

Despite incredible recent advances in machine learning, building machine learning applications remains prohibitively time-consuming and expensive for all but the best-trained, best-funded engineering organizations. This expense comes not from a need for new and improved statistical models but instead from a lack of sys…

2017-05-22abs ↗pdf ↗

New method for mixed-variable GSA improves material design efficiency.

problem Designing materials with both quantitative and qualitative variables.
method Integrates LVGP with Sobol' analysis for mixed-variable GSA.
result Accelerates exploration of novel MOF candidates in combinatorial design spaces.

Mathematical advances needed for Digital Twins, differing from traditional models.

problem Foundational mathematical advances required for Digital Twins.
method Multi-scale, multi-physics modeling and coupling, different reliability criteria and uncertainty assessments.
result AI/ML methods can perform well in biomedical problems but fail in simple engineering systems.

In this work we address the problem of argument search. The purpose of argument search is the distillation of pro and contra arguments for requested topics from large text corpora. In previous works, the usual approach is to use a standard search engine to extract text parts which are relevant to the given topic and su…

2019-05-26abs ↗pdf ↗

Shapelet transform improves time series classification for earthquake, wind, and wave events.

problem Autonomous detection of specific events from large time series datasets in civil engineering.
method Shapelet transform for local similarity in time series subsequences, combined with machine learning.
result Shapelet transform yields a new feature representation for time series signals in civil engineering.

Game theory finds nowadays a broad range of applications in engineering and machine learning. However, in a derivative-free, expensive black-box context, very few algorithmic solutions are available to find game equilibria. Here, we propose a novel Gaussian-process based approach for solving games in this context. We f…

2016-11-08abs ↗pdf ↗

Holographic Invariant Storage uses vector architectures to ensure LLM safety at design time.

problem Mitigating context drift in large language models (LLMs) during deployment.
method Introduces Holographic Invariant Storage (HIS) protocol that combines known properties of bipolar Vector Symbolic Architectures into a design-time safety contract.
result Closed-form guarantees for single-signal recovery fidelity, continuous-noise robustness, and multi-signal capacity degradation are provided and validated.

This review discusses challenges and solutions for AI in chemical engineering.

problem Challenges in applying classical machine learning to chemical engineering data.
method Identifying four data characteristics and discussing their applications and solutions.
result Current research extends data science and machine learning to handle chemical engineering data challenges.

New method uses models from regularity structures as features in machine learning.

problem Learning solutions to PDEs with low regularity.
method Developed a flexible definition of model feature vectors and two algorithms for combining them with linear regression.
result Advantage in learning solutions to PDEs compared to alternative methods.

Paper uses deep reinforcement learning for better control of rocket engines during start-up phases.

problem Lack of optimal control during transient phases of liquid rocket engines.
method Deep reinforcement learning approach for optimal control of a gas-generator engine's continuous start-up phase.
result Deep reinforcement learning controller achieves highest performance and minimal computational effort.

Paper proposes verifier engineering for improving foundation models.

problem Challenges in providing effective supervision signals for foundation models.
method Leverages automated verifiers to perform verification tasks and deliver feedback.
result Verifier engineering can enhance foundation models' capabilities.

Study optimizes inspection and monitoring of deteriorating structures using POMDPs.

problem Optimizing decision-making for deteriorating engineering systems with uncertain observations.
method Developed theoretical and computational foundations for Value of Information (VoI) and Value of Structural Health Monitoring (VoSHM) in POMDPs.
result POMDP policies inherently leverage VoI to guide optimal observational actions, improving long-term cost.

Pairwise Choice Markov Chains (PCMC) have been recently introduced to overcome limitations of choice models based on traditional axioms unable to express empirical observations from modern behavior economics like context effects occurring when a choice between two options is altered by adding a third alternative. The i…

2019-09-25abs ↗pdf ↗

Entity linking is the task of mapping potentially ambiguous terms in text to their constituent entities in a knowledge base like Wikipedia. This is useful for organizing content, extracting structured data from textual documents, and in machine learning relevance applications like semantic search, knowledge graph const…

2018-07-16abs ↗pdf ↗

Deep learning models can be understood through information theoretic analysis.

problem Understanding the learned representations of neural networks in security contexts.
method Information theoretic analysis of neural network representations using mutual information and homeomorphism.
result Mutual information remains invariant under homeomorphism, suggesting that neural networks require meaningful feature engineering.

New metrics quantify implementation risk in portfolio backtesting, revealing systematic differences in engine implementations.

problem Systematic divergence in backtested portfolio metrics due to differences in engine implementations.
method Formalized implementation risk, proposed four metrics, executed 15 strategies through five engines, analyzed source-code defects.
result Implementation risk introduces measurable ambiguity in performance attribution, but does not alter investment decisions.

Proposes efficient algorithm for system-level I&M decisions under uncertainty.

problem Optimal management strategies for deteriorating civil engineering systems.
method Factored partially observable Markov decision process with Bayesian networks and DDMAC reinforcement learning.
result DDMAC policies offer substantial benefits over heuristic approaches in system-level cost optimization.