Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

12.5%25.0%37.5%50.0% · Nov 199319922001200920182026
48 results for Database Indexing

Enhances index selection for databases with task-specific inductive biases.

problem Challenges in traditional and automatic tuning strategies for database index set selection.
method Applies deep RL with task-specific inductive biases to index set selection, reformulating the problem as permutation learning.
result Improves index selection, achieving up to 40% smaller configurations with similar latency.

We study the distribution of fluctuations over a time scale ΔtΔt (i.e., the returns) of the S&P 500 index by analyzing three distinct databases. Database (i) contains approximately 1 million records sampled at 1 min intervals for the 13-year period 1984-1996, database (ii) contains 8686 daily records for the 35-year pe…

1999-05-20abs ↗pdf ↗

Content based image retrieval, a technique which uses visual contents of image to search images from large scale image databases according to users' interests. This paper provides a comprehensive survey on recent technology used in the area of content based face image retrieval. Nowadays digital devices and photo shari…

2014-02-20abs ↗pdf ↗

CwA optimizes search performance by jointly learning a balanced database partition and a neural probing function.

problem Suboptimal search performance due to mismatched database and query distributions.
method CwA jointly learns a balanced database partition and a neural probing function to optimize search performance directly for the query distribution.
result CwA achieves up to 4.7x throughput over state-of-the-art methods at equal recall.

New method accurately reconstructs Russell 3000 index, revealing crowded portfolios.

problem Crowding in index portfolios during reconstitution events.
method Developed a Python package for accurate index reconstruction using CRSP US Stock data.
result Annual Russell 3000 portfolios are more crowded than quarterly ones, suggesting lower transaction costs.

Geometric Brownian motion simulates stock prices for Brazilian small caps index.

problem Simulating stock prices for the Brazilian small caps index.
method Used geometric Brownian motion to simulate stock prices of Brazilian small caps index using historical data.
result Simulated prices better for portfolios with higher returns, lower risks, and higher Sharpe Indexes.

LIFT uses demonstrations to train reinforcement learning controllers for data management tasks.

problem Large training data requirements, algorithmic instability, and lack of standard tools in reinforcement learning for data management.
method LIFT combines human demonstrations with deep reinforcement learning and TensorForce library.
result LIFT controllers trained from demonstrations outperform human baselines and heuristics in database and stream processing tasks.

Gene expression programming predicts compression index of fine-grained soils efficiently.

problem Estimating the compression index of fine-grained soils is costly and time-consuming.
method Developed a gene expression programming model using soil parameters.
result The GEP model predicts the compression index more accurately than conventional methods.

Deep neural network algorithms are difficult to analyze because they lack structure allowing to understand the properties of underlying transforms and invariants. Multiscale hierarchical convolutional networks are structured deep convolutional networks where layers are indexed by progressively higher dimensional attrib…

2017-03-12abs ↗pdf ↗

Study tackles database variability in medical data using ensemble models and CNNs.

problem Achieving robust generalization in machine learning models across multiple medical databases.
method Ensemble of local models based on convolutional neural networks (CNNs) and various data preprocessing techniques.
result Improved inter-database generalization performance and scalability of models.

Study connects database alignment and planted matching using Gaussian features.

problem Identify matching between correlated user features in anonymized databases.
method Derived results for database alignment and planted matching, showing connections and thresholds.
result Performance thresholds for database alignment converge to planted matching when feature dimensionality is sufficiently high.

Graph database outperforms in filtering ESG stocks efficiently.

problem Efficiently filtering ESG stocks from large lists of equities.
method Compared SQL, No-SQL, and graph databases; used Python for database interactions; collected data from stock price and financial news.
result Graph database is more efficient for ESG stock filtering.

Bayesian entity resolution merges together multiple, noisy databases and returns the minimal collection of unique individuals represented, together with their true, latent record values. Bayesian methods allow flexible generative models that share power across databases as well as principled quantification of uncertain…

2014-10-17abs ↗pdf ↗

We present a database of parliamentary debates that contains the complete record of parliamentary speeches from Dáil Éireann, the lower house and principal chamber of the Irish parliament, from 1919 to 2013. In addition, the database contains background information on all TDs (Teachta Dála, members of parliament), such…

2017-08-15abs ↗pdf ↗

Paper improves text-to-SQL translation by encoding schema relations with self-attention.

problem Improving text-to-SQL translation accuracy across diverse databases.
method Uses relation-aware self-attention to encode schema information.
result Significant gains on Spider dataset (42.94% exact match accuracy).

Graph Neural Networks improve machine learning on relational databases.

problem Training machine learning models on relational databases requires costly data extraction and feature engineering.
method Uses Graph Neural Networks to extract features from relational databases.
result Outperforms state-of-the-art automatic feature engineering methods.

Paper presents a new Wi-Fi RSS and geomagnetic field database for indoor localization and trajectory estimation.

problem Indoor localization and trajectory estimation challenges.
method Convolutional neural network (CNN) for RSS data and LSTM network for geomagnetic field intensity.
result CNN and LSTM networks show feasibility for localization and trajectory estimation.

New deep learning method validated across multiple sleep staging databases.

problem Improving automatic sleep scoring accuracy across different datasets.
method Ensemble of local models using deep learning for automatic sleep staging.
result Good general performance compared to human experts and state-of-the-art methods.

We lay theoretical foundations for new database release mechanisms that allow third-parties to construct consistent estimators of population statistics, while ensuring that the privacy of each individual contributing to the database is protected. The proposed framework rests on two main ideas. First, releasing (an esti…

2017-10-04abs ↗pdf ↗

A new algorithm uses bandits to diversify database activity monitoring.

problem Limitation of current DAM systems in collecting diverse data.
method Redefined DAM sampling as a bandit problem and developed a novel algorithm combining expert knowledge and random exploration.
result Adding diversity to sampling using the bandit-based approach improves coverage without decreasing alert quality.

The paper studies causal effects of multiple treatments in healthcare databases with rare outcomes.

problem Estimating causal effects of multiple treatments in healthcare databases with rare outcomes.
method The paper designs three sets of simulations and compares the operating characteristics of three types of methods: Bayesian Additive Regression Trees (BART), regression adjustment on multivariate spline of generalized propensity scores (RAMS), and inverse probability of treatment weighting (IPTW) with multinomial logistic regression or generalized boosted models.
result BART and RAMS provide lower bias and mean squared error compared to IPTW methods.

The problem of searching for experts in a given academic field is hugely important in both industry and academia. We study exactly this issue with respect to a database of authors and their publications. The idea is to use Latent Semantic Indexing (LSI) and Latent Dirichlet Allocation (LDA) to perform topic modelling i…

2013-11-25abs ↗pdf ↗

We propose a method to identify all the nodes that are relevant to compute all the conditional probability distributions for a given set of nodes. Our method is simple, effcient, consistent, and does not require learning a Bayesian network first. Therefore, our method can be applied to high-dimensional databases, e.g. …

2012-06-27abs ↗pdf ↗

We introduce multiscale invariant dictionaries to estimate quantum chemical energies of organic molecules, from training databases. Molecular energies are invariant to isometric atomic displacements, and are Lipschitz continuous to molecular deformations. Similarly to density functional theory (DFT), the molecule is re…

2016-05-16abs ↗pdf ↗

Hashing has been widely used for large-scale approximate nearest neighbor search because of its storage and search efficiency. Recent work has found that deep supervised hashing can significantly outperform non-deep supervised hashing in many applications. However, most existing deep supervised hashing methods adopt a …

2017-07-26abs ↗pdf ↗