Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

2835658481,130 · Jun 202019922001200920172026
48 results for open-source data

Fine-tuned open-source LLMs match or exceed closed-source models in social science research.

problem Limited scalability and high costs of large LLMs in social science research.
method Fine-tuning open-source models for specific tasks, exploring training set size effects, proposing hybrid workflow.
result Small, fine-tuned open-source LLMs achieve equal or superior performance to commercial alternatives.

SAGDA generates synthetic agricultural datasets to improve ML in African farming.

problem Data scarcity in African agriculture limits machine learning innovations.
method SAGDA is an open-source Python toolkit that generates, augments, and validates synthetic agricultural datasets.
result SAGDA enhances ML applications in agriculture, such as yield prediction and fertilizer recommendation.

FinRobot opens-source AI for financial tasks, breaking down complex problems.

problem Barriers to AI adoption in finance due to proprietary data and specialized knowledge.
method Develops open-source AI agent platform with four layers: Financial AI Agents, LLM Algorithms, LLMOps/DataOps, and Foundation Models.
result FinRobot democratizes AI access for financial analysis.

We provide complete source code for building a fundamental industry classification based on publically available and freely downloadable data. We compare various fundamental industry classifications by running a horserace of short-horizon trading signals (alphas) utilizing open source heterotic risk models (https://ssr…

2017-06-13abs ↗pdf ↗

Scoping review and benchmarking of synthetic EHR data generation methods.

problem Creating realistic synthetic electronic health records for research and training.
method Conducted a scoping review and benchmarked seven methods on open-source EHR datasets.
result GAN-based methods excel in fidelity and utility, while rule-based methods excel in privacy protection.

SMART is an open source web application designed to help data scientists and research teams efficiently build labeled training data sets for supervised machine learning tasks. SMART provides users with an intuitive interface for creating labeled data sets, supports active learning to help reduce the required amount of …

2018-12-11abs ↗pdf ↗

Apache Spark is a popular open-source platform for large-scale data processing that is well-suited for iterative machine learning tasks. In this paper we present MLlib, Spark's open-source distributed machine learning library. MLlib provides efficient functionality for a wide range of learning settings and includes sev…

2015-05-26abs ↗pdf ↗

Deep learning methods have shown extraordinary potential for analyzing very diverse biomedical data, but their dissemination beyond developers is hindered by important computational hurdles. We introduce ImJoy (https://imjoy.io/), a flexible and open-source browser-based platform designed to facilitate widespread reuse…

2019-05-30abs ↗pdf ↗

LeanDojo removes barriers to theorem proving with open-source tools and data.

problem Difficulty in reproducing and building on existing theorem proving methods.
method Introduces LeanDojo, an open-source Lean playground with toolkits, data, models, and benchmarks.
result ReProver, an LLM-based prover augmented with retrieval, outperforms non-retrieval baselines and GPT-4.

CoinTossX is a low-latency, open-source matching engine for financial trading.

problem Efficiently matching orders in financial markets with low latency and high throughput.
method Developed in Java, orders submitted via UDP SBE, low-latency message transport (Aeron Media Driver). Separates order generation and matching.
result Demonstrated low-latency, high-throughput performance in various deployment scenarios.

This study examines representation bias in open-source Qwen models for investment decisions.

problem Representation bias in financial applications of large language models.
method Balanced round-robin prompting over 150 U.S. equities, constrained decoding, token-logit aggregation.
result Firm size and valuation increase model confidence, while risk factors decrease it.

Deep Learning has established itself to be a common occurrence in the business lexicon. The unprecedented success of deep learning in recent years can be attributed to: abundance of data, availability of gargantuan compute capabilities offered by GPUs, and adoption of open-source philosophy by the researchers and indus…

2019-09-30abs ↗pdf ↗

AutoML serves as the bridge between varying levels of expertise when designing machine learning systems and expedites the data science process. A wide range of techniques is taken to address this, however there does not exist an objective comparison of these techniques. We present a benchmark of current open source Aut…

2018-08-17abs ↗pdf ↗

Uncertainty Toolbox aids in assessing and improving uncertainty quantification in machine learning.

problem Disparate evaluation metrics and implementations hinder direct comparison of uncertainty quantification results.
method Provides an open-source Python library for assessing, visualizing, and improving uncertainty quantification.
result Facilitates more accurate and comparable uncertainty quantification across different works.

This paper benchmarks FinGPT for financial datasets using open-source large language models.

problem Challenges in integrating GPT-based models with financial datasets.
method Instruction Tuning paradigm for open-source large language models adapted for financial contexts.
result Demonstrates the effectiveness and adaptability of FinGPT in financial tasks.

Recent advances in machine learning have made significant contributions to drug discovery. Deep neural networks in particular have been demonstrated to provide significant boosts in predictive power when inferring the properties and activities of small-molecule compounds. However, the applicability of these techniques …

2016-11-10abs ↗pdf ↗

ML4Chem offers a user-friendly platform for developing and deploying machine learning models in chemistry.

problem Developing and deploying machine learning models in chemistry and materials science.
method User-experience design, six core building blocks: data, featurization, models, model optimization, inference, and visualization.
result Ease of use and functionality of the atomistic module for neural networks and kernel ridge regression.

auton-survival simplifies survival analysis for healthcare data.

problem Handling censored time-to-event data in healthcare.
method Open-source package for survival regression, adjustment, counterfactual estimation, phenotyping, and treatment effects.
result Demonstrates auton-survival's ability to support complex health and epidemiological questions.

HealthSyn generates synthetic user behavior data for health interventions.

problem Lack of representative data for testing AI health interventions.
method Uses Markov processes to simulate diverse user actions, generating logs for ML algorithms.
result Synthetic data can be used to develop, test, and evaluate ML algorithms and RL-based interventions.

mcanalysis quantifies menstrual cycle effects in health data.

problem Lack of standardised statistical methods for menstrual cycle research.
method Fourier-basis generalised additive model (GAM) pipeline.
result Nine out of 15 health outcomes showed significant association with menstrual cycle.

GPI uses GenAI models to infer causal and predictive effects from unstructured data.

problem Estimating causal and predictive effects from unstructured data like text and images.
method Leverages open-source GenAI models to generate and represent unstructured data, applying machine learning to these representations.
result GPI efficiently estimates causal and predictive effects with quantified uncertainty, without fine-tuning.

Quantum CNNs improve on multi-channel data processing.

problem Lack of efficient processing for multi-channel data in QCNNs.
method Developed hardware-adaptable quantum circuit ansatzes for convolutional kernels.
result Quantum CNNs outperform existing QCNNs on multi-channel data classification tasks.

Framework for few-shot relation classification with minimal training data.

problem Few-shot relation classification with limited training data.
method Meta-learning framework that combines instance and support knowledge.
result Framework outperforms state-of-the-art results and achieves competitive performance with large training data.

The AlphaGo, AlphaGo Zero, and AlphaZero series of algorithms are remarkable demonstrations of deep reinforcement learning's capabilities, achieving superhuman performance in the complex game of Go with progressively increasing autonomy. However, many obstacles remain in the understanding of and usability of these prom…

2019-02-12abs ↗pdf ↗

In recent years, an active field of research has developed around automated machine learning (AutoML). Unfortunately, comparing different AutoML systems is hard and often done incorrectly. We introduce an open, ongoing, and extensible benchmark framework which follows best practices and avoids common mistakes. The fram…

2019-07-01abs ↗pdf ↗

Preference learning (PL) is a core area of machine learning that handles datasets with ordinal relations. As the number of generated data of ordinal nature is increasing, the importance and role of the PL field becomes central within machine learning research and practice. This paper introduces an open source, scalable…

2015-06-04abs ↗pdf ↗

We introduce Graph-Sparse Logistic Regression, a new algorithm for classification for the case in which the support should be sparse but connected on a graph. We val- idate this algorithm against synthetic data and benchmark it against L1-regularized Logistic Regression. We then explore our technique in the bioinformat…

2017-12-15abs ↗pdf ↗