The paper discusses regularization properties of artificial data for deep learning. Artificial datasets allow to train neural networks in the case of a real data shortage. It is demonstrated that the artificial data generation process, described as injecting noise to high-level features, bears several similarities to e…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “Artificial Datasets”
In this paper, we propose generating artificial data that retain statistical properties of real data as the means of providing privacy with respect to the original dataset. We use generative adversarial network to draw privacy-preserving artificial data samples and derive an empirical method to assess the risk of infor…
GANs trained on artificial datasets avoid dataset biases, revealing generative model weaknesses.
problem GANs trained on real datasets often underfit or overfit, making analysis difficult.
method Trained GANs on artificial datasets with infinite samples and simple distributions.
result GANs fail to learn optimal parameters, suggesting limitations in generative models.
Generative Adversarial Networks (GANs) became very popular for generation of realistically looking images. In this paper, we propose to use GANs to synthesize artificial financial data for research and benchmarking purposes. We test this approach on three American Express datasets, and show that properly trained GANs c…
One of the big restrictions in brain computer interface field is the very limited training samples, it is difficult to build a reliable and usable system with such limited data. Inspired by generative adversarial networks, we propose a conditional Deep Convolutional Generative Adversarial (cDCGAN) Networks method to ge…
Automated medical prognosis has gained interest as artificial intelligence evolves and the potential for computer-aided medicine becomes evident. Nevertheless, it is challenging to design an effective system that, given a patient's medical history, is able to predict probable future conditions. Previous works, mostly c…
Approaches to Fraud Detection on Credit Card Transactions Using Artificial Intelligence Methodscs.LG
This paper summarizes AI methods for detecting credit card fraud.
problem Detecting credit card fraud from millions of transactions.
method Rule-based and AI approaches, addressing imbalanced datasets, real-time scenarios, and feature engineering.
result Summarizes state-of-the-art AI methods for fraud detection.
This paper presents the application of a newly developed nature-inspired metaheuristic optimization method, namely the Adaptive Wind Driven Optimization (AWDO), to the training of feedforward artificial neural networks (NN) and presents a discussion into the future research of AWDO implementation in Deep Learning (DL).…
Framework predicts mortality risk in MAFLD subjects.
problem Lack of mortality prediction methods for MAFLD subjects.
method Artificial Intelligence-based framework MAFUS using ML algorithms.
result Support Vector Machines (SVM) is the best model for mortality prediction.
Paper develops ML-based PLA verifiers that operate like the likelihood test.
problem Designing secure PLA verifiers when no attack information is available.
method Developed neural network and OCLSSVM models trained as two-class classifiers on legitimate data.
result One-class models can operate as the likelihood test at convergence.
Perceptual capabilities of artificial systems have come a long way since the advent of deep learning. These methods have proven to be effective, however they are not as efficient as their biological counterparts. Visual attention is a set of mechanisms that are employed in biological visual systems to ease computationa…
Prediction markets are used in real life to predict outcomes of interest such as presidential elections. This paper presents a mathematical theory of artificial prediction markets for supervised learning of conditional probability estimators. The artificial prediction market is a novel method for fusing the prediction …
Paper uses AI to improve medical diagnosis accuracy.
problem Improving accuracy of medical diagnoses.
method Heuristic frequentist and Bayesian approaches applied to a nationwide dataset.
result Algorithm outperforms human doctors in detecting abnormal births.
Efficient Federated Learning over Multiple Access Channel with Differential Privacy Constraintscs.LG
Paper addresses FL over MAC with DP constraints, proposing a novel consensus scheme.
problem Federated learning over a multiple access channel with differential privacy constraints.
method Proposes a novel consensus scheme using digital distributed stochastic gradient descent (D-DSGD) with artificial noise to preserve DP.
result Demonstrates improved convergence rate and DP level for a given MAC capacity.
Deep Calibration With Artificial Neural Network: A Performance Comparison on Option Pricing Modelsq-fin.MF
ANN improves option pricing models by calibrating parameters faster and more accurately.
problem Calibration of GARCH-type option pricing models is computationally intensive and model-dependent.
method Trained ANN models on Monte Carlo simulation data to calibrate GARCH parameters.
result ANN outperforms traditional methods in calibration speed and accuracy.
Monte-Carlo Sampling applied to Multiple Instance Learning for Histological Image Classificationcs.CV
We propose a patch sampling strategy based on a sequential Monte-Carlo method for high resolution image classification in the context of Multiple Instance Learning. When compared with grid sampling and uniform sampling techniques, it achieves higher generalization performance. We validate the strategy on two artificial…
The Artificial Prediction Market is a recent machine learning technique for multi-class classification, inspired from the financial markets. It involves a number of trained market participants that bet on the possible outcomes and are rewarded if they predict correctly. This paper generalizes the scope of the Artificia…
Cold posteriors in BNNs harm performance, likely due to incorrect likelihood.
problem Cold posteriors in Bayesian neural networks degrade performance.
method Developed a generative model explaining cold posteriors and matched it to the tempered likelihoods.
result Cold posteriors are a result of using the wrong likelihood for image classification datasets.
This work introduces 'Artificial Entanglement' to understand LLMs' fine-tuning effectiveness.
problem Understanding the effectiveness of parameter-efficient fine-tuning methods for large language models.
method Adopting a quantum-information-inspired perspective, the study measures 'Artificial Entanglement' in neural networks.
result LoRA and FFT induce distinct internal entanglement signatures but not external ones, suggesting a 'no-hair' property.
An AI approach selects variables in linear models.
problem Selecting significant variables in linear regression models.
method Artificial Neural Network trained to determine variable significance based on OLS estimates.
result The AI approach outperforms traditional methods in accuracy and variable selection.
This study ranks feature-block importance in multiblock neural networks.
problem Understanding feature contributions in multiblock neural networks.
method Three methods: composite, knock-in, and knock-out strategies.
result Each strategy has its merits for specific application scenarios.
AI learns market manipulation through simulation, suggesting regulation.
problem Regulating AI to prevent market manipulation.
method Used a genetic algorithm in an artificial market simulation.
result AI discovered market manipulation as an optimal strategy.
New method constructs graphs from data efficiently, suitable for large datasets.
problem Memory and runtime limitations of traditional TMFG for large datasets.
method Uses k-Nearest Neighbors Graphs and memory management for scalable graph construction.
result Provides a parsimonious way to construct graphs for learning tasks.
Enhances neural network dynamics to boost computational capacity.
problem Improving computational capacity of neural networks.
method Introducing Phase Transition Adaptation to drive system dynamics towards edge of stability.
result Consistently achieves enhancement in computational capacity over multiple datasets.
Deep learning is a subset of a broader family of machine learning methods based on learning data representations. These models are inspired by human biological nervous systems, even if there are various differences pertaining to the structural and functional properties of biological brains. The elementary constituents …
Study forecasts Bitcoin prices using ML algorithms.
problem Accurately predicting Bitcoin price movements.
method Applied four ML algorithms: SVM, ANN, NB, RF, and LR.
result RF outperforms other models in continuous dataset, NB in discrete.
MTS-CycleGAN adapts multivariate time series data for ironmaking industry.
problem Creating a domain invariant dataset from multivariate time series data of different blast furnaces.
method Adversarial-based deep mapping learning network (CycleGAN) with LSTM-based AutoEncoder and discriminator.
result MTS-CycleGAN successfully translates multivariate time series data between different blast furnaces.
Proposes a new GAN architecture for generating data conditioned on partial information.
problem Generating data conditioned on partial ancillary information.
method Introduces a new Adversarial Network architecture and training strategy.
result The proposed method outperforms standard Conditional GANs in generating data under partial conditioning.
GPEX interprets deep neural networks without strict assumptions.
problem Interpreting deep neural networks without strict assumptions.
method Derive an evidence lower-bound that encourages GP's posterior to match ANN's output.
result GPs can closely match ANN's outputs without strict assumptions.
CEILS generates feasible counterfactual explanations by considering causal impacts.
problem Current counterfactual explanations lack feasibility and causal impact consideration.
method CEILS integrates causal reasoning into existing counterfactuals generation algorithms.
result CEILS provides feasible recommendations to achieve desired outcomes.
Deep-learning CNN automates Cu alloy grain size evaluation.
problem Automating the evaluation of Cu alloy grain size to reduce labor and improve accuracy.
method Deep-learning convolutional neural network (CNN) for automated image acquisition and processing.
result Achieved 91.1% classification accuracy on Cu alloy sub-images.
The paper investigates AI robustness through experiments and statistical analysis.
problem Inaccurate AI predictions can lead to safety and adoption issues.
method Design of experiments framework to study AI classification robustness.
result AI algorithms' robustness is influenced by various factors.
In this work we present a review of the state of the art of Learning Vector Quantization (LVQ) classifiers. A taxonomy is proposed which integrates the most relevant LVQ approaches to date. The main concepts associated with modern LVQ approaches are defined. A comparison is made among eleven LVQ classifiers using one r…
Recent approaches based on artificial neural networks (ANNs) have shown promising results for named-entity recognition (NER). In order to achieve high performances, ANNs need to be trained on a large labeled dataset. However, labels might be difficult to obtain for the dataset on which the user wants to perform NER: la…
Recent work establishes dataset difficulty and removes annotation artifacts via partial-input baselines (e.g., hypothesis-only models for SNLI or question-only models for VQA). When a partial-input baseline gets high accuracy, a dataset is cheatable. However, the converse is not necessarily true: the failure of a parti…
Autism spectrum condition (ASC) or autism spectrum disorder (ASD) is primarily identified with the help of behavioral indications encompassing social, sensory and motor characteristics. Although categorized, recurring motor actions are measured during diagnosis, quantifiable measures that ascertain kinematic physiognom…
Gene expression profiles have been widely used to characterize patterns of cellular responses to diseases. As data becomes available, scalable learning toolkits become essential to processing large datasets using deep learning models to model complex biological processes. We present an autoencoder to capture nonlinear …
Artificial intelligence has impacted many aspects of human life. This paper studies the impact of artificial intelligence on economic theory. In particular we study the impact of artificial intelligence on the theory of bounded rationality, efficient market hypothesis and prospect theory.
Neural machine learning methods, such as deep neural networks (DNN), have achieved remarkable success in a number of complex data processing tasks. These methods have arguably had their strongest impact on tasks such as image and audio processing - data processing domains in which humans have long held clear advantages…
Deep learning methods have predominantly been applied to large artificial neural networks. Despite their state-of-the-art performance, these large networks typically do not generalize well to datasets with limited sample sizes. In this paper, we take a different approach by learning multiple layers of kernels. We combi…
This paper analyzes the variability of Concept Activation Vectors (CAVs).
problem The variability of CAVs in explaining AI models.
method Theoretical analysis and experiments on real-life datasets to quantify CAVs variability.
result The variance of CAVs decreases as 1/N, where N is the number of random examples.
PAMS is a Python-based platform for simulating artificial markets.
problem Simulating complex market behaviors for research and education.
method Developed as a Python-based simulator with deep learning integration.
result Demonstrated effectiveness through agent price prediction studies.
Improved prediction of hierarchical time series using structured regularization.
problem Making coherent forecasts for hierarchical time series.
method Structured regularization method for bottom-level time series predictions.
result Superior prediction accuracy and computational efficiency compared to previous methods.
WLDA enhances LDA for missing data, improving classification accuracy and interpretability.
problem Missing data in real-world datasets hinders classification accuracy and interpretability of LDA.
method WLDA incorporates a weight matrix to handle missing data directly, preserving interpretability.
result WLDA significantly outperforms traditional methods in datasets with missing values.
We introduce a novel algorithmic approach to content recommendation based on adaptive clustering of exploration-exploitation ("bandit") strategies. We provide a sharp regret analysis of this algorithm in a standard stochastic noise setting, demonstrate its scalability properties, and prove its effectiveness on a number…
Deep neural networks are a family of computational models that have led to a dramatical improvement of the state of the art in several domains such as image, voice or text analysis. These methods provide a framework to model complex, non-linear interactions in large datasets, and are naturally suited to the analysis of…
We introduce an exact distributed algorithm to train Random Forest models as well as other decision forest models without relying on approximating best split search. We explain the proposed algorithm and compare it to related approaches for various complexity measures (time, ram, disk, and network complexity analysis).…
Proposes BGNN for tumor heterogeneity prediction using graph neural networks.
problem Tumor classification limitations and heterogeneity assessment challenges.
method Artificial data generation, tumor heterogeneity estimation, and BGNN model development.
result BGNN achieves accuracy in predicting tumor heterogeneity.