This work explores representation complexity in RL paradigms, revealing model-based RL as the easiest task.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Flow-based data sets are necessary for evaluating network-based intrusion detection systems (NIDS). In this work, we propose a novel methodology for generating realistic flow-based network traffic. Our approach is based on Generative Adversarial Networks (GANs) which achieve good results for image generation. A major c…
The paper classifies Auerbach bases of spaces.
We derive Gaussian approximations for random forest predictions using region-based stabilization.
Overparameterized models generalize well in offline contextual bandits, but policy-based algorithms struggle.
Introduces LoCA regret to evaluate model-based RL methods.
Synthetic construction of 3D complex bases.
Starting from the requirement that risk measures of financial portfolios should be based on their losses, not their gains, we define the notion of loss-based risk measure and study the properties of this class of risk measures. We characterize loss-based risk measures by a representation theorem and give examples of su…
We propose a direction of arrival (DOA) estimation method that combines sound-intensity vector (IV)-based DOA estimation and DNN-based denoising and dereverberation. Since the accuracy of IV-based DOA estimation degrades due to environmental noise and reverberation, two DNNs are used to remove such effects from the obs…
In this paper we investigate continuous speech recognition using electroencephalography (EEG) features using recently introduced end-to-end transformer based automatic speech recognition (ASR) model. Our results demonstrate that transformer based model demonstrate faster training compared to recurrent neural network (R…
New DQ based on expectiles improves portfolio diversification.
Improved hypothesis testing and change-point detection using diffusion-based methods.
The success of kernel-based learning methods depend on the choice of kernel. Recently, kernel learning methods have been proposed that use data to select the most appropriate kernel, usually by combining a set of base kernels. We introduce a new algorithm for kernel learning that combines a {\em continuous set of base …
Simple model-based reinforcement learning outperforms model-free methods in complex tasks.
Improves graph-based active learning for non-Gaussian models.
A neural network model minimizes region-based free energy for faster inference in MRFs.
In this paper, we develop and explore deep anomaly detection techniques based on the capsule network (CapsNet) for image data. Being able to encoding intrinsic spatial relationship between parts and a whole, CapsNet has been applied as both a classifier and deep autoencoder. This inspires us to design a prediction-prob…
Proposes new methods for interpreting document classification models.
Deep RL optimizes goal-based investing strategies.
Study batch reinforcement learning methods for personalized medical treatments.
New method combines gradient optimization with constraint-based techniques for causal discovery.
Gradient-based MCMC for discrete spaces improves sampling performance.
GEBM combines energy function and base distribution for better generative modeling.
New method trains energy-based models faster and more stably.
Domain adaptation is essential to enable wide usage of deep learning based networks trained using large labeled datasets. Adversarial learning based techniques have shown their utility towards solving this problem using a discriminator that ensures source and target distributions are close. However, here we suggest tha…
Sphere-bases for simplicial and cubical complexes are constructed and analyzed.
EB-RANSAC uses energy-based model for robust estimation without complex sampling.
Compression-based similarity measures are effectively employed in applications on diverse data types with a basically parameter-free approach. Nevertheless, there are problems in applying these techniques to medium-to-large datasets which have been seldom addressed. This paper proposes a similarity measure based on com…
In this paper, we investigate deep learning (DL)-enabled signal demodulation methods and establish the first open dataset of real modulated signals for wireless communication systems. Specifically, we propose a flexible communication prototype platform for measuring real modulation dataset. Then, based on the measured …
Knowledge bases contribute to many web search and mining tasks, yet they are often incomplete. To add missing facts to a given knowledge base, various embedding models have been proposed in the recent literature. Perhaps surprisingly, relatively simple models with limited expressiveness often performed remarkably well …
We review the utility-based valuation method for pricing derivative securities in incomplete markets. In particular, we review the practical approach to the utility-based pricing by the means of computing the first order expansion of marginal utility-based prices with respect to a small number of random endowments.
New models handle survival analysis with concept-based learning.
GATES improves neural architecture search by modeling operations as information transformation.
Parity defined for based matrices, a new example of virtual knot parity.
Detrended fluctuation analysis (DFA) is a simple but very efficient method for investigating the power-law long-term correlations of non-stationary time series, in which a detrending step is necessary to obtain the local fluctuations at different timescales. We propose to determine the local trends through empirical mo…
Loop group method varies with base point choice.
We investigate the validity of the equivalence principle along paths in gravitational theories based on derivations of the tensor algebra over a differentiable manifold. We prove the existence of local bases, called normal, in which the components of the derivations vanish along arbitrary paths. All such bases are expl…
Unsupervised relation discovery aims to discover new relations from a given text corpus without annotated data. However, it does not consider existing human annotated knowledge bases even when they are relevant to the relations to be discovered. In this paper, we study the problem of how to use out-of-relation knowledg…
Model-based machine learning improves communication systems.
M3PO improves model-based meta-RL with theoretical guarantees.
Unified kernel-based methods improve nonlinear causal discovery.
We propose two neural network based mixture models in this article. The proposed mixture models are explicit in nature. The explicit models have analytical forms with the advantages of computing likelihood and efficiency of generating samples. Computation of likelihood is an important aspect of our models. Expectation-…
Magnitude-based pruning is one of the simplest methods for pruning neural networks. Despite its simplicity, magnitude-based pruning and its variants demonstrated remarkable performances for pruning modern architectures. Based on the observation that magnitude-based pruning indeed minimizes the Frobenius distortion of a…
We study the -Einstein warped product manifolds, where the scalar curvature of the Base is a multiple of the warping function, and we called this condition (inside a warped product manifold) -curvature-Base ().The aim of this paper is to check if there are Base-manifolds with non-flat metrics that sa…
In our physically inspired in-tree (IT) based clustering algorithm and the series after it, there is only one free parameter involved in computing the potential value of each point. In this work, based on the Delaunay Triangulation or its dual Voronoi tessellation, we propose a nonparametric process to compute potentia…
Model-based reinforcement learning algorithms tend to achieve higher sample efficiency than model-free methods. However, due to the inevitable errors of learned models, model-based methods struggle to achieve the same asymptotic performance as model-free methods. In this paper, We propose a Policy Optimization method w…
Cellular network configuration plays a critical role in network performance. In current practice, network configuration depends heavily on field experience of engineers and often remains static for a long period of time. This practice is far from optimal. To address this limitation, online-learning-based approaches hav…
Efficient momentum-based methods for reinforcement learning with improved sample complexity.