Paper proposes a new flatness measure for neural networks to improve generalization.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
The paper explores methods to construct knots with diffeomorphic -traces.
We prove that an isoparametric hypersurface with four principal curvatures and multiplicity pair is either the one constructed by Ozeki and Takeuchi, or one of the two constructed by Ferus, Karcher, and Münzner. This completes the classification of isoparametric hypersurfaces in spheres that É. Cartan initiated…
In this paper, we successfully generalize the eigenvalue comparison theorem for the Dirichlet -Laplacian () obtained by Matei [A.-M. Matei, First eigenvalue for the -Laplace operator, Nonlinear Anal. TMA 39 (8) (2000) 1051--1068] and Takeuchi [H. Takeuchi, On the first eigenvalue of the -Laplacian …
In this sequel, employing more commutative algebra than that explored in \cite{CCJ}, we show that an isoparametric hypersurface with four principal curvatures and multiplicities in is one constructed by Ozeki-Takeuchi \cite[I]{OT} and Ferus-Karcher-Münzner \cite{FKM}, referred to collectively as of OT-…
We introduce a new formulation of asset trading games in continuous time in the framework of the game-theoretic probability established by Shafer and Vovk (Probability and Finance: It's Only a Game! (2001) Wiley). In our formulation, the market moves continuously, but an investor trades in discrete times, which can dep…
We introduce a new criterion to determine the order of an autoregressive model fitted to time series data. It has the benefits of the two well-known model selection techniques, the Akaike information criterion and the Bayesian information criterion. When the data is generated from a finite order autoregression, the Bay…
New criterion improves predictive evaluation in weighted inference scenarios.
A widely applicable Bayesian information criterion (Watanabe, 2013) is applicable for both regular and singular models in the model selection problem. This criterion tends to overestimate the log marginal likelihood. We identify an overestimating term of a widely applicable Bayesian information criterion. Adjustment of…
Ozeki and Takeuchi \cite[I]{OT} introduced the notion of Condition A and Condition B to construct two classes of inhomogeneous isoparametric hypersurfaces with four principal curvatures in spheres, which were later generalized by Ferus, Karcher and Münzner to many more examples via the Clifford representations; we will…
Proposes a new hyperprior and predictive criterion for weakly informative hyperprior in relevance vector machine.
The classification of isoparametric hypersurfaces with four principal curvatures in spheres in [2] hinges on a crucial characterization, in terms of four sets of equations of the 2nd fundamental form tensors of a focal submanifold, of an isoparametric hypersurface of the type constructed by Ferus, Karcher and Münzner. …
SIC detects elbows in error curves automatically.
Study shows the corrected Akaike criterion is inadmissible for estimating Kullback-Leibler discrepancy.
Complete criterion for VoI in multi-decision influence diagrams established.
In the information-based paradigm of inference, model selection is performed by selecting the candidate model with the best estimated predictive performance. The success of this approach depends on the accuracy of the estimate of the predictive complexity. In the large-sample-size limit of a regular model, the predicti…
LS improves model selection for singular statistical models.
SplitWise enhances stepwise regression by adaptively encoding numeric predictors into binary features.
In this paper, we propose an information-theoretic exploration strategy for stochastic, discrete multi-armed bandits that achieves optimal regret. Our strategy is based on the value of information criterion. This criterion measures the trade-off between policy information and obtainable rewards. High amounts of policy …
A new criterion selects models in overparameterized settings.
A new criterion HBIC improves model selection for factor analysis with missing data.
Statistical inference is considered for variables of interest, called primary variables, when auxiliary variables are observed along with the primary variables. We consider the setting of incomplete data analysis, where some primary variables are not observed. Utilizing a parametric model of joint distribution of prima…
This paper introduces Kernel-based Information Criterion (KIC) for model selection in regression analysis. The novel kernel-based complexity measure in KIC efficiently computes the interdependency between parameters of the model using a variable-wise variance and yields selection of better, more robust regressors. Expe…
The paper derives an equation linking WAIC and WBIC for singular models.
We have recently proposed a new information-based approach to model selection, the Frequentist Information Criterion (FIC), that reconciles information-based and frequentist inference. The purpose of this current paper is to provide a simple example of the application of this criterion and a demonstration of the natura…
We test three common information criteria (IC) for selecting the order of a Hawkes process with an intensity kernel that can be expressed as a mixture of exponential terms. These processes find application in high-frequency financial data modelling. The information criteria are Akaike's information criterion (AIC), the…
When the in-sample Sharpe ratio is obtained by optimizing over a k-dimensional parameter space, it is a biased estimator for what can be expected on unseen data (out-of-sample). We derive (1) an unbiased estimator adjusting for both sources of bias: noise fit and estimation error. We then show (2) how to use the adjust…
Develops higher arity VC theory and characterizes PAC learning in product spaces.
Complex hyperbolic triangle groups were first considered by Mostow in building the first nonarithmetic lattices in PU(2, 1). They are a natural generalization of the classical triangle groups acting on the hyperbolic plane. A well-known theorem of Takeuchi is that there are only finitely many Fuchsian triangle groups t…
We study tick-by-tick financial returns belonging to the FTSE MIB index of the Italian Stock Exchange (Borsa Italiana). We can confirm previously detected non-stationarities. However, scaling properties reported in the previous literature for other high-frequency financial data are only approximately valid. As a conseq…
Paper improves feature selection accuracy using transfer learning.
Proposes SNML for selecting word2vec Skip-gram dimensionality.
Safe Bayesian optimization method using information theory.
A new method for automatic gradient tree boosting using information theory.
Paper introduces NICc for fast cluster-based validation of prediction models.
Comparing with traditional learning criteria, such as mean square error (MSE), the minimum error entropy (MEE) criterion is superior in nonlinear and non-Gaussian signal processing and machine learning. The argument of the logarithm in Renyis entropy estimator, called information potential (IP), is a popular MEE cost i…
The paper describes a method to infer the signal-to-noise ratio in portfolio optimization.
Factorized Information Criterion (FIC) is a recently developed information criterion, based on which a novel model selection methodology, namely Factorized Asymptotic Bayesian (FAB) Inference, has been developed and successfully applied to various hierarchical Bayesian models. The Dirichlet Process (DP) prior, and one …
Accurate model selection is a fundamental requirement for statistical analysis. In many real-world applications of graphical modelling, correct model structure identification is the ultimate objective. Standard model validation procedures such as information theoretic scores and cross validation have demonstrated poor …
A new criterion for deep active learning selects minimal labeled data points.
We consider the bridge linear regression modeling, which can produce a sparse or non-sparse model. A crucial point in the model building process is the selection of adjusted parameters including a regularization parameter and a tuning parameter in bridge regression models. The choice of the adjusted parameters can be v…
We consider a problem of data integration. Consider determining which genes affect a disease. The genes, which we call predictor objects, can be measured in different experiments on the same individual. We address the question of finding which genes are predictors of disease by any of the experiments. Our formulation i…
Factorized information criterion (FIC) is a recently developed approximation technique for the marginal log-likelihood, which provides an automatic model selection framework for a few latent variable models (LVMs) with tractable inference algorithms. This paper reconsiders FIC and fills theoretical gaps of previous FIC…
MIC improves VAR order selection accuracy.
DE-QT detects optimal Q-learning stopping points.
Active learning aims to train a classifier as fast as possible with as few labels as possible. The core element in virtually any active learning strategy is the criterion that measures the usefulness of the unlabeled data based on which new points to be labeled are picked. We propose a novel approach which we refer to …
A statistical model or a learning machine is called regular if the map taking a parameter to a probability distribution is one-to-one and if its Fisher information matrix is always positive definite. If otherwise, it is called singular. In regular statistical models, the Bayes free energy, which is defined by the minus…
IIC provides a PAC-Bayes bound for interpolating models, revealing factors affecting generalization.