Develops theory of weightings for Lie groupoids and algebroids.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Explains weightings along submanifolds, focusing on Lie groupoids.
Paper proves multiplicative weight updates can train neural networks without learning rate tuning.
New methods improve LLM preference optimization by intelligently weighting multiple reference models.
Independent Component Analysis (ICA) - one of the basic tools in data analysis - aims to find a coordinate system in which the components of the data are independent. In this paper we present Multiple-weighted Independent Component Analysis (MWeICA) algorithm, a new ICA method which is based on approximate diagonalizat…
Paper adapts multiplicative weights method to Gaussian graphical models.
Corrupting the input and hidden layers of deep neural networks (DNNs) with multiplicative noise, often drawn from the Bernoulli distribution (or 'dropout'), provides regularization that has significantly contributed to deep learning's success. However, understanding how multiplicative corruptions prevent overfitting ha…
New algorithm for online optimization over symmetric cones, unifying previous methods.
Multi-task learning is a method for improving the generalizability of multiple tasks. In order to perform multiple classification tasks with one neural network model, the losses of each task should be combined. Previous studies have mostly focused on multiple prediction tasks using joint loss with static weights for tr…
The study explores weightings on submanifolds and their geometric properties.
BiQGEMM efficiently multiplies quantized DNN weights using lookup tables.
Multiple kernel learning (MKL) method is generally believed to perform better than single kernel method. However, some empirical studies show that this is not always true: the combination of multiple kernels may even yield an even worse performance than using a single kernel. There are two possible reasons for the fail…
MSD removes dequantization bottleneck in LLM inference by approximating high-precision activations.
Study of coloured invariants of torus knots using algebras.
BayesBlend blends multiple models' predictions for better insurance loss predictions.
Post-training quantization method using multiple low-precision points achieves higher precision for critical weights.
Online learning makes sequence of decisions with partial data arrival where next movement of data is unknown. In this paper, we have presented a new technique as multiple times weight updating that update the weight iteratively forsame instance. The proposed technique analyzed with popular state-of-art algorithms from …
The paper proposes a novel MKL approach for OCC using -norm constraints.
Introduces VB-structures for geometric objects on manifolds.
Neural Architecture Search (NAS) has shown great potentials in finding better neural network designs. Sample-based NAS is the most reliable approach which aims at exploring the search space and evaluating the most promising architectures. However, it is computationally very costly. As a remedy, the one-shot approach ha…
New sampling-based approach for filtering problems using multiplicative Gaussian functions.
We introduce a novel scheme to train binary convolutional neural networks (CNNs) -- CNNs with weights and activations constrained to {-1,+1} at run-time. It has been known that using binary weights and activations drastically reduce memory size and accesses, and can replace arithmetic operations with more efficient bit…
This paper presents a novel multitask multiple kernel learning framework that efficiently learns the kernel weights leveraging the relationship across multiple tasks. The idea is to automatically infer this task relationship in the \textit{RKHS} space corresponding to the given base kernels. The problem is formulated a…
With the development of multimedia era, multi-view data is generated in various fields. Contrast with those single-view data, multi-view data brings more useful information and should be carefully excavated. Therefore, it is essential to fully exploit the complementary information embedded in multiple views to enhance …
We improve prediction set coverage by assigning weights to individual sets.
Improves conformal prediction by combining multiple score functions and optimizing weights.
LASLA improves multiple testing accuracy with network-structured data.
Study reduces NAS search cost by generating multiple complex architectures in one shot.
A new metric, Weighted Regret, unifies FDR and power evaluation in online multiple testing.
This work investigates fundamental questions related to learning features in convolutional neural networks (CNN). Empirical findings across multiple architectures such as VGG, ResNet, Inception, DenseNet and MobileNet indicate that weights near the center of a filter are larger than weights on the outside. Current regu…
The complex analytic methods have found a wide range of applications in the study of multiplicity-free representations. This article discusses, in particular, its applications to the question of restricting highest weight modules with respect to reductive symmetric pairs. We present a number of multiplicity-free branch…
Aggregating multiple learners through an ensemble of models aim to make better predictions by capturing the underlying distribution of the data more accurately. Different ensembling methods, such as bagging, boosting, and stacking/blending, have been studied and adopted extensively in research and practice. While baggi…
Combining information from different sources is a common way to improve classification accuracy in Brain-Computer Interfacing (BCI). For instance, in small sample settings it is useful to integrate data from other subjects or sessions in order to improve the estimation quality of the spatial filters or the classifier. …
In recent studies, several asymptotic upper bounds on generalization errors on deep neural networks (DNNs) are theoretically derived. These bounds are functions of several norms of weights of the DNNs, such as the Frobenius and spectral norms, and they are computed for weights grouped according to either input and outp…
We consider a Gaussian process formulation of the multiple kernel learning problem. The goal is to select the convex combination of kernel matrices that best explains the data and by doing so improve the generalisation on unseen data. Sparsity in the kernel weights is obtained by adopting a hierarchical Bayesian approa…
Bayesian approach for multivariate density regression of complex data.
Estimates multiple means in high dimensions using convex combinations.
Given a weighted line arrangement in the projective plane, with weights satisfying natural constraint conditions, we show the existence of a Ricci-flat Kähler metric with cone singularities along the lines asymptotic to a polyhedral Kähler cone at each multiple point. Moreover, we discuss a Chern-Weil formula that expr…
WiGS improves active learning for regression by dynamically selecting informative samples.
We consider the problem of identifying patterns in a data set that exhibit anomalous behavior, often referred to as anomaly detection. In most anomaly detection algorithms, the dissimilarity between data samples is calculated by a single criterion, such as Euclidean distance. However, in many cases there may not exist …
NetFuse merges different DNN models with varying weights for faster inference.
The paper computes characteristic classes for Lie group representations.
We empirically investigate the best trade-off between sparse and uniformly-weighted multiple kernel learning (MKL) using the elastic-net regularization on real and simulated datasets. We find that the best trade-off parameter depends not only on the sparsity of the true kernel-weight spectrum but also on the linear dep…
We study binary classification in the setting where the learner is presented with multiple corrupted training samples, with possibly different sample sizes and degrees of corruption, and introduce an approach based on minimizing a weighted combination of corruption-corrected empirical risks. We establish a generalizati…
Proposes a novel network for CTR prediction by learning modality-specific and modality-invariant representations.
clusterBMA combines clustering results from multiple models using Bayesian model averaging.
In the multiple linear regression setting, we propose a general framework, termed weighted orthogonal components regression (WOCR), which encompasses many known methods as special cases, including ridge regression and principal components regression. WOCR makes use of the monotonicity inherent in orthogonal components …
Paper refines Alesker-Bernig-Schuster theorem, proving Hodge-Riemann relations for Euclidean balls.