arXiv research

New algorithm reduces regret in graphical bilinear bandits.

Efficient algorithm converges to Nash equilibrium in bilinear problems with bandit feedback.

New algorithms solve linear bandits in high dimensions efficiently.

We introduce the bilinear bandit problem with low-rank structure in which an action takes the form of a pair of arms from two different entity types, and the reward is a bilinear function of the known feature vectors of the arms. The unknown in the problem is a $d_1$ by $d_2$ matrix $\mathbfΘ^*$ that defines the reward…

Unified bounds for sketched bilinear forms in machine learning and statistics.

This paper identifies the minimal set of nodes for optimal conditional interventions in causal bandits.

We introduce a rich class of graphical models for multi-armed bandit problems that permit both the state or context space and the action space to be very large, yet succinctly specify the payoffs for any context-action pair. Our main result is an algorithm for such models whose regret is bounded by the number of parame…

GL-LowPopArt improves minimax-optimal estimation for trace regression.

We study multi-armed bandit problems with graph feedback, in which the decision maker is allowed to observe the neighboring actions of the chosen action, in a setting where the graph may vary over time and is never fully revealed to the decision maker. We show that when the feedback graphs are undirected, the original …

Based on differential privacy (DP) framework, we introduce and unify privacy definitions for the multi-armed bandit algorithms. We represent the framework with a unified graphical model and use it to connect privacy definitions. We derive and contrast lower bounds on the regret of bandit algorithms satisfying these def…

New algorithm optimizes resource allocation in non-stationary networks.

New method proves fast regret bounds for online RLHF with generalized preferences.

New algorithm finds causal parent nodes without graph learning.

The paper tackles causal bandits for SEMs, proposing algorithms that avoid estimating $2^N$ reward distributions.

New algorithm tackles nonstationary linear bandits with latent dynamics.

The paper explores how to apply causal knowledge across different datasets to improve learning.

This paper presents a novel unifying framework of bilinear LSTMs that can represent and utilize the nonlinear interaction of the input features present in sequence datasets for achieving superior performance over a linear LSTM and yet not incur more parameters to be learned. To realize this, our unifying framework allo…

New algorithm reduces regret in sequential decision-making problems.

Algorithm identifies correct hypothesis from alternatives in bandit problems.

Generalization of twistor spinors to Kähler manifolds which are called Kählerian twistor spinors are considered. We find the differential equation satisfied by the bilinear forms of Kählerian twistor spinors. We show that the bilinear form equation reduces to Kählerian conformal Killing-Yano equation under special cond…

Drawing a sample from a discrete distribution is one of the building components for Monte Carlo methods. Like other sampling algorithms, discrete sampling suffers from the high computational burden in large-scale inference problems. We study the problem of sampling a discrete random variable with a high degree of depen…

Algorithm identifies bilinear dynamical systems from noisy data.

In this paper, we extend Su-Zhang's Cheeger-Mueller type theorem for symmetric bilinear torsions to manifolds with boundary in the case that the Riemannian metric and the non-degenerate symmetric bilinear form are of product structure near the boundary. Our result also extends Bruening-Ma's Cheeger-Mueller type theorem…

Bilinear MLPs offer a new way to interpret deep learning models without complex nonlinearities.

Identifies bilinear systems from a single trajectory with optimal sample complexity.

Generalizes Riemann's results on flat coordinates for non-symmetric bilinear forms.

The theory of harmonic symmetric bilinear forms on a Riemannian manifold is an analogue of the theory of harmonic exterior differential forms on this manifold. To show this, we must consider every symmetric bilinear form on a Riemannian manifold as a one-form with values in the cotangent bundle of this manifold. In thi…

Paper reduces sample complexity for bilinear systems identification to nearly constant.

This note provides a neat and enjoyable expansion and application of the magnificent Ordentlich-Cover theory of "universal portfolios." I generalize Cover's benchmark of the best constant-rebalanced portfolio (or 1-linear trading strategy) in hindsight by considering the best bilinear trading strategy determined in hin…

We present a formal model of human decision-making in explore-exploit tasks using the context of multi-armed bandit problems, where the decision-maker must choose among multiple options with uncertain rewards. We address the standard multi-armed bandit problem, the multi-armed bandit problem with transition costs, and …

Enhances knot invariants using bilinear forms on vector spaces.

Constructs a bilinear form from a quasimorphism on symplectic manifold groups.

In this paper, we propose to employ a bank of modality-dedicated Convolutional Neural Networks (CNNs), fuse, train, and optimize them together for person classification tasks. A modality-dedicated CNN is used for each modality to extract modality-specific features. We demonstrate that, rather than spatial fusion at the…

We define a type of biquandle which is a generalization of symplectic quandles. We use the extra structure of these bilinear biquandles to define new knot and link invariants and give some examples.

A parsimonious model reduces over-parameterization in skewed matrix variate mixtures.

Study learns linear system dynamics from noisy bilinear data.

We use the Jones-Wenzl idempotents to construct a basis of Temperley-Lieb algebra TL_n. This allows a short calculation for a Gram determinant of Lickorish's bilinear form on the Temperley-Lieb algebra.

Non-bilinear observations make optimal control harder, showing non-convex costs and non-affine optimal controllers.

This thesis is concerned with the theory of invariant bilinear differential pairings on parabolic geometries. It introduces the concept formally with the help of the jet bundle formalism and provides a detailed analysis. More precisely, after introducing the most important notations and definitions, we first of all giv…

We present an alternative definition for the Goussarov--Habiro filtration of the Z-module freely generated by oriented integral homology 3-spheres, by means of Lagrangian-preserving homology handlebody replacements (LP-surgeries). Garoufalidis, Goussarov and Polyak proved that the graded space (G_n)_n associated to thi…

Proposes a low-rank bilinear pooling model for link prediction in knowledge graphs.

Study dynamics of alternating minimization for bilinear regression under large system limits.

Vector-valued neural learning has emerged as a promising direction in deep learning recently. Traditionally, training data for neural networks (NNs) are formulated as a vector of scalars; however, its performance may not be optimal since associations among adjacent scalars are not modeled. In this paper, we propose a n…

In this paper the notion of an M-th order invariant bilinear differential pairing is introduced and a formal definition is given. If the manifold has an AHS structure, then various first order pairings are constructed. This yields a classification of all first order invariant bilinear differential pairings on homogeneo…

Improved SEG method converges to Nash equilibrium in bilinear games.

We are interested in approximation of a multivariate function $f(x_1,\dots,x_d)$ by linear combinations of products $u^1(x_1)\cdots u^d(x_d)$ of univariate functions $u^i(x_i)$, $i=1,\dots,d$. In the case $d=2$ it is a classical problem of bilinear approximation. In the case of approximation in the $L_2$ space the bili…

We provide a diagrammatic computation for the bilinear form, which is defined as the pairing between the (relative) cup products with every local coefficients and every integral homology 2-class of every links in the 3-sphere. As a corollary, we construct bilinear forms on the twisted Alexander modules of links.

Financial time-series analysis and forecasting have been extensively studied over the past decades, yet still remain as a very challenging research topic. Since the financial market is inherently noisy and stochastic, a majority of financial time-series of interests are non-stationary, and often obtained from different…