The paper explores dual learning, a technique that improves machine translation and image transformation.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Many supervised learning tasks are emerged in dual forms, e.g., English-to-French translation vs. French-to-English translation, speech recognition vs. text to speech, and image classification vs. image generation. Two dual tasks have intrinsic connections with each other due to the probabilistic correlation between th…
In this paper, we propose a dual memory structure for reinforcement learning algorithms with replay memory. The dual memory consists of a main memory that stores various data and a cache memory that manages the data and trains the reinforcement learning agent efficiently. Experimental results show that the dual memory …
Derives a primal-dual MLSVD formulation for multilinear data.
Constrained Markov Decision Process (CMDP) is a natural framework for reinforcement learning tasks with safety constraints, where agents learn a policy that maximizes the long-term reward while satisfying the constraints on the long-term cost. A canonical approach for solving CMDPs is the primal-dual method which updat…
Optimizes subset selection in sparse learning problems.
PDCA algorithm learns policies for RL with constraints using a primal-dual approach.
Paper develops Byzantine-resilient algorithms for decentralized learning.
Dual averaging-type methods are widely used in industrial machine learning applications due to their ability to promoting solution structure (e.g., sparsity) efficiently. In this paper, we propose a novel accelerated dual-averaging primal-dual algorithm for minimizing a composite convex function. We also derive a stoch…
Efficient algorithm solves best subset selection problem.
Dual PC algorithm improves structure learning of Bayesian networks.
Paper proposes a novel metric learning algorithm using Riemannian optimization.
The wavelet transform has seen success when incorporated into neural network architectures, such as in wavelet scattering networks. More recently, it has been shown that the dual-tree complex wavelet transform can provide better representations than the standard transform. With this in mind, we extend our previous meth…
New algorithm for federated learning with non-smooth regularizers.
Proposes a fair meta-learning framework for few-shot classification.
In this paper we propose a novel dual adversarial co-learning approach for multi-domain text classification (MDTC). The approach learns shared-private networks for feature extraction and deploys dual adversarial regularizations to align features across different domains and between labeled and unlabeled data simultaneo…
New algorithm achieves sublinear regret in CMDPs without error cancellations.
GPs with neural network dual kernels improve reinforcement learning performance.
Inferring a person's goal from their behavior is an important problem in applications of AI (e.g. automated assistants, recommender systems). The workhorse model for this task is the rational actor model - this amounts to assuming that people have stable reward functions, discount the future exponentially, and construc…
Dual behavior policy improves reinforcement learning across various environments.
New method accelerates convergence for entropy-regularized reinforcement learning problems.
DPTA improves CIL by adapting PTMs with dual prototypes.
This paper introduces and evaluates a novel training method for neural networks: Dual Variable Learning Rates (DVLR). Building on insights from behavioral psychology, the dual learning rates are used to emphasize correct and incorrect responses differently, thereby making the feedback to the network more specific. Furt…
Dual-structured method improves cross-domain imitation learning.
Recently, considerable research efforts have been devoted to the design of methods to learn from data overcomplete dictionaries for sparse coding. However, learned dictionaries require the solution of an optimization problem for coding new data. In order to overcome this drawback, we propose an algorithm aimed at learn…
Solves dual imbalance in detecting sparse anomalies in MIL.
A method to improve sequential learning by keeping past data errors in check.
In this paper, we study randomized reduction methods, which reduce high-dimensional features into low-dimensional space by randomized methods (e.g., random projection, random hashing), for large-scale high-dimensional classification. Previous theoretical results on randomized reduction methods hinge on strong assumptio…
Drago optimizes DRO problems with faster convergence.
Sketching techniques have become popular for scaling up machine learning algorithms by reducing the sample size or dimensionality of massive data sets, while still maintaining the statistical power of big data. In this paper, we study sketching from an optimization point of view: we first show that the iterative Hessia…
Study allocates resources to strategic agents while balancing cost and incentives.
Dual Bayesian Affine Estimators for Wiener-type state-space models
A novel method for clustering multi-view data using dual representations.
CADE learns dual node representations for better generalization.
Given a convex optimization problem and its dual, there are many possible first-order algorithms. In this paper, we show the equivalence between mirror descent algorithms and algorithms generalizing the conditional gradient method. This is done through convex duality, and implies notably that for certain problems, such…
Algorithm optimizes constrained reinforcement learning with dual variables.
A new method for faster optimization on statistical manifolds.
Improves SVGP methods for faster and more accurate Gaussian process inference.
In recent years, there has been a surge of interest in developing deep learning methods for non-Euclidean structured data such as graphs. In this paper, we propose Dual-Primal Graph CNN, a graph convolutional architecture that alternates convolution-like operations on the graph and its dual. Our approach allows to lear…
Multi-task learning aims to learn multiple tasks jointly by exploiting their relatedness to improve the generalization performance for each task. Traditionally, to perform multi-task learning, one needs to centralize data from all the tasks to a single machine. However, in many real-world applications, data of differen…
The paper improves Gaussian process models for efficient batch optimization.
Dual-T method improves transition matrix estimation in noisy label learning.
The stochastic dual coordinate-ascent (S-DCA) technique is a useful alternative to the traditional stochastic gradient-descent algorithm for solving large-scale optimization problems due to its scalability to large data sets and strong theoretical guarantees. However, the available S-DCA formulation is limited to finit…
Previous studies on stochastic primal-dual algorithms for solving min-max problems with faster convergence heavily rely on the bilinear structure of the problem, which restricts their applicability to a narrowed range of problems. The main contribution of this paper is the design and analysis of new stochastic primal-d…
This research develops a dual-level reinforcement learning strategy to track daily VWAP accurately.
We introduce Primal-Dual Wasserstein GAN, a new learning algorithm for building latent variable models of the data distribution based on the primal and the dual formulations of the optimal transport (OT) problem. We utilize the primal formulation to learn a flexible inference mechanism and to create an optimal approxim…
This paper develops basic setting for the dual Orlicz-Brunn-Minkowski theory for star bodies. An Orlicz -radial addition of two or more star bodies is proposed and related dual Orlicz-Brunn-Minkowski inequality is established. Based on a linear Orlicz -radial addition of two star bodies, we derive a f…
Framework explains how dual deep networks learn features from unlabeled data.