Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

2845688511,135 · Jun 202019922001200920172026
48 results for human action generation

A method to generate long-range human actions by leveraging graph convolutional networks and self-attention.

problem Generating long-range skeleton-based human actions is challenging due to small frame deviations.
method Proposes a variant of GCNs with self-attention to adaptively sparsify action graphs and capture structure information.
result Extensive experiments show superior performance compared to existing methods on human action datasets.

SocialInteractionGAN generates realistic human interactions from low-dimensional data.

problem Generating realistic human interactions from limited data.
method Adversarial architecture with a recurrent encoder-decoder generator and dual-stream discriminator.
result SocialInteractionGAN produces high-quality action sequences of interacting people.

Training deep reinforcement learning agents complex behaviors in 3D virtual environments requires significant computational resources. This is especially true in environments with high degrees of aliasing, where many states share nearly identical visual features. Minecraft is an exemplar of such an environment. We hypo…

2019-08-02abs ↗pdf ↗

A new algorithm improves recommendation systems by considering repeated exposure to actions.

problem Improving recommendation systems by accounting for human memory decay.
method Introducing Weighted Tallying Bandits (WTB) and studying them under Repeated Exposure Optimality (REO).
result A simple modification of the successive elimination algorithm achieves nearly optimal complete policy regret.

SLHF uses sequential game theory to optimize preferences from human feedback.

problem Optimizing preferences from human feedback in sequential settings.
method SLHF frames the problem as a sequential-move game between Leader and Follower, decomposing the optimization into refinement and adversarial optimization.
result SLHF achieves strong alignment across diverse preference datasets and scales to large models.

Large-scale public datasets have been shown to benefit research in multiple areas of modern artificial intelligence. For decision-making research that requires human data, high-quality datasets serve as important benchmarks to facilitate the development of new methods by providing a common reproducible standard. Many h…

2019-03-15abs ↗pdf ↗

Robots learn actions and language through curiosity-driven self-exploration.

problem Efficient development of actions and language in infants and robots.
method Curiosity-driven self-exploration using Q-learning to amortize active inference.
result Curiosity-driven exploration enables faster learning and compositional generalization.

This work compares human feedback methods for reward learning in bandits.

problem Understanding how human feedback affects the performance of reward learning methods.
method Theoretical comparison of human feedback approaches in offline contextual bandits.
result Human bias and uncertainty in feedback modeling impact the theoretical guarantees of reward learning methods.

Although deep reinforcement learning agents have produced impressive results in many domains, their decision making is difficult to explain to humans. To address this problem, past work has mainly focused on explaining why an action was chosen in a given state. A different type of explanation that is useful is a counte…

2019-09-27abs ↗pdf ↗

Improved action recognition in live videos with hybrid FR-DL method.

problem High computational costs and lack of temporal information in conventional action recognition.
method Automated selection of representative frames, feature extraction, background subtraction, HOG, deep neural network, LSTM, Softmax-KNN classifier.
result Significant improvement in accuracy and speed compared to state-of-the-art methods.

When machine predictors can achieve higher performance than the human decision-makers they support, improving the performance of human decision-makers is often conflated with improving machine accuracy. Here we propose a framework to directly support human decision-making, in which the role of machines is to reframe pr…

2019-05-29abs ↗pdf ↗

Visual observations of dynamic phenomena, such as human actions, are often represented as sequences of smoothly-varying features . In cases where the feature spaces can be structured as Riemannian manifolds, the corresponding representations become trajectories on manifolds. Analysis of these trajectories is challengin…

2016-03-07abs ↗pdf ↗

LLM extracts actionable insights from customer reviews.

problem Extracting actionable insights from customer reviews.
method Large language model approach distinguishing perceptual attributes from actionable features.
result High consistency and predictive validity of LLM insights compared to human coders.

Paper proposes Roweisposes for 3D action recognition using generalized eigenvalue problem.

problem Need for basic methods in 3D action recognition.
method Roweisposes uses Roweis discriminant analysis for generalized subspace learning.
result Roweisposes is effective for 3D action recognition.

A new RL approach learns near-equivalent actions for healthcare decisions.

problem Finding optimal actions in healthcare settings where actions may be near-equivalent.
method Temporal difference learning with a near-greedy heuristic for action selection.
result The proposed algorithm discovers meaningful near-equivalent actions and converges well.

TraLFM models human mobility patterns from traffic trajectories.

problem Understanding human mobility patterns from traffic data.
method Latent factor modeling of sequential, personal, and temporal factors.
result TraLFM significantly outperforms state-of-the-art methods in latent factor analysis and next location prediction.

Designs neural networks on matrix manifolds for improved performance in tasks like human action recognition.

problem Designing neural networks for tasks on non-Euclidean manifolds.
method Develops fully-connected and convolutional layers for SPD manifolds, and MLR on SPSD manifolds.
result Demonstrates improved performance in human action recognition and node classification tasks.

New RLHF algorithm identifies optimal policies from human feedback without explicit reward inference.

problem Training large language models with human feedback without reward inference.
method Model-free RLHF algorithm BSAD\mathsf{BSAD} that identifies optimal policies directly from human preference.
result Provable, instance-dependent sample complexity ildeO(cMSA3H3Mlog1δ) ilde{\mathcal{O}}(c_{\mathcal{M}}SA^3H^3M\log\frac{1}δ).

Predictive Q-learning algorithm for IoT networks with human operators.

problem Resilient and predictive actions for IoT networks with faulty components.
method Predictive and resilient Q-learning algorithm considering historical data and human operator feedback.
result Optimal scheduling policies avoiding attacked locations and faults.

Paper proposes interpretable RL policies from a mixture of experts.

problem Making RL policies transparent and understandable in real-world applications.
method Policy iteration scheme with interpretable experts and prototypical states.
result Proposed algorithm learns policies comparable to neural networks but more interpretable.

We seek to align agent policy with human expert behavior in a reinforcement learning (RL) setting, without any prior knowledge about dynamics, reward function, and unsafe states. There is a human expert knowing the rewards and unsafe states based on his preference and objective, but querying that human expert is expens…

2019-12-30abs ↗pdf ↗

DMGNN predicts 3D human motions using adaptive multiscale graphs.

problem Predicting 3D skeleton-based human motions accurately.
method Dynamic multiscale graph neural networks (DMGNN) with adaptive multiscale graphs and MGCU.
result DMGNN outperforms state-of-the-art methods in short and long-term predictions.

Deep reinforcement learning (DRL) has gained a lot of attention in recent years, and has been proven to be able to play Atari games and Go at or above human levels. However, those games are assumed to have a small fixed number of actions and could be trained with a simple CNN network. In this paper, we study a special …

2019-01-24abs ↗pdf ↗

Learning predictive models from interaction with the world allows an agent, such as a robot, to learn about how the world works, and then use this learned model to plan coordinated sequences of actions to bring about desired outcomes. However, learning a model that captures the dynamics of complex skills represents a m…

2019-12-30abs ↗pdf ↗

The paper tackles learning from imperfect human feedback, especially in dueling bandit problems.

problem Learning from human feedback that can be irrational or imperfect.
method Developed a Robustified Stochastic Mirror Descent for Imperfect Dueling (RoSMID) algorithm.
result Achieved nearly optimal regret for dueling bandit problems under imperfect human feedback.

An assistant learns to mediate decisions between humans and experts, balancing risk and learning.

problem Learning to mediate decisions between imperfect humans and expert knowledge.
method Formalizes online decision mediation, proposes a policy to balance immediate loss and future generalization.
result Consistent gains over benchmarks in decision-making performance.