Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,786 papers · 148 categories

Trend · papers per month

103205308410 · Jun 202019922001200920172026
48 results for evaluation setups

Introduces LoCA regret to evaluate model-based RL methods.

problem Lack of consistent metrics to evaluate model-based RL methods.
method Inspired by neuroscience, introduces LoCA regret to measure model-based behavior.
result LoCA regret can identify model-based behavior and assess how close methods are to optimal model-based behavior.

This research tackles few-shot video action recognition, improving accuracy with a two-stream setup.

problem Few-shot video action recognition with limited labeled examples.
method Two-stream models combining convolutional and recurrent neural network video encoders with metric-based few-shot algorithms.
result The setup achieves 84.2% accuracy on a 5-shot 5-way task, outperforming other methods.

Design interventions to learn causal structure from observational data.

problem Identify causal structure from observational data, especially when direction of edges is unknown.
method Design non-adaptive interventions to maximize the number of identifiable edges, formulate as optimization problems.
result Proposed algorithms can efficiently identify causal structure from interventions, even for general causal structures.

We present a data-efficient reinforcement learning algorithm resistant to observation noise. Our method extends the highly data-efficient PILCO algorithm (Deisenroth & Rasmussen, 2011) into partially observed Markov decision processes (POMDPs) by considering the filtering process during policy evaluation. PILCO conduct…

2016-02-08abs ↗pdf ↗

Optimistic search speeds up change point detection in large datasets.

problem Efficiently detecting change points in large-scale data with high computational demands.
method Adaptive logarithmic queries to reduce evaluation complexity.
result Asymptotic minimax optimality and fast localization rates for change point detection.

New study finds optimal hyperparameter tuning crucial for fair optimizer comparisons.

problem Inadequate hyperparameter tuning and misleading evaluation setups hinder fair comparisons of optimizers.
method Systematic study of ten optimizers across four model scales and data-to-model ratios.
result Optimal hyperparameters for one optimizer may be suboptimal for another, and many claimed speedups are lower than expected.

MadEvolve optimizes trading algorithms using LLMs, achieving significant improvements in feature generation and trading strategy optimization.

problem Optimizing trading algorithms for better performance and feature generation.
method A framework inspired by Alpha-Evolve, using LLMs to evolve trading strategies and feature pipelines.
result Significant improvements in trading performance across various tasks, including feature generation and trading strategy optimization.

Distributed model training is vulnerable to byzantine system failures and adversarial compute nodes, i.e., nodes that use malicious updates to corrupt the global model stored at a parameter server (PS). To guarantee some form of robustness, recent work suggests using variants of the geometric median as an aggregation r…

2018-03-27abs ↗pdf ↗

Robust reinforcement learning agents generalize well to out-of-distribution settings using pretrained representations.

problem Achieving sample-efficient reinforcement learning agents that generalize to real-world settings.
method Trained 240 representations and 10,000 RL policies on a simulated robotic setup, evaluating different pretrained VAE-based representations' effects on OOD generalization.
result Many reinforcement learning agents are surprisingly robust to realistic distribution shifts, including sim-to-real cases.

In this work, a unified framework for gradient-free Multidimensional Scaling (MDS) based on Coordinate Search (CS) is proposed. This family of algorithms is an instance of General Pattern Search (GPS) methods which avoid the explicit computation of derivatives but instead evaluate the objective function while searching…

2019-02-04abs ↗pdf ↗

Randomized control methods improve asset pricing and performance analysis.

problem Challenges in drawing inferences from traditional random portfolios in performance evaluation.
method Geometric random walks and Markov chain Monte Carlo methods to construct flexible control groups.
result Captured premia associated with size, value, quality, and momentum in a constrained setting.

We introduce and describe the results of a novel shared task on bandit learning for machine translation. The task was organized jointly by Amazon and Heidelberg University for the first time at the Second Conference on Machine Translation (WMT 2017). The goal of the task is to encourage research on learning machine tra…

2017-07-27abs ↗pdf ↗

Like all sub-fields of machine learning Bayesian Deep Learning is driven by empirical validation of its theoretical proposals. Given the many aspects of an experiment it is always possible that minor or even major experimental flaws can slip by both authors and reviewers. One of the most popular experiments used to eva…

2018-11-23abs ↗pdf ↗

New framework assesses graph-learning datasets for better evaluation.

problem Insufficient evaluation of graph-learning datasets and methods.
method Introduces Rings framework for dataset ablations and proposes performance separability and mode complementarity measures.
result Demonstrates utility of Rings framework for graph-learning dataset evaluation.

Recently, deep reinforcement learning (RL) methods have been applied successfully to multi-agent scenarios. Typically, these methods rely on a concatenation of agent states to represent the information content required for decentralized decision making. However, concatenation scales poorly to swarm systems with a large…

2018-07-17abs ↗pdf ↗

This review explores how multiple agents learn to communicate in complex environments.

problem Learning effective communication strategies among multiple agents in partially observable environments.
method Review of recent algorithms and models for improving communication between agents, including Deep Recurrent Q-Networks.
result Introduction of a novel entropy-based evaluation metric for communication strategies.

Deep reinforcement learning (RL) has achieved breakthrough results on many tasks, but agents often fail to generalize beyond the environment they were trained in. As a result, deep RL algorithms that promote generalization are receiving increasing attention. However, works in this area use a wide variety of tasks and e…

2018-10-29abs ↗pdf ↗

This paper introduces Task 2 of the DCASE2019 Challenge, titled "Audio tagging with noisy labels and minimal supervision". This task was hosted on the Kaggle platform as "Freesound Audio Tagging 2019". The task evaluates systems for multi-label audio tagging using a large set of noisy-labeled data, and a much smaller s…

2019-06-07abs ↗pdf ↗

Reinforcement learning is a promising approach to developing hard-to-engineer adaptive solutions for complex and diverse robotic tasks. However, learning with real-world robots is often unreliable and difficult, which resulted in their low adoption in reinforcement learning research. This difficulty is worsened by the …

2018-03-19abs ↗pdf ↗

Study examines how network architecture handles increasing data complexity.

problem Understanding how network architecture affects performance with complex data.
method Empirical study comparing various network architectures on an image classification task with increasing class numbers.
result Modern architectures show better generalization performance with increasing data complexity.

This work addresses the problem of author name homonymy in the Web of Science. Aiming for an efficient, simple and straightforward solution, we introduce a novel probabilistic similarity measure for author name disambiguation based on feature overlap. Using the researcher-ID available for a subset of the Web of Science…

2018-08-10abs ↗pdf ↗

New algorithms reduce variance in solving complex mathematical problems.

problem Solving convex-concave saddle point problems, variational inequalities, and inclusions.
method Stochastic variance reduction for extragradient, forward-backward-forward, and forward-reflected-backward methods.
result All proposed methods converge with complexities matching or improving deterministic counterparts.

Generative Adversarial Networks (GANs) produce systematically better quality samples when class label information is provided., i.e. in the conditional GAN setup. This is still observed for the recently proposed Wasserstein GAN formulation which stabilized adversarial training and allows considering high capacity netwo…

2017-09-21abs ↗pdf ↗

New setup for continuous online learning improves understanding of imitation learning.

problem Challenges in capturing regularity in online problems.
method Continuous Online Learning (COL) setup, focusing on continuous gradient changes.
result Fundamental equivalence between sublinear dynamic regret and solving certain EPs.

Study shows how task similarity affects forgetting in teacher-student setup.

problem Catastrophic forgetting in continual learning.
method Extended teacher-student setup to multiple teachers, analyzing similarity between tasks.
result Task similarity, whether at readouts or features, influences forgetting and transfer.

In critical applications of anomaly detection including computer security and fraud prevention, the anomaly detector must be configurable by the analyst to minimize the effort on false positives. One important way to configure the anomaly detector is by providing true labels for a few instances. We study the problem of…

2018-09-17abs ↗pdf ↗

Deep learning has thrived by training on large-scale datasets. However, in robotics applications sample efficiency is critical. We propose a novel adaptive masked proxies method that constructs the final segmentation layer weights from few labelled samples. It utilizes multi-resolution average pooling on base embedding…

2019-02-19abs ↗pdf ↗

MO-GP models fill gaps in biophysical data with across-domain info transfer.

problem Gap filling of biophysical parameters LAI and fAPAR over rice areas.
method Multi-output Gaussian Processes (MO-GP) based on Linear Model of Coregionalization (LMC).
result MO-GP models successfully predict biophysical variables even in high missing data regimes.

New metric evaluates generative models across domains, diagnosing fidelity, diversity, and generalization.

problem Evaluating generative models in diverse domains with limited metrics.
method Introduces a 3D evaluation metric (αα-Precision, ββ-Recall, Authenticity) for domain-agnostic diagnostics.
result Unified metric characterizes fidelity, diversity, and generalization, diagnosing model performance.

Randomly guessing weights helps analyze RL benchmarks objectively.

problem Understanding the complexity of reinforcement learning benchmarks.
method Generate policy networks by randomly guessing their parameters, evaluate on benchmarks, and analyze results.
result Small untrained networks can provide a robust baseline for various RL tasks.

Deep learning (DL) training-as-a-service (TaaS) is an important emerging industrial workload. The unique challenge of TaaS is that it must satisfy a wide range of customers who have no experience and resources to tune DL hyper-parameters, and meticulous tuning for each user's dataset is prohibitively expensive. Therefo…

2016-11-18abs ↗pdf ↗