Action chunking and data exploration improve behavior cloning in robotics.
problem Exponential errors in learning from demonstrations for continuous control tasks.
method Action chunking and exploratory data collection.
result Control-theoretic stability is key to improving imitation learning.
Study uses big data to analyze quantum invariants.
problem Investigate structural properties of Jones polynomial.
method Exploratory and topological data analysis, including coloring, rank increase, categorification.
result Contrasts behavior of Jones polynomial under various enhancements.
Proposes ALRL for single shot active learning with pseudo annotators.
problem Real-world applications where human experts are not always available.
method Substitutes human annotators with pseudo annotators providing random labels.
result ALRL outperforms state-of-the-art approaches in real-world datasets.
Study of repeated principal-agent bandit game with self-interested and exploratory learning agents.
problem Interaction between principal and agent in unknown environments with learning and exploration behaviors.
method Developed algorithms for self-interested and exploratory learning agents with bandit feedback, achieving regret bounds.
result Achieved O ~ ( T 2 / 3 ) \widetilde{O}(T^{2/3}) O ( T 2/3 ) regret bound for exploratory learning agent in i.i.d. reward setup. Study uses social media analytics to identify exercise-related topics.
problem Understanding exercise-related discussions on social media.
method Data collection, topic modeling, and data annotation.
result 86% of detected topics were meaningful after annotation.
We develop a model of issue-specific voting behavior. This model can be used to explore lawmakers' personal voting patterns of voting by issue area, providing an exploratory window into how the language of the law is correlated with political support. We derive approximate posterior inference algorithms based on variat…
Study speculative trading using RL with exploratory framework.
problem Sequential optimal stopping problem over entry and exit times with general utility function and price process.
method Formulated as a sequential optimal stopping problem, solved using Cox processes driven by bounded, non-randomized intensity controls. Characterized randomized control via probability measure over jump intensities and regularized objective function by Shannon's entropy. Established error estimates and convergence of RL objective to value function.
result Closed-form solutions for optimal policy and value function are derived.
This paper quantifies privacy loss in exploratory data analysis.
problem Privacy loss in exploratory data analysis is often overlooked in privacy budgets.
method Quantitative analysis of privacy loss for statistical functions.
result Privacy loss must be considered in calculating machine learning privacy budgets.
Study of entropy-regularized LQG MFGs with exploratory actions.
problem Optimizing multi-population mean field games with entropy regularization.
method Introduced exploratory actions and derived optimal action distributions.
result Optimal action distributions lead to ε-Nash equilibria in finite-population MFGs.
Study finds key investing characteristics for success in equity markets.
problem Understanding what traits lead to financial success in equity markets.
method Exploratory factor analysis and multiple linear regression on 403 respondents' data.
result Investing characteristics significantly impact individual investors' excess return.
This paper reviews R packages for automating data analysis tasks.
problem Time-consuming Exploratory Data Analysis in large, noisy data sets.
method Systematic review of 12 R packages for autoEDA.
result Identifies automated tasks and areas for future development.
A novel triclustering method tracks structures in time-varying graphs.
problem Tracking structures in time-varying graphs.
method Maximum a posteriori approach for three-dimensional co-clustering.
result Time segments are directly inferred from edge distribution evolution.
Interprets how intrinsic motivation shapes behavior in RL agents.
problem Understanding how intrinsic motivation influences behavior in reinforcement learning agents.
method Analyzed five RL agents in procedurally generated environments using various interpretability techniques.
result Curiosity-driven agents exhibit broader and more dynamic attention than extrinsically motivated agents.
New method learns dynamical systems efficiently using active learning.
problem Efficiently learning dynamical systems from data.
method Active learning strategies leveraging Gaussian process regression.
result Data-efficient training of the model through exploratory sampling.
In this paper, we propose a new algorithm for exploratory projection pursuit. The basis of the algorithm is the insight that previous approaches used fairly narrow definitions of interestingness / non interestingness. We argue that allowing these definitions to depend on the problem / data at hand is a more natural app…
Parameter noise enhances RL exploration efficiency.
problem Enhancing RL exploration efficiency through parameter noise.
method Combining parameter noise with traditional RL methods.
result RL with parameter noise learns more efficiently than traditional RL methods.
DECE visualizes machine learning decisions with counterfactual explanations.
problem Making machine learning models transparent and explainable.
method Interactive visualization system supporting counterfactual explanations at instance- and subgroup-levels.
result DECE enables users to explore and understand machine learning model decisions.
ABDA automatically analyzes data without expert supervision.
problem Automatic exploratory data analysis for mixed data types.
method Automatic Bayesian Density Analysis (ABDA) for missing value estimation, data type and likelihood discovery, anomaly detection, and dependency structure mining.
result ABDA provides accurate density estimation and is suitable for mixed data types.
A framework for robust exploration in reinforcement learning under ambiguity.
problem Optimal stopping under ambiguity in reinforcement learning.
method Continuous-time robust reinforcement learning framework using g g g -expectation and backward stochastic differential equations. result Constructs a robust exploratory stopping time approximating the optimal stopping time under ambiguity.
Paper tackles expected predictions computation for arbitrary generative models.
problem Hard to compute expected predictions for arbitrary generative models.
method Identifies tractable generative and discriminative models for expected predictions.
result Tractable computation of high-order moments and expectations for classification.
Study on utility maximization with Tsallis entropy in reinforcement learning.
problem Exploring utility maximization with Tsallis entropy in reinforcement learning.
method Introducing Tsallis entropy regularizer to induce exploration, investigating specific examples, characterizing well-posedness, designing reinforcement learning algorithm.
result Characterized well-posedness and provided semi-closed-form solutions for specific examples, found distinct optimal strategies.
We propose in this paper an exploratory analysis algorithm for functional data. The method partitions a set of functions into K K K clusters and represents each cluster by a simple prototype (e.g., piecewise constant). The total number of segments in the prototypes, P P P , is chosen by the user and optimally distributed am…
RL solves large-scale MV portfolio allocation with high returns.
problem Large-scale mean-variance portfolio optimization.
method Continuous-time reinforcement learning with a multivariate Gaussian policy.
result Our method outperforms econometric and deep RL methods by significant margins.
New algorithm learns satisficing behaviors more efficiently in complex environments.
problem Intractability of optimal exploration in complex environments.
method Extends a deep reinforcement learning agent to learn satisficing policies without model-based planning.
result Demonstrates efficient learning of satisficing behaviors and optimal behaviors when feasible.
Breaks the hardness conjecture for batch RL with a novel tournament-based approach.
problem Sample-efficient reinforcement learning from exploratory data.
method BVFT algorithm using pairwise comparison and state-action partition.
result Solves the learning problem in a setting previously thought impossible.
New method for portfolio management learns from past wealth evolution.
problem Optimizing portfolio selection based on past performance.
method Simulated annealing clustering for asset selection, considering past wealth evolution.
result Strategy effectively learns from past performance and performs well in practice.
Automates organizing diverse web data into a hierarchical topic model.
problem Manual classification of all scientific and popular scientific knowledge is impractical.
method Proposes an algorithm to aggregate multiple collections into a single hierarchical topic model.
result Demonstrates a web service for topical exploratory search.
Study creates open-access wildfire dataset for Russia.
problem Data scarcity for comprehensive Eurasian wildfire research.
method Machine learning for exploratory data analysis and predictive modeling.
result Identified key environmental factors influencing fire behavior.
New method explains high-dimensional sphere data with latent factors.
problem Understanding intricate dependence structure in high-dimensional sphere data.
method Exploratory factor analysis of the projected normal distribution with a fast alternating expectation profile conditional maximization algorithm.
result Uniformly excellent results on various data types, including tweets, brain imaging, and cancer gene expression.
NADPEx uses dropout to enable temporally consistent exploration in reinforcement learning.
problem Achieving temporally consistent exploration in reinforcement learning agents.
method Integrates dropout into reinforcement learning policies to ensure temporal consistency.
result NADPEx outperforms naive exploration and parameter noise in tasks with sparse rewards.
Enhances exploration in reinforcement learning with diversity-driven approach.
problem Challenges in efficient exploration in reinforcement learning, especially in large state spaces.
method Diversity-driven exploration strategy combining off- and on-policy reinforcement learning algorithms.
result Significantly enhances exploratory behaviors, preventing local optima.
Study uses RL to optimize investment with financial constraints, showing exploration benefits.
problem Optimal investment with financial constraints in continuous time.
method Reinforcement learning framework, focusing on Gaussian and truncated Gaussian distributions.
result Exploration leads to more dispersed wealth distribution with heavier tails, especially with smaller exploration parameters.
BSG learns dynamic network spillovers and uncertainty quantification.
problem Identifying indirect spillovers and systemic risk in dynamic networks.
method Bayesian Spillover Graphs using FEVD and Bayesian time series models.
result Significant performance gains over baselines in identifying source and sink nodes.
The abstract warns against flawed empirical research in machine learning.
problem Flawed empirical research in machine learning leading to unreliable results.
method Call for more awareness of experimental knowledge plurality and epistemic limitations.
result Current empirical machine learning research should be exploratory, not confirmatory.
This paper introduces a new system for discovering patterns in morphogenetic systems using modular architecture and unsupervised learning.
problem Discovering novel patterns in morphogenetic systems is challenging and often relies on manual tuning.
method Introduces a hierarchical, modular architecture for unsupervised learning of diverse representations combined with goal exploration algorithms.
result The new system efficiently adapts diversity search towards user preferences with minimal feedback.
metboost improves prediction performance in hierarchically clustered data.
problem Challenges in exploratory regression analysis with hierarchically clustered data.
method metboost extends boosted decision trees to hierarchically clustered data, constraining tree structure while allowing terminal node means to differ.
result metboost improves prediction performance by up to 15% compared to boosted decision trees.
The paper tackles confidence calibration for exploratory machine learning problems.
problem Difficulty in curating datasets and confusion about category validity.
method Introduces four new algorithms for category-specific confidence estimation, including kernel density ratios.
result Kernel density ratios provide a novel approach to confidence calibration, especially for exploratory problems.
Bayesian model identifies three types of travelers adapting to feedback.
problem Capturing adaptive, feedback-driven travel behavior in heterogeneous individuals.
method Latent Class Reinforcement Learning (LCRL) model with Variational Bayes estimation.
result Three distinct traveler classes identified: context-dependent, persistent exploitative, and exploratory.
Deep learning speeds up IFA estimation for large datasets.
problem Slow MML estimation for large-scale IFA models.
method Importance-weighted autoencoder (IWAE) for fast VI.
result IWAE yields accurate estimates faster than MH-RM.
Uncharted Forest visualizes data associations for classification and provenance studies.
problem Exploratory data analysis in high-dimensional datasets.
method Unsupervised tree ensemble (uncharted forest) for partitioning and visualizing data.
result Visualizes class associations, sample associations, and class heterogeneity.
LoRA fine-tuning causes forgetting, studied via particle system dynamics.
problem Catastrophic forgetting in LoRA fine-tuning.
method Mean-field self-attention model, partial differential equations, dynamical systems.
result Characterization of phase transitions in forgetting behavior.
A new method speeds up factor analysis for high-dimensional data.
problem Estimating covariance parameters in high-dimensional Gaussian data with limited observations.
method Matrix-free likelihood method using implicitly restarted Lanczos and limited-memory quasi-Newton algorithms.
result Our method is faster than EM without sacrificing accuracy.
Study on typical knots and links using grid diagrams, focusing on size, components, and writhe.
problem Understanding the statistical behavior of knots and links, especially their typical properties.
method Modeling knots and links with grid diagrams, examining three invariants: size, components, and writhe, through numerical analysis.
result The size of a random knot is uniformly distributed and linearly dependent on grid size, while the number of components follows a distribution whose mean and variance grow with log_2 of grid size.
The paper tackles optimal stopping problems using reinforcement learning and singular control.
problem Continuous-time and state-space optimal stopping problems.
method Formulated as a singular control problem with randomized stopping times and penalized cumulative residual entropy.
result Identified unique optimal exploratory strategy through dynamic programming.
Archetypal analysis helps understand binary data sets.
problem Explaining binary questionnaire data.
method Using archetypal analysis for binary observations.
result The approach contributes to understanding binary data sets.
ACA identifies and explains anomalies in data.
problem Explaining anomalies in non-supervised data analysis.
method Abnormal Component Analysis (ACA) using data depth.
result ACA provides a linear explanation for anomalies.
Transfer learning improves performance modeling by reducing model construction cost.
problem Reducing the cost of constructing performance models for configurable systems.
method Empirical study on four software systems, varying configurations and environmental conditions.
result Transfer learning is beneficial for small environmental changes but only reduces sampling efficiency for severe changes.
A-DOGE embeds attributed graphs efficiently using density of states.
problem Efficiently represent node-attributed graphs with few numerical features.
method A-DOGE uses density of states to blend topology and attributes, leveraging efficient approximation algorithms.
result A-DOGE achieves competitive performance with modern supervised GNNs while being significantly faster.