GSR optimizes tasks in scientific workflows, improving performance across diverse applications.
problem Uncertainty in task selection and evaluation in scientific workflow optimization.
method Generate-Select-Refine (GSR) framework that alternates between task generation and optimization.
result GSR outperforms existing LLM-based optimizers in various scientific applications.
Meta-learning agents forget tasks; this work creates a memory system to help them remember.
problem Meta-learning agents forget previously learned tasks when new ones appear.
method Developed a meta-learning architecture that combines LSTM and a differentiable neural episodic memory.
result Agents with the episodic LSTM architecture can solve tasks more effectively when they recur.
CausalEvolve improves efficiency and discovery in open-ended scientific tasks.
problem Lack of targeted guidance and knowledge organization in evolve-based agents.
method Causal scratchpad that identifies and reasons about guiding factors for evolution.
result Effective improvement in evolutionary efficiency and better solutions.
Robot learns multiple tasks hierarchically by transferring knowledge.
problem Learning multiple complex tasks in open-ended environments.
method Task-oriented procedures, goal-babbling, imitation learning, active learning, intrinsic motivation.
result Robots can learn complex tasks more efficiently by transferring knowledge from simpler ones.
This work tackles autonomous learning of interrelated tasks in robots.
problem Learning interrelated tasks in robots, especially in complex environments.
method Using a multi-task reinforcement learning approach within an MDP framework.
result Demonstrates how to autonomously learn interrelated tasks in robots.
A new framework evaluates LLM calibration in open-ended QA.
problem Evaluating LLM calibration in open-ended QA settings.
method Sem-ECE framework: sampling answers, grouping by semantic classes, and using frequencies as confidence.
result Sem-ECE estimators are unbiased and Sem2 achieves smaller calibration error. DIVA generates diverse tasks for complex simulators, enabling adaptive agent training.
problem Lack of diverse training data for complex, open-ended simulators.
method Evolutionary approach using domain randomization and procedural generation.
result Successfully trains adaptive agent behavior in complex simulators.
Shai is a 10B model for asset management tasks, outperforming baselines.
problem Improving performance in asset management tasks.
method Continuous pre-training and fine-tuning on asset management-specific data.
result Shai outperforms baseline models in asset management tasks.
Method recombines image content and style from different images.
problem Recombining image content and style from different images.
method Constructs content embedding, uses VAE with leakage filtering to ensure separation of style and content.
result Synthesizes novel images with state-of-the-art performance on few-shot learning tasks.
Paper reviews intrinsic motivations and their role in open-ended learning.
problem Understanding intrinsic motivations and their role in open-ended learning.
method Defining intrinsic motivations, presenting psychological/neuroscientific and computational models.
result Links between psychological/neuroscientific and computational models of intrinsic motivations.
New method for evaluating LLMs reduces bias in open-ended evaluations.
problem Bias in Elo-based ratings of LLMs due to data redundancies.
method Proposes evaluation as a 3-player game and introduces novel solution concepts.
result Novel method leads to more robust and intuitive ratings.
Survey on knotoids and braidoids, their theory and applications.
problem Understanding open-ended knot diagrams and their geometric counterparts.
method Review of fundamental concepts and existing research.
result Exploration of knotoids and braidoids in protein studies.
Study examines how decoding algorithms affect fairness in language generation models.
problem Impact of decoding algorithms on fairness in open-ended language generation.
method Systematic analysis of top-p, top-k, and temperature decoding algorithms. result Decoding algorithms significantly impact fairness across demographic groups.
Top-H decoding improves text generation by balancing creativity and coherence.
problem Balancing creativity and coherence in text generation.
method Entropy-constrained minimum divergence problem, NP-hard ECMM problem, top-H decoding.
result Top-H decoding outperforms min-p sampling by up to 25.63% on creative writing benchmarks.
New algorithm improves performance in nontransitive games.
problem Nontransitive games lack a clear winner.
method Geometric framework for agent objectives, PSRO_rN algorithm.
result PSRO_rN consistently outperforms alternatives in nontransitive games.
The paper analyzes how open-end fund sales affect prices and returns.
problem How open-end fund sales impact prices and returns.
method Continuous-time market-clearing model to derive expected-return restrictions.
result Forced-sale pressure predicts actual fund selling and positive returns.
MiniHack simplifies creation of complex RL environments.
problem Limited availability of challenging RL benchmarks.
method Develops a sandbox framework for easy RL environment design.
result MiniHack enables rapid creation of diverse RL testbeds.
Quriosity analyzes curiosity-driven questions from diverse sources.
problem Understanding and analyzing human curiosity-driven questions.
method Collection of 13.5K questions from various sources, development of an iterative prompt improvement framework.
result 42% of questions are causal, revealing unique linguistic properties.
Local-HDP learns independent topics for each 3D object category in real-time.
problem Learning independent topics for each 3D object category in real-time.
method Local-Hierarchical Dirichlet Process (Local-HDP) with online variational inference.
result Local-HDP outperforms other approaches in accuracy, scalability, and memory efficiency.
New method predicts nonfactuality in LLM responses using semantic isotropy.
problem Assessing trustworthiness of long-form LLM responses efficiently.
method Semantic isotropy of text embeddings on the unit sphere.
result Higher semantic isotropy correlates with lower factual consistency.
Study finds exposure bias distortion is limited and not incremental in open-ended text generation.
problem Exposure bias in auto-regressive language models causing incremental distortion.
method Proposed metrics to quantify exposure bias impact, used ground-truth prefixes instead of model-generated prefixes.
result Exposure bias distortion is limited and not incremental during generation.
FSPO optimizes synthetic preferences for LLM personalization.
problem Personalizing large language models for diverse users.
method FSPO reframes reward modeling as a meta-learning problem, using few labeled preferences and synthetic data.
result FSPO achieves high winrates in personalized responses, both synthetic and real.
This paper presents the beginnings of an automatic statistician, focusing on regression problems. Our system explores an open-ended space of statistical models to discover a good explanation of a data set, and then produces a detailed report with figures and natural-language text. Our approach treats unknown regression…
A polynomial knot is a smooth embedding κ:ℜ→ℜn whose components are polynomials. The case n=3 is of particular interest. It is both an object of real algebraic geometry as well as being an open ended topological knot. This paper contains basic results for these knots as well as many examples.
Hyperfitting improves LLM generation quality by enhancing diversity, contrary to simple temperature scaling.
problem Improving open-ended generation quality of LLMs with minimal fine-tuning effort.
method Demonstrates that hyperfitting, a phenomenon where LLMs are fine-tuned to near-zero training loss, enhances generation quality and mitigates repetition.
result Hyperfitting is distinct from temperature scaling and involves a dynamic, context-dependent rank reordering mechanism in the final transformer block.
Variance-Calibrated Modulation (VCM) addresses the likelihood trap in LLMs by reshaping the probability distribution before truncation.
problem LLMs fall into the likelihood trap, leading to repetitive degeneration and vocabulary dullness.
method VCM reshapes the probability distribution before truncation through Contextual Searchlight and Adaptive Self-Debiasing.
result VCM mitigates the likelihood trap across open-ended generation, factual QA, and mathematical reasoning.
New homology categorifies knotoid polynomial.
problem Generalizing knot theory to open-ended diagrams.
method Defined winding homology as a triply-graded invariant.
result Categorifies Turaev's polynomial invariant of knotoids.
This work uses image generation models to find vision model bugs.
problem Automatically discovering failures in vision models.
method Conditional text-to-image generation and captioning models.
result Demonstrated utility of large-scale generative models to find vision model bugs.
New method for explaining dialogue response generation models.
problem Interpreting sequence generation models, especially dialogue response generation.
method Local Explanation of Response Generation (LERG) method.
result LERG improves dialogue response generation explanations compared to existing methods.
A new framework evaluates LLMs by considering judge reliability.
problem Evaluating LLMs without ground truth labels can lead to biased results.
method Introduces judge-specific discrimination parameters and estimates model quality and judge reliability.
result Improves agreement with human preferences and produces calibrated uncertainty quantification.
Adaptive contrastive search improves text generation quality and diversity.
problem Decoding high-quality text from language model outputs.
method Adaptive contrastive search incorporating uncertainty-guided degeneration penalty.
result Enhanced text generation quality and diversity across different models and datasets.
New text-to-image diffusion models improve scene understanding for AI agents.
problem Fine-grained scene understanding for AI agents from text and images.
method Pre-trained text-to-image diffusion models optimized for generating images from text prompts.
result Policies learned with Stable Control Representations outperform state-of-the-art approaches on various control tasks.
This paper gives mathematical models for flat knotted ribbons, and makes specific conjectures for the least length of ribbon (for a given width) needed to tie the trefoil knot and the figure eight knot. The first conjecture states that (for width one) the least length of ribbon needed to tie an open-ended trefoil knot …
Hallucinations in models are mislinked estimates, not errors.
problem Hallucinations in generative models as failures to link estimates to plausible causes.
method Formalized hallucinations, showed even optimal estimators hallucinate, provided a general lower bound on hallucinate rate, reframed hallucination as structural misalignment, and experimentally supported theory.
result Hallucinations are structural misalignments between loss minimization and human-acceptable outputs, leading to estimation errors.
Deep learning models predict mutual funds' performance better than traditional methods.
problem Predicting mutual funds' performance accurately.
method Deep learning models (LSTM, GRUs) trained with Bayesian optimization and ensemble methods.
result Ensemble method of LSTM and GRUs achieves the highest accuracy in forecasting mutual funds' Sharpe ratios.
Graphoids are topological invariants of virtual graph diagrams.
problem Understanding knotted graphs with open ends in proteins and simplifying virtual spatial graphs.
method Topological interpretations of graphoids using graph Reidemeister moves.
result Virtual graphoids are useful for studying knotted graphs and simplifying spatial graphs.
A new approach reduces the size of prediction sets in CP, making it more efficient.
problem Large and costly prediction sets in standard CP.
method Expand correctness criterion to include inferred admissible answers, and use prediction cascades to prune implausible labels.
result Empirically effective in natural language processing and drug discovery.
Statistical framework improves LLM chatbot ranking.
problem Improving evaluation of LLM-based chatbots through pairwise comparisons.
method Factored tie model, covariance modeling, and parameter constraints.
result Substantial improvements in modeling pairwise comparison data.
New F-polynomial distinguishes knotoid diagrams not previously possible.
problem Polynomial invariants for knotoids.
method Introduced F-polynomial and constructed distinguishing examples. result New invariant F distinguishes knotoids not previously possible. Study finds Indian mutual funds adjust cash holdings based on inflows, impacting stock purchases.
problem Active liquidity management by mutual funds in India.
method Examined cash holdings and stock purchases of Indian equity mutual funds.
result Funds with active liquidity choices outperform, highlighting the importance of this strategy.
In massive open online courses (MOOCs), peer grading serves as a critical tool for scaling the grading of complex, open-ended assignments to courses with tens or hundreds of thousands of students. But despite promising initial trials, it does not always deliver accurate results compared to human experts. In this paper,…
New approach uses 'growth' and 'harvesting' concepts to improve deep learning models.
problem Current deep learning models lack transparency and high convergence rates.
method Reconsider neural networks as single-species population dynamics with balanced growth and harvesting rates.
result SGD with balanced growth and harvesting rates outperforms adaptive methods in all three requirements.
Paper improves emotion expression in AI chatbots.
problem AI chatbots generate responses that lack emotion.
method Developed neural models to express specific emotions in generated responses.
result An encoder-decoder model with multiple attention layers performs best in expressing required emotion.
Generative grading improves automated feedback for structured problems.
problem Difficulty in providing high-quality feedback on structured assignments.
method Generative descriptions of student cognition, probabilistic programs, and learning to infer feedback.
result Achieved near-human accuracy in grading and feedback across diverse domains.
Inference-Time Scaling can be extended to domains prone to systematic failure using intrinsic statistics.
problem Scaling inference time in domains prone to systematic failure
method Intrinsic Selection (iS), Intrinsic Particle Filtering (iPF), and Particle Distillation (dPF)
result Intrinsic Selection improves engineering design selection by 20% and pass@1 by 6.1 points on average.
Mathematical pipeline identifies structural homology of knotted proteins.
problem Quantification and classification of protein structures, especially knotted proteins, require noise-free and complete data.
method Developed a geometric framework using persistent homology to analyze protein structures.
result Persistent homology accurately represents structural homology of knotted proteins and identifies geometric features of protein entanglement.
Constant Proportion Portfolio Insurance (CPPI) is a strategy designed to give participation in a risky asset while protecting the invested capital. Some gap risk due to extreme events is often kept by the issuer of the product: a put option on the CPPI strategy is included in the product. In this paper we present a new…
Tiny neural networks learn Atari games with just 6 neurons.
problem Understanding and simplifying complex vision-based decision-making tasks.
method Separate learning of state representations and policies, using novel encoding algorithms.
result 6-neuron neural networks achieve comparable results to state-of-the-art methods.