Paper bounds parameter transfer learning performance and applies it to self-taught learning.
problem Transfer learning performance bounds and self-taught learning theory.
method Introduces local stability and transfer learnability, derives a learning bound.
result First theoretical learning bound for self-taught learning.
Autoencoder selects relevant source samples for self-taught learning.
problem Negative transfer from irrelevant source samples.
method Autoencoder with ℓ2,1-norm sparsity constraint for relevance metric. result Promising results in expanded training set for classifier training.
Proposes a new self-taught learning approach for SVM classification.
problem Classification with limited labeled target data and abundant unlabeled source data.
method Introduces a new objective function that learns a common space and robust SVM classifiers.
result Superior performance compared to existing algorithms on Caltech-256 and MSRC+LMO datasets.
Self-taught optimizer improves code generation using language models.
problem Improving code generation using language models.
method Recursive self-improvement of a scaffolding program that generates code.
result Improved scaffolding program generates programs with significantly better performance.
A neuro-inspired architecture learns without supervision using clustering and predictive coding.
problem Achieving continual learning without supervision.
method Neuro-inspired architecture based on online clustering and hierarchical predictive coding.
result The architecture achieves continual learning without supervision.
Unsupervised learning for evolving data streams with STAM architecture.
problem Learning from non-stationary, unlabeled data streams over time.
method Self-Taught Associative Memory (STAM) architecture with online clustering, novelty detection, and feature storage.
result STAM architecture improves clustering and classification tasks compared to existing continual learning models.
In this paper we propose a strategy for semi-supervised image classification that leverages unsupervised representation learning and co-training. The strategy, that is called CURL from Co-trained Unsupervised Representation Learning, iteratively builds two classifiers on two different views of the data. The two views c…
New method for LLMs to learn reasoning by optimizing latent variables.
problem Teaching LLMs to generate logical justifications for answers.
method Formalized reasoning as latent variable model, derived FEM objective, designed sampling schemes.
result Prompt Posterior Sampling (PPS) outperforms other schemes in learning to reason.
We consider the problem of using a factor model we call {\em spike-and-slab sparse coding} (S3C) to learn features for a classification task. The S3C model resembles both the spike-and-slab RBM and sparse coding. Since exact inference in this model is intractable, we derive a structured variational inference procedure …
EarthMapper offers a tool for semantic segmentation of remote sensing imagery.
problem Lack of annotated data for remote sensing sensors like hyperspectral imagery.
method Self-taught spatial-spectral feature extraction, various classifiers, and post-processing models.
result Evaluated on Indian Pines and Pavia University datasets, demonstrating state-of-the-art performance.
We develop a personalized real time risk scoring algorithm that provides timely and granular assessments for the clinical acuity of ward patients based on their (temporal) lab tests and vital signs. Heterogeneity of the patients population is captured via a hierarchical latent class model. The proposed algorithm aims t…
Sparse coding is an unsupervised learning algorithm that learns a succinct high-level representation of the inputs given only unlabeled data; it represents each input as a sparse linear combination of a set of basis functions. Originally applied to modeling the human visual cortex, sparse coding has also been shown to …
PAMA learns covariate importance for better matching in observational studies.
problem Poor performance of conventional matching methods when covariates differ in relevance.
method PAMA is a semi-supervised framework that learns covariate importance from paired data and optimizes a weighted quadratic score.
result PAMA outperforms standard methods, particularly in high-dimensional settings and under model misspecification.
We propose a sparse-coding framework for activity recognition in ubiquitous and mobile computing that alleviates two fundamental problems of current supervised learning approaches. (i) It automatically derives a compact, sparse and meaningful feature representation of sensor data that does not rely on prior expert know…
CILF learns adaptive embeddings for class-incremental learning with novel class detection and model update.
problem Handling unknown classes and model update in streaming data with new classes.
method CILF uses decoupled prototype based loss for intra-class and inter-class structure improvement, and a learnable curriculum clustering operator for adaptive embedding.
result CILF effectively detects multiple novel classes and mitigates embedding confusion, while updating the model without catastrophic forgetting.
Meta-learning adapts models for unseen tasks across AI, robotics, and NLP.
problem Adapting models to unseen tasks efficiently and accurately.
method Black-box, metric-based, layered, and Bayesian approaches.
result Meta-learning enhances model generalization and adaptation to unseen tasks.
Meta-learning improves neural networks by adapting learning algorithms.
problem Conventional AI approaches solve tasks from scratch, but meta-learning aims to improve the learning algorithm.
method Meta-learning adapts a learning algorithm based on multiple learning episodes.
result Meta-learning can tackle deep learning challenges like data and computation bottlenecks.
metric-learn simplifies metric learning in Python.
problem Performing distance metric learning efficiently.
method Unified scikit-learn compatible interface for supervised and weakly-supervised metric learning.
result Unified interface for cross-validation and model selection.
Meta-learning speeds up learning new tasks.
problem Designing and improving machine learning pipelines.
method Observing and learning from different machine learning approaches.
result Learning new tasks much faster than traditional methods.
Survey explores how transfer learning improves deep reinforcement learning.
problem Challenges in reinforcement learning efficiency and effectiveness.
method Categorizes and analyzes transfer learning approaches.
result Transfer learning enhances reinforcement learning performance.
Machine learning models adapt to motor learning but face challenges.
problem Adapting machine learning to handle motor variability and differentiate new movements from known ones.
method Parameter adaptation, transfer and meta-learning, reinforcement learning.
result Challenges in applying machine learning models for motor learning support systems.
Dropout learning is analyzed as ensemble learning to prevent overfitting.
problem Overfitting in deep learning models.
method Dropout learning ignores some inputs and hidden units with a probability, p, and combines them with the learned network.
result Combining neglected hidden units with the learned network can be seen as ensemble learning.
Optimal learning paths designed for E-learning systems using reinforcement learning.
problem Designing optimal learning paths for E-learning systems.
method Developed a hierarchical skill model and a proficiency level model, applied reinforcement learning to find the optimal learning strategy.
result Demonstrated the effectiveness of the proposed framework via numerical experiments.
New theory improves deep learning performance without statistical assumptions.
problem Improving deep learning performance without statistical assumptions.
method Measure-theoretic theory for machine learning, derived regularization method.
result New regularization method outperforms previous methods in various datasets.
Dex improves reinforcement learning by solving complex environments incrementally.
problem Training reinforcement learning agents for complex, ever-changing environments.
method Incremental learning approach, using optimal weights from simpler environments.
result Incremental learning yields superior performance across multiple Dex environments.
HGAIL learns policies without expert demonstrations.
problem Lack of expert demonstrations in imitation learning.
method Combines hindsight and GAIL to learn policies.
result Comparable performance to current methods, with curriculum learning.
New method uses bi-level optimization to learn useful representations for imitation learning.
problem Learning useful representations for multiple tasks in imitation learning settings.
method Formulates representation learning as a bi-level optimization problem.
result Bi-level optimization framework provides sample complexity benefits for imitation learning.
Tabular Q-Learning with learned state abstractions solves continuous control tasks.
problem Challenging reinforcement learning problems in continuous control.
method Learned state abstraction to transform continuous state-space into discrete.
result Tabular Q-Learning with learned abstractions achieves efficient learning in unseen tasks.
Unsupervised meta-learning speeds up reinforcement learning tasks.
problem Efficiently solving new reinforcement learning tasks.
method Formulating unsupervised meta-reinforcement learning and using mutual information for task proposals.
result Unsupervised meta-reinforcement learning effectively acquires accelerated procedures without manual task design.
Pymc-learn simplifies probabilistic machine learning for non-specialists.
problem Making probabilistic machine learning accessible to non-experts.
method Inspired by scikit-learn, Pymc-learn provides a high-level language for probabilistic models.
result Pymc-learn brings probabilistic machine learning to non-specialists with ease, performance, and flexibility.
Study Whittle index learning algorithms for restless bandits with constant stepsizes.
problem Optimizing decisions in restless multi-armed bandits with constant stepsizes.
method Developed Q-learning algorithms with constant stepsizes for index learning in restless bandits, extending to DQN and function approximations.
result The algorithms learn the Whittle index effectively.
Paper discusses flaws in traditional RL for lifelong learning.
problem Traditional RL fails to model lifelong learning systems.
method Simplified prototype of lifelong RL system.
result Insights into lifelong RL, showing traditional RL's limitations.
AI learns to learn sequentially without forgetting.
problem Preventing catastrophic forgetting in machine learning models.
method Meta-learning a neuromodulatory activation-gating function to control selective activation in deep neural networks.
result State-of-the-art continual learning performance with 600 classes (9,000 updates).
New unsupervised learning technique learns independent kernels for better machine learning tasks.
problem Improving unsupervised representation learning for machine learning tasks.
method Stacking convolutional transforms using alternating proximal minimization scheme.
result DCTL outperforms shallow version CTL on benchmark datasets.
Poisson learning doesn't solve graph semi-supervised learning issues.
problem Global information loss in graph-based semi-supervised learning.
method Poisson learning is Laplace regularization with thresholding.
result Poisson learning cannot overcome the global information loss problem.
Meta-learning helps models learn quickly from few samples.
problem Deep learning requires many samples, which are hard to get.
method Meta-learning optimizes models to adapt quickly to new tasks.
result Meta-learning can improve model efficiency and adaptability.
New self-imitation learning method improves performance in continuous control tasks.
problem Improving off-policy learning in continuous control tasks.
method Proposes a n-step lower bound to generalize lower-bound Q-learning and introduces a new family of self-imitation learning algorithms.
result n-step lower bound Q-learning achieves a better trade-off between bias and contraction rate, leading to improved performance.
Deep reinforcement learning finds optimal learning policies for adaptive systems.
problem Finding individualized learning plans for learners with unknown latent traits.
method Formulated as a Markov decision process, applied deep Q-learning with a transition model estimator.
result The algorithm efficiently discovers optimal learning policies with small data sets.
Unified framework explains all types of learning, including brain.
problem Lack of clear explanation for deep learning success.
method Constructing a learning principle that equates all learning to probability estimation.
result Unified understanding of learning across different fields.
A neural network learns to update another neural network's parameters.
problem Learning to update parameters of neural networks efficiently.
method Used a LSTM-based network to learn and apply updates to another neural network's parameters.
result The learned algorithm can update parameters of both layers and generalizes well.
This paper reviews data representation learning from traditional methods to deep learning.
problem Learning the intrinsic structure of data.
method Investigates traditional and deep learning methods.
result Deep learning models have achieved top results in various tasks.
Combines deep learning with active learning for image data.
problem Challenges of active learning with deep learning models.
method Bayesian convolutional neural networks integrated into active learning framework.
result Significant improvement in active learning approaches for image data.
Survey of deep learning in sentiment analysis.
problem Improving sentiment analysis accuracy.
method Overview and survey of deep learning applications.
result Deep learning achieves state-of-the-art sentiment analysis results.
Cyclical learning rates improve DRL performance without manual tuning.
problem Manual hyperparameter tuning in DRL is time-consuming and error-prone.
method Proposes cyclical learning rates for DRL problems.
result Cyclical learning achieves similar or better results than fixed learning rates.
Unsupervised meta-learning improves learning from small labeled data.
problem Acquiring representations from unlabeled data for effective downstream learning.
method Develops an unsupervised meta-learning method that optimizes for task learning ability from unlabeled data.
result Simple task construction mechanisms, like clustering embeddings, lead to good performance on various downstream tasks.
Paper proposes a neural network for learning crossmodal stimuli.
problem Improving crossmodal processing in dynamic environments.
method Deep neural architecture trained by expectation learning.
result Self-adaptable deep learning model for crossmodal stimuli.
Adaptive meta-learning improves few-shot learning and federated learning performance.
problem Improving few-shot learning and federated learning performance.
method Adaptive gradient-based meta-learning methods integrating online convex optimization and sequential prediction algorithms.
result Improved meta-test-time performance on standard problems in few-shot learning and federated learning.
Study batch reinforcement learning methods for personalized medical treatments.
problem Batch reinforcement learning for personalized medical treatments.
method Direct policy learning and model-based learning approaches.
result Model-based learning is impossible with finite model classes but feasible with relaxed conditions.