We consider the problem of how a teacher algorithm can enable an unknown Deep Reinforcement Learning (DRL) student to become good at a skill over a wide range of diverse environments. To do so, we study how a teacher algorithm can learn to generate a learning curriculum, whereby it sequentially samples parameters contr…
Framework improves agent's ability to learn from noisy images.
problem Agents tend to focus on distracting regions in unsupervised image-based goal exploration.
method Proposes a novel framework combining absolute Learning Progress with unsupervised image-based goal exploration.
result Agents successfully identify and ignore distracting regions, improving overall performance.
Model predicts cannabis use disorder risk for adolescents and young adults.
problem Predicting cannabis use disorder progression in adolescents and young adults.
method Bayesian machine learning model trained on longitudinal data.
result Model provides personalized risk assessment with AUC of 0.68-0.75 and E/O ratio of 0.95-1.
Nonlinearity is crucial to the performance of a deep (neural) network (DN). To date there has been little progress understanding the menagerie of available nonlinearities, but recently progress has been made on understanding the rôle played by piecewise affine and convex nonlinearities like the ReLU and absolute value …
Progress in probabilistic generative models has accelerated, developing richer models with neural architectures, implicit densities, and with scalable algorithms for their Bayesian inference. However, there has been limited progress in models that capture causal relationships, for example, how individual genetic factor…
Research connects probabilistic and variational approaches to Kahler-Einstein metrics.
problem Constructing Kahler-Einstein metrics on complex projective varieties.
method Combines probabilistic construction and variational methods.
result Non-Archimedean geometry of X emerges from probabilistic framework.
Hypothesis testing is an important cognitive process that supports human reasoning. In this paper, we introduce a computational hypothesis testing approach based on memory augmented neural networks. Our approach involves a hypothesis testing loop that reconsiders and progressively refines a previously formed hypothesis…
Paper introduces a new curriculum generation method for reinforcement learning.
problem Improving reinforcement learning performance and speed through curriculum learning.
method The paper proposes a novel curriculum generation paradigm based on progression and mapping functions.
result Empirical results show the new approach outperforms state-of-the-art algorithms.
Disease progression modeling (DPM) using longitudinal data is a challenging machine learning task. Existing DPM algorithms neglect temporal dependencies among measurements, make parametric assumptions about biomarker trajectories, do not model multiple biomarkers jointly, and need an alignment of subjects' trajectories…
This paper improves disentanglement in VAEs by progressively learning hierarchical representations.
problem Compromised disentanglement in VAEs due to high-level abstraction extraction.
method Progressive learning of independent hierarchical representations from high to low levels.
result Improved disentanglement demonstrated on two benchmark datasets using new metrics.
New algorithm outperforms existing ones by focusing on mastering rate.
problem Low sample efficiency in learning progress-based algorithms.
method Proposes a new algorithm based on mastering rate.
result Significantly outperforms learning progress-based algorithms.
Space2Vec learns multi-scale spatial representations from grid cell insights.
problem Encoding spatial features with varying scales from GIS data.
method Proposes Space2Vec, a multi-scale representation learning model using grid cell insights.
result Space2Vec outperforms baselines in predicting POI types and image classification with geo-locations.
Develops a privacy-preserving algorithm for sparse robust regression.
problem Privacy-preserving machine learning for sparse robust regression.
method Develops FRAPPE algorithm for non-smooth loss under differential privacy.
result Achieves better privacy and statistical accuracy trade-off.
This work designs an active world model learning system with progress-based curiosity.
problem Learning compact world models from visual exploration.
method Constructs a curious agent in a 3D environment, using γ-Progress as a curiosity signal. result The γ-Progress-driven controller outperforms state-of-the-art exploration strategies. Deep learning's success requires vast computing power, making future progress unsustainable.
problem Deep learning's success is heavily dependent on computing power, making future progress unsustainable.
method Cataloging and extrapolating the dependency on computing power for various deep learning applications.
result Continued progress in deep learning applications will require more computationally-efficient methods.
Study uses machine learning and survival analysis to predict CKD progression.
problem Early detection and management of CKD to reduce ESRD risk.
method Combines machine learning and classical statistical models to identify novel CKD progression predictors.
result Deep learning models outperform other methods in predicting CKD progression.
Study finds little progress in medical machine learning benchmarks over 3 years.
problem Lack of meaningful progress in medical machine learning benchmarks for structured healthcare data.
method Comprehensive review and meta-analysis of benchmarks in medical machine learning for structured data.
result Deep recurrent models perform only better than logistic regression on certain clinical prediction tasks.
We study grassmannians associated with a linear space with a nondegenerate hermitian form. The geometry of these grassmannians allows us to explain the relation between a (pseudo-)riemannian projective geometry and the conformal structure on its ideal boundary (absolute). Such relation encompasses, for instance, the us…
New 4-manifolds with exotic diffeomorphisms found.
problem Existence of exotic diffeomorphisms in 4-manifolds.
method Proves existence of infinitely many contractible 4-manifolds with exotic diffeomorphisms.
result Infinitely many contractible 4-manifolds with absolutely exotic diffeomorphisms.
The paper bounds the mean absolute error in DNN vector-to-vector regression.
problem Bounding the mean absolute error in deep neural network based vector-to-vector regression.
method Error decomposition techniques in statistical learning theory and non-convex optimization theory were used to derive upper bounds for approximation, estimation, and optimization errors.
result Theoretical upper bounds for mean absolute error in DNN vector-to-vector regression were derived and validated experimentally.
Alzheimer's disease (AD) is a degenerative brain disease impairing a person's ability to perform day to day activities. The clinical manifestations of Alzheimer's disease are characterized by heterogeneity in age, disease span, progression rate, impairment of memory and cognitive abilities. Due to these variabilities, …
We introduce a novel approach for predicting the progression of adolescent idiopathic scoliosis from 3D spine models reconstructed from biplanar X-ray images. Recent progress in machine learning have allowed to improve classification and prognosis rates, but lack a probabilistic framework to measure uncertainty in the …
Combines absolute and relative wealth in portfolio optimization with power utility functions.
problem Optimizing portfolios with both absolute and relative wealth considerations.
method Integrates power utility functions for absolute and relative wealth, considering multiple benchmarks.
result Obtains an explicit solution for portfolio optimization combining absolute and relative wealth.
Improved self-supervised learning on ImageNet achieves top-1 accuracy of 77.1%.
problem Self-supervised ResNets underperform supervised learning on ImageNet.
method ReLICv2 combines explicit invariance loss with contrastive objective over varied data views.
result ReLICv2 achieves 77.1% top-1 accuracy on ImageNet, improving over previous state-of-the-art by 1.5%.
A complete surface of constant mean curvature 1 (CMC-1) in hyperbolic 3-space with constant curvature -1 has two natural notions of "total curvature"-- one is the total absolute curvature which is the integral over the surface of the absolute value of the Gaussian curvature, and the other is the dual total absolute cur…
Curriculum learning speeds up agent learning in Minecraft, a complex visual domain.
problem Training agents to learn multiple tasks in a complex, visual domain.
method Learning-progress based curriculum and dynamic exploration bonuses.
result Curriculum learning improves agent performance in a complex reinforcement learning problem.
Absolutely partially hyperbolic surface endomorphisms have a coherent center foliation.
problem Understanding the dynamics of absolutely partially hyperbolic surface endomorphisms.
method Showed the existence of a center foliation and leaf conjugacy to the linearization.
result Absolutely partially hyperbolic surface endomorphisms have a dynamically coherent center foliation.
The paper introduces Absolute Shapley Value to handle negative contributions in machine learning model training.
problem Negative marginal contributions in machine learning model training.
method Investigates three philosophies: Original Shapley Value, Zero Shapley Value, and Absolute Shapley Value.
result Absolute Shapley Value significantly outperforms other definitions in evaluating data importance.
We introduce a conceptually simple and scalable framework for continual learning domains where tasks are learned sequentially. Our method is constant in the number of parameters and is designed to preserve performance on previously encountered tasks while accelerating learning progress on subsequent problems. This is a…
Deep neural nets on 1-D data are convex Lasso models with reflection features.
problem Training neural networks on 1-D data.
method Proving equivalence to convex Lasso problems with discrete, explicitly defined dictionary matrices.
result Reflection features in neural networks with certain activations.
Study absolute equivalence for Pfaffian systems, applying to control systems.
problem Absolute equivalence of Pfaffian systems with specific independence conditions.
method Structural results for Pfaffian systems of corank 3, applied to control systems.
result Dynamic feedback linearization of control systems with 2 inputs.
Neural networks learn distance-based representations, not just intensity.
problem Understanding how neural networks interpret and learn from internal activations.
method Manipulated ReLU and Absolute Value activations to observe sensitivity to distance and intensity perturbations.
result Neural networks are highly sensitive to small distance-based perturbations, challenging the intensity-based interpretation.
The paper studies curves in Finsler-like spaces and their properties.
problem Investigating properties of curves in asymmetric metric spaces induced by Finsler structures.
method Analyzes three types of absolutely continuous curves in Finsler-like spaces and establishes the Lisini structure theorem.
result Characterizes the nature of absolutely continuous curves in terms of dynamical transference plans.
Researchers compute Bayes error for classification models using normalizing flows.
problem Evaluating the inherent difficulty of classification problems.
method Invertible transformations and Gaussian base distributions to compute Bayes error.
result State-of-the-art models can achieve near-optimal accuracy but not always.
The aim of the present paper is to investigate conformal changes in absolute parallelism geometry. We find out some new conformal invariants in terms of the Weitzenböck connection and the Levi-Civita connection of an absolute parallelism space.
LALR adapts learning rate for faster convergence in regression and neural nets.
problem Finding optimal learning rates for faster convergence in regression and neural networks.
method Lipschitz continuity theory applied to Mean Absolute Error and Quantile loss functions.
result Adaptive learning rate policy enables up to 20x faster convergence.
New method predicts AD progression using MEG brain networks.
problem Early diagnosis and prediction of Alzheimer's disease progression.
method MG2G, a deep learning method that maps brain networks into a latent space.
result MG2G detects subtle brain connectivity patterns and predicts AD progression.
This paper extends results of Mortimer and Williams (1991) about changes of probability measure up to a random time under the assumptions that all martingales are continuous and that the random time avoids stopping times. We consider locally absolutely continuous measure changes up to a random time, changes of probabil…
Deep learning classifies keratoconus patients with high accuracy.
problem Accurately identifying keratoconus patients for early intervention.
method Unsupervised and semi-supervised machine learning models using corneal topography and clinical data.
result Unsupervised method with 29 variables shows better classification accuracy.
Bayesian model identifies health disparities in disease progression.
problem Health disparities bias disease progression models.
method Interpretable Bayesian model accounting for three disparities.
result Model identifies and corrects for health disparities.
A classical result in Riemannian geometry states that the absolutely continuous curves into a (finite-dimensional) Riemannian manifold form an infinite-dimensional manifold. In the present paper this construction and related results are generalised to absolutely continuous curves with values in a strong Riemannian mani…
Study absolute continuity of Wasserstein barycenters on manifolds with singular cost functions.
problem Absolute continuity of Wasserstein barycenters on manifolds with singular cost functions.
method Approximation framework to handle singularity, geometrically transparent.
result Precise analytic condition on cost profile for necessary assumptions.
Deep neural networks solve Raven's Progressive Matrices with high accuracy.
problem Testing relational reasoning in machine learning systems.
method Combining Wild Relation Networks with Multi-Layer Relation Networks and introducing Magnitude Encoding.
result Deep neural networks achieve 98.0 percent accuracy, significantly improving over previous methods.
We show how to construct absolutely exotic smooth structures on compact 4-manifolds with boundary, including contractible manifolds. In particular, we prove that any compact smooth 4-manifold W with boundary that admits a relatively exotic structure contains a pair of codimension-zero submanifolds homotopy equivalent t…
We prove that any isometry between the unit spheres of C2-smooth (more generally, absolutely smooth) smooth Banach spaces extends to a linear isometry of the Banach spaces. This answers the famous Tingley's problem in the class of absolutely smooth 2-dimensional Banach spaces.
Gradient span algorithms show consistent progress in high dimensions.
problem Understanding consistent training progress in large machine learning models.
method Proving deterministic behavior of gradient span algorithms on Gaussian random functions.
result Gradient span algorithms have asymptotically deterministic behavior in high dimensions.
Proposes faster neural network learning by using subsets of training data.
problem Manual design and validation of network topologies is time-consuming.
method Exploits subsets of training data at each incremental training step and performs online hyperparameter selection.
result Significantly reduces overall training time while maintaining performance.
Paper proposes a new PLL framework with a progressive identification algorithm.
problem Weakly supervised learning with partial labels.
method Flexible model and optimization algorithm for PLL, progressive identification algorithm.
result Established an estimation error bound and set new state of the art.