We present a representation for describing transition models in complex uncertain domains using relational rules. For any action, a rule selects a set of relevant objects and computes a distribution over properties of just those objects in the resulting state given their properties in the previous state. An iterative g…
Event2vec learns object embeddings in HINs by considering both relation properties and quantities.
problem Ignoring relation properties in existing NRL methods for HINs.
method Event2vec uses events to represent relations and defines event-driven proximities to measure object relevance.
result Event2vec preserves event-driven proximities in the embedding space and outperforms state-of-the-art methods.
New meta-RL method avoids exploration-exploitation trade-off.
problem Learning to explore and exploit simultaneously in meta-RL.
method Developed new objectives for exploration and exploitation.
result DREAM outperforms existing methods on complex tasks.
In many applications, it is desirable to extract only the relevant aspects of data. A principled way to do this is the information bottleneck (IB) method, where one seeks a code that maximizes information about a 'relevance' variable, Y, while constraining the information encoded about the original data, X. Unfortunate…
PRI-VAE learns disentangled representations by optimizing principle-of-relevant-information.
problem Learning disentangled representations under VAE framework remains unknown.
method Proposes PRI-VAE, a novel learning objective to optimize disentanglement.
result Demonstrates effectiveness of PRI-VAE on four benchmark datasets.
Paper proposes a method to make learned models focus on task-relevant information.
problem Mismatch between model objective and downstream task objective.
method Direct prediction towards task-relevant information, self-supervised.
result Model more effectively models relevant parts of the scene conditioned on the goal.
Adequate evaluation of an information retrieval system to estimate future performance is a crucial task. Area under the ROC curve (AUC) is widely used to evaluate the generalization of a retrieval system. However, the objective function optimized in many retrieval systems is the error rate and not the AUC value. This p…
In Hamiltonian mechanics, a (continuous) symmetry leads to conserved quantity, which is a function on (extended) phase space. In Nambu mechanics, a straightforward consequence of symmetry is just a relative integral invariant, a differential form which only upon integration over a cycle provides a conserved real number…
A new method exposes motion-related relevance in video frames.
problem Deconstructing relevance in spatio-temporal models for video processing.
method Proposes a discriminative method to separate spatial and temporal relevance.
result Demonstrates effectiveness on UCF-101 action recognition dataset.
New neural network learns relevant transformations in data, improving object recognition.
problem Current equivariant architectures consider all possible transformations, ignoring relevant ones.
method Co-attentive equivariant neural networks that focus on co-occurring transformations.
result Outperforms conventional equivariant networks on rotated MNIST and CIFAR-10.
The paper proposes a framework to reason about object dynamics for faster reinforcement learning.
problem Current reinforcement learning approaches lack prior knowledge about the environment, limiting efficiency.
method Integrates object dynamics and behavior into reinforcement learning to improve efficiency.
result Demonstrates the need for reasoning about object behavior and dynamics, leading to faster learning.
Feature Selection (FS) plays an important role in learning and classification tasks. The object of FS is to select the relevant and non-redundant features. Considering the huge amount number of features in real-world applications, FS methods using batch learning technique can't resolve big data problem especially when …
New Variational InfoMax objective improves neural network performance.
problem Optimizing neural networks using Bayesian Inference and Information Bottleneck.
method Derive Variational InfoMax (VIM) objective that maximizes InfoMax directly.
result VIM improves model performance in accuracy, robustness, and representation quality.
We consider the problem of learning to play first-person shooter (FPS) video games using raw screen images as observations and keyboard inputs as actions. The high-dimensionality of the observations in this type of applications leads to prohibitive needs of training data for model-free methods, such as the deep Q-netwo…
This preprint was split in two and became the first two parts of a four-part series (arXiv:1405.1956, arXiv:1405:1955, and two in preparation). The remaining relevance of this preprint is due to the series of videotaped lectures (wClips) that are linked within.
The paper tackles uncertainty in multi-objective decision-making.
problem Learning Pareto-efficient decisions with statistical confidence in uncertain outcomes.
method Adapting Pareto-efficient decisions to uncertainty, using conformal prediction.
result Statistical guarantees for efficient decisions in uncertain contexts.
We propose a framework for the completely unsupervised learning of latent object properties from their interactions: the perception-prediction network (PPN). Consisting of a perception module that extracts representations of latent object properties and a prediction module that uses those extracted properties to simula…
The outlying property detection problem is the problem of discovering the properties distinguishing a given object, known in advance to be an outlier in a database, from the other database objects. In this paper, we analyze the problem within a context where numerical attributes are taken into account, which represents…
This study aims to identify the leading of inflation indicators of monetary policy in DRC. The results reveal that the most relevant inflation indicators usually come from the monetary origin than the real sector. Variance decomposition analyzes place in the foreground the rate of exchange, the money supply and the pub…
Many classical algorithms are found until several years later to outlive the confines in which they were conceived, and continue to be relevant in unforeseen settings. In this paper, we show that SVRG is one such method: being originally designed for strongly convex objectives, it is also very robust in non-strongly co…
We exhibit some families of subgroups of the pure braid group that are highly generating, in the sense of Abels and Holz. In one class of examples, the relevant geometric object is a complex termed the restricted arc complex of a surface. Another arises by considering "dangling braiges," introduced by Bux, Fluch, Schwa…
We give completely combinatorial proofs of the main results of [3] using polygons. Namely, we prove that the mapping class group of a surface with boundary acts faithfully on a finitely-generated linear category. Along the way we prove some foundational results regarding the relevant objects from bordered Heegaard Floe…
YAHPO Gym introduces a new benchmark for evaluating hyperparameter optimization methods.
problem Evaluating and comparing hyperparameter optimization methods on well-curated benchmark suites.
method Surrogate-based benchmark collection of 14 scenarios, each with multi-fidelity and multi-objective hyperparameter optimization problems.
result Surrogate-based benchmarks produce more faithful results than tabular benchmarks.
Jointly learns feature and sample relevancies for robust sparse recovery.
problem Sparse recovery sensitivity to data contaminants like outliers or misspecified noise.
method Jointly learns feature and sample relevancies via marginal likelihood optimization.
result Consistent sparse and robust prediction models across diverse tasks.
RFFNet scales kernel methods to large datasets by learning kernel relevance.
problem Scaling kernel methods to large datasets while maintaining interpretability.
method Designs random Fourier features for ARD kernels and uses first-order stochastic optimization for learning kernel relevances.
result RFFNet achieves low prediction error and identifies relevant features, leading to more interpretable solutions.
Injective flows for star-like manifolds improve variational inference efficiency.
problem Efficiently modeling densities on star-like manifolds with exact Jacobian computation.
method Proposed injective flows for star-like manifolds with exact Jacobian computation.
result Exact Jacobian computation for star-like manifolds reduces computational cost to NFs.
This paper introduces modal epistemic tools for risk management.
problem Identifying and certifying risk claims when institutions lack the necessary epistemic stance.
method Develops crisp and fuzzy modal semantics for assurance and working commitment, distinguishing between object-level risk claims and meta-level epistemic diagnostics.
result Risk governance should model evidential incompleteness and failures of escalation, not just hazards and losses.
mRMR method selects relevant features for marketing models without redundancy.
problem Selecting relevant features from large feature spaces in machine learning.
method Extends mRMR framework with non-linear redundancy and model-based relevance measures.
result Implemented mRMR method in production for Uber's marketing machine learning platform.
In the present paper, we consider local moves on classical and welded diagrams: (self-)crossing change, (self-)virtualization, virtual conjugation, Delta, fused, band-pass and welded band-pass moves. Interrelationship between these moves is discussed and, for each of these move, we provide an algebraic classification. …
Learning robot objective functions from human input has become increasingly important, but state-of-the-art techniques assume that the human's desired objective lies within the robot's hypothesis space. When this is not true, even methods that keep track of uncertainty over the objective fail because they reason about …
This paper introduces GEMINI, a new mutual information metric for unsupervised neural network training.
problem The mutual information (MI) as a clustering objective does not lead to satisfactory clusters.
method The authors generalised MI by changing its core distance, introducing GEMINIs that do not require regularizations and can automatically select the number of clusters.
result GEMINIs can automatically select the number of clusters without requiring a priori knowledge of the number of clusters.
Elliptical Attention improves transformer performance by focusing on contextually relevant features.
problem Transformer models suffer from representation collapse and are vulnerable to contaminated samples.
method Uses Mahalanobis distance to define hyper-ellipsoidal neighborhoods for attention weights.
result Elliptical Attention reduces representation collapse and enhances model robustness.
A new method improves target selection for manipulating complex systems like the brain.
problem Improper incorporation of low-variance outcomes into latent space of predictive models.
method Developed a novel objective based on supervised variational autoencoders (SVAEs) for PPCA (Probabilistic Principal Component Analysis).
result gPCR (Generative Principal Component Regression) dramatically improves target selection in manipulation compared to standard PCR and SVAEs.
Modern retrieval systems are often driven by an underlying machine learning model. The goal of such systems is to identify and possibly rank the few most relevant items for a given query or context. Thus, such systems are typically evaluated using a ranking-based performance metric such as the area under the precision-…
DynAE improves deep clustering by dynamically shifting from reconstruction to centroid construction.
problem Lack of clear cost functions in unsupervised learning for capturing variations and similarities.
method Dynamic Autoencoder (DynAE) that gradually eliminates reconstruction in favor of centroid construction.
result DynAE achieves state-of-the-art results in deep clustering compared to other methods.
The Riemannian geometry is one of the main theoretical pieces in Modern Mathematics and Physics. The study of Riemann Geometry in the relevant literature is performed by using a well defined analytical path. Usually it starts from the concept of metric as the primary concept and by using the connections as an intermedi…
Tree ensemble method tackles multi-objective constrained optimization in energy systems.
problem Complex, multi-objective, and constrained optimization problems in energy systems.
method Data-driven tree ensemble approach for black-box problems with heterogeneous variable spaces.
result Competitive performance and sampling efficiency compared to state-of-the-art tools.
A novel tracking method for dense honeybee colonies using pixel personality.
problem Tracking large numbers of densely-arranged, interacting objects in a 2D environment.
method Segmentation-based object detection followed by adaptive object recognition through visual appearance.
result Reconstructed ~46% of trajectories in 5 minutes and 71% of tracks for at least 2 minutes.
This paper introduces GEMINI, a new metric for unsupervised neural network training that avoids the need for regularizations.
problem The mutual information (MI) as a clustering objective does not lead to satisfactory clusters.
method The authors generalised the mutual information by changing its core distance, introducing the Generalised Mutual Information (GEMINI).
result Some GEMINIs do not require regularizations when training and can automatically select the number of clusters.
Efficiently processes high res images by selecting relevant patches.
problem High memory and compute requirements for processing large images.
method Differentiable Top-K operator to select relevant patches.
result End-to-end trainable model using backpropagation.
Generative model for discrete objects using Markov chains with valid transitions.
problem Generating valid discrete objects with unique construction histories.
method Markov chain with restricted local operations that preserve validity.
result Generative model produces valid discrete objects and compares favorably to alternatives.
GoBOED optimizes experiments for specific decision-making objectives, improving downstream outcomes.
problem Reducing parameter uncertainty does not always improve decision-making in critical settings.
method Combines variational posterior surrogate and differentiable convex decision layer for gradient-based design optimization.
result GoBOED identifies designs that better align with specific decision objectives and reveals wider optimal design windows.
This paper analyzes self-supervised learning from a multi-view perspective.
problem Understanding and optimizing self-supervised learning from multi-view data.
method Information-theoretical framework to understand and design self-supervised learning objectives.
result Self-supervised representations can extract task-relevant information and discard task-irrelevant information.
Paper proposes PSIPS for identifying Pareto set with correlated objectives.
problem Identifying the best answer among items with multiple conflicting metrics.
method Posterior sampling in stopping and sampling rules for structure and correlation.
result PSIPS is asymptotically optimal and demonstrates good empirical performance.
A new method extracts linguistic objects from text using CNNs.
problem Lack of interpretability in deep learning models for text.
method Weighted extension of Text Deconvolution Saliency (wTDS) measure.
result Extracts interpretable linguistic objects from text.
The paper analyzes the benefit-cost ratio for feature selection in machine learning.
problem Tackling the challenge of distinguishing relevant features from noise in feature selection.
method Simulation study with different cost and data settings to analyze the benefit-cost ratio.
result The benefit-cost ratio can overemphasize cheap noise features in scenarios with large cost differences and small effect sizes.
Novel method transfers orometric measures to metric data sets, identifying key items.
problem Identifying key items in metric data sets like knowledge graphs.
method Transfers orometric measures to bounded metric spaces, using 'isolation' and 'prominence' functions.
result Identifies structurally relevant items in geographic data sets of Germany and France.
New algorithms minimize noisy, irregular functions without gradients.
problem Minimizing noisy, irregular, and algebraically intractable functions.
method Generalized gradient descent recursion with smooth approximations.
result Convergence results under weak assumptions on function regularity.