New metrics compare rational spectra using optimal transport.
problem Comparing rational spectra efficiently and accurately.
method Optimal transport and linear-systems theory.
result Established connection to Wasserstein distance.
Paper develops metrics for random dynamical systems using vector-valued RKHSs.
problem Creating metrics for random nonlinear dynamical systems.
method Develops metrics on random dynamical systems using Perron-Frobenius operators in vector-valued reproducing kernel Hilbert spaces (vvRKHSs). Uses operator-valued kernels and time-wise independence criteria.
result Extends existing metrics for deterministic systems and introduces kernel maximal mean discrepancy for random processes.
We address the problem of disambiguating large scale catalogs through the definition of an unknown artist clustering task. We explore the use of metric learning techniques to learn artist embeddings directly from audio, and using a dedicated homonym artists dataset, we compare our method with a recent approach that lea…
As part of the 2016 public evaluation challenge on Detection and Classification of Acoustic Scenes and Events (DCASE 2016), the second task focused on evaluating sound event detection systems using synthetic mixtures of office sounds. This task, which follows the `Event Detection - Office Synthetic' task of DCASE 2013,…
New algorithm reduces costs in wind energy systems by minimizing decision changes.
problem Costs associated with decision changes in wind energy systems.
method Episodic CBO with movement costs using Gaussian Process and mirror descent.
result Our algorithm consistently outperforms standard CBO in altitude optimization.
Planetary exploration missions with Mars rovers are complicated, which generally require elaborated task planning by human experts, from the path to take to the images to capture. NASA has been using this process to acquire over 22 million images from the planet Mars. In order to improve the degree of automation and th…
A new metric assesses causal graphs using node permutations to detect inconsistencies.
problem Quantifying the goodness of causal graphs and distinguishing them from random graphs.
method Constructing a baseline through node permutations and comparing inconsistencies.
result The proposed metric can distinguish between true and wrong causal graphs.
Similarity metrics are a core component of many information retrieval and machine learning systems. In this work we propose a method capable of learning a similarity metric from data equipped with a binary relation. By considering only the similarity constraints, and initially ignoring the features, we are able to lear…
New metric predicts neural network reliability under novel conditions.
problem Verifying neural networks' safety in novel scenarios.
method ML Dependability metric, Task Undependability, Harmful Undependability.
result Accurately predicts reliability under novel conditions.
This paper reviews causal inference methods for time series data.
problem Estimating treatment effects and identifying causal relations from time series data.
method Comprehensive review of approaches for treatment effect estimation and causal discovery.
result Provides a list of evaluation metrics and datasets for time series causal inference.
Paper optimizes recommendation systems for long-term business metrics.
problem Short-term reward optimization ignores long-term business metrics.
method Introduced a framework for modeling long-term rewards in RecoGym.
result Proposed a simple extension leading to state-of-the-art results.
Automated method selects best model from many for production systems.
problem Selecting the best model for production systems from a large pool.
method Automated online experimentation mechanism using Bayesian surrogate models.
result Efficiently identifies the best model with small online experiments.
User Simulators are one of the major tools that enable offline training of task-oriented dialogue systems. For this task the Agenda-Based User Simulator (ABUS) is often used. The ABUS is based on hand-crafted rules and its output is in semantic form. Issues arise from both properties such as limited diversity and the i…
IITK wins FinSim 2020 task on financial hypernym detection.
problem Classifying financial terms into hypernym concepts in an external ontology.
method Used context-dependent and context-independent word embeddings (Word2vec and BERT) for classification.
result Ranked 1st based on mean rank and accuracy metrics.
Novel method estimates complex nonlinear systems with stochastic differential equations.
problem Handling complex nonlinear dynamical systems with strong learning guarantees.
method Estimates drift and diffusion coefficients of continuous, multidimensional, nonlinear controlled stochastic differential equations.
result Strong theoretical guarantees including finite-sample bounds for various metrics.
Deep learning models for inverse problems are evaluated over time.
problem Solving inverse problems for natural systems from measurements.
method Comparing deep learning approaches on benchmark tasks and proposing neural-adjoint method.
result Neural-adjoint method achieves best performance in many scenarios.
Pseudo-Likelihood Inference improves ABC for high-dimensional Bayesian inference.
problem Intractable likelihood in Bayesian system identification.
method PLI combines neural approximation with integral probability metrics and adaptive bandwidth.
result PLI outperforms SNPE on challenging tasks, especially with more data.
Adam optimizer leads to more forgetting in neural networks.
problem Understanding and quantifying catastrophic forgetting in neural networks.
method Comparative analysis of various optimization algorithms and metrics in different learning scenarios.
result Adam optimizer causes more forgetting compared to classical algorithms like SGD.
One-hot encoding is a labelling system that embeds classes as standard basis vectors in a label space. Despite seeing near-universal use in supervised categorical classification tasks, the scheme is problematic in its geometric implication that, as all classes are equally distant, all classes are equally different. Thi…
We introduce and describe the results of a novel shared task on bandit learning for machine translation. The task was organized jointly by Amazon and Heidelberg University for the first time at the Second Conference on Machine Translation (WMT 2017). The goal of the task is to encourage research on learning machine tra…
New metrics needed for better understanding emergent communication in multi-agent systems.
problem Current metrics for emergent communication are insufficient for complex environments.
method Training deep reinforcement learning agents in simple games to analyze communication effectiveness.
result Messages in emergent communication can be misleading and do not always impact the environment.
Survey of graph adversarial learning tasks and their attacks and defenses.
problem Uncertainty and unreliability of deep learning models on graphs against adversarial examples.
method Unified problem definition and comprehensive review of existing works.
result Unified definitions and taxonomies for graph adversarial learning tasks.
HyperFair integrates fairness in recommender systems using probabilistic soft logic.
problem Ensuring fairness in recommender systems across diverse domains.
method Soft fairness constraints integrated as regularization in a joint inference objective function.
result HyperFair improves fairness of predictions from black-box models and hybrid systems.
LionForests interprets random forests for better understanding of predictions.
problem Interpreting black-box tree ensemble models like random forests.
method Combining unsupervised learning and a similarity metric to explain tree ensembles.
result LionForests provides transparent rules for interpreting random forest predictions.
Paper constructs various algebroids using n-systems and metric n-systems.
problem Creating algebroids from n-systems and metric n-systems.
method Using n-systems and metric n-systems to construct algebroids.
result Explicit computations for all resulting structure maps.
Optimizes exploration for nonlinear systems to learn controllers efficiently.
problem Learning optimal controllers for unknown nonlinear systems.
method Formally quantifies which parameters are most critical, and develops an algorithm to efficiently explore these parameters.
result Proves a near-instance-optimal rate for learning controllers.
Study finds transparency and model performance metrics increase trust in AutoML systems.
problem Understanding what information influences trust in AutoML systems.
method Three studies: qualitative interviews, controlled experiment, and card-sorting task.
result Transparency and model performance metrics are most important for establishing trust in AutoML systems.
We improve Riemannian metrics for constrained systems control.
problem Controlling mechanical systems with configuration constraints.
method Constructing complete Riemannian metrics by modifying incomplete ones.
result A controller can be found to satisfy a design criterion.
Meta metric learning improves few-shot learning for diverse domains.
problem Few-shot learning struggles with diverse domains and varying label numbers.
method Task-specific learners with metric learning and a meta learner to discover task-specific metrics.
result Meta metric learning achieves superior performance in diverse multi-domain tasks and flexible label numbers.
Improves deep learning robustness by considering task and model.
problem Adversarial attacks on deep learning systems.
method Binary and interval label encoding strategy to redefine classification tasks and design corresponding loss functions.
result Our method enhances robustness without sacrificing accuracy.
A CBR system investigates the TS-SS metric for document similarity.
problem Finding the most similar documents for user queries.
method Case-Based Reasoning (CBR) with TS-SS, Euclidean, and Cosine similarity measures.
result TS-SS metric shows surprising inappropriateness for high-dimensional features.
New algorithm improves efficiency of quantum system modeling.
problem Intractable complexities in quantum Hamiltonian learning and Gibbs sampling.
method Generalized quantum natural gradient descent and Quantum-Probabilistic Mirror Descent.
result Data sample efficiency proven using information geometry and quantum metrology.
Unified online algorithm for both competitive ratio and regret minimization.
problem Achieving both competitive ratio and regret minimization in online algorithms.
method Extending a regret minimization algorithm to handle movement cost and combining it with a base algorithm.
result Unified online algorithm that guarantees both competitive ratio and small regret over any time interval.
Few-shot learning has become essential for producing models that generalize from few examples. In this work, we identify that metric scaling and metric task conditioning are important to improve the performance of few-shot algorithms. Our analysis reveals that simple metric scaling completely changes the nature of few-…
We study the anti-self-dual equation for non-diagonal SU(2)-invariant metrics and give an equivalent ninth-order system. This system reduce to a sixth-order system if the metric is in the conformal class of scalar-flat-Kaehler metric.
We investigate deep neural network performance in the textindependent speaker recognition task. We demonstrate that using angular softmax activation at the last classification layer of a classification neural network instead of a simple softmax activation allows to train a more generalized discriminative speaker embedd…
ExpO regularizes models to improve their explainability.
problem Improving the interpretability of black-box models.
method ExpO is a hybridization of regularization and post-hoc explanation systems.
result Post-hoc explanations for ExpO-regularized models have better explanation quality.
Paper tackles counterfactual sentence detection and evaluation.
problem Detect and evaluate counterfactual sentences in natural language.
method Used a BERT base model for classification and a hybrid BERT Multi-Layer Perceptron for sequence identification. Introduced cascaded linear inputs to improve performance.
result Achieved an F1 score of 85.00% in Task 1 and 83.90% in Task 2.
Self-supervised metric learning boosts downstream tasks in multi-view data.
problem Improving distance-based downstream tasks without labeled data.
method Developed a statistical framework to study self-supervised metric learning in multi-view data.
result Self-supervised metric learning improves target distances for various downstream tasks.
This paper analyzes the impact of asynchronous updates on OVA models' accuracy.
problem The impact of asynchronous updates on the accuracy of OVA models.
method Defined a metric to quantify dataset differences, analyzed three factors (number of classes, data points, and training dataset divergence), and evaluated Spoken Language Understanding system.
result The proposed metric correlates strongly with model performances.
The paper explores how magnetic systems' spectra can identify metrics and 1-forms.
problem Can the marked magnetic action spectrum of magnetic systems with Anosov flow determine the metric and 1-form?
method The paper addresses this question in two settings: locally for systems with close metrics and 1-forms, and for metrics in the same conformal class.
result The paper answers the question affirmatively in both settings.
MPP trains a transformer to predict multiple physical systems, improving accuracy across various tasks.
problem Training models for specific physical systems is inefficient and requires fine-tuning.
method MPP trains a shared transformer on multiple heterogeneous physical systems, projecting fields into a shared embedding space.
result A single MPP-pretrained transformer outperforms task-specific models on all pretraining sub-tasks and downstream tasks.
Many radiological studies can reveal the presence of several co-existing abnormalities, each one represented by a distinct visual pattern. In this article we address the problem of learning a distance metric for plain radiographs that captures a notion of "radiological similarity": two chest radiographs are considered …
The paper describes flat Hessian metrics on surfaces and their potentials.
problem Understanding Hessian metrics on surfaces.
method Theoretical description and explicit construction using integrable systems.
result Explicit construction of potentials for flat Hessian metrics on surfaces.
This paper describes the Amobee sentiment analysis system, adapted to compete in SemEval 2017 task 4. The system consists of two parts: a supervised training of RNN models based on a Twitter sentiment treebank, and the use of feedforward NN, Naive Bayes and logistic regression classifiers to produce predictions for the…
Hybrid model improves few-shot learning across diverse tasks.
problem Few-shot learning with limited data.
method Combines optimization and metric-based approaches.
result Superior performance across various settings.
The paper quantifies uncertainty in aggregated machine learning metrics.
problem Uncertainty in summarizing model performance across multiple tasks.
method Statistical methodologies including bootstrapping and Bayesian modeling.
result Insights into model performance dominance for specific tasks.
Paper proves trajectories of Chaplygin systems are reparametrized geodesics.
problem Understanding trajectories of Chaplygin systems.
method Constructive proof using modified Riemannian metrics.
result Reparametrized geodesics of Chaplygin systems.