The Mismatch Principle improves Lasso robustness to model uncertainties.
problem Estimation robustness under model misspecifications.
method Generalized Lasso with the Mismatch Principle.
result The Mismatch Principle provides robust error bounds for Lasso.
New algorithm reduces performance loss in IRL with mismatched transition dynamics.
problem Performance degradation in inverse reinforcement learning due to mismatched transition dynamics.
method Proposed a robust Maximum Causal Entropy (MCE) IRL algorithm leveraging robust reinforcement learning insights.
result Empirically demonstrated stable performance improvement under transition dynamics mismatches.
New method uses surrogate gradients to train efficient spiking networks on neuromorphic hardware.
problem Training high-performing spiking networks on analog neuromorphic hardware is challenging due to device mismatch and lack of efficient algorithms.
method Introduces a general in-the-loop learning framework based on surrogate gradients.
result Learning self-corrects for device mismatch, resulting in competitive spiking network performance.
CycleFQI tackles offline reinforcement learning for cyclic MDPs, mitigating state distribution mismatch.
problem Offline reinforcement learning for cyclic MDPs with heterogeneous dynamics and discount factors.
method CycleFQI decomposes the cyclic process into stage-wise sub-problems, using vector of stage-specific Q-functions.
result CycleFQI mitigates the curse of dimensionality and provides finite-sample suboptimality error bounds.
Ensemble decoders to capture latent space topology in deep generative models.
problem Topological mismatch between latent space geometry and data manifolds.
method Using ensembles of decoders to compute geodesics on the expected manifold.
result Ensemble approach provides a simple and reliable way to capture model uncertainty in latent space.
The methodology of community detection can be divided into two principles: imposing a network model on a given graph, or optimizing a designed objective function. The former provides guarantees on theoretical detectability but falls short when the graph is inconsistent with the underlying model. The latter is model-fre…
New algorithms solve inverse problems using deep learning, converging faster than traditional methods.
problem Solving inverse problems with deep learning models.
method Simple non-convex algorithm for linear and nonlinear inverse problems, with theoretical and empirical support.
result The proposed algorithms converge faster than conventional techniques for certain inverse problems.
One-step Bellman alignment improves online RL by reducing task mismatch.
problem Online RL struggles with task similarity defined by rewards or transitions.
method One-step Bellman alignment and re-weighted targeting (RWT) to correct task mismatch.
result Regret bounds show task shift complexity, not target MDP, affects performance.
PLRM synthesizes labels from mismatched sources for better training sets.
problem Creating labeled training sets is a major challenge in machine learning.
method PLRM uses probabilistic modeling to synthesize labels from indirect supervision sources with different output spaces.
result PLRM outperforms baselines by 2%-9% on various tasks.
This paper considers the classification of linear subspaces with mismatched classifiers. In particular, we assume a model where one observes signals in the presence of isotropic Gaussian noise and the distribution of the signals conditioned on a given class is Gaussian with a zero mean and a low-rank covariance matrix.…
The paper addresses score-mismatched diffusion models and zero-shot conditional samplers.
problem Theoretical guarantees for score-mismatched diffusion models in zero-shot conditional sampling.
method Theoretical analysis of score-mismatched diffusion models and zero-shot conditional samplers.
result Theoretical performance guarantees with explicit dimensional dependencies for score-mismatched diffusion samplers.
New model tackles real-world distribution mismatches in machine learning.
problem Real-world applications often have training and test distributions that differ.
method Developed a learning model based on information theory using importance sampling.
result The model performs better under large distribution deviations.
Paper identifies objective mismatch in MBRL, affecting control task performance.
problem Objective mismatch in MBRL framework affects control task performance.
method Proposes re-weighting dynamics model training to mitigate mismatch.
result Likelihood of one-step ahead predictions is not always correlated with control performance.
Paper proposes active learning for sound event detection with reduced annotation effort.
problem Reducing annotation effort for sound event detection.
method Change point detection for candidate selection, mismatch-first farthest-traversal for selection, training with context recordings.
result The proposed system achieves similar performance to full annotation with only 2% of data, reducing annotation effort.
BinaryDuo improves BNNs by coupling binary activations, outperforming state-of-the-art models.
problem Gradient mismatch in BNNs due to binarizing activations.
method Using gradient of smoothed loss function to estimate gradient mismatch, proposing BinaryDuo scheme with coupled ternary activations.
result BinaryDuo outperforms state-of-the-art BNNs on various benchmarks.
New insights into how to inspect and learn from multi-stage processes and AI reasoning.
problem Understanding how to attribute outcomes to early stages in multi-stage operations and AI reasoning.
method Information-theoretic analysis and mathematical proofs of four key results.
result Uniform checkpoint spacing is minimax-optimal for inspection design under homogeneous signal attenuation.
Thompson Sampling shows polynomial regret for combinatorial semi-bandits with subgaussian rewards.
problem Finding optimal solutions in combinatorial semi-bandits with suboptimal sampling.
method Proposes Thompson Sampling with polynomial regret for linear combinatorial semi-bandits.
result Demonstrates 'mismatched sampling paradox' where knowing distributions can lead to worse performance.
New method improves hyperparameter tuning efficiency across similar tasks.
problem Mismatch between evaluations in current and previous tasks.
method Nested drop-out and auto-relevance determination for learning basis functions of increasing complexity.
result Improves sample efficiency in hyperparameter tuning across different data regimes.
New method addresses error bounds for PnP-ULA under mismatched models.
problem Error bounds for PnP-ULA under mismatched measurement and prior models.
method Posterior-L2 pseudometric to quantify error bounds.
result Explicit error bound for PnP-ULA under mismatched posterior distribution.
Paper addresses linear regression with partially mismatched data using local search with theoretical guarantees.
problem Linear regression with partially mismatched data.
method Optimization formulation and greedy local search algorithm with theoretical guarantees.
result Local search algorithm converges to nearly-optimal solution at a linear rate under certain conditions.
PACMAN provides bounds for classification tasks considering accuracy vs. negative log-loss mismatch.
problem Mismatch between accuracy and negative log-loss in classification tasks.
method Point-wise PAC approach over generalization gap, using likelihood ratio and concentration inequalities.
result PACMAN provides point-wise PAC bounds for the generalization problem.
End-to-end denoising framework improves SDR and PESQ metrics.
problem Spectrum and metric mismatches in speech enhancement networks.
method Optimizes network on time-domain signals after ISTFT and uses improved loss functions.
result Significantly improved SDR and PESQ performance.
Deep learning predicts mismatched ratings in Amazon reviews.
problem Identifying reviews with mismatched ratings on Amazon.
method Converted reviews to vectors using paragraph vector, trained a recurrent neural network with gated recurrent unit, incorporated semantic relationships.
result Model accurately predicts rating mismatches and provides feedback.
Study on LMMSE estimation with model mismatch, quantifying MSE trade-offs.
problem Model mismatch in LMMSE estimation with undermodeling.
method Analyzing the average MSE of LMMSE estimation with random regressors.
result Performance improvement depends on sufficient samples and model complexity.
Current approaches for Knowledge Distillation (KD) either directly use training data or sample from the training data distribution. In this paper, we demonstrate effectiveness of 'mismatched' unlabeled stimulus to perform KD for image classification networks. For illustration, we consider scenarios where this is a comp…
This work improves convergence guarantees for unadjusted HMC in KL and Rényi divergences.
problem Understanding convergence properties of unadjusted HMC in divergences like KL and Rényi.
method One-shot couplings to establish regularization and lift convergence bounds.
result Quantitative control of relative density mismatch and warm-start requirements.
Paper proposes a method to handle linear regression with partially shuffled data.
problem Linear regression with mismatched predictors and responses.
method Pseudo-likelihood approach based on two-component mixture densities with EM optimization.
result The method can tolerate larger fractions of mismatches and estimate noise level.
A new method handles mismatched data in multivariate regression.
problem Handling mismatched data in multivariate linear regression.
method Two-stage approach: first stage estimates parameters, second stage estimates permutation.
result Permutation recovery conditions become less stringent with increasing number of responses.
Unified framework for imitating tasks across domains with discrepancies.
problem Learning tasks across domains with embodiment, viewpoint, and dynamics mismatches.
method Two-step approach: alignment followed by adaptation. Alignment uses Generative Adversarial MDP Alignment (GAMA) for state and action correspondences from unpaired, unaligned demonstrations. Adaptation leverages these correspondences for zero-shot imitation.
result Effectiveness of the proposed approach in embodiment, viewpoint, and dynamics mismatch scenarios.
The current processes for building machine learning systems require practitioners with deep knowledge of machine learning. This significantly limits the number of machine learning systems that can be created and has led to a mismatch between the demand for machine learning systems and the ability for organizations to b…
Ensemble models improve prediction calibration for mismatched distributions.
problem Calibration issues in deep neural networks with mismatched train and test distributions.
method Simple data augmentation and mixing techniques for ensemble models.
result Improves calibration and accuracy on CIFAR10 and CIFAR100 benchmarks.
Deep transfer learning improves sleep staging with small datasets.
problem Insufficient data for deep neural networks due to channel mismatch.
method Transfer learning from large to small datasets, finetuning the pretrained network.
result Significant performance improvement in sleep staging.
New method corrects state distribution mismatch for off-policy policy optimization.
problem Mismatch between behavior and evaluation policy state distributions.
method Off-policy policy gradient with state distribution correction.
result Significantly improved policy quality in simulations.
The dictionary-aided sparse regression (SR) approach has recently emerged as a promising alternative to hyperspectral unmixing (HU) in remote sensing. By using an available spectral library as a dictionary, the SR approach identifies the underlying materials in a given hyperspectral image by selecting a small subset of…
Empirical study compares finite- and infinite-width BNNs, revealing performance differences under model mismatch.
problem Comparing BNNs with different widths due to conflicting model properties and inference intractability.
method Empirical comparison of finite- and infinite-width BNNs, analyzing performance under model mismatch.
result Increasing width can hurt BNN performance when the model is mis-specified, and finite-width BNNs generalize better under model mismatch.
We characterize the performance of sequential information guided sensing, Info-Greedy Sensing, when there is a mismatch between the true signal model and the assumed model, which may be a sample estimate. In particular, we consider a setup where the signal is low-rank Gaussian and the measurements are taken in the dire…
The performance of automatic speech recognition (ASR) systems can be significantly compromised by previously unseen conditions, which is typically due to a mismatch between training and testing distributions. In this paper, we address robustness by studying domain invariant features, such that domain information become…
Framework improves CATE estimation by aligning active learning with causal objectives.
problem High cost of outcome measurements limits CATE estimation.
method Causal-EPIG framework, targeting unobservable causal quantities.
result Strategies outperform standard baselines, revealing context-dependent optimal approaches.
Most of the existing studies on voice conversion (VC) are conducted in acoustically matched conditions between source and target signal. However, the robustness of VC methods in presence of mismatch remains unknown. In this paper, we report a comparative analysis of different VC techniques under mismatched conditions. …
Helical ribbons arise in many biological and engineered systems, often driven by anisotropic surface stress, residual strain, and geometric or elastic mismatch between layers of a laminated composite. A full mathematical analysis is developed to analytically predict the equilibrium deformed helical shape of an initiall…
New algorithm solves Schrödinger bridge problem with mismatched channels.
problem Solving Schrödinger bridge problem with input and noise channel mismatch.
method Design of a Sinkhorn recursion with memory for nonlinear PDEs.
result Demonstrates solving control-affine Schrödinger bridge problem.
Bayesian method corrects bias in imbalanced datasets.
problem Prevalence bias in machine learning datasets.
method Bayesian risk minimization framework, bias-corrected loss function.
result Corrected loss function improves model performance.
SRRM improves recursive transport surrogates in the small-discrepancy regime.
problem Insufficient understanding of recursive partitioning methods' statistical behavior and resolution in the small-discrepancy regime.
method Introduced Selective Recursive Rank Matching (SRRM) to improve the resolution of Recursive Rank Matching (RRM).
result SRRM yields a higher-fidelity practical surrogate for the Wasserstein distance at moderate additional computational cost.
Probabilistic models analyze data by relying on a set of assumptions. Data that exhibit deviations from these assumptions can undermine inference and prediction quality. Robust models offer protection against mismatch between a model's assumptions and reality. We propose a way to systematically detect and mitigate mism…
This paper tackles objective inconsistency in federated optimization with heterogeneous clients.
problem Objective inconsistency due to heterogeneity in clients' datasets and computation speeds.
method General framework for analyzing federated heterogeneous optimization algorithms, including FedAvg and FedProx, and proposing FedNova.
result FedNova eliminates objective inconsistency while preserving fast error convergence.
Study addresses covariate mismatch in federated learning, improving model accuracy.
problem Learning from clients with different feature sets in federated learning.
method Developed two approaches for linear prediction under covariate mismatch: plug-in estimator and impute-then-regress strategy.
result Proposed methods provide asymptotic and finite-sample learning rates, improving model accuracy.
A new method improves data generation quality by correcting score mismatches.
problem Score mismatch issue in conditional score-based data generation methods.
method Denoising Likelihood Score Matching (DLSM) loss for classifier training.
result The proposed method outperforms previous methods on Cifar-10 and Cifar-100 benchmarks.
Deep learning corrects GRACE TWSA mismatch in NOAH models.
problem Improving hydrological model predictive performance with GRACE data.
method Developed and applied deep convolutional neural network (CNN) models to learn and correct TWSA mismatch.
result Significant improvement in correlation coefficient and Nash-Sutcliff efficiency over original NOAH TWSA.