Neural networks struggle with identity relations; DR units improve generalization.
problem Neural networks fail to generalize identity relations.
method Exploring various factors in neural network architecture and learning process, including number of hidden layers, activation function, and data representation.
result DR units improve generalization, leading to almost perfect test accuracy in mid fusion setting.
DR technique helps deep models learn faster and better.
problem Vanishing gradients and local minima in deep model training.
method DR technique applies penalties on hidden units to improve learning.
result DR improves convergence and generalization in deep neural networks.
Price responsiveness is a major feature of end use customers (EUCs) that participate in demand response (DR) programs, and has been conventionally modeled with static demand functions, which take the electricity price as the input and the aggregate energy consumption as the output. This, however, neglects the inherent …
A new SL strategy optimizes HVAC DR in multi-zone buildings.
problem Optimal DR of HVAC units in multi-zone buildings is challenging.
method Supervised learning with ANN replication and DNN integration.
result SLAMP achieves effective DR schedules with reduced computation time.
Basic binary relations such as equality and inequality are fundamental to relational data structures. Neural networks should learn such relations and generalise to new unseen data. We show in this study, however, that this generalisation fails with standard feed-forward networks on binary vectors. Even when trained wit…
The paper examines soliton surfaces using a parallel transport frame field in 4D space.
problem Geometric properties of soliton surfaces associated with the Betchov-Da Rios equation.
method Parallel transport frame field approach in four-dimensional Euclidean space.
result Characterization of soliton surfaces as flat, minimal, semi-umbilic, or Wintgen ideal.
FEALM learns features for better nonlinear DR of hidden patterns.
problem DR misses important patterns on distorted manifolds.
method FEALM generates optimized projections using an optimization algorithm and neighbor-shape dissimilarity.
result FEALM captures important patterns on hidden manifolds.
DR-MCTS improves decision quality and sample efficiency in complex environments.
problem Improving decision quality and sample efficiency in complex environments.
method Integrates Doubly Robust off-policy estimation into Monte Carlo Tree Search (MCTS).
result DR-MCTS achieves superior performance in Tic-Tac-Toe and VirtualHome tasks.
Let X=X∪Z be a data set in RD, where X is the training set and Z is the test one. Many unsupervised learning algorithms based on kernel methods have been developed to provide dimensionality reduction (DR) embedding for a given training set $Φ: \mathbf{X} \to \mat…
New DR-IC estimator reduces bias and variance in OPE.
problem Estimating value of a target policy using logged data from a different policy.
method DR-IC estimator that combines parametric reward model and context-based switching rule.
result DR-IC estimator outperforms state-of-the-art OPE algorithms.
Paper defines and evaluates DR complex for persistent homology.
problem Computing persistent homology of Euclidean point cloud data.
method Delaunay-Rips complex construction for speed and stability.
result DR produces stable persistence diagrams under point cloud perturbations.
New algorithms solve DR-submodular maximization with faster convergence.
problem Maximizing monotone DR-submodular functions under convex constraints.
method Introduced strongly DR-submodular functions and proposed SDRFW and PGA algorithms.
result SDRFW achieves optimal approximation ratio after fewer iterations.
Online and stochastic learning has emerged as powerful tool in large scale optimization. In this work, we generalize the Douglas-Rachford splitting (DRs) method for minimizing composite functions to online and stochastic settings (to our best knowledge this is the first time DRs been generalized to sequential version).…
Paper tackles non-monotone DR-submodular maximization with approximation and regret guarantees.
problem Maximizing non-monotone DR-submodular functions over specific sets.
method Frank-Wolfe algorithm for general convex sets, Stochastic Gradient Ascent for down-closed convex sets.
result First approximation guarantees for both offline and online settings.
Dimensionality reduction (DR) is often used as a preprocessing step in classification, but usually one first fixes the DR mapping, possibly using label information, and then learns a classifier (a filter approach). Best performance would be obtained by optimizing the classification error jointly over DR mapping and cla…
Paper tackles online DR-submodular maximization with various convex sets.
problem Maximizing DR-submodular functions online over different convex sets.
method Develops online algorithms with approximation guarantees for various convex sets.
result Achieves 1/e-approximation ratio with O(T2/3) regret for down-closed sets. New DR method improves robustness in high-dimensional treatment effects.
problem Estimating dynamic treatment effects with high-dimensional confounders.
method Proposes a novel DR representation for intermediate conditional outcome models.
result Achieves superior robustness guarantees with high-dimensional confounders.
Interactive DR framework for comparing datasets.
problem Limited flexibility in existing DR methods for comparative analysis.
method Unified linear comparative analysis (ULCA) with interactive optimization and visualization.
result ULCA and optimization algorithm improve comparative analysis efficiency and flexibility.
New model-free DR-RL algorithm with finite sample complexity.
problem Limited model-free DR-RL methods with convergence guarantees or sample complexities.
method Integrates Multi-level Monte Carlo (MLMC) technique with threshold mechanism.
result First model-free DR-RL approach with finite sample complexity for total variation and Chi-square divergence.
The paper studies continuous submodular functions and their optimization.
problem Maximizing continuous submodular functions in poly. time.
method Characterization of continuous submodularity, operations preserving it, and algorithms for constrained maximization.
result Continuous submodularity is equivalent to a weak DR property, leading to continuous DR-submodular functions with the full DR property.
A new DR formulation improves metric learning for faster and more stable performance.
problem Learning embeddings for class separation in metric learning.
method Distance-ratio (DR) formulation for metric learning.
result DR formulation achieves improved or comparable generalization performances.
The bag of words (BOW) represents a corpus in a matrix whose elements are the frequency of words. However, each row in the matrix is a very high-dimensional sparse vector. Dimension reduction (DR) is a popular method to address sparsity and high-dimensionality issues. Among different strategies to develop DR method, Un…
Paper tackles online learning for DR management with incentives.
problem Estimating baseline consumption in DR programs with consumer incentives.
method Online learning scheme using least-squares with perturbed reward prices.
result Achieves low regret of $\mathcal{O}\left((\log{T})^2
ight)$ compared to optimal.
Paper analyzes an algorithm for maximizing non-concave functions with budget constraints.
problem Maximizing non-concave functions with budget constraints under DR-submodularity.
method Generalized Sequential algorithm for online monotone DR-submodular function maximization.
result First competitive ratio bound matches known tight bound for linear objective functions.
New DR algorithm preserves both local and global structure.
problem Trade-off between preserving local and global structure in DR methods.
method Analysis of existing DR methods and design principles for loss functions.
result Design of PaCMAP algorithm that preserves both local and global structure.
In this paper, we propose a novel recurrent neural network architecture for speech separation. This architecture is constructed by unfolding the iterations of a sequential iterative soft-thresholding algorithm (ISTA) that solves the optimization problem for sparse nonnegative matrix factorization (NMF) of spectrograms.…
New dual formulation reduces generalization error for ERM-fDR.
problem Generalization error in constrained optimization problems.
method Introduces a dual formulation of ERM-fDR using Legendre-Fenchel transform and implicit function theorem.
result Explicit characterizations of generalization error for algorithms under mild conditions.
We study the behaviour of analytic torsion under smooth fibrations. Namely, let F \to E \to^{f} B be a smooth fiber bundle of connected closed oriented smooth manifolds and let V be a flat vector bundle over E. Assume that E and B come with Riemannian metrics and V comes with a unimodular (not necessarily fla…
Dynamic regressor selection (DRS) systems work by selecting the most competent regressors from an ensemble to estimate the target value of a given test pattern. This competence is usually quantified using the performance of the regressors in local regions of the feature space around the test pattern. However, choosing …
ProbDR framework interprets DR algorithms as probabilistic inference.
problem Efficiently compressing high-dimensional data into lower dimensions.
method ProbDR variational framework that treats DR as probabilistic inference.
result ProbDR unifies various DR algorithms and enables probabilistic reasoning.
DRSS method identifies unnecessary samples and features in DR covariate shift.
problem Identifying unnecessary samples and features in DR covariate shift.
method Combines DR learning and safe screening techniques.
result DRSS method provides reliable identification of unnecessary samples and features under specified distribution uncertainty.
Adapts DR objectives for both sample and feature size reduction.
problem Simultaneously reduce sample and feature sizes.
method Semi-relaxed Gromov-Wasserstein optimal transport.
result OT plan delivers competitive hard clustering.
This paper establishes non-asymptotic learning bounds for the DR covariate shift adaptation.
problem Distribution shift between training and test domains in machine learning.
method Doubly-robust (DR) estimator combining density ratio estimation and pilot regression model.
result First non-asymptotic learning bounds for DR covariate shift adaptation.
Regression aims at estimating the conditional mean of output given input. However, regression is not informative enough if the conditional density is multimodal, heteroscedastic, and asymmetric. In such a case, estimating the conditional density itself is preferable, but conditional density estimation (CDE) is challeng…
SGD improves DR by solving two-stage sampling problems.
problem Improving the learning properties of SGD for distribution regression.
method Applying SGD to two-stage sampling problems in distribution regression.
result Theoretical guarantees for SGD's performance in DR, with optimal bounds.
Paper proposes methods to reduce bias and variance in recommender systems.
problem Bias in recommender systems due to users' preferences.
method Proposes a principled approach to reduce bias and variance in DR methods, and a novel semi-parametric collaborative learning approach.
result The proposed methods outperform existing debiasing methods in both theory and experiments.
In this paper, we investigate Dimensionality reduction (DR) maps in an information retrieval setting from a quantitative topology point of view. In particular, we show that no DR maps can achieve perfect precision and perfect recall simultaneously. Thus a continuous DR map must have imperfect precision. We further prov…
This paper explores autoencoders for estimating intrinsic dimensionality.
problem Estimating the intrinsic dimensionality of random vectors.
method Use of autoencoders for dimension estimation, focusing on architectural choices and regularization techniques.
result Autoencoders can be adapted for intrinsic dimension estimation, addressing questions beyond classic DR/DE techniques.
A new algorithm interprets DR dimensions and selects features.
problem Lack of interpretability in DR algorithms.
method I-KDR algorithm that maps data to a lower dimensional space with interpretable dimensions and feature selection.
result I-KDR provides better interpretations and higher discriminative performance.
DR-submodular continuous functions are important objectives with wide real-world applications spanning MAP inference in determinantal point processes (DPPs), and mean-field inference for probabilistic submodular models, amongst others. DR-submodularity captures a subclass of non-convex functions that enables both exact…
New method tackles online DR-submodular maximization with improved regret guarantees.
problem Online maximization of non-monotone DR-submodular functions over down-closed convex sets.
method 1/e-linearization through exponential reparametrization, surrogate potential, and reduction to online linear optimization.
result Achieves O(T1/2) static regret with single gradient query per round, improving state of the art. Proposes DR-ACI for causal effect intervals with temporal dependence.
problem Causal effect intervals under temporal dependence.
method Doubly robust adaptive conformal inference (DR-ACI).
result Constructs prediction intervals for causal effects.
We revisit the classical Douglas-Rachford (DR) method for finding a zero of the sum of two maximal monotone operators. Since the practical performance of the DR method crucially depends on the stepsizes, we aim at developing an adaptive stepsize rule. To that end, we take a closer look at a linear case of the problem a…
Paper presents ERM with f-divergence regularization and its properties.
problem Minimizing empirical risk with f-divergence constraints. method Introduces normalization function and solves ERM-fDR via ODE. result Characterizes difference between empirical risks and provides numerical algorithm.
Let (M,∂M) be a compact 3-manifold with boundary which admits a complete, convex co-compact hyperbolic metric. For each hyperbolic metric g on M such that $\dr M$ is smooth and strictly convex, the induced metric on $\dr M$ has curvature K>−1, and each such metric on $\dr M$ is obtained for a unique ch…
Paper introduces a new framework for optimizing non-convex functions.
problem Optimizing non-convex functions, especially DR-submodular and concave functions.
method Developed a general meta-algorithm to convert linear/quadratic optimization to optimization of upper-linearizable/quadratizable functions.
result Unified approach to concave and DR-submodular optimization problems.
Proposes a robust estimator for RD designs.
problem Estimating treatment effects in RD designs.
method Doubly robust estimator combining two estimators.
result Enhances robustness of treatment effect estimators.
Paper proposes a new DR estimator for adaptive experiments with improved performance.
problem Improving policy evaluation in adaptive experiments with dependent samples.
method Adaptive-fitting variant of sample-splitting for non-Donsker nuisance estimators.
result Proposed DR estimator shows better performance than other estimators with dependent samples.