A new procedure for learning cost-sensitive SVM(CS-SVM) classifiers is proposed. The SVM hinge loss is extended to the cost sensitive setting, and the CS-SVM is derived as the minimizer of the associated risk. The extension of the hinge loss draws on recent connections between risk minimization and probability elicitat…
Study examines noise sensitivity of DNNs for binary classification.
problem Understanding non-robustness of DNN classifiers under noise.
method Defined and extended noise sensitivity and stability concepts for Boolean functions, applied to DNN models.
result Sorted out the relation between definitions and properties of DNN architectures under noise.
New method prunes neural networks at initialization, improving performance.
problem Improving neural network compression at initialization.
method Formally characterizes initialization conditions for reliable pruning based on connection sensitivity.
result Improved neural network performance on image classification tasks.
The paper explores SHAP scores and their connection to functional ANOVA, highlighting challenges in approximations.
problem Estimating SHAP scores and understanding their limitations.
method Using the connection to functional ANOVA, the paper outlines the challenges in SHAP approximations and their relation to feature distribution and ANOVA terms.
result Challenges in SHAP approximations are primarily due to feature distribution and the number of ANOVA terms estimated.
The paper examines stability of ReLU networks in tangent space and activation regions.
problem Stability and sensitivity of ReLU networks to small changes.
method Tangent sensitivity measure for ReLU networks, focusing on stability induced by individual examples.
result Tangent sensitivity correlates with the distribution of activation regions and generalization gap.
Linking output sensitivity to deep learning generalization.
problem Understanding and comparing the generalization properties of deep neural networks.
method Linking the loss function to output sensitivity and analyzing its relation to bias-variance decomposition.
result Output sensitivity is a strong metric for comparing generalization performance of deep networks.
Paper introduces a new method for risk-sensitive investment management using RL.
problem Risk-sensitive portfolio management with unknown model parameters.
method Combines RL and risk-sensitive stochastic control with Gaussian perturbations for exploration.
result Endogenous relative-entropy regularization and optimal investment strategy derived.
We construct several natural connections and Dirac type operators on a general metric contact manifold which are more sensitive to the geometric background. In the special case of CR manifolds these connections are also compatible with the CR structure and include among them the Webster connection. We also describe sev…
Modeling curvature-sensitive cells in visual cortex with geometric structures.
problem Understanding the functional architecture of curvature-sensitive cells in the visual cortex.
method Geometric model based on Engel structure and SIM(2) symmetry.
result Identified SIM(2) as the natural symmetry group for curvature-sensitive cells.
Proposes PSCs for UQ in deep nets without retraining.
problem Estimating uncertainty in deep nets with a single pass.
method Identifies sensitive, smooth intermediate layer, fits probabilistic model.
result PSCs achieve UQ and OOD detection performance matching existing methods.
This paper analyzes risk-sensitive reinforcement learning with Conditional Value-at-Risk (CVaR) for robust Markov Decision Processes.
problem Risk-sensitive reinforcement learning for robust Markov Decision Processes (RMDPs) with state-action-dependent ambiguity sets.
method The paper establishes a connection between robustness and risk sensitivity, defining a new risk measure NCVaR and proposing value iteration algorithms.
result The proposed approach using NCVaR optimization and value iteration algorithms can solve problems with state-action-dependent ambiguity sets.
We prove that if M is a closed, connected, oriented, rationally inessential manifold, then the Hofer-Zehnder capacity of the unit disk bundle of the cotangent bundle of M is finite.
New bounds on machine learning data leakage identified.
problem Machine Learning models can leak sensitive information.
method Formalized attack setups, derived universal bounds, studied mutual information.
result Connected attack success rate to generalization gap and mutual information.
MimosaNet prevents model stealing by making neural networks sensitive to weight changes.
problem Neural networks are vulnerable to model stealing due to robustness to minor parameter changes.
method Develops a method to create a sensitive version of a trained neural network.
result The sensitive network produces the same responses but is highly sensitive to weight changes, preventing model stealing.
The paper proposes a new method to measure risk with fine-grained tail sensitivity.
problem Risk measures that do not account for tail sensitivity are insufficient for machine learning systems.
method The approach involves specifying a reference distribution with desired tail behavior and constructing risk measures compatible with this upper probability.
result Risk measures with fine-grained tail sensitivity can replace the expectation operator in machine learning systems.
Bayesian approach improves AdaLoRA's performance and efficiency.
problem Improving the efficiency and performance of adaptive low-rank adaptation.
method Utilized Bayesian metrics and the Improved Variational Online Newton (IVON) optimizer for adaptive parameter budget allocation.
result Bayesian counterpart outperforms sensitivity-based importance metric and is faster than AdaLoRA.
The paper develops a method to achieve fairness in predictions using Wasserstein barycenters.
problem Learning a fair real-valued function independent of sensitive attributes.
method Establishing a connection between fair regression and optimal transport theory, deriving a close form expression for the optimal fair predictor as the Wasserstein barycenter of sensitive groups.
result The optimal fair predictor's distribution is the Wasserstein barycenter of sensitive groups' distributions, offering an intuitive interpretation and a simple post-processing algorithm.
New methods connect low-loss points on neural network surfaces.
problem Connecting low-loss points on neural network loss surfaces.
method Macroscopic distributional assumptions and global connection models.
result Accuracy correlates with complexity and sensitivity.
Combines cost-sensitive and Neyman-Pearson paradigms for better binary classification.
problem Asymmetric binary classification problems with unequal error severities.
method Develops TUBE-CS algorithm to bridge cost-sensitive and Neyman-Pearson paradigms.
result High-probability control of population type I error.
Prunes neural networks while preserving accuracy, using sensitivity sampling.
problem Sparsifying neural networks while maintaining predictive accuracy.
method Uses sensitivity sampling to construct an importance distribution, then adaptively prunes weights.
result Pruned networks incur minimal loss in performance compared to original networks.
BCDP enhances privacy by protecting sensitive features more precisely.
problem Uniform privacy protection in LDP degrades performance for sensitive features.
method Bayesian Coordinate Differential Privacy (BCDP) adjusts privacy protection per feature sensitivity.
result BCDP improves accuracy in downstream tasks without sacrificing privacy.
In an incomplete market, with incompleteness stemming from stochastic factors imperfectly correlated with the underlying stocks, we derive representations of homothetic (power, exponential and logarithmic) forward performance processes in factor-form using ergodic BSDE. We also develop a connection between the forward …
QSAR models struggle to predict activity cliffs, but graph isomorphism features improve AC-sensitivity.
problem QSAR models struggle to predict activity cliffs (ACs).
method Nine distinct QSAR models combining molecular representation methods and regression techniques.
result Graph isomorphism features improve AC-sensitivity.
Algorithm generates private continuous-time data for sensitive domains.
problem Private generation of continuous-time data for sensitive domains.
method Mean-field Langevin dynamics and noisy particle gradient descent.
result Strong privacy guarantees for one-time data contributions.
New loss function improves classification for imbalanced and sensitive groups.
problem Optimizing metrics like balanced error and equal opportunity in imbalanced and sensitive classification.
method Developed a principled vector-scaling (VS) loss function that addresses multiplicative adjustments necessary at terminal training phase.
result The VS loss function improves minority class performance and generalizes to different types of imbalances.
FANNet analyzes noise tolerance and training bias in neural networks.
problem Low noise tolerance and input sensitivity in neural networks lead to failures on unseen inputs.
method Formal analysis using model checking under different noise ranges.
result Noise tolerance of ±11% for the trained network, sensitive input nodes identified, and biasness confirmed. Learning-based link scheduling improves network performance in millimeter-wave multi-connectivity.
problem Efficient link scheduling is crucial for maximizing network performance in millimeter-wave multi-connectivity.
method A learning-based approach to predict optimal link scheduling.
result The learning-based solution outperforms base line methods and approaches the optimal solution.
Develops algorithms for multi-class Neyman-Pearson classification with cost sensitivity.
problem Asymmetric misclassification costs in multi-class classification problems.
method Establishes connection with cost-sensitive learning, proposes two algorithms, extends NP oracle properties.
result Proposes algorithms with theoretical guarantees for multi-class Neyman-Pearson classification.
Connects robust optimization to conformal prediction for uncertainty sets.
problem Decision-making under uncertainty in sensitive data.
method Defines Mahalanobis distance as a conformity score and generates conformal uncertainty sets.
result Conformal uncertainty sets provide valid and conservative ellipsoidal regions.
Sublinear LSVI via LSH reduces runtime to sublinear in actions.
problem Efficiently estimating value functions in reinforcement learning with sublinear runtime.
method Formulated as approximate maximum inner product search, used LSH to solve with sublinear time complexity.
result Sublinear runtime while maintaining LSVI's regret.
This paper uses the relationship between graph conductance and spectral clustering to study (i) the failures of spectral clustering and (ii) the benefits of regularization. The explanation is simple. Sparse and stochastic graphs create a lot of small trees that are connected to the core of the graph by only one edge. G…
Deep networks infer parameters for chaotic dynamics in climate models.
problem Uncertainty in climate sensitivity due to coarse model resolution.
method Three deep network algorithms (fully-connected, 1D, 2D convolutional) trained on Lorenz-96 model.
result Convolutional networks outperform fully-connected and 1D networks in parameter recovery.
Prevents sensitive data generation in diffusion models using labeled and unlabeled data.
problem Generating sensitive data in diffusion models using unlabeled data.
method Positive-Unlabeled Diffusion Models, approximating ELBO with labeled and unlabeled data.
result Prevents the generation of sensitive data without compromising image quality.
A framework for sensitivity measures using scoring functions.
problem Constructing sensitivity measures for any elicitable functional.
method Score-based sensitivities constructed via consistent scoring functions.
result Demonstrated intuitive and desirable properties of score-based sensitivities.
This work provides efficient algorithms for approximating ℓ_p sensitivities and related statistics.
problem Estimating the importance of datapoints in high-dimensional datasets.
method Efficient algorithms for computing α-approximation of ℓ_1 sensitivities and total sensitivity using importance sampling and sensitivity computations.
result Real-world datasets have significantly lower intrinsic effective dimensionality than theoretical predictions.
Unified framework for CVA sensitivities, hedging, and risk assessment.
problem Computing and managing Credit Value Adjustment (CVA) sensitivities and risks.
method Probabilistic machine learning and refined regression on simulated data, validated by Monte Carlo methods.
result Identification of optimal sensitivities for practical tasks like hedging and risk assessment.
In this paper, we study the sensitivity of the spectral clustering based community detection algorithm subject to a Erdos-Renyi type random noise model. We prove phase transitions in community detectability as a function of the external edge connection probability and the noisy edge presence probability under a general…
The paper studies risk-sensitive MDPs with recursive risk measures.
problem Risk-sensitive decision-making in MDPs with unbounded costs.
method Recursive application of static risk measures, Bellman equation derivation, existence of optimal policies.
result Existence of Markovian optimal policies for infinite planning horizons, contractive model for stationary optimal policy.
Method reduces model bias in water temperature prediction using physics-guided GNNs.
problem Model bias in traditional physics-based models across different income and education levels.
method Physics-guided GNNs with refined neighbor selection and weights.
result Preserves equitable performance across different sensitive groups in the Delaware River Basin.
Conditional Random Fields (CRF) have been widely used in a variety of computer vision tasks. Conventional CRFs typically define edges on neighboring image pixels, resulting in a sparse graph such that efficient inference can be performed. However, these CRFs fail to model long-range contextual relationships. Fully-conn…
New method speeds up causal sensitivity analysis.
problem Bounding causal effects in unobserved confounding.
method Amortized approach using prior-data fitted networks.
result Orders of magnitude faster computation.
A new approach to sensitivity analysis without the Sobol decomposition.
problem Traditional sensitivity indices like Sobol indices have limitations.
method Introducing sensitivity measures that generalize existing indices and define interaction effects.
result Sensitivity measures can create new indices and define interaction effects.
Worst-Case Sensitivity measures model sensitivity to uncertainty set size.
problem Model sensitivity to uncertainty set size in Distributionally Robust Optimization.
method Introducing Worst-Case Sensitivity as a measure of model sensitivity, and deriving closed-form expressions for various uncertainty sets.
result DRO solutions can be sensitive to the family and size of the uncertainty set, and worst-case sensitivity reflects these properties.
Simplified equation predicts model sensitivity to data.
problem Understanding model sensitivity to training data is challenging and costly.
method Derived using Bayesian principles, the Memory-Perturbation Equation (MPE) unifies and generalizes existing sensitivity measures.
result Empirical results show sensitivity estimates during training can predict generalization on unseen test data.
This paper investigates the finite horizon risk-sensitive portfolio optimization in a regime-switching credit market with physical and information-induced default contagion. It is assumed that the underlying regime-switching process has countable states and is unobservable. The stochastic control problem is formulated …
Study on detecting backdoor attacks using adversarial detection methods.
problem Mitigating backdoor attacks in deep neural networks.
method Comprehensive studies on adversarial and backdoor examples, revising adversarial defense methods.
result Adversarial defense methods can be effective in detecting backdoor attacks.
Paper introduces AIF for anomaly detection with variable feature sensitivity.
problem Lack of variable sensitivity in anomaly detection methods.
method Extended Isolation Forest with feature sensitivities (Anisotropic Isolation Forest).
result AIF enables anomaly detection with controllable sensitivity to different features.
Geometric modeling for human food and chemical sensitivities.
problem Modeling biochemical processes in humans with sensitivities.
method Geometric approach to biochemical modeling.
result Geometric models improve understanding of sensitivities.