Adversarial attack methods have demonstrated the fragility of deep neural networks. Their imperceptible perturbations are frequently able fool classifiers into potentially dangerous misclassifications. We propose a novel way to interpret adversarial perturbations in terms of the effective input signal that classifiers …
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,982 papers · 148 categories
Trend · papers per month
48 results for “gray-box scenario”
Randomized diversification defends machine learning models against adversarial attacks.
problem Vulnerability of machine learning systems to adversarial attacks.
method Multi-channel architecture with shared secret key for randomized transforms in a gray-box scenario.
result Increased robustness against various adversarial attacks.
In this appraisal paper, we evaluate the efficacy of SHIELD, a compression-based defense framework for countering adversarial attacks on image classification models, which was published at KDD 2018. Here, we consider alternative threat models not studied in the original work, where we assume that an adaptive adversary …
In the last decade, deep learning algorithms have become very popular thanks to the achieved performance in many machine learning and computer vision tasks. However, most of the deep learning architectures are vulnerable to so called adversarial examples. This questions the security of deep neural networks (DNN) for ma…
Gray-box attack improves on white-box methods for trading agents.
problem Robustness of Deep RL trading agents against adversarial attacks.
method Hybrid Deep Neural Network policy for gray-box adversarial attack.
result Adversary can reduce trading agent's reward by 214.17%.
Data-driven approach learns effective equations for phase field interfaces.
problem Learning accurate equations for phase field interface dynamics.
method Data-driven identification of partial differential equations from phase field data.
result Data-driven equations outperform analytical approximations in certain regimes.
Adversarial samples are perturbed inputs crafted to mislead the machine learning systems. A training mechanism, called adversarial training, which presents adversarial samples along with clean samples has been introduced to learn robust models. In order to scale adversarial training for large datasets, these perturbati…
Enhances NOAA's Geospace model with machine learning for predicting ground magnetic perturbations.
problem Predicting the probability of ground magnetic field changes.
method Combining physics-based model with machine learning (boosted ensemble of classification trees).
result The ML-enhanced model consistently improves probabilistic forecast metrics.
It has been shown that adversaries can craft example inputs to neural networks which are similar to legitimate inputs but have been created to purposely cause the neural network to misclassify the input. These adversarial examples are crafted, for example, by calculating gradients of a carefully defined loss function w…
Though deep neural networks have achieved state-of-the-art performance in visual classification, recent studies have shown that they are all vulnerable to the attack of adversarial examples. Small and often imperceptible perturbations to the input images are sufficient to fool the most powerful deep neural networks. Va…
Crop yield forecasting is the methodology of predicting crop yields prior to harvest. The availability of accurate yield prediction frameworks have enormous implications from multiple standpoints, including impact on the crop commodity futures markets, formulation of agricultural policy, as well as crop insurance ratin…
Neural Networks (NN) have been proposed in the past as an effective means for both modeling and control of systems with very complex dynamics. However, despite the extensive research, NN-based controllers have not been adopted by the industry for safety critical systems. The primary reason is that systems with learning…
ATHENA builds flexible defenses against adversarial attacks.
problem Extensive research on adversarial attacks is domain-specific and cannot be easily extended.
method Designing an extensible framework based on diverse weak defenses.
result Comprehensive empirical study demonstrates the effectiveness of ATHENA.
Recommender system is an important component of many web services to help users locate items that match their interests. Several studies showed that recommender systems are vulnerable to poisoning attacks, in which an attacker injects fake data to a given system such that the system makes recommendations as the attacke…
Proposes FMS for more efficient neural network hyperparameter optimization.
problem Efficient hyperparameter optimization for deep learning models.
method Uses logged checkpoints of trained weights to guide hyperparameter selections.
result Proposes Forecasting Model Search (FMS) method.
We develop an automated variational inference method for Bayesian structured prediction problems with Gaussian process (GP) priors and linear-chain likelihoods. Our approach does not need to know the details of the structured likelihood model and can scale up to a large number of observations. Furthermore, we show that…
Equation discovery method reconstructs model structure and parameters from data.
problem Nonlinear system identification challenges.
method Two interlaced parts: model structure identification and parameter estimation.
result Equation discovery method successfully reconstructs model structure and parameters from data.
Unlike traditional programs (such as operating systems or word processors) which have large amounts of code, machine learning tasks use programs with relatively small amounts of code (written in machine learning libraries), but voluminous amounts of data. Just like developers of traditional programs debug errors in the…
DPC uses physics and neural nets to solve SDEs.
problem Solving stochastic differential equations with missing physics.
method Physics-data fusion with conditional maximum mean discrepancy (CMMD) loss.
result DPC achieves highly accurate solutions on benchmark examples.
New method learns from non-uniform data and partial physical knowledge.
problem Identifying dynamical systems from non-uniformly sampled data.
method Physics-informed neural networks integrating numerical integration methods.
result Learning unknown kinetic rates and estimating parameters from non-uniform data.
NDS learns dynamical models with prior knowledge, improving accuracy and efficiency.
problem Learning accurate dynamical models with limited data and varying dynamics.
method Neural Dynamical Systems (NDS) integrates prior knowledge in ODEs with neural networks to estimate parameters and predict states.
result NDS achieves higher accuracy and uses fewer samples compared to other methods.
Modeling buildings' heat dynamics is a complex process which depends on various factors including weather, building thermal capacity, insulation preservation, and residents' behavior. Gray-box models offer a causal inference of those dynamics expressed in few parameters specific to built environments. These parameters …
Paper builds ML classifier to detect crypto-ransomware.
problem Detecting crypto-ransomware with high accuracy and low false positives.
method Behavior-based detection using input/output activities and file-content entropy. Deep-learning classifier with adversarial research and Integrated Gradient method for explanation.
result Deep-learning classifier achieves high accuracy and low false positive rate in detecting crypto-ransomware.
In recent years, defending adversarial perturbations to natural examples in order to build robust machine learning models trained by deep neural networks (DNNs) has become an emerging research field in the conjunction of deep learning and security. In particular, MagNet consisting of an adversary detector and a data re…
Proposes a framework to identify and correct model-form errors in nonlinear systems.
problem Model-form errors in nonlinear dynamical systems due to unknown or approximated governing equations.
method Uses a hybrid approach combining machine learning and Bayesian filtering to estimate and correct model-form errors.
result Improves the predictive capability of known but approximate governing equations for nonlinear dynamical systems.
Research in deep learning for multi-speaker source separation has received a boost in the last years. However, most studies are restricted to mixtures of a specific number of speakers, called a specific scenario. While some works included experiments for different scenarios, research towards combining data of different…
Two new methods score stress test scenarios for risk managers.
problem Comparing and evaluating stress test scenarios for risk managers.
method Inspired by Archer-Mouy-Selmi, two methodologies for scoring stress test scenarios.
result New methods can compare and evaluate stress test scenarios.
MimickNet approximates clinical ultrasound post-processing without proprietary data.
problem Matching proprietary clinical-grade ultrasound post-processing techniques.
method Deep learning framework MimickNet that transforms raw DAS beams into post-processed images.
result MimickNet achieves high SSIM scores (0.930-0.967) on test sets.
Fast Empirical Scenariosstat.ML
Extracts representative scenarios from large data panels.
problem Creating representative scenarios from large data panels.
method Two novel algorithms: one identifies new scenarios, the other selects known important data points.
result Efficient algorithms for consistent scenario-based modeling and multi-dimensional numerical integration.
Methodology measures financial impacts using existing credit loss infrastructure.
problem Measuring the impact of financial scenarios on expected credit losses.
method Captures scenario effects through changes in default probabilities; uses existing provisioning infrastructure.
result Methodology validated through standardized climate scenario exercise in Canada and Quebec.
REDS improves scenario discovery from few simulations, reducing costs by 50-75%.
problem Discovering scenarios in data spaces resulting from simulations with limited computational resources.
method Uses an intermediate machine learning model to label data for subgroup discovery methods.
result Reduces the number of simulations required by 50-75% on average.
Proposes a new framework for environmental CVA with robust wrong-way risk.
problem Limited operational implementations of translating environmental scenarios into CVA.
method Three components: hazard rate mapping, tail generators, and KL divergence-based wrong-way risk bound.
result Nature CVAs can vary significantly across different ecosystem generators.
Study examines the scenario approach for robust optimization, focusing on nonconvex cases.
problem Robust optimization with nonconvex uncertainty sets.
method Scenario approach via i.i.d sampling, analysis of concentration of measures, asymptotic and finite sample guarantees.
result Obstruction to consistency in noncompact decision sets, finite sample guarantees for nonconvex problems.
This paper formed part of a preliminary research report for a risk consultancy and academic research. Stochastic Programming models provide a powerful paradigm for decision making under uncertainty. In these models the uncertainties are represented by a discrete scenario tree and the quality of the solutions obtained i…
Statistical depth metrics help identify risky power grid scenarios.
problem Identifying extreme scenarios for risk mitigation in power grid planning.
method Functional depth metrics for sub-selecting outlying scenarios.
result The proposed approach effectively identifies risky scenarios for operational risk mitigation.
Two autoencoding models learn latent traffic scene representations.
problem Learning latent representations of traffic scenarios.
method CNN and RNN models for spatio-temporal and temporal data, incorporating permutation invariance.
result Latent scenario embeddings can be used for clustering and similarity retrieval.
A new method using energy distance for ensemble and scenario reduction.
problem Solving complex dynamic and stochastic programs, especially in energy systems.
method Proposes a new method based on energy distance for ensemble and scenario reduction.
result Reduced scenario sets exhibit better statistical properties for energy distance than Wasserstein distance.
Reverse Stress Testing for Multivariate Scenarios: A Conditional Framework for Stressed Time Seriesq-fin.RM
Develops a method for reverse stress testing in multivariate scenarios.
problem Reconstructing a multivariate stress scenario from a single exogenous shock.
method Maximizing conditional density under three distributional assumptions.
result Simulated scenarios are economically coherent and reproduce risk-reward asymmetry.
CMTS: Conditional Multiple Trajectory Synthesizer for Generating Safety-critical Driving Scenarioscs.LG
CMTS synthesizes near-miss driving scenarios for safer autonomous driving tests.
problem Lack of near-miss driving data for testing autonomous driving algorithms.
method Generative model conditioned on road maps, using Variational Bayesian methods.
result Synthesized data covers more near-miss scenarios, improving trajectory prediction and risk handling.
Method generates plausible financial stress scenarios using large deviations.
problem Misleading risk management by overlooking or overemphasizing implausible scenarios.
method Exploits large-deviations principle to concentrate risk factors near most likely stress configurations.
result Can generate informative stress scenarios even with limited historical data.
Generates multimodal safety-critical scenarios for robustness evaluation of decision-making algorithms.
problem Lack of comprehensive evaluation of neural network robustness under real-world scenarios.
method Proposes a flow-based multimodal scenario generator using weighted likelihood maximization and gradient-based sampling.
result Demonstrates improved testing efficiency and multimodal modeling capability compared to traditional methods.
Adaptive framework generates challenging adversarial scenarios for autonomous vehicles.
problem Lack of efficient and adaptable evaluation methods for autonomous vehicles.
method Adaptive evaluation framework using ensemble models and nonparametric Bayesian clustering.
result Adversarial scenarios significantly degrade tested autonomous vehicles' performance.
Algorithm reduces historical expected shortfall computation by focusing on worst-case scenarios.
problem Computing the historical expected shortfall efficiently and accurately.
method Multi-step algorithm using Monte Carlo simulations to identify and reduce the number of worst-case scenarios.
result Non-asymptotic bounds for the L p-error of the expected shortfall estimator are derived.
Scenario-based Risk Evaluationq-fin.MF
Risk measures such as Expected Shortfall (ES) and Value-at-Risk (VaR) have been prominent in banking regulation and financial risk management. Motivated by practical considerations in the assessment and management of risks, including tractability, scenario relevance and robustness, we consider theoretical properties of…
Three scenarios for continual learning tasks are described and compared.
problem Difficulty in comparing continual learning methods due to different evaluation protocols.
method Three continual learning scenarios based on task identity and inference requirements.
result Different scenarios have varying difficulty and require different approaches.
Paper proposes a copula method to generate unfavorable VaR scenarios.
problem Creating unfavorable VaR scenarios for insurance models.
method Patchwork copulas to create unfavorable VaR scenarios with given marginal distributions.
result Demonstrated with a 19-dimensional real-life insurance losses data set.
Study optimal timing to divest from assets with uncertain future scenarios.
problem Optimal timing to divest from assets with uncertain future scenarios.
method Smooth model of decision making under ambiguity aversion, optimal stopping problem with learning.
result Proves a minimax result reducing the problem to standard optimal stopping problems with learning.
Researchers validate ML scenario generators by checking dependencies and detecting memorization effects.
problem Validation of machine learning-based scenario generators differs from classical methods due to data-driven dependencies.
method Two novel validation aspects: checking dependencies and detecting memorization effects. Novel memorization ratio introduced.
result Validation methods successfully detect dependencies and memorization effects in ML-based scenario generators.