Automated design of resilient, efficient DNNs for hardware.
problem Designing reliable and efficient DNNs for hardware.
method Evolutionary optimization technique for DNN architecture design.
result Strong correlation between predicted and actual error resilience.
A methodology for resilience analysis of Capsule Networks under approximation errors.
problem Resilience of Capsule Networks under approximation errors.
method Modeling and analyzing approximation errors in Capsule Networks' inference.
result Capsule Networks are more resilient to errors during dynamic routing than other stages.
High error rates improve neural network performance and reduce power consumption.
problem Training neural networks with high Bit Error Rates (BERs).
method Trained three Binarized Convolutional Neural Network architectures on various datasets with high BERs.
result High BERs do not significantly degrade test accuracy, enabling more efficient hardware.
Mitigates faults in DNNs by clipping activation values, improving their resilience.
problem Fault tolerance of DNNs in safety-critical applications.
method Clipping activation functions to reduce impact of faulty weights.
result Significant improvement in classification accuracy (68.92%) for fault mitigation.
HarDNN detects and protects CNNs from hardware errors.
problem Hardware errors in CNNs can corrupt inference output.
method Statistical error injection and heuristic vulnerability assessment.
result HarDNN improves CNN resilience with minimal additional computation.
Ranger improves DNNs' fault resilience without re-computation.
problem Transient faults in DNNs cause errors, reducing reliability.
method Range restriction to transform critical faults to benign faults.
result Significant improvement in error resilience (3x to 50x) with no accuracy loss.
Improved deep neural network generalization through noise resilience.
problem Understanding and predicting generalization error of deep neural networks.
method Noise resilience measures to predict generalization error.
result Secured 5th position in the PGDL competition at NeurIPS 2020.
TensorFI injects faults in TensorFlow programs to assess their reliability.
problem Ensuring reliability of machine learning systems in safety-critical domains.
method TensorFI is a flexible fault injection framework for TensorFlow applications.
result TensorFI evaluates the resilience of 12 ML programs, including autonomous vehicle DNNs.
This paper evaluates how well outlier detection methods work with samples of data.
problem Resilience of outlier detection methods to sampling.
method Estimating resilience to sampling of outlier detection methods and their ensembles.
result Outlier detection methods are not equally resilient to sampling, and careful selection of sampling scheme and method is necessary.
BRIDGE improves decentralized learning resilience against Byzantine failures.
problem Decentralized learning in distributed systems is vulnerable to Byzantine failures.
method Introduces BRIDGE, a scalable Byzantine-resilient decentralized gradient descent algorithm.
result Proves algorithmic and statistical convergence guarantees for BRIDGE.
This study proposes hidden state curiosity to enhance RL models' resilience against noise.
problem Curiosity traps in RL models distract agents from discovering novel experiences.
method Proposed hidden state curiosity based on the Free Energy Principle to reward agents for KL divergence between predictive priors and posteriors.
result Agents with hidden state curiosity are more resilient against curiosity traps compared to those with prediction error curiosity.
The intrinsic error tolerance of neural network (NN) makes approximate computing a promising technique to improve the energy efficiency of NN inference. Conventional approximate computing focuses on balancing the efficiency-accuracy trade-off for existing pre-trained networks, which can lead to suboptimal solutions. In…
WAEs offer a statistical understanding of density estimation and error bounds.
problem Concurrent density estimation with neural network-induced transformations.
method Statistical analysis of WAEs focusing on upper bounds and error propagation.
result Established deterministic upper bounds on WAE errors and explored their resilience.
Paper introduces a new index to measure financial and workplace resilience of firms.
problem Corporate resilience and its types in turbulent markets.
method Quantitative analysis of earnings expectations and implied discount rates.
result Evidence of workplace resilience amplification by financial status in the COVID-19 era.
We provide a methodology, resilient feature engineering, for creating adversarially resilient classifiers. According to existing work, adversarial attacks identify weakly correlated or non-predictive features learned by the classifier during training and design the adversarial noise to utilize these features. Therefore…
Measures financial resilience using BSDEs and their properties.
problem Measuring financial resilience in dynamic risk environments.
method Developed stochastic calculus for BSDEs with jumps, revealing resilience rate as expectation of generator.
result Resilience rate can be represented as expectation of BSDE generator, revealing properties of dynamic risk measures.
Generalizes robust statistics to various perturbations under Wasserstein distance.
problem Robust statistics for datasets corrupted by various perturbations.
method Generalizes robust statistics to any Wasserstein distance, showing robust estimation under certain perturbations.
result Generalized resilience property holds under moment or hypercontractive conditions, simplifying and improving known results.
Python tool assesses European agricultural production resilience.
problem Estimating resilience of European agricultural production systems.
method Python software to compute annual production resilience indicator.
result Demonstrates resilience of European agricultural production.
This paper measures financial market resilience in China and identifies key uncertainties.
problem Measuring financial market resilience in China.
method Quantitative analysis of total financial market and sub-markets, Diebold-Yilmaz connectedness approach.
result Financial market resilience in China is event-driven and influenced by geopolitical risks, economic and trade policy uncertainty, and U.S.-China tensions.
The resilience of low-degree Rademacher chaos is studied, providing probabilistic lower bounds.
problem Understanding how much a Rademacher chaos can withstand adversarial sign-flips without significant probability changes.
method Probabilistic lower-bound guarantees for the resilience of Rademacher chaos of arbitrary degree.
result Probabilistic lower-bound guarantees for the resilience of Rademacher chaos of arbitrary degree, especially meaningful for constant degree.
COMRADE is a communication-efficient, Byzantine-resilient second-order optimization algorithm.
problem Byzantine failures in distributed optimization.
method COMRADE is a communication-efficient, second-order optimization algorithm that uses a simple norm-based thresholding rule to filter out Byzantine workers.
result COMRADE achieves linear-quadratic convergence and is robust against Byzantine workers.
Noise-resilient optimization on noisy quantum computers.
problem Noise's impact on hybrid quantum-classical optimization.
method Iterative quantum circuit with noise consideration, using Quantum Fisher Information bound.
result Algorithm robustness against different noise strengths.
New model shows negative resilience can improve trading efficiency.
problem Optimal trade execution in limit order books with negative resilience.
method Stochastic order book model with negative resilience.
result Negative resilience can lead to more efficient trading.
Proposes resilience metrics for large blackout costs with logarithmic resilience.
problem Large variations in blackout costs make estimating risk impractical.
method Uses mean of log of large blackout costs, tail slope index, and frequency.
result Solves problems of heavy tail and large variations in blackout costs.
Stocks of more resilient firms outperformed during the pandemic, reflecting disaster risk.
problem The impact of social distancing on firms' operations and stock performance.
method Cross-sectional analysis of firms' resilience and stock performance, controlling for risk factors.
result Stocks of more resilient firms are expected to yield significantly lower returns than less resilient ones, reflecting disaster risk.
Financial markets can be seen as complex systems that are constantly evolving and sensitive to external disturbance, such as systemic risks and economic instabilities. Analysis of resilient market performance, therefore, becomes useful for investors. From a systems perspective, this paper proposes a novel function-base…
ResiliNet improves distributed neural network inference resilience.
problem Physical node failures in distributed neural networks cause performance drops.
method Skip hyperconnection and failout technique.
result ResiliNet provides inference resiliency for distributed neural networks.
Paper benchmarks DRL policies' resilience to state transitions.
problem Measuring DRL policies' resilience to state perturbations.
method Disentangled representation learning and RL-based techniques.
result Demonstrated feasibility of resilience benchmarking in DQN, A2C, and PPO2.
New method quantifies resilience of electric distribution systems from historical data.
problem Large blackouts caused by extreme winds have significant costs and impacts.
method Formulate large event risk from utility outage data, quantify resilience improvements through investments.
result Investments in wind hardening and faster restoration can reduce the probability of large cost events.
New framework for resilient bi-criteria optimization under noisy feedback.
problem Bi-criteria combinatorial optimization with noisy function evaluations.
method Introducing (α,β,δ,extttN)-resilience and developing a black-box framework. result Achieves sublinear regret and constraint violation for bi-criteria bandit problems.
Paper tackles Byzantine resilience in distributed multi-task learning.
problem Resilience of distributed algorithms in the presence of Byzantine agents.
method Online weight assignment rule based on accumulated loss and filtering.
result Aggregation with proposed weight assignment rule improves expected regret.
In many applications, different populations are compared using data that are sampled in a biased manner. Under sampling biases, standard methods that estimate the difference between the population means yield unreliable inferences. Here we develop an inference method that is resilient to sampling biases and is able to …
This paper uses robust optimization to analyze supply chain resilience.
problem Supply chain resilience analysis of multi-modal logistics networks.
method Robust optimization with budget-of-uncertainty.
result Interactive effects of network size, disruption scale, and degree on resilience.
Small stocks drive market crashes by suppressing resilience.
problem The single-security price limit exacerbates market panic during crashes.
method Simplified dynamic model on networks of investors and stocks, empirical verification.
result Unexpected linear association between price limit and critical market confidence.
Byrd-SAGA reduces variance to robustify SGD against Byzantine attacks.
problem Learning over networks with malicious Byzantine attacks.
method Byrd-SAGA uses geometric median for robust aggregation of corrected stochastic gradients.
result Byrd-SAGA achieves provably linear convergence to optimal solution in the presence of Byzantine workers.
CyBeR-0 optimizes federated learning with Byzantine resilience and reduced communication costs.
problem Byzantine attacks and communication inefficiency in federated learning.
method Transformed robust aggregation for zero-order optimization under client heterogeneity.
result CyBeR-0 achieves stable performance with minimal communication costs and reduced memory usage.
Firms' collaboration networks can decline but remain resilient.
problem Resilience of firms' collaboration networks during decline.
method Analysis of 21,500 R&D collaborations over 25 years, simulating drop-out cascades.
result Firms' collaboration networks can adapt to mitigate decline and recover.
We present a large-scale study of commonality in liquidity and resilience across assets in an ultra high-frequency (millisecond-timestamped) Limit Order Book (LOB) dataset from a pan-European electronic equity trading facility. We first show that extant work in quantifying liquidity commonality through the degree of ex…
Study reveals clusters of resilient and vulnerable Spanish agri-food firms post-Ukraine-Russia war.
problem Financial resilience of agri-food companies in Spain during the Ukraine-Russia conflict.
method Cluster analysis using centred log-ratios for compositional data of financial ratios.
result Increase in resilient firms by 2023, highlighting sectoral adaptation to economic challenges.
New framework boosts neural network performance and resilience.
problem Susceptibility of compact neural network implementations to system disturbances.
method Realistic crossbar simulations and Mosaics framework to re-use synaptic connections.
result Compact neural networks are noise-immune and perform well under disturbances.
We show that wealth processes in the block-shaped order book model of Obizhaeva/Wang converge to their counterparts in the reduced-form model proposed by Almgren/Chriss, as the resilience of the order book tends to infinity. As an application of this limit theorem, we explain how to reduce portfolio choice in highly-re…
This paper defines resilience in knowledge graph embeddings and surveys existing works.
problem Challenges in knowledge graph embedding models, including noise, missing information, distribution shift, and adversarial attacks.
method Unified definition of resilience, formalization in the context of knowledge graphs, systematic survey of existing works.
result Most existing works focus on robustness, leaving other aspects of resilience unexplored.
Supply chain resilience depends on balancing competition and self-interest.
problem Maintaining resilience in decentralized supply chains under uncertainty and competition.
method Modeling competitive suppliers and retailers with yield uncertainty and congestion, analyzing network formation.
result Decentralized supply chains can form resilient networks through competition and self-interest, contrary to intuition.
Study finds ESG investments more resilient than traditional equity indices during market turmoil.
problem Resilience of ESG investments during financial instability.
method Daily returns analysis using MGND and EGARCH-in-mean models.
result ESG investments show higher resilience compared to traditional equity indices during crises.
Global catastrophe risk pools increase financial resilience by diversifying risk and including more countries.
problem Low- to middle-income countries rely heavily on foreign aid for recovery from extreme weather events, which is slow and uncertain.
method Developed a method to form global catastrophe risk pools that maximize risk diversification and select countries with low bilateral correlations or low shares in the pool risk.
result Global pooling increases risk diversification, lowers countries' shares in the pool risk, and increases the number of countries benefiting from risk pooling.
Build accurate DNN models requires training on large labeled, context specific datasets, especially those matching the target scenario. We believe advances in wireless localization, working in unison with cameras, can produce automated annotation of targets on images and videos captured in the wild. Using pedestrian an…
Boosting is known to be sensitive to label noise. We studied two approaches to improve AdaBoost's robustness against labelling errors. One is to employ a label-noise robust classifier as a base learner, while the other is to modify the AdaBoost algorithm to be more robust. Empirical evaluation shows that a committee of…
Proposes Stochastic-Sign SGD for federated learning with theoretical guarantees.
problem Developing efficient, private, and resilient parameter estimation methods for federated learning.
method Introduces Stochastic-Sign SGD, a novel method based on SIGNSGD, which addresses convergence and communication efficiency.
result Demonstrates the effectiveness of Stochastic-Sign SGD through experiments on MNIST and CIFAR-10 datasets.