New algorithm eliminates symmetry requirement for training neural networks on resistive device arrays.
problem Training accuracy on resistive device arrays depends on device switching symmetry.
method Developed 'Tiki-Taka' algorithm to minimize unintentional cost term due to device asymmetry.
result Achieves same accuracy with non-symmetric devices as with symmetric devices.
In a previous work we have detailed the requirements to obtain a maximal performance benefit by implementing fully connected deep neural networks (DNN) in form of arrays of resistive devices for deep learning. This concept of Resistive Processing Unit (RPU) devices we extend here towards convolutional neural networks (…
High-speed model accurately simulates neuromorphic devices.
problem Accurately modeling stochastic synapses in large-scale neuromorphic systems.
method Generative vector autoregressive model based on resistive memory cell data.
result Fast, high-throughput model reproduces synaptic parameters and correlations.
In our previous work we have shown that resistive cross point devices, so called Resistive Processing Unit (RPU) devices, can provide significant power and speed benefits when training deep fully connected networks as well as convolutional neural networks. In this work, we further extend the RPU concept for training re…
Python scripts analyze MRAM-based neuromorphic devices' process variation impacts on machine learning accuracy.
problem Impact of process variation on MRAM-based neuromorphic devices' performance in machine learning applications.
method Developed transportable Python scripts to analyze output variation under changes in device dimensions.
result Revealed impacts and limits for processing variation of device fabrication on energy vs. accuracy tradeoffs.
TxSim models DNN training on resistive crossbars, improving accuracy and feasibility.
problem Non-idealities in resistive crossbar systems degrade DNN training accuracy.
method TxSim is a fast, customizable framework that models all training operations, reducing simulation time with minimal accuracy loss.
result TxSim reveals substantial (3%-10%) accuracy degradation due to non-idealities in large-scale DNNs.
One-step learning in crosspoint memory reduces computation time.
problem Real-time AI at the edge requires fast, low-energy computing.
method Crosspoint resistive memory with feedback configures linear and logistic regression.
result Linear and logistic regression can be computed in one step.
Novel CNN array for sign language recognition using wearable IMUs.
problem Efficiently recognizing sign language from wearable IMU signals.
method Two-dimensional Convolutional Neural Network array architecture for Indian sign language recognition.
result Peak classification accuracies of 94.20% for general sentences and 95.00% for interrogative sentences achieved.
Spatial separation of suspended particles based on contrast in their physical or chemical properties forms the basis of various biological assays performed on lab-on-achip devices. To electronically acquire this information, we have recently introduced a microfluidic sensing platform, called Microfluidic CODES, which c…
Improved accuracy in neural networks using CTF memory with RPU.
problem Challenges in achieving high accuracy in neural networks using in-memory computing.
method Exploring the trade-off between conductance change range and linearity in CTF memory for RPU-based matrix operations.
result Achieved accuracy of 97.9% on MNIST dataset, 89.1% and 70.5% on CIFAR-10 and CIFAR-100 datasets.
In recent years, deep neural networks (DNN) have demonstrated significant business impact in large scale analysis and classification tasks such as speech recognition, visual object detection, pattern extraction, etc. Training of large DNNs, however, is universally considered as time consuming and computationally intens…
RESIST improves decentralized learning resilience against MITM attacks.
problem Decentralized learning's vulnerability to MITM attacks.
method Multistep consensus gradient descent framework with robust statistics-based screening methods.
result Achieves algorithmic and statistical convergence for various ERM problems.
DNPUs improve neural network performance with high-capacity nanoelectronic nodes.
problem Limited performance of single DNPUs in solving complex classification problems.
method Developed DNPUs as high-capacity neurons and implemented multi-DNPU networks.
result Feed-forward DNPU networks improve single DNPU performance from 77% to 94% test accuracy.
In this paper, a spintronic neuromorphic reconfigurable Array (SNRA) is developed to fuse together power-efficient probabilistic and in-field programmable deterministic computing during both training and evaluation phases of restricted Boltzmann machines (RBMs). First, probabilistic spin logic devices are used to devel…
FDA3 defends IIoT applications against adversarial attacks by federating defense knowledge.
problem Adversarial attacks on DNNs in IIoT applications can cause devastating consequences.
method Federated learning approach to aggregate defense knowledge from different sources.
result FDA3 can resist more attacks than existing methods and prevent new attacks.
This paper approximates p-resistance for multi-class graph clustering.
problem Efficiently clustering graphs with p-Laplacian bias. method Developed an approximation to p-resistance for multi-class clustering. result Approximated p-resistance provides a computationally feasible alternative to p-Laplacian eigenvectors. Federated learning is protected against adversarial attacks with residual-based reweighting.
problem Adversarial attacks on federated learning's aggregation process.
method Residual-based reweighting combined with iteratively reweighted least squares.
result Our aggregation algorithm outperforms other methods in label-flipping and backdoor attacks.
FAL improves formation resistivity prediction from cased boreholes with noise resistance.
problem Noise and high-frequency disaster in predicting formation resistivity from cased boreholes.
method Frequency-aware framework and temporal anti-noise block for LSTM.
result FAL achieves a 24.3% improvement in R2 over LSTM, reaching R2=0.91.
Optimal trading strategy under market resistance and concave price impact model.
problem Optimal trading in a market with endogenous resistance and concave price impact.
method Modeling market resistance, deriving a stochastic Fredholm equation, proving existence and uniqueness, proposing an iterative scheme.
result Existence and uniqueness of optimal control under certain conditions, exponential convergence of iterative scheme.
Extends Newton's minimal resistance problem to Riemannian surfaces.
problem Minimal resistance on Riemannian surfaces.
method Derive resistance functional, analyze constrained minimization.
result Smooth extremals are loxodromes, global minimizers characterized.
Memory-augmented neural networks (MANNs) are designed for question-answering tasks. It is difficult to run a MANN effectively on accelerators designed for other neural networks (NNs), in particular on mobile devices, because MANNs require recurrent data paths and various types of operations related to external memory a…
New curvature defined via graph resistances leads to Ricci flow.
problem Defining curvature on graph edges for analysis.
method Introducing Ricci--Foster curvature based on effective resistances and studying Ricci flow.
result Existence of solutions to Ricci flow on short time intervals, preservation of nonnegative curvature.
New method calculates discrete curvature using effective resistances.
problem Calculating discrete curvature on graphs.
method Effective resistances to calculate curvature on graph nodes and links.
result Relation to established discrete curvatures and convergence to continuous curvature.
Bit-slice sparsity improves ReRAM-based DNN acceleration.
problem Limited ADC power and area constraints in ReRAM-based DNN accelerators.
method Proposed bit-slice L1 algorithm to induce sparsity during training.
result 2x sparsity improvement compared to previous methods.
Extends Newton's minimal resistance problem to Lorentz-Minkowski space.
problem Minimal resistance in Lorentz-Minkowski space.
method Derived functional energy, determined Euler-Lagrange equation, analyzed maximum principle, found separable and radial solutions.
result Obtained solutions with conical singularities at the origin and analyzed the Single Shock Condition.
Memristors have recently received significant attention as ubiquitous device-level components for building a novel generation of computing systems. These devices have many promising features, such as non-volatility, low power consumption, high density, and excellent scalability. The ability to control and modify biasin…
Developed causal chambers for AI validation, providing real-world data.
problem Limited real-world datasets for AI method validation.
method Created computer-controlled physical systems (causal chambers) to generate datasets.
result Demonstrated applications in various AI fields, validated causal models.
PoET-BiN reduces power consumption in neural networks on embedded devices.
problem Power inefficiency in neural network implementations on embedded platforms.
method Look-Up Table based implementation with a modified Decision Tree approach.
result Near state-of-the-art results with up to 6 orders of magnitude energy reduction.
Bayesian neural networks are compressed using feature and weight pruning based on posterior inclusion probabilities.
problem Efficiently compressing Bayesian neural networks to reduce computation cost and improve generalizability.
method Bayesian model selection principles are applied to obtain posterior inclusion probabilities for pruning and feature selection.
result Pruned models show better generalizability on simulated and real-world data.
A new method improves RVFL networks for resource-efficient machine learning.
problem Deploying machine learning on edge devices with limited resources.
method Density encoding and hyperdimensional computing operations.
result The proposed method achieves higher accuracy and lower energy consumption.
Proposes a new method to improve deep model security against adversarial deformations.
problem Deep neural networks' resistance to adversarial attacks, especially location perturbations.
method Regularizes flow gradients to provide a tighter bound and improve model resistance.
result Models trained with flow gradient regularization show better resistance to adversarial deformations compared to input gradient regularization and adversarial training.
The article deals with intrinsic metrics, Dirac operators and spectral triples induced by regular Dirichlet and resistance forms. We show, in particular, that if a local resistance form is given and the space is compact in resistance metric, then the intrinsic metric yields a geodesic space. Given a regular Dirichlet f…
Study predicts antimicrobial resistance in ICU patients quickly.
problem Delayed AMR testing in ICU leads to suboptimal treatment.
method Developed predictive models using clinical and microbiological data.
result Machine learning models predict AMR with higher accuracy than naive model.
Graph curvature measured by inverse resistance distance.
problem Defining and analyzing curvature in graphs.
method Defining curvature via inverse resistance distance and proving properties.
result Graphs with positive curvature have controlled diameter and spectral properties.
Improves magnetic field mapping using an array of magnetometers with noisy input.
problem Improving magnetic field maps in indoor environments with noisy magnetometer data.
method Uses Gaussian process regression with an array of magnetometers, incorporating known array positions and relative magnetometer locations.
result The method produces higher quality magnetic field maps compared to using a single magnetometer.
Simpler proof for non-basic sets in 2D.
problem Proving non-basic sets in 2D.
method Defining Sternfeld arrays and proving non-basic sets.
result Simpler proof of non-basic sets in 2D.
Paper explores robust regression methods and their bias-variance trade-off.
problem Understanding the trade-off between robust estimation and optimization methods.
method Examines traditional outlier-resistant robust estimation and robust optimization.
result Both methods follow converse strategies due to a bias-variance trade-off.
Paper improves DOA estimation in sparse arrays using Siamese neural networks.
problem Challenges in DOA estimation with limited snapshots in sparse linear arrays.
method Introduces a Siamese neural network with a sparse augmentation layer for enhanced signal feature embedding.
result Demonstrates improved DOA estimation accuracy in sparse arrays.
In natural hazard warning systems fast decision making is vital to avoid catastrophes. Decision making at the edge of a wireless sensor network promises fast response times but is limited by the availability of energy, data transfer speed, processing and memory constraints. In this work we present a realization of a wi…
Direction of arrival (DoA) estimation of targets improves with the number of elements employed by a phased array radar antenna. Since larger arrays have high associated cost, area and computational load, there is recent interest in thinning the antenna arrays without loss of far-field DoA accuracy. In this context, a c…
Physical activity levels are an important predictor of cardiovascular health and increasingly being measured by sensors, like accelerometers. Accelerometers produce rich multivariate data that can inform important clinical decisions related to individual patients and public health. The CHAMPION study, a study of youth …
A new framework enhances binaural audio for moving talkers.
problem Real-time binaural audio enhancement for moving sound sources.
method Mixture-of-experts framework combining multiple binaural filters.
result Dynamic spatial audio rendering adapts to moving talkers.
Post-quantum cryptography needed for blockchain security.
problem Quantum computers threaten traditional blockchain cryptography.
method Review of theoretical cryptography and quantum information theory.
result Post-quantum cryptography is essential for blockchain security.
Work addresses long-term accuracy issues in IoT air quality sensors.
problem Limited accuracy of IoT air quality sensors in long-term field deployments.
method Adaptive machine learning strategies for network calibration.
result Prolongs the validity of multisensor calibration models for continuous learning.
Antimicrobial resistance is an important public health concern that has implications in the practice of medicine worldwide. Accurately predicting resistance phenotypes from genome sequences shows great promise in promoting better use of antimicrobial agents, by determining which antibiotics are likely to be effective i…
The paper studies minimal resistance dynamics in radial fields, finding unique solutions for incompressible flows.
problem Nonlinear dynamics of minimal resistance in radial fields.
method Analysis of two non-equilibrium scenarios: scale-invariant free expansion and incompressible source flow.
result Incompressible flow acts as a structural regularizer, admitting unique, smooth, and strictly concave solutions.
Analog arrays are a promising upcoming hardware technology with the potential to drastically speed up deep learning. Their main advantage is that they compute matrix-vector products in constant time, irrespective of the size of the matrix. However, early convolution layers in ConvNets map very unfavorably onto analog a…
New method designs antimicrobial peptides with high potency and low toxicity.
problem Designing potent antimicrobial drugs with low toxicity.
method CLaSS method using deep generative autoencoder and atomistic simulations.
result Design and synthesis of two novel AMPs with high potency and low toxicity.