System for automatic differentiation in a functional array-processing language.
problem Efficient automatic differentiation in functional array languages.
method Automatic differentiation in a higher-order functional array-processing language with source-to-source support and global optimizations.
result The system outperforms state-of-the-art tools on machine learning and computer vision benchmarks.
Improves magnetic field mapping using an array of magnetometers with noisy input.
problem Improving magnetic field maps in indoor environments with noisy magnetometer data.
method Uses Gaussian process regression with an array of magnetometers, incorporating known array positions and relative magnetometer locations.
result The method produces higher quality magnetic field maps compared to using a single magnetometer.
Paper improves DOA estimation in sparse arrays using Siamese neural networks.
problem Challenges in DOA estimation with limited snapshots in sparse linear arrays.
method Introduces a Siamese neural network with a sparse augmentation layer for enhanced signal feature embedding.
result Demonstrates improved DOA estimation accuracy in sparse arrays.
Deep neural networks improve angle of arrival estimation with lower complexity.
problem Estimating the number of sources and their angles of arrival from a single antenna array observation.
method Apply a deep neural network (DNN) approach to the problem.
result Deep neural networks can attain maximum likelihood performance with feasible complexity and outperform other methods.
This paper proposes a learning framework for n-bit quantized neural networks that improves accuracy and speed on FPGAs.
problem Efficiently implementing quantized neural networks on FPGAs to maintain accuracy and speed.
method A novel learning framework for n-bit QNNs, constrained weights, reconstructed gradient function, n-BQ-NN structure, and SVPE array.
result Quantized models achieve almost the same accuracy as full-precision models and outperform typical low-precision QNNs.
Stochastic partition models tailor a product space into a number of rectangular regions such that the data within each region exhibit certain types of homogeneity. Due to constraints of partition strategy, existing models may cause unnecessary dissections in sparse regions when fitting data in dense regions. To allevia…
A neural network, IHT-Net, improves DOA estimation with sparse arrays.
problem Single-snapshot DOA estimation with sparse arrays in dynamic settings.
method IHT-inspired neural network with recurrent neural network and autoencoders.
result IHT-Net achieves faster convergence and higher accuracy in DOA estimation.
Infinite Tucker Decomposition (InfTucker) and random function prior models, as nonparametric Bayesian models on infinite exchangeable arrays, are more powerful models than widely-used multilinear factorization methods including Tucker and PARAFAC decomposition, (partly) due to their capability of modeling nonlinear rel…
Robust STAP with coprime arrays reduces clutter using sparse modeling.
problem Limited performance due to training samples support in practical applications.
method Two-stage approach: 1) RD virtual snapshot, 2) RD sparse measurement modeling with OMP-like recovery.
result Robust to prior knowledge errors, good clutter suppression performance.
Anomaly detection is one of the frequent and important subroutines deployed in large-scale data processing systems. Even being a well-studied topic, existing techniques for unsupervised anomaly detection require storing significant amounts of data, which is prohibitive from memory and latency perspective. In the big-da…
Developing a visual platform for faster astronomical source cataloging.
problem Speeding up cataloging of large area surveys in radio astronomy.
method Integration of advanced source finding and classification tools into a visual analytic platform.
result Improvement and acceleration of cataloging process in astronomical surveys.
Analog arrays speed up ConvNets by parallelizing kernel matrix training.
problem Early ConvNets struggle with analog arrays due to small kernel matrices.
method Replicate kernel matrix on multiple analog arrays, training in parallel.
result Analog arrays achieve high acceleration factors (16-128) for ConvNets.
The natural habitat of most Bayesian methods is data represented by exchangeable sequences of observations, for which de Finetti's theorem provides the theoretical foundation. Dirichlet process clustering, Gaussian process regression, and many other parametric and nonparametric Bayesian models fall within the remit of …
Simpler proof for non-basic sets in 2D.
problem Proving non-basic sets in 2D.
method Defining Sternfeld arrays and proving non-basic sets.
result Simpler proof of non-basic sets in 2D.
Direction of arrival (DoA) estimation of targets improves with the number of elements employed by a phased array radar antenna. Since larger arrays have high associated cost, area and computational load, there is recent interest in thinning the antenna arrays without loss of far-field DoA accuracy. In this context, a c…
Novel CNN array for sign language recognition using wearable IMUs.
problem Efficiently recognizing sign language from wearable IMU signals.
method Two-dimensional Convolutional Neural Network array architecture for Indian sign language recognition.
result Peak classification accuracies of 94.20% for general sentences and 95.00% for interrogative sentences achieved.
The CHAMPION study clusters multi-dimensional accelerometer data to understand health links.
problem Clustering multi-dimensional data from pediatric longitudinal studies.
method Developed a finite mixture of multidimensional arrays model for clustering 4-dimensional accelerometer data.
result Demonstrated the feasibility and utility of clustering higher order data.
In a previous work we have detailed the requirements to obtain a maximal performance benefit by implementing fully connected deep neural networks (DNN) in form of arrays of resistive devices for deep learning. This concept of Resistive Processing Unit (RPU) devices we extend here towards convolutional neural networks (…
A hardware-based reservoir computing system predicts time series with high speed and accuracy.
problem Processing time-dependent signals with high speed and accuracy.
method A hardware-based reservoir computing system using a field-programmable gate array (FPGA) for both the reservoir and output layers.
result Achieves comparable accuracy to software approaches but with a superior real-time prediction rate up to 160 MHz.
DNPUs improve neural network performance with high-capacity nanoelectronic nodes.
problem Limited performance of single DNPUs in solving complex classification problems.
method Developed DNPUs as high-capacity neurons and implemented multi-DNPU networks.
result Feed-forward DNPU networks improve single DNPU performance from 77% to 94% test accuracy.
Independent component analysis (ICA) has become a standard data analysis technique applied to an array of problems in signal processing and machine learning. This tutorial provides an introduction to ICA based on linear algebra formulating an intuition for ICA from first principles. The goal of this tutorial is to prov…
Accumulation of standardized data collections is opening up novel opportunities for holistic characterization of genome function. The limited scalability of current preprocessing techniques has, however, formed a bottleneck for full utilization of contemporary microarray collections. While short oligonucleotide arrays …
New algorithm eliminates symmetry requirement for training neural networks on resistive device arrays.
problem Training accuracy on resistive device arrays depends on device switching symmetry.
method Developed 'Tiki-Taka' algorithm to minimize unintentional cost term due to device asymmetry.
result Achieves same accuracy with non-symmetric devices as with symmetric devices.
Bayesian Empirical Bayes extends EB to complex structures using probabilistic symmetry.
problem Improving simultaneous inference in complex settings like arrays and graphs.
method Generalized empirical Bayes approach based on probabilistic symmetry.
result BEB outperforms existing methods in denoising arrays and spatial data.
This paper improves neural network efficiency by combining filter columns and retraining, boosting array utilization and accuracy.
problem Efficient implementation of sparse convolutional neural networks on systolic arrays.
method Column combining of filter matrices, retraining of remaining weights, joint optimization for high utilization and accuracy.
result Significantly increased systolic array utilization efficiency (e.g., ~4x) and maintained high classification accuracy.
Deep RL learns to play Pong from frames alone.
problem Scaling up RL problems leads to computational bottlenecks.
method End-to-end DRL approach using ANN and Policy Gradients.
result Successfully learned to play Pong from frames.
Missing data is an important challenge when dealing with high dimensional data arranged in the form of an array. In this paper, we propose methods for estimation of the parameters of array variate normal probability model from partially observed multiway data. The methods developed here are useful for missing data impu…
Tensors or {\em multi-way arrays} are functions of three or more indices (i,j,k,⋯) -- similar to matrices (two-way arrays), which are functions of two indices (r,c) for (row,column). Tensors have a rich history, stretching over almost a century, and touching upon numerous disciplines; but they have only recent…
The study examines convergence of stochastic processes on large graphs and adjacency matrices.
problem Analyzing convergence of stochastic processes on large graphs and adjacency matrices.
method Introduced new metrics on the space of measure-valued graphons and used them to show convergence of random trajectories to deterministic curves.
result The Metropolis chain converges to a deterministic gradient flow curve on the space of graphons under certain conditions.
RCNPs extend equivariant neural processes to higher dimensions, improving performance on tasks with inherent symmetries.
problem Inherently equivariant tasks in spatio-temporal modeling, Bayesian Optimization, and continuous control.
method Relational Conditional Neural Processes (RCNPs) that extend equivariances to higher dimensions.
result Empirically competitive performance on tasks with equivariances.
Myia compiler optimizes ML models with efficient AD for array programming.
problem Efficient automatic differentiation for array programming in ML.
method Introduces a new graph-based IR that supports function calls, higher-order functions, and recursion.
result Myia compiler enables efficient AD using source transformation without a tape, supporting higher-order derivatives.
New algorithms improve direction finding using prior signal knowledge.
problem Efficiently estimate signal direction from sensor data.
method Multi-step knowledge-aided iterative conjugate gradient algorithms.
result MS-KAI-CG algorithms outperform existing techniques in simulations.
Method uses deep learning to estimate traffic intensity.
problem Estimating stochastic intensity of traffic processes.
method Deep neural networks for nonlinear filtering.
result Deep learning method accurately estimates traffic intensity.
Tangent automates derivatives in Python, improving expressiveness and performance.
problem Efficiently calculating derivatives for complex models in Python.
method Source-code transformation for dynamically typed array programming.
result Demonstrates improved expressiveness and performance in automatic differentiation.
Researchers show NN-based communication algorithms can be implemented on hardware without significant performance loss.
problem Reducing complexity and improving performance of NN-based communication algorithms for practical hardware implementation.
method Implementation of NN-based algorithms in fixed-point arithmetic with quantized weights on specialized hardware (FPGAs, ASICs).
result It is possible to implement NN-based algorithms in fixed-point arithmetic with quantized weights on hardware without significant performance loss.
Paper proposes a learning-based sparse Bayesian method for accurate off-grid DOA estimation.
problem One-bit off-grid direction of arrival (DOA) estimation in a single snapshot scenario.
method Formulated off-grid DOA estimation model, used Sparse Bayesian framework, proposed Learning-based Sparse Bayesian approach.
result Improved computational efficiency and accuracy in off-grid DOA estimation.
High-speed model accurately simulates neuromorphic devices.
problem Accurately modeling stochastic synapses in large-scale neuromorphic systems.
method Generative vector autoregressive model based on resistive memory cell data.
result Fast, high-throughput model reproduces synaptic parameters and correlations.
We augment the nonnegative matrix factorization method for audio source separation with cues about directionality of sound propagation. This improves separation quality greatly and removes the need for training data, with only a twofold increase in run time. This is the first method which can exploit directional inform…
NLM combines neural networks and logic programming for complex reasoning.
problem Complex reasoning tasks involving logic and properties.
method Neural-symbolic architecture combining neural networks and logic programming.
result NLM achieves perfect generalization on various tasks.
This article establishes the performance of stochastic blockmodels in addressing the co-clustering problem of partitioning a binary array into subsets, assuming only that the data are generated by a nonparametric process satisfying the condition of separate exchangeability. We provide oracle inequalities with rate of c…
We consider two eigenvalue problems for Laplacian on some specific doubly connected domain. In particular, we study the following two eigenvalue problems. Let B1 be an open ball in Rn and B0 be a ball contained in B1. Let ν be the outward unit normal on ∂B1. Then the first eigenvalue o…
Improved DOA estimation with distributed sensors across multiple frequencies.
problem Sensor gain uncertainties and directional perturbations in multi-frequency scenarios.
method Distributed optimization with local coherence models and iterative exchange of information.
result Advantages in statistical and computational efficiency through parallel iterative technique.
An array system of coupled maps is proposed as a model for economy evolution. The local dynamics of each map or agent is controlled by two parameters. One of them represents the growth capacity of the agent and the other one is a control term representing the local environmental pressure which avoids an exponential gro…
Two novel search strategies reduce complexity for target localization with size-dependent noise.
problem Target localization with varying measurement noise based on query region size.
method Proposes dyaPM and hiePM strategies with low complexity and connected query geometry. result Unified analysis shows dyaPM asymptotically optimal in search time, hiePM near-optimal in rate. Classifies compact radio sources in the Galactic plane using machine learning.
problem Challenges in processing large volumes of radio continuum survey data.
method Produced a curated dataset of ~20,000 images, trained two classifiers: gradient-boosted decision trees and convolutional neural networks.
result High classification accuracy (F1-score>90%) for separating Galactic objects from the extragalactic background.
In this paper we prove the following geometric inequality in the hyperbolic space $\H^n$ (n≥5), which is a hyperbolic Alexandrov-Fenchel inequality, \[\begin{array}{rcl} \ds \int_Σ\s_4 d μ\ge \ds\vs C_{n-1}^4ω_{n-1}\left\{\left(\frac{|Σ|}{ω_{n-1}} \right)^\frac 12 + \left(\frac{|Σ|}{ω_{n-1}} \right)^{\frac 12\frac…
The paper proves existence of solutions for mean field equations on compact Riemann surfaces.
problem Existence of solutions for mean field equations on compact Riemann surfaces.
method Min-max scheme introduced by Djadli-Malchiodi (2006) and Djadli (2008).
result Proves existence of solutions for mean field equations on compact Riemann surfaces.
Tensor analysis tackles complex multidimensional data across fields.
problem Efficiently extracting information from high-dimensional data.
method Interdisciplinary approach combining statistics, optimization, and numerical linear algebra.
result Significant progress in tensor analysis over the last decade.