Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

18355370 · Jun 202019922001200920172026
48 results for 2D CNNs

Theoretical analysis of CNNs' inductive biases and their efficiency in approximating functions.

problem Understanding and optimizing the inductive biases in deep CNNs.
method Theoretical analysis combining multichanneling, downsampling, weight sharing, and locality.
result Deep CNNs with O(logd)\mathcal{O}(\log d) depth can approximate any continuous function, and require O~(log2d)\widetilde{\mathcal{O}}(\log^2d) samples for sparse functions.

CNN detects phase transitions in Potts models without prior knowledge.

problem Detecting phase transitions in qq-state Potts models using deep learning.
method Trained a deep CNN on Ising model spin configurations and temperatures, then tested on Potts model images.
result Deep CNN accurately detects phase transitions in Potts models, including high- and low-temperature regions.

We propose an extension of Convolutional Neural Networks (CNNs) to graph-structured data, including strided convolutions and data augmentation on graphs. Our method matches the accuracy of state-of-the-art CNNs when applied on images, without any prior about their 2D regular structure. On fMRI data, we obtain a signifi…

2018-02-27abs ↗pdf ↗

The paper analyzes deep ReLU CNNs' approximation properties in 2D space.

problem Establishing L2L^2 approximation properties for deep ReLU CNNs.
method Analysis based on decomposition theorem for convolutional kernels, properties of ReLU activation, and connections with one-hidden-layer ReLU NNs.
result Universal approximation theorem for deep ReLU CNNs with classic structure.

Autonomous driving requires 3D perception of vehicles and other objects in the in environment. Much of the current methods support 2D vehicle detection. This paper proposes a flexible pipeline to adopt any 2D detection network and fuse it with a 3D point cloud to generate 3D information with minimum changes of the 2D d…

2018-02-12abs ↗pdf ↗

Fully Convolutional Neural Networks (F-CNNs) achieve state-of-the-art performance for segmentation tasks in computer vision and medical imaging. Recently, computational blocks termed squeeze and excitation (SE) have been introduced to recalibrate F-CNN feature maps both channel- and spatial-wise, boosting segmentation …

2020-02-25abs ↗pdf ↗

CNN improves neutrino event reconstruction in IceCube DeepCore.

problem Difficulties in distinguishing muon neutrinos and reconstructing inelasticity at GeV scale energies.
method 2D Convolutional Neural Network exploiting time and depth translational symmetry.
result CNN model outperforms conventional methods for flavor identification and inelasticity reconstruction.

Symmetric CNNs improve sequential recommendation and protein structure prediction.

problem Improving prediction accuracy in sequential recommendation and protein structure inference.
method Developed a CNN architecture that preserves symmetry in convolutional layers, using parameterized convolutional kernels.
result Symmetric structured CNNs achieve better performance with fewer parameters.

Achieving superhuman playing level by AlphaGo corroborated the capabilities of convolutional neural architectures (CNNs) for capturing complex spatial patterns. This result was to a great extent due to several analogies between Go board states and 2D images CNNs have been designed for, in particular translational invar…

2017-11-17abs ↗pdf ↗

JigsawHSI improves land-use classification using hyperspectral images.

problem Land-use land-cover classification in hyperspectral images.
method Convolutional Neural Network (CNN) tailored for geoscientific analysis, using Jigsaw architecture.
result JigsawHSI achieves state-of-the-art performance in land-use classification.

Performance of neural networks can be significantly improved by encoding known invariance for particular tasks. Many image classification tasks, such as those related to cellular imaging, exhibit invariance to rotation. We present a novel scheme using the magnitude response of the 2D-discrete-Fourier transform (2D-DFT)…

2018-05-31abs ↗pdf ↗

Convolutional Neural Networks (CNNs) have become the method of choice for learning problems involving 2D planar images. However, a number of problems of recent interest have created a demand for models that can analyze spherical images. Examples include omnidirectional vision for drones, robots, and autonomous cars, mo…

2018-01-30abs ↗pdf ↗

Improved anti-cancer drug sensitivity prediction using REFINED CNN ensemble learning.

problem Challenges in predicting anti-cancer drug sensitivity for individual cell lines.
method Using REFINED CNN, which represents high-dimensional vectors as compact 2D images with spatial correlations, and building ensembles of these models.
result Ensemble approaches significantly improve drug sensitivity prediction performance compared to single models.

CNN layers with large norms are still robust to adversarial attacks.

problem Understanding the relationship between layer norms and adversarial robustness in CNNs.
method Theoretical analysis of 1\ell_1 and \ell_\infty norms, norm decay method, adversarial training frameworks.
result Adversarially robust CNNs can have comparable or larger layer norms than non-adversarially robust ones.

The past several years have seen both an explosion in the use of Convolutional Neural Networks (CNNs) and the design of accelerators to make CNN inference practical. In the architecture community, the lion share of effort has targeted CNN inference for image recognition. The closely related problem of video recognition…

2018-10-16abs ↗pdf ↗

Group convolutional neural networks (G-CNNs) can be used to improve classical CNNs by equipping them with the geometric structure of groups. Central in the success of G-CNNs is the lifting of feature maps to higher dimensional disentangled representations, in which data characteristics are effectively learned, geometri…

2019-09-26abs ↗pdf ↗

This paper proposes a principled information theoretic analysis of classification for deep neural network structures, e.g. convolutional neural networks (CNN). The output of convolutional filters is modeled as a random variable Y conditioned on the object class C and network filter bank F. The conditional entropy (CENT…

2017-11-29abs ↗pdf ↗

Global Navigation Satellite System (GNSS) signals are subject to different kinds of events causing significant errors in positioning. This work explores the application of Machine Learning (ML) methods of anomaly detection applied to GNSS receiver signals. More specifically, our study focuses on multipath contamination…

2019-11-06abs ↗pdf ↗

This research uses Siamese networks to identify partial mouse brain images from the Allen atlas.

problem Identifying precise mouse brain microscopy images from the Allen atlas.
method Siamese Networks with contrastive learning to find corresponding atlas plates for partial images.
result Siamese CNNs achieved 25% TOP-1 and 100% TOP-5 accuracy in identifying brain slices from the Allen atlas.

Split learning preserves privacy in 1D CNN models for detecting heart abnormalities.

problem Privacy leakage in 1D CNN models under split learning.
method Implemented and validated an 1D CNN model under split learning, applied privacy leakage mitigation techniques.
result Split learning alone is insufficient to maintain raw data privacy in 1D CNN models.

The random subspace method, known as the pillar of random forests, is good at making precise and robust predictions. However, there is not a straightforward way yet to combine it with deep learning. In this paper, we therefore propose Neural Random Subspace (NRS), a novel deep learning based random subspace method. In …

2019-11-18abs ↗pdf ↗

CNNs require fewer samples than LCNs and FCNs for image-based tasks due to locality and weight sharing.

problem Quantifying statistical benefits of locality and weight sharing in CNNs over LCNs and FCNs.
method Dynamic Signal Distribution (DSD) task and information theoretic tools.
result CNNs require fewer samples than LCNs and FCNs for image-based tasks.

Representation learning seeks to expose certain aspects of observed data in a learned representation that's amenable to downstream tasks like classification. For instance, a good representation for 2D images might be one that describes only global structure and discards information about detailed texture. In this paper…

2016-11-08abs ↗pdf ↗

In this paper, we present an acoustic scene classification framework based on a large-margin factorized convolutional neural network (CNN). We adopt the factorized CNN to learn the patterns in the time-frequency domain by factorizing the 2D kernel into two separate 1D kernels. The factorized kernel leads to learn the m…

2019-10-14abs ↗pdf ↗

Enhanced DQN model boosts trading performance with advanced techniques.

problem Improving automated trading performance in financial markets.
method Incorporation of Prioritized Experience Replay, Regularized Q-Learning, Noisy Networks, Dueling, Double DQN, and CNN architectures.
result Significantly improved returns and Sharpe Ratio compared to the original DQN model.