Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

2835668481,131 · Jun 202019922001200920172026
48 results for deep & cross network

DCN-V2 improves deep & cross network for web-scale learning to rank systems.

problem Efficiently learning feature interactions in large-scale recommender systems.
method Proposes DCN-V2, an improved framework for deep & cross network learning.
result DCN-V2 outperforms state-of-the-art algorithms on benchmark datasets.

Many studies have been undertaken by using machine learning techniques, including neural networks, to predict stock returns. Recently, a method known as deep learning, which achieves high performance mainly in image recognition and speech recognition, has attracted attention in the machine learning field. This paper im…

2018-01-03abs ↗pdf ↗

Proposes a method to solve deep neural networks' local minimum problem.

problem Local minimum problem in deep neural networks training.
method Transforms cross-entropy loss into risk-averse error criterion, adjusts RSI, and uses convexity region.
result Trained deep learning machine is expected to be inside a global minimum's attraction basin.

As a highlighting research topic in the multimedia area, cross-media retrieval aims to capture the complex correlations among multiple media types. Learning better shared representation and distance metric for multimedia data is important to boost the cross-media retrieval. Motivated by the strong ability of deep neura…

2017-04-14abs ↗pdf ↗

Hopfield networks outperform deep-learning methods in portfolio optimization.

problem Optimizing portfolios and managing asset allocation efficiently.
method Application of Hopfield networks to portfolio optimization, using combinatorial purged cross-validation.
result Modern Hopfield Networks perform on par or better than deep-learning methods, with faster training times and better stability.

Feature engineering has been the key to the success of many prediction models. However, the process is non-trivial and often requires manual feature engineering or exhaustive searching. DNNs are able to automatically learn feature interactions; however, they generate all the interactions implicitly, and are not necessa…

2017-08-17abs ↗pdf ↗

This paper shows using classification instead of regression improves deep RL scalability.

problem Challenges in training value functions for large networks in deep RL.
method Used categorical cross-entropy loss instead of mean squared error regression.
result Significant improvements in performance and scalability across various domains.

Cross-Domain Collaborative Filtering (CDCF) provides a way to alleviate data sparsity and cold-start problems present in recommendation systems by exploiting the knowledge from related domains. Existing CDCF models are either based on matrix factorization or deep neural networks. Either of the techniques in isolation m…

2019-07-19abs ↗pdf ↗

Proposes a deep learning model for timely and accurate recommendations.

problem Inability to provide timely recommendations and ranking issues with implicit feedback.
method Unified cross-network solution using listwise ranking for implicit data.
result Superior performance in accuracy, novelty, and diversity compared to baselines.

We introduce deep scale-spaces (DSS), a generalization of convolutional neural networks, exploiting the scale symmetry structure of conventional image recognition tasks. Put plainly, the class of an image is invariant to the scale at which it is viewed. We construct scale equivariant cross-correlations based on a princ…

2019-05-28abs ↗pdf ↗

As the success of deep learning reaches more grounds, one would like to also envision the potential limits of deep learning. This paper gives a first set of results proving that certain deep learning algorithms fail at learning certain efficiently learnable functions. The results put forward a notion of cross-predictab…

2018-12-16abs ↗pdf ↗

The cross-domain recommendation technique is an effective way of alleviating the data sparse issue in recommender systems by leveraging the knowledge from relevant domains. Transfer learning is a class of algorithms underlying these techniques. In this paper, we propose a novel transfer learning approach for cross-doma…

2018-04-18abs ↗pdf ↗

We introduce the HSIC (Hilbert-Schmidt independence criterion) bottleneck for training deep neural networks. The HSIC bottleneck is an alternative to the conventional cross-entropy loss and backpropagation that has a number of distinct advantages. It mitigates exploding and vanishing gradients, resulting in the ability…

2019-08-05abs ↗pdf ↗

Adam achieves optimal convergence in deep ReLU networks via novel Kakeya bounds.

problem Training deep ReLU networks using Adam in non-smooth settings.
method Stratified Morse theory and Kakeya bounds to analyze region crossings and convergence.
result First global-optimal convergence for Adam in non-smooth, non-convex ReLU landscapes.

Predict stock movement by considering cross effects among stocks.

problem Challenges in predicting stock price movement due to cross effects among stocks.
method Multi-GCGRU framework combining GCN and GRU, encoding cross effects from financial domain knowledge and data-driven relationships.
result Our model outperforms other baselines in predicting stock movement.

This paper investigates the impact of normalization on deep neural networks for click-through rate prediction.

problem The effect of normalization on deep neural network models for CTR estimation.
method Systematic study of various normalization approaches applied to feature embedding and MLP part of DNN models.
result Correct normalization significantly enhances model performance, as demonstrated by extensive experiments on real-world datasets.

This paper improves image super-resolution by integrating cross-scale non-local attention.

problem Improving image super-resolution by leveraging long-range and cross-scale feature correlations.
method Proposes a Cross-Scale Non-Local (CS-NL) attention module integrated into a recurrent neural network.
result Significantly improved performance on SISR benchmarks.

Pipeline integrates cross-sectional and longitudinal multi-omics data for IBD research.

problem Integrating diverse data types from the same individuals for disease understanding.
method Statistical and deep learning methods for variable selection, feature extraction, and joint integration.
result Identified microbial pathways, metabolites, and genes discriminating IBD status.

Researchers propose better probabilistic models for deep learning.

problem Using cross-entropy loss for non-categorical data.
method Introducing continuous-categorical distribution and proposing probabilistic alternatives.
result Potential for outperformance in deep learning models with proper probabilistic treatment.

XMixup improves transfer learning accuracy by 1.9% with less training time.

problem Efficiently transfer knowledge from large source datasets to target tasks with small samples.
method Cross-domain Mixup technique that selects auxiliary samples from source datasets and augments training samples via mixup strategy.
result Improves accuracy by 1.9% on average over six real-world transfer learning datasets.

In recent years, there have been numerous developments towards solving multimodal tasks, aiming to learn a stronger representation than through a single modality. Certain aspects of the data can be particularly useful in this case - for example, correlations in the space or time domain across modalities - but should be…

2017-09-02abs ↗pdf ↗

DHEN improves CVR prediction for ads with multitask learning and auxiliary loss.

problem Predicting conversion rates in ad-recommendation systems.
method DHEN integrates multiple feature-crossing modules and uses a multitask learning framework, ablation studies, and self-supervised auxiliary loss.
result DHEN achieves state-of-the-art performance in CVR prediction.

FuncNN package enables deep learning with functional covariates.

problem Lack of software for deep learning with functional covariates.
method Developed an R package using keras architecture, introducing functions for model building, predictions, and cross-validation.
result First package for deep learning with functional covariates.

Deep learning detects APT attacks with high accuracy and low false positives.

problem Detecting Advanced Persistent Threat (APT) attacks in network traffic.
method Used C5.0 decision tree, Bayesian network, and 6-layer deep neural network models on NSL-KDD dataset.
result Deep learning model achieved 98.85% accuracy and 1.13 false positive rate.

This paper uses deep learning to detect money laundering in cross-border transactions.

problem Detecting money laundering in cross-border transactions is challenging due to complexity and scale.
method Unsupervised learning models, including CNNs and hybrid CNNGRU architectures, were tested for anomaly detection.
result Hybrid Convolutional-Recurrent Neural Integration Model (CRNIM) showed superior performance.

Optimizes tensor rank selection for neural network compression.

problem Finding optimal tensor rank for regression models.
method Analyzes population expressions for training-testing discrepancy under Gaussian design.
result Optimal rank minimizes prediction error and aligns with cross-validation.

MetFA aligns source and target domains for cross-device image classification.

problem Learning discriminative class boundaries across different domains.
method Distance metric guided feature alignment (MetFA) for domain-invariant and discriminative feature extraction.
result MetFA outperforms state-of-the-art methods in cross-device image classification.

Model compression has been widely adopted to obtain light-weighted deep neural networks. Most prevalent methods, however, require fine-tuning with sufficient training data to ensure accuracy, which could be challenged by privacy and security issues. As a compromise between privacy and performance, in this paper we inve…

2019-11-21abs ↗pdf ↗

EIDGM model estimates DE parameters from RCS data.

problem Estimating DE parameters from RCS data with heterogeneities.
method Physics-informed neural network emulator + Wasserstein GAN parameter generator.
result EIDGM accurately captures diverse parameter distributions.

CAggNet improves medical image segmentation by fusing coarse and fine features.

problem Medical image segmentation accuracy and efficiency.
method Crossing Aggregation Network with nested skip connections and weighted aggregation.
result CAggNet achieves more accurate and efficient segmentation compared to existing methods.