A new model improves click-through rate prediction for recommendation systems.
problem Improving accuracy of click-through rate prediction in recommendation systems.
method Combines traditional feature engineering with deep neural networks to automate feature combinations.
result The model (FNFM) outperforms current deep learning feature combination models.
Predicting the click-through rate of an advertisement is a critical component of online advertising platforms. In sponsored search, the click-through rate estimates the probability that a displayed advertisement is clicked by a user after she submits a query to the search engine. Commercial search engines typically rel…
We review a method for click-through rate prediction based on the work of Menon et al. [11], which combines collaborative filtering and matrix factorization with a side-information model and fuses the outputs to proper probabilities in [0,1]. In addition we provide details, both for the modeling as well as the experime…
DeepMCP improves CTR prediction by learning better feature representations.
problem Data sparsity in CTR prediction models.
method DeepMCP models user-ad, ad-ad, and feature-CTR relationships through three subnets.
result DeepMCP outperforms state-of-the-art models in CTR prediction.
Click-through rate (CTR) prediction is a critical task in online display advertising. The data involved in CTR prediction are typically multi-field categorical data, i.e., every feature is categorical and belongs to one and only one field. One of the interesting characteristics of such data is that features from one fi…
Sparse tensor additive regression models tensor covariates for scalar responses.
problem Modeling scalar responses from tensor covariates with sparse and low-rank structures.
method Proposes a non-convex optimization problem and an efficient penalized alternating minimization algorithm.
result Establishes an error bound for the estimator and demonstrates the model's efficacy in simulations and online advertising.
Proposes a time-aware attention model for CTR prediction.
problem Lack of temporal signals in existing CTR prediction models.
method Time-aware attention model with absolute and relative temporal signals, regularized adversarial sampling.
result Significantly improves CTR prediction performance.
SIM models user interests from long sequential behavior data, improving click-through rate prediction.
problem Challenges in capturing user interests with long user behavior sequences.
method SIM uses a cascaded search paradigm with two units: General Search Unit and Exact Search Unit.
result SIM achieves significant CTR and RPM lifts in Alibaba's display advertising system.
Method detects interactions for better CTR prediction.
problem Predicting click-through rate with high-dimensional categorical features and time-varying interactions.
method Online Random Intersection Chains (ORIC) for detecting informative interactions.
result ORIC detects high-interpretability interactions that improve CTR prediction.
Paper proposes FINN for better CTR prediction by modeling feature interactions.
problem Improving CTR prediction in advertising and recommendation systems.
method Proposes Feature Interaction based Neural Network (FINN) to model feature interactions.
result FINN outperforms other deep models in CTR prediction tasks.
Proposes DTS framework to predict CTR by tracking user interest evolution over time.
problem Predicting CTR by ignoring dynamic user interest changes over time.
method Integrates time information using ODEs in a neural network to model interest evolution.
result Achieves superior CTR prediction performance compared to existing methods.
Improved CTR prediction with XDBoost neural network.
problem Predicting CTR with limited data and complex user behavior.
method Iterative three-stage neural network model XDBoost.
result XDBoost outperforms existing SOTA models for CTR prediction.
ShadowSync separates background synchronization for scalable distributed training.
problem Reducing synchronization overhead in distributed training for high scalability.
method Separates synchronization from training and runs it in the background.
result Achieves both high throughput and excellent model quality at scale.
Click-through rate~(CTR) prediction, whose goal is to estimate the probability of the user clicks, has become one of the core tasks in advertising systems. For CTR prediction model, it is necessary to capture the latent user interest behind the user behavior data. Besides, considering the changing of the external envir…
Proposes FEFM and DeepFEFM for CTR prediction, outperforming state-of-the-art models.
problem Click-through rate prediction in online applications.
method Field-Embedded Factorization Machine (FEFM) and its deep counterpart DeepFEFM, combining feature embeddings and deep neural networks.
result FEFM and DeepFEFM outperform existing models in CTR prediction tasks.
Improves CTR prediction by considering spatial and temporal auxiliary ads.
problem Improving CTR prediction in online advertising systems.
method Deep Spatio-Temporal Neural Networks (DSTNs) for CTR prediction.
result DSTNs outperform state-of-the-art methods in CTR prediction.
Enhanced ad event prediction boosts performance.
problem Improving ad performance metrics like CTR and CVR.
method New feature engineering approach for ad event prediction.
result Significantly outperforms alternative prediction algorithms.
With the rapid development of online advertising and recommendation systems, click-through rate prediction is expected to play an increasingly important role.Recently many DNN-based models which follow a similar Embedding&MLP paradigm have been proposed, and have achieved good result in image/voice and nlp fields. In t…
AutoFIS automatically selects important feature interactions for CTR prediction models.
problem Manual feature interaction design is inefficient and prone to noise.
method Two-stage algorithm: search stage relaxes feature interactions to continuous parameters, re-train stage refines model performance.
result AutoFIS significantly improves CTR and CVR of FM-based models.
FiBiNET combines feature importance and bilinear interactions for CTR prediction.
problem Improving click-through rate prediction in advertising and feed ranking systems.
method FiBiNET dynamically learns feature importance via SENET and bilinear feature interactions.
result FiBiNET outperforms shallow and deep models on real-world datasets.
Click through rate (CTR) prediction is very important for Native advertisement but also hard as there is no direct query intent. In this paper we propose a large-scale event embedding scheme to encode the each user browsing event by training a Siamese network with weak supervision on the users' consecutive events. The …
Proposes a novel network for CTR prediction by learning modality-specific and modality-invariant representations.
problem Learning good representation of items from multimodal features in E-commerce is challenging due to redundant information across modalities.
method Introduces a Multimodal Adversarial Representation Network (MARN) that calculates modality-specific weights and learns modality-invariant representations.
result Consistently achieves remarkable improvements over state-of-the-art methods in CTR prediction.
In the cost per click (CPC) pricing model, an advertiser pays an ad network only when a user clicks on an ad; in turn, the ad network gives a share of that revenue to the publisher where the ad was impressed. Still, advertisers may be unsatisfied with ad networks charging them for "valueless" clicks, or so-called accid…
A new embedding structure, res-embedding, improves deep CTR models by enhancing generalization performance.
problem Deep CTR models often suffer from poor generalization performance due to learning of embedding parameters.
method Developed a res-embedding structure that combines a central embedding vector from an item-based interest graph with a residual embedding vector.
result Empirical evaluation shows significant improvement in model performance using the res-embedding structure.
Online advertisement is the main source of revenue for Internet business. Advertisers are typically ranked according to a score that takes into account their bids and potential click-through rates(eCTR). Generally, the likelihood that a user clicks on an ad is often modeled by optimizing for the click through rates rat…
This paper investigates the impact of normalization on deep neural networks for click-through rate prediction.
problem The effect of normalization on deep neural network models for CTR estimation.
method Systematic study of various normalization approaches applied to feature embedding and MLP part of DNN models.
result Correct normalization significantly enhances model performance, as demonstrated by extensive experiments on real-world datasets.
CAN approximates explicit feature interactions for CTR prediction.
problem Learning explicit feature interactions from sparse features.
method Co-Action Network approximates explicit pairwise feature interactions without introducing too many additional parameters.
result CAN outperforms state-of-the-art CTR models and the cartesian product method.
This paper tackles overfitting in CTR models by introducing Multi-Epoch learning with Data Augmentation.
problem Overfitting of the embedding layer in CTR models during multi-epoch training.
method Introduces Multi-Epoch learning with Data Augmentation (MEDA) framework to reduce overfitting and enhance performance.
result MEDA minimizes overfitting and achieves data augmentation through varied embedding spaces, improving performance without overfitting.
Click-through rate prediction is an essential task in industrial applications, such as online advertising. Recently deep learning based models have been proposed, which follow a similar Embedding\&MLP paradigm. In these methods large scale sparse input features are first mapped into low dimensional embedding vectors, a…
Study proposes an ad creative selection algorithm considering user fatigue.
problem Ad creative effectiveness varies with user exposure.
method Proposes an algorithm that considers user fatigue in ad selection.
result The proposed algorithm outperforms baseline algorithms in real-world testing.
AutoRec automates deep recommendation models using AutoML.
problem Adapting to changing data and tasks in recommender systems.
method AutoML platform for model search and hyperparameter tuning.
result Identifies models similar to the best model without prior knowledge.
New model for display advertising with stochastic and adversarial components.
problem Display advertising with stochastic and adversarial click-through-rates.
method Adversarial scaling model; two algorithms tested: action elimination and mirror descent.
result Two algorithms are robust to adversarial scaling.
Predicting keywords performance, such as number of impressions, click-through rate (CTR), conversion rate (CVR), revenue per click (RPC), and cost per click (CPC), is critical for sponsored search in the online advertising industry. An interesting phenomenon is that, despite the size of the overall data, the data are v…
E-commerce system predicts customer interest in sequentially ordered products.
problem Modeling customer interest in sequentially ordered products.
method Embed purchased items with Word2Vec and model the sequence with LSTM RNN.
result The recommender system outperforms its predecessor in click-through rate.
In online advertising, display ads are increasingly being placed based on real-time auctions where the advertiser who wins gets to serve the ad. This is called real-time bidding (RTB). In RTB, auctions have very tight time constraints on the order of 100ms. Therefore mechanisms for bidding intelligently such as clickth…
DeepLight accelerates CTR predictions in ad serving by 46X.
problem Significantly increased serving delay and high memory usage for ad serving.
method Explicitly searching feature interactions, pruning layers, promoting sparsity.
result Accelerates model inference by 46X on Criteo dataset.
Although deep learning techniques have been successfully applied to many tasks, interpreting deep neural network models is still a big challenge to us. Recently, many works have been done on visualizing and analyzing the mechanism of deep neural networks in the areas of image processing and natural language processing.…
Mixed dimension embeddings reduce memory usage in recommendation systems.
problem Space-intensive embedding representations in recommendation systems.
method Mixed dimension embeddings where vector dimension scales with query frequency.
result Significant reduction in memory usage with minimal performance loss.
AB-testing is a very popular technique in web companies since it makes it possible to accurately predict the impact of a modification with the simplicity of a random split across users. One of the critical aspects of an AB-test is its duration and it is important to reliably compute confidence intervals associated with…
The current work characterizes the users of a VoD streaming space through user-personas based on a tenure timeline and temporal behavioral features in the absence of explicit user profiles. A combination of tenure timeline and temporal characteristics caters to business needs of understanding the evolution and phases o…
We propose a novel sparse tensor decomposition method, namely Tensor Truncated Power (TTP) method, that incorporates variable selection into the estimation of decomposition components. The sparsity is achieved via an efficient truncation step embedded in the tensor power iteration. Our method applies to a broad family …
Comparison Lift uses bandit algorithms to optimize online ad testing.
problem Optimizing online ad testing to maximize click-through rates.
method Bandit-based experimentation algorithm that adapts to test results.
result Ad click-through rates increased by 46% on average.
TPG-DNN predicts user intent using GRU loss and multi-task learning.
problem Improving user experience and shopping efficiency in e-commerce.
method Adaptive GRU loss function with multi-task learning.
result TPG-DNN outperforms existing CTR models on Taobao datasets.
Models applied on real time response task, like click-through rate (CTR) prediction model, require high accuracy and rigorous response time. Therefore, top-performing deep models of high depth and complexity are not well suited for these applications with the limitations on the inference time. In order to further impro…
Neural Calibration improves reliability of probabilistic predictions by learning from field-aware information.
problem Miscalibration of probabilistic predictions in machine learning models.
method Neural Calibration, a simple yet powerful post-hoc calibration method that learns from field-aware information.
result Neural Calibration significantly improves reliability in metrics like negative log-likelihood, Brier score, and AUC.
AdaEnsemble learns adaptive feature interactions for CTR prediction.
problem Learning feature interactions for CTR prediction in recommender systems and Ads ranking.
method AdaEnsemble is a Sparsely-Gated Mixture-of-Experts (SparseMoE) architecture that dynamically selects feature interaction depth.
result AdaEnsemble achieves better prediction accuracy and inference efficiency compared to state-of-the-art models.
App enhances midwives' skills in low-income countries.
problem Low-income countries have high maternal and child mortality rates.
method Deep learning models predict midwives' interest in learning materials.
result Deep learning models accurately predict midwives' interest in learning materials.
Proposes DenoiseBid to correct uncertain CTR and CVR estimates for autobidding.
problem Uncertainty in CTR and CVR estimates affects autobidding algorithm performance.
method Bayesian approach to correct noisy estimates with recovered distributions.
result Proposed DenoiseBid method improves efficiency of autobidding in auctions.