Collectivistic countries influence Bitcoin returns more than individualistic ones during the pandemic.
problem The impact of public attention to COVID-19 on Bitcoin returns.
method Rolling and recursive-evolving algorithms to account for timing and estimation bias.
result Collectivistic countries have stronger causal impacts on Bitcoin returns.
Autonomous driving is getting a lot of attention in the last decade and will be the hot topic at least until the first successful certification of a car with Level 5 autonomy. There are many public datasets in the academic community. However, they are far away from what a robust industrial production system needs. Ther…
Proposes a multi-modal attention network for better stock price prediction.
problem Predicting future stock movements using historical records and social media.
method Extracts semantic information from social media, estimates credibility, and integrates with numeric features.
result Significantly improved prediction accuracy and trading profits compared to previous methods.
New model outperforms traditional disease models in forecasting COVID-19.
problem Forecasting COVID-19 spread with high accuracy and reliability.
method Developed a novel neural forecasting model called ACTS using inter-series attention.
result ACTS outperforms leading forecasters in multiple metrics.
Machine learning methods have gained a great deal of popularity in recent years among public administration scholars and practitioners. These techniques open the door to the analysis of text, image and other types of data that allow us to test foundational theories of public administration and to develop new theories. …
Enhanced Transformer solves math problems better with explicit relation encoding.
problem Improving Transformer models for solving math word problems.
method Integrates Tensor-Product Representations and TP-Attention mechanism.
result Sets new state of the art on the Mathematics Dataset.
Domestic Violence (DV) is considered as big social issue and there exists a strong relationship between DV and health impacts of the public. Existing research studies have focused on social media to track and analyse real world events like emerging trends, natural disasters, user sentiment analysis, political opinions,…
Paper proposes a new model for fine-grained review classification using weak supervision.
problem Fine-grained analysis of reviews is challenging due to segment-level labels.
method Employed Multiple Instance Learning (MIL) with sigmoid attention mechanism for weak supervision.
result Proposed model outperforms state-of-the-art models in segment-level sentiment classification.
regvis.net offers a visual survey of regulatory visualization.
problem Lack of a comprehensive resource for regulatory visualization.
method Collection and manual tagging of 80+ publications, creation of a searchable webpage.
result First publication set tailored for regulatory visualization.
MMformer improves forecasting of environmental time series data.
problem Accurately forecasting environmental change trends for policy-making.
method Meta-learning MTS model combining self-attention and adaptive transferable multi-head attention.
result MMformer outperforms other models in air quality and climate datasets, reducing prediction errors by 50% in MSE and 20% in MAE.
This work proposes a collaborative multi-head attention layer to reduce model size without sacrificing accuracy.
problem Over-parameterization in transformer models trained with large datasets.
method Proposes a collaborative multi-head attention layer that shares key/query projections.
result Reduction in model size by 4 for same accuracy and speed.
We introduce a transformer-based GNN model, named UGformer, to learn graph representations. In particular, we present two UGformer variants, wherein the first variant (publicized in September 2019) is to leverage the transformer on a set of sampled neighbors for each input node, while the second (publicized in May 2021…
Improved hybrid acoustic model using interleaved self-attention and convolution.
problem Limited application of transformer in hybrid acoustic models.
method Proposed a model structure with interleaved self-attention and 1D convolution.
result Competitive recognition results on Librispeech dataset.
New method uses shared attention for multi-task time series forecasting.
problem Insufficient training instances in single-task forecasting.
method Self-attention based sharing schemes across multiple tasks.
result Outperforms state-of-the-art single-task forecasting baselines and RNN-based multi-task forecasting method.
Inspired by the observation that humans are able to process videos efficiently by only paying attention where and when it is needed, we propose an interpretable and easy plug-in spatial-temporal attention mechanism for video action recognition. For spatial attention, we learn a saliency mask to allow the model to focus…
3D Axial-Attention improves lung nodule classification accuracy.
problem Limited 3D attention in existing methods.
method Proposes 3D Axial-Attention network with 3D positional encoding.
result 3D Axial-Attention achieves state-of-the-art performance.
Simpler CNN model with spatial attention and temporal pooling outperforms complex models.
problem Emotion recognition from videos with small face deformations and identity variations.
method Spatial attention mechanism and temporal softmax pooling applied to a pre-trained CNN.
result The approach achieves higher accuracy than state-of-the-art methods on the EmotiW dataset.
Orion-Bix combines biaxial attention and meta-learning for tabular few-shot learning.
problem Scaling and generalizing tabular models with mixed numeric and categorical fields, weak feature structure, and limited labeled data.
method Orion-Bix uses biaxial attention and meta-learned in-context reasoning to efficiently capture local and global dependencies.
result Orion-Bix outperforms gradient-boosting baselines and state-of-the-art tabular models on public benchmarks.
KGRL uses reinforcement learning with knowledge graphs for better interactive recommendation.
problem Achieving responsiveness and accuracy in dynamic user-item interactions.
method KGRL combines reinforcement learning and knowledge graphs, using a local knowledge network and attention mechanism.
result KGRL outperforms state-of-the-art methods in simulated and real-world environments.
Paper develops an attention mechanism for long-term scientific impact prediction.
problem Predicting the long-term impact of scientific papers based on citation records.
method Develops an attention mechanism to predict long-term scientific impact.
result Emphasizing the limited attention can better stand on the shoulders of giants.
Improved volatility forecasts for U.S. stocks using social media and news data.
problem Challenges in forecasting equity market volatility due to infrequency and variability of macroeconomic announcements.
method Estimating public attention and sentiment towards scheduled macroeconomic variables using various data sources and machine learning.
result Significant improvement in volatility forecasts for U.S. stocks, up to 14.99% on average.
AIMM-X monitors markets for suspicious behavior using transparent scoring.
problem Detecting market manipulation from benign mechanisms.
method Combines microstructure signals and public attention signals for anomaly detection.
result Transparent scoring allows tracing and understanding flagged windows.
Improves dialogue response model interpretability using attention and regularization.
problem Improving interpretability of dual encoder models for dialogue response suggestions.
method Integrates attention mechanism and novel regularization loss to emphasize important words.
result Improves model accuracy and interpretability compared to existing methods.
Study shows how missing data from certain groups can unfairly bias risk models.
problem Data missingness without indicators of missingness can unfairly bias risk models.
method Developed an analytically tractable model of differential feature under-reporting and proposed new methods to mitigate bias.
result Under-reporting typically leads to increasing disparities in risk models.
Traffic flow prediction is crucial for urban traffic management and public safety. Its key challenges lie in how to adaptively integrate the various factors that affect the flow changes. In this paper, we propose a unified neural network module to address this problem, called Attentive Crowd Flow Machine~(ACFM), which …
Machine learning suffers from poor design, data, and evaluation practices.
problem Ad hoc design, poor data hygiene, and lack of statistical rigor in model evaluation.
method Examines the entire machine learning process from design to evaluation, highlighting common pitfalls and providing recommendations.
result Common pitfalls in machine learning research and development are identified and actionable recommendations are provided.
Model earnings call transcripts for better stock price prediction.
problem Predicting future stock price movements using earnings call transcripts.
method Deep learning framework with an attention mechanism to encode text data into vectors for predicting stock price movements.
result The proposed model outperforms traditional machine learning methods in stock price prediction.
MRA-BGCN improves traffic forecasting accuracy through complex graph interactions.
problem Challenging traffic forecasting due to spatial-temporal dependency and uncertainty.
method Proposes MRA-BGCN, a deep learning model that uses bicomponent graph convolution and multi-range attention.
result MRA-BGCN achieves state-of-the-art results on real-world traffic datasets.
STAM learns important time steps and variables for multivariate time series prediction.
problem Accurate interpretation of multivariate time series predictions.
method Spatiotemporal attention mechanism (STAM) for multivariate time series modeling.
result STAM maintains state-of-the-art prediction accuracy with improved interpretability.
We explore solutions for automated labeling of content in bug trackers and customer support systems. In order to do that, we classify content in terms of several criteria, such as priority or product area. In the first part of the paper, we provide an overview of existing methods used for text classification. These met…
Stock market prediction is one of the most attractive research topic since the successful prediction on the market's future movement leads to significant profit. Traditional short term stock market predictions are usually based on the analysis of historical market data, such as stock prices, moving averages or daily re…
Proposes HetSANN for learning heterogeneous graph structures without meta-paths.
problem Learning low-dimensional vector space of heterogeneous information networks.
method Implicitly represents heterogeneous information through entity space transformation and attention mechanism.
result Significant improvements over state-of-the-art solutions on public datasets.
RKT model improves knowledge tracing by considering exercise relations and student forget behavior.
problem Traditional KT models fail to consider both exercise relations and student forget behavior.
method RKT model uses relation-aware self-attention to incorporate exercise relations and student forget behavior.
result RKT model outperforms state-of-the-art KT methods on real-world datasets.
With the growing importance of personalized recommendation, numerous recommendation models have been proposed recently. Among them, Matrix Factorization (MF) based models are the most widely used in the recommendation field due to their high performance. However, MF based models suffer from cold start problems where us…
Cephalometric tracing method is usually used in orthodontic diagnosis and treatment planning. In this paper, we propose a deep learning based framework to automatically detect anatomical landmarks in cephalometric X-ray images. We train the deep encoder-decoder for landmark detection, and combine global landmark config…
Speech enhancement improved by adapting to unknown speakers without auxiliary signals.
problem Improving speech enhancement accuracy for unknown speakers.
method Adopting multi-task learning for speech enhancement and speaker identification, using multi-head self-attention.
result Achieved state-of-the-art performance and improved subjective quality.
Abstracts Higgs bundles without diving into geometry.
problem Understanding Higgs bundles without geometry.
method Informal linear algebra approach.
result Anticipates deeper structure in Higgs bundles moduli space.
Pointwise localization allows more precise localization and accurate interpretability, compared to bounding box, in applications where objects are highly unstructured such as in medical domain. In this work, we focus on weakly supervised localization (WSL) where a model is trained to classify an image and localize regi…
Paper speeds up matrix multiplication on Intel PIII using SIMD.
problem Efficiently multiplying large matrices for faster algorithm performance.
method Implemented matrix-matrix multiply using Intel Pentium SIMD architecture.
result Average performance 2.09 times faster than public domain routines.
RAN model recognizes multiple activities from unlabeled sensor data.
problem Handling weakly labeled multi-activity data from wearable sensors.
method Recurrent Attention Networks (RAN) for sequential multi-activity recognition and localization.
result RAN model can infer multiple activities and determine activity locations from unlabeled data.
Transformer models show distinct spectral fingerprints under voice changes.
problem Detecting architectural biases in transformer models.
method Spectral analysis of attention-induced token graphs.
result Clear architectural signatures in model fingerprints correlate with language-specific behavior.
Finding regions for which there is higher controversy among different classifiers is insightful with regards to the domain and our models. Such evaluation can falsify assumptions, assert some, or also, bring to the attention unknown phenomena. The present work describes an algorithm, which is based on the Exceptional M…
Bitcoins and Blockchain technologies are attracting the attention of different scientific communities. In addition, their widespread industrial applications and the continuous introduction of cryptocurrencies are also stimulating the attention of the public opinion. The underlying structure of these technologies consti…
Recent literature seek to forecast implied volatility derived from equity, index, foreign exchange, and interest rate options using latent factor and parametric frameworks. Motivated by increased public attention borne out of the financialization of futures markets in the early 2000s, we investigate if these extant mod…
Improved object detection for scientific document images.
problem Current object detectors fail to accurately localize regions in scientific document images.
method Revised R-CNN model with region embedding for fine-grained proposals.
result 17% mAP improvement over standard object detection models.
This study improves electricity price forecasting in the Irish balancing market.
problem Limited and inconsistent research on short-term price forecasting in volatile balancing markets.
method Compared statistical, machine learning, and deep learning models using a public dataset and framework.
result LEAR, a statistical approach, outperforms complex models in the balancing market.
With a point of departure in the concept "uncomfortable knowledge," this article presents a case study of how the American Planning Association (APA) deals with such knowledge. APA was found to actively suppress publicity of malpractice concerns and bad planning in order to sustain a boosterish image of planning. In th…
Opioid overdose is a growing public health crisis in the United States. This crisis, recognized as "opioid epidemic," has widespread societal consequences including the degradation of health, and the increase in crime rates and family problems. To improve the overdose surveillance and to identify the areas in need of p…