Study compares methods for detecting novelty in textual data streams.
problem Lack of annotated datasets for novelty detection.
method Simulation framework to create controlled datasets and benchmark methods.
result Evaluation of state-of-the-art methods on different types of novelty.
A vast amount of textual web streams is influenced by events or phenomena emerging in the real world. The social web forms an excellent modern paradigm, where unstructured user generated content is published on a regular basis and in most occasions is freely distributed. The present Ph.D. Thesis deals with the problem …
Enhances CMS with Bayesian nonparametrics for better low-frequency token estimation.
problem Improving frequency estimation of low-frequency tokens in data streams.
method Integrates Bayesian nonparametrics (Pitman-Yor process) into CMS for more accurate frequency estimation.
result CMS-PYP outperforms CMS and CMS-DP in estimating low-frequency tokens.
Text clustering method replaces centroids with summaries for interpretability and scalability.
problem Efficiently clustering text data while maintaining interpretability and scalability.
method k-NLPmeans and k-LLMmeans, which periodically replace numeric centroids with textual summaries.
result Consistently outperforms classical baselines and recent LLM-based clustering methods.
We consider a novel question answering (QA) task where the machine needs to read from large streaming data (long documents or videos) without knowing when the questions will be given, which is difficult to solve with existing QA methods due to their lack of scalability. To tackle this problem, we propose a novel end-to…
R package sentometrics analyzes text sentiment for predictions.
problem Unlocking value from textual data using sentiment analysis.
method Optimized textual sentiment indexation with R package sentometrics.
result Forecasted CBOE Volatility Index using text sentiment data.
LLmFPCA-detect detects anomalies in sparse longitudinal text data using LLMs and mFPCA.
problem Challenges in detecting patterns and anomalies in sparse longitudinal textual data.
method Pairs LLM-based text embeddings with mFPCA to detect clusters and anomalies.
result LLmFPCA-detect outperforms state-of-the-art baselines on Amazon and Wikipedia datasets.
Examines parallels between human subjects and texts for causal inference.
problem Ambiguity and fallacies in causal inference using textual data.
method Two strategies: shifting from traits to perceptions and from concepts to parts.
result Highlights the importance of clarifying fundamental concepts.
Taxicab correspondence analysis visualizes sparse text data sets.
problem Visualization of extremely sparse contingency tables.
method Robust variant of correspondence analysis for sparse data.
result Visualized an 8265-dimensional textual data set.
Textual data predicts electricity consumption and weather.
problem Lack of textual data in time series prediction models.
method Used TF-IDF and neural word embeddings to predict time series from text.
result Textual data can predict time series with sufficient accuracy.
New model uses financial filings to predict bankruptcy, even without MDA sections.
problem Lack of complete MDA data limits traditional bankruptcy prediction models.
method Conditional Multimodal Discriminative (CMMD) model learns from accounting, market, and textual data.
result Empirical results show superior classification performance compared to traditional models.
The paper proposes a new recommender system combining ratings and textual reviews.
problem Lack of using textual reviews in recommender systems.
method Combines Latent Factor Model with Latent Dirichlet Allocation for textual reviews.
result Combining textual reviews with ratings improves recommendation quality.
Surveying machine learning methods for economic forecasting.
problem Improving accuracy of economic forecasts using machine learning.
method Nowcasting, textual data, panel and tensor data, high-dimensional Granger causality tests, time series cross-validation, classification with economic losses.
result Recent advances in machine learning methods enhance economic forecasting accuracy.
Paper introduces a benchmark for predicting bankruptcy from text data.
problem Lack of a common benchmark dataset and evaluation strategy for unstructured data in bankruptcy prediction.
method Describes and evaluates several baseline models, including a bag-of-words model.
result A lightweight bag-of-words model performs surprisingly well, especially when considering data from multiple years.
A new framework predicts stock movements using news sentiment and relational data.
problem Predicting stock prices from textual information is challenging due to market uncertainty and natural language complexity.
method Multi-Graph Recurrent Network (MGRN) combining textual sentiment from financial news and relational data.
result The model outperforms benchmarks in predicting stock movements.
We introduce a multimodal visual-textual search refinement method for fashion garments. Existing search engines do not enable intuitive, interactive, refinement of retrieved results based on the properties of a particular product. We propose a method to retrieve similar items, based on a query item image and textual re…
Interpretable text-response modelling for structured outcomes
problem Predicting structured responses alongside textual data
method Joint non-negative matrix factorisation and binomial regression
result Recovering stable response-relevant textual signals
Benchmark assesses forecasting models' ability to use textual context.
problem Forecasting models struggle with integrating textual context.
method Introduces a benchmark with numerical and textual data, evaluates various models.
result LLM prompting method outperforms other models.
Paper explores different models for fake news detection.
problem Detecting fake news with various models.
method Used machine learning algorithms and pretrained features like TFIDF, CV, and W2V.
result Developed models for better fake news detection.
Data stream classification methods demonstrate promising performance on a single data stream by exploring the cohesion in the data stream. However, multiple data streams that involve several correlated data streams are common in many practical scenarios, which can be viewed as multi-task data streams. Instead of handli…
This study improves stock price prediction using multimodal data.
problem Improving financial asset price forecasting accuracy.
method Combining candlestick time series and textual news flow data using LSTM and pre-trained models.
result Textual modality reduces MAPE by 55%.
Data stream clustering tackles real-time data processing challenges.
problem Real-time processing of data streams with less prior information.
method Review of data stream clustering algorithms and their characteristics.
result Comparison and analysis of data stream clustering algorithms.
System detects financial forecasts in tweets, achieving high precision.
problem Detecting financial forecasts in social media messages.
method Natural Language Processing and Machine Learning techniques for real-time analysis.
result Achieves over 90% precision for financial forecasts.
An integrated approach is proposed across visual and textual data to both determine and justify a medical diagnosis by a neural network. As deep learning techniques improve, interest grows to apply them in medical applications. To enable a transition to workflows in a medical context that are aided by machine learning,…
Bayesian tensor train method recovers streaming data with high accuracy.
problem Recovering high-order, incomplete, and noisy streaming data.
method Bayesian tensor train decomposition using streaming variational Bayes method.
result The proposed SPTT algorithm excels in recovering streaming data compared to state-of-the-art methods.
This paper improves stock price prediction using multimodal data.
problem Accurate stock price prediction with diverse data integration.
method Combining financial metrics, tweets, and news articles through multimodal machine learning.
result Significant performance improvement in stock price prediction by up to 5%.
stream-learn is a Python library for analyzing data streams with various drift types.
problem Analyzing drifting and imbalanced data streams.
method Synthetic data stream generator, evaluation methodologies, and imbalanced binary classification metrics.
result Efficient implementation of classifiers for data stream analysis.
New method rebalances evolving data streams incrementally.
problem Incremental rebalancing of evolving data streams.
method Proposes a new streaming approach for rebalancing data streams online.
result Outperforms existing approaches in rebalancing data streams.
The gap between our ability to collect interesting data and our ability to analyze these data is growing at an unprecedented rate. Recent algorithmic attempts to fill this gap have employed unsupervised tools to discover structure in data. Some of the most successful approaches have used probabilistic models to uncover…
New method predicts drug interactions from drug images.
problem Predicting drug interactions from molecular structures.
method Siamese neural network using drug structure images.
result First work predicting DDIs from drug images.
Entity linking is the task of mapping potentially ambiguous terms in text to their constituent entities in a knowledge base like Wikipedia. This is useful for organizing content, extracting structured data from textual documents, and in machine learning relevance applications like semantic search, knowledge graph const…
MSIN model discovers relevant financial news for time series data.
problem Discovering relevant textual stories associated with numerical time series data.
method Joint learning of time series and text data using MSIN model.
result MSIN achieves up to 84.9% and 87.2% in recalling ground truth articles for two stock time series.
Survey on LLMs for time series analytics across various domains.
problem Cross-modality gap between LLMs and time series data.
method Taxonomy of approaches, cross-modality strategies, and experiments on multimodal datasets.
result Effective combinations of textual data and cross-modality strategies enhance time series analytics.
Paper presents ECL dataset for multi-modal bankruptcy prediction.
problem Developing models to predict corporate bankruptcy using textual and numerical data.
method Used ECL dataset to develop and evaluate classical and neural models.
result Textual and numerical data modalities complement each other for bankruptcy prediction.
Paper presents a technique using Spearman's Rank Correlation Coefficient for KE in TDs.
problem Extracting common characteristics and grouping similar TDs.
method Spearman's Rank Correlation Coefficient (SRCC) for KE.
result SRCC proves a comprehensive measure for high-quality KE.
An important, yet largely unstudied, problem in student data analysis is to detect misconceptions from students' responses to open-response questions. Misconception detection enables instructors to deliver more targeted feedback on the misconceptions exhibited by many students in their class, thus improving the quality…
Dynamic Model Tree improves online learning for evolving data streams.
problem Effective and transparent machine learning on data streams is challenging.
method Revisit Model Trees for data stream applications, introducing Dynamic Model Tree.
result Dynamic Model Tree reduces the number of splits and outperforms state-of-the-art models.
Transformer learns CoVaR from financial news, improving systemic risk forecasts.
problem Quantifying systemic financial risk using conditional Value-at-Risk (CoVaR).
method Transformer-based approach integrating financial news articles with market data.
result Transformer CoVaR improves out-of-sample forecasts and identifies market stress periods.
SAFE detects fake news by analyzing text and image similarities.
problem Detecting fake news with less focus on text-image similarity.
method SAFE uses neural networks to extract text and visual features, then learns their relationship to predict fake news.
result SAFE effectively recognizes fake news based on text, images, or mismatches.
Adapts DPMM for fast streaming data clustering.
problem Clustering streaming data with time-dependent statistics.
method Adapts DPMM and sampling-based inference for online clustering.
result Obtains state-of-the-art results in speed and accuracy.
CROC identifies the earliest-changing stream as the root cause in multi-stream data.
problem Distribution-free root cause analysis in multi-stream data with unknown distributional changes.
method Conformal p-values and finite-sample valid confidence sets.
result CROC efficiently isolates the root cause under minimal assumptions.
Human labeling of data can be very time-consuming and expensive, yet, in many cases it is critical for the success of the learning process. In order to minimize human labeling efforts, we propose a novel active learning solution that does not rely on existing sources of unlabeled data. It uses a small amount of labeled…
In machine learning, the one-class classification problem occurs when training instances are only available from one class. It has been observed that making use of this class's structure, or its different contexts, may improve one-class classifier performance. Although this observation has been demonstrated for static …
A CBR system investigates the TS-SS metric for document similarity.
problem Finding the most similar documents for user queries.
method Case-Based Reasoning (CBR) with TS-SS, Euclidean, and Cosine similarity measures.
result TS-SS metric shows surprising inappropriateness for high-dimensional features.
TSK-Streams learns fuzzy rules from data streams.
problem Adaptive learning from evolving data streams.
method Combines AMRules principles with fuzzy rule advantages.
result TSK-Streams performs highly competitively in experiments.
This research generates synthetic data streams for handling concept drifts and novel classes.
problem Handling concept drifts and novel classes in dynamic data streams.
method Synthetic data stream generation for both concept drifts and novel classes.
result Demonstrates the effectiveness of unsupervised drift detectors in open set recognition.
SDF adapts Deep Forest for evolving data streams with active learning.
problem Adapting Deep Forest for evolving data streams.
method Streaming Deep Forest (SDF) with Augmented Variable Uncertainty (AVU) active learning.
result SDF with AVU outperforms other methods trained with all instances by 70% labeling budget.
Paper improves Oja's algorithm for Markovian data streams.
problem Estimating the top eigenvector of a covariance matrix from Markovian data.
method Improves Oja's algorithm for streaming PCA with Markovian dependence.
result First sharp rate for Oja's algorithm on entire data stream, removing sample size dependence.