On the one hand, nowadays, fake news articles are easily propagated through various online media platforms and have become a grand threat to the trustworthiness of information. On the other hand, our understanding of the language of fake news is still minimal. Incorporating hierarchical discourse-level structure of fak…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “discourse structure”
Improved text generation with discourse-aware soft prompts.
problem Efficient fine-tuning methods don't generalize across all generation tasks.
method Hierarchical blocking and attention sparsity on prefix parameters.
result Structured design of prefix parameters yields more coherent generations.
This paper presents a novel latent variable recurrent neural network architecture for jointly modeling sequences of words and (possibly latent) discourse relations between adjacent sentences. A recurrent neural network generates individual words, thus reaping the benefits of discriminatively-trained vector representati…
Text documents are structured on multiple levels of detail: individual words are related by syntax, but larger units of text are related by discourse structure. Existing language models generally fail to account for discourse structure, but it is crucial if we are to have language models that reward coherence and gener…
Word embeddings are ubiquitous in NLP and information retrieval, but it is unclear what they represent when the word is polysemous. Here it is shown that multiple word senses reside in linear superposition within the word embedding and simple sparse coding can recover vectors that approximately capture the senses. The …
This work presents a novel objective function for the unsupervised training of neural network sentence encoders. It exploits signals from paragraph-level discourse coherence to train these models to understand text. Our objective is purely discriminative, allowing us to train models many times faster than was possible …
Case Law has a significant impact on the proceedings of legal cases. Therefore, the information that can be obtained from previous court cases is valuable to lawyers and other legal officials when performing their duties. This paper describes a methodology of applying discourse relations between sentences when processi…
Language of Persuasion and Misrepresentation in Business Communication: A Textual Detection Approachcs.CL
The study detects deceptive language in business communication using AI.
problem Deceptive language in business communication.
method Combining classical rhetoric, communication psychology, and linguistic theory with computational textual analysis and transformer models.
result Detection accuracies of over 99% achieved in controlled settings.
New approach to topic modelling with covariates for large text corpora.
problem Complex topic modelling in large text corpora.
method Combining convex NMF with regression for tractable estimation.
result Faster, interpretable, and better inferential justification than generative models.
Implicit discourse relation classification is of great challenge due to the lack of connectives as strong linguistic cues, which motivates the use of annotated implicit connectives to improve the recognition. We propose a feature imitation framework in which an implicit relation network is driven to learn from another …
The study redefines algorithmic fairness as a sociotechnical concept.
problem Systemic discrimination in automated decision-making.
method Literature review and sociotechnical analysis.
result Algorithmic fairness should be viewed through a sociotechnical lens.
Bitcoin price prediction models fail to outperform a simple 'today's price' baseline, especially at longer horizons.
problem Lack of robust models that consistently outperform a naive price predictor at various horizons.
method Surveyed peer-reviewed papers, categorized by evaluation methodology, contrasted with social media discourse, and proposed methodological standards.
result No peer-reviewed study has shown robust superiority over the naive baseline across multiple market regimes at short-to-medium horizons.
Model criticism tool evaluates text coherence and structure in generated long-form text.
problem Evaluate the high-level structure of generated text for coherence, coreference, and topicality.
method Apply model criticism in latent space to compare real and generated data distributions.
result Transformer-based models struggle with maintaining structural coherence and coreference.
In this paper, we propose a deep, globally normalized topic model that incorporates structural relationships connecting documents in socially generated corpora, such as online forums. Our model (1) captures discursive interactions along observed reply links in addition to traditional topic information, and (2) incorpor…
Forbidden knowledge in machine learning -- Reflections on the limits of research and publicationcs.LG
Certain research strands can yield "forbidden knowledge". This term refers to knowledge that is considered too sensitive, dangerous or taboo to be produced or shared. Discourses about such publication restrictions are already entrenched in scientific fields like IT security, synthetic biology or nuclear physics researc…
System detects financial news temporality combining NLP and ML.
problem Separate context from predictions in financial news.
method Combines NLP and ML, extracts dominant tenses.
result High detection precision compared to baseline.
We present a new topic model that generates documents by sampling a topic for one whole sentence at a time, and generating the words in the sentence using an RNN decoder that is conditioned on the topic of the sentence. We argue that this novel formalism will help us not only visualize and model the topical discourse s…
Distributed representations of words, better known as word embeddings, have become important building blocks for natural language processing tasks. Numerous studies are devoted to transferring the success of unsupervised word embeddings to sentence embeddings. In this paper, we introduce a simple representation of sent…
In the wake of the still ongoing global financial crisis, bank interdependencies have come into focus in trying to assess linkages among banks and systemic risk. To date, such analysis has largely been based on numerical data. By contrast, this study attempts to gain further insight into bank interconnections by tappin…
This research aims to identify how Bitcoin-related news publications and online discourse are expressed in Bitcoin exchange movements of price and volume. Being inherently digital, all Bitcoin-related fundamental data (from exchanges, as well as transactional data directly from the blockchain) is available online, some…
Encouraging sustainable mobility patterns is at the forefront of policymaking at all scales of governance as the collective consciousness surrounding climate change continues to expand. Not every community, however, possesses the necessary economic or socio-cultural capital to encourage modal shifts away from private m…
FX Market Volatilityq-fin.MF
Paper examines two methods for FX market volatility modeling.
problem FX market volatility modeling problem.
method Classical econometric GCH and mathematical approaches (SSA, dynamical systems stability analysis).
result Both mathematical tools show promising results in FX market volatility modeling.
Recent research in psycholinguistics has provided increasing evidence that humans predict upcoming content. Prediction also affects perception and might be a key to robustness in human language processing. In this paper, we investigate the factors that affect human prediction by building a computational model that can …
The New Yorker publishes a weekly captionless cartoon. More than 5,000 readers submit captions for it. The editors select three of them and ask the readers to pick the funniest one. We describe an experiment that compares a dozen automatic methods for selecting the funniest caption. We show that negative sentiment, hum…
The following discourse is inspired by the works on hyperbolic groups of Epstein, and Neumann/Reeves. Epstein showed that geometrically finite hyperbolic groups are biautomatic. Neumann/Reeves showed that virtually central extensions of word hyperbolic groups are biautomatic. We prove the following generalisation: Theo…
Current advances in research, development and application of artificial intelligence (AI) systems have yielded a far-reaching discourse on AI ethics. In consequence, a number of ethics guidelines have been released in recent years. These guidelines comprise normative principles and recommendations aimed to harness the …
The web is loaded with textual content, and Natural Language Processing is a standout amongst the most vital fields in Machine Learning. But when data is huge simple Machine Learning algorithms are not able to handle it and that is when Deep Learning comes into play which based on Neural Networks. However since neural …
Twitmo analyzes geo-tagged Twitter data for topic modeling and visualization.
problem Analyzing public discourse on Twitter for various topics, parties, or individuals.
method Collects and preprocesses geo-tagged Tweets, applies LDA, CTM, STM, and visualizes results.
result Automatic pooling of Tweets into pseudo-documents improves topic coherence.
Two things seem to be indisputable in the contemporary deep learning discourse: 1. The categorical cross-entropy loss after softmax activation is the method of choice for classification. 2. Training a CNN classifier from scratch on small datasets does not work well. In contrast to this, we show that the cosine loss fun…
Unveiling Early Warning Signals of Systemic Risks in Banks: A Recurrence Network-Based Approachq-fin.RM
This study uses high-frequency data to identify early warning signals for bank crises.
problem Identifying early warning signals for impending bank crises.
method Constructing multiple recurrence networks (MRNs) based on high-frequency stock returns to monitor nonlinear dynamics.
result Key indicators of MRNs, particularly average mutual information, provide valuable insights into periods of extreme volatility.
Study models opaque financial markets using multi-agent simulation.
problem Challenges in financial markets with obscured data availability.
method Multi-agent simulation with small-scale meta-heuristic methods.
result Captures bilateral market dynamics of OTC trading.
Tokenized RWAs face liquidity issues despite promising markets.
problem Low trading volumes and limited investor participation in tokenized assets.
method Empirical analysis of tokenized real estate, private credit, and treasury funds.
result Most tokenized assets exhibit low transfer activity and limited secondary trading.
LSTM networks improve stock price prediction accuracy.
problem Enhancing stock price forecasting accuracy.
method LSTM networks with hyperparameter tuning and feature selection.
result 53% improvement in predictive accuracy.
We introduce the multiresolution recurrent neural network, which extends the sequence-to-sequence framework to model natural language generation as two parallel discrete stochastic processes: a sequence of high-level coarse tokens, and a sequence of natural language tokens. There are many ways to estimate or learn the …
New framework replicates private equity performance using AI and liquid strategies.
problem Inadequate trust and transparency in private equity markets.
method Advanced graphical models and asymmetric risk adjustments.
result Liquid, scalable solution that closely mimics private equity performance.
Graph neural networks detect collusion patterns across markets.
problem Detecting and predicting collusion in different national markets.
method Two-phase approach using GNNs for zero-shot learning and OOD generalization.
result GNNs outperform NNs in detecting complex collusive patterns.
Supervised machine learning models boast remarkable predictive capabilities. But can you trust your model? Will it work in deployment? What else can it tell you about the world? We want models to be not only good, but interpretable. And yet the task of interpretation appears underspecified. Papers provide diverse and s…
Study finds significant price declines and capital reallocation from centralized to decentralized exchanges after FTX collapse.
problem Quantifying trust dynamics and redistribution between centralized and decentralized exchanges.
method Interdisciplinary approach combining causal inference and computational text analysis.
result Significant price declines and capital reallocation from centralized to decentralized exchanges following the FTX collapse.
This study maps systemic risks in TradFi and DeFi, highlighting their interdependence.
problem Systemic risks in traditional and decentralized finance.
method Conceptual model and comparative analysis of TradFi and DeFi.
result Systemic risks in DeFi can affect TradFi and vice versa, creating a crosstagion effect.
Under the Solvency II regime, life insurance companies are asked to derive their solvency capital requirements from the full loss distributions over the coming year. Since the industry is currently far from being endowed with sufficient computational capacities to fully simulate these distributions, the insurers have t…
Distributive Justice and Fairness Metrics in Automated Decision-making: How Much Overlap Is There?stat.ML
The paper explores fairness metrics in automated decision-making and their limitations.
problem Discrimination in automated resource allocation decisions.
method Analysis of fairness metrics and distributive justice principles.
result Prominent fairness metrics fail to address egalitarian and sufficiency concerns in resource allocation.
Game theory shows miners' hardware improvements don't centralize mining.
problem Decentralization of cryptocurrency mining.
method Game-theoretical model of mining efficiency and competition.
result Advancements in mining hardware efficiency do not lead to centralization.
Research on Credit Risk Early Warning Model of Commercial Banks Based on Neural Network Algorithmq-fin.RM
Study uses neural networks to predict credit risk in banks.
problem Credit risk management in commercial banks.
method Backpropagation neural network model.
result Neural network model improves credit risk prediction.
New complete panel dataset for LMICs helps analyze innovation and development.
problem Lack of complete data for empirical analyses in LMICs.
method Predictive Mean Matching multiple imputation technique.
result Created a large dataset of 47 variables for 82 LMICs from 2005-2019.
We use techniques based on the splitting tensor to explicitly integrate the Codazzi equation along the relative nullity distribution and express the second fundamental form in terms of the Jacobi tensor of the ambient space. This approach allows us to easily recover several important results in the literature on comple…
Message passing is the key to graph neural networks, but new terms are needed to avoid confusion.
problem Current methods of graph neural networks cannot solve all problems over given input graphs.
method Demonstrates that any function of interest can be expressed using pairwise message passing over a modified graph.
result Message passing is the fundamental approach for graph neural networks, and new terms are needed to avoid confusion.
The problem of building a coherent and non-monotonous conversational agent with proper discourse and coverage is still an area of open research. Current architectures only take care of semantic and contextual information for a given query and fail to completely account for syntactic and external knowledge which are cru…
There has been growing interest in using neural networks and deep learning techniques to create dialogue systems. Conversational recommendation is an interesting setting for the scientific exploration of dialogue with natural language as the associated discourse involves goal-driven dialogue that often transforms natur…