A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Study uses EEG and ML to predict movie ratings with 72% accuracy.
In an attempt to gather a deeper understanding of how convolutional neural networks (CNNs) reason about human-understandable concepts, we present a method to infer labeled concept data from hidden layer activations and interpret the concepts through a shallow decision tree. The decision tree can provide information abo…
Data science enhances knot theory by analyzing invariant relations.
Dependent MMD coresets help compare multiple related datasets.
This is a lecture note for the course DS-GA 3001 <Natural Language Understanding with Distributed Representation> at the Center for Data Science , New York University in Fall, 2015. As the name of the course suggests, this lecture note introduces readers to a neural network based approach to natural language understand…
New approach to understand recurrent policies as FSMs without minimization.
Improved text-to-image and multimodal understanding through adaptive generation order optimization.
NNs accurately predict energy eigenvalues and other physical phenomena in 1D quantum mechanics.
Understanding large, structured documents like scholarly articles, requests for proposals or business reports is a complex and difficult task. It involves discovering a document's overall purpose and subject(s), understanding the function and meaning of its sections and subsections, and extracting low level entities an…
This paper offers a mathematical introduction to GANs.
This paper introduces the YouTube-8M Video Understanding Challenge hosted as a Kaggle competition and also describes my approach to experimenting with various models. For each of my experiments, I provide the score result as well as possible improvements to be made. Towards the end of the paper, I discuss the various e…
CERT improves language understanding by contrastively learning sentence-level semantics.
Researchers improve transformer networks' optimization and understanding.
Educational game on crypto investment helps students grasp macroeconomics.
Joint scene understanding and segmentation for automotive applications is a challenging problem in two key aspects:- (1) classifying every pixel in the entire scene and (2) performing this task under unstable weather and illumination changes (e.g. foggy weather), which results in poor outdoor scene visibility. This poo…
With online calendar services gaining popularity worldwide, calendar data has become one of the richest context sources for understanding human behavior. However, event scheduling is still time-consuming even with the development of online calendars. Although machine learning based event scheduling models have automate…
Zero-shot understanding of accidents from surveillance videos using vision-language models
ZeroSCROLLS benchmarks zero-shot natural language understanding over long texts.
We can define a neural network that can learn to recognize objects in less than 100 lines of code. However, after training, it is characterized by millions of weights that contain the knowledge about many object types across visual scenes. Such networks are thus dramatically easier to understand in terms of the code th…
Improves understanding of stochastic NGVI convergence rates.
Linear models can grok without understanding, improving generalization.
Cyclic Boosting offers detailed prediction understanding for machine learning models.
Although deep learning techniques have been successfully applied to many tasks, interpreting deep neural network models is still a big challenge to us. Recently, many works have been done on visualizing and analyzing the mechanism of deep neural networks in the areas of image processing and natural language processing.…
Graph machine learning lacks a balanced theory, focusing on expressive power and optimization.
In this paper, we aim to understand Residual Network (ResNet) in a scientifically sound way by providing a bridge between ResNet and Feynman path integral. In particular, we prove that the effect of residual block is equivalent to partial differential equation, and the ResNet transforming process can be equivalently co…
Understanding optimal prompts for binary sequence predictors is challenging.
Label smoothing improves generalization by controlling generalization loss.
Image understanding is an important research domain in the computer vision due to its wide real-world applications. For an image understanding framework that uses the Bag-of-Words model representation, the visual codebook is an essential part. Random forest (RF) as a tree-structure discriminative codebook has been a po…
The paper uses DNN for electricity price forecasting and XAI for understanding the factors.
Deep neural networks (DNNs) transform stimuli across multiple processing stages to produce representations that can be used to solve complex tasks, such as object recognition in images. However, a full understanding of how they achieve this remains elusive. The complexity of biological neural networks substantially exc…
With the recent success of deep neural networks in computer vision, it is important to understand the internal working of these networks. What does a given neuron represent? The concepts captured by a neuron may be hard to understand or express in simple terms. The approach we propose in this paper is to characterize t…
We present a new dataset for form understanding in noisy scanned documents (FUNSD) that aims at extracting and structuring the textual content of forms. The dataset comprises 199 real, fully annotated, scanned forms. The documents are noisy and vary widely in appearance, making form understanding (FoUn) a challenging t…
Adapts large transformer model for search query intent understanding.
In this chapter, we provide a brief overview of applying machine learning techniques for clinical prediction tasks. We begin with a quick introduction to the concepts of machine learning and outline some of the most common machine learning algorithms. Next, we demonstrate how to apply the algorithms with appropriate to…
Language model benchmarks often misrepresent true understanding, revealing vulnerabilities in evaluation methods.
This paper provides a guide to feature importance methods for better scientific inference.
PyFi uses adversarial agents to train VLMs on financial image understanding.
Batch Normalization (BN) improves both convergence and generalization in training neural networks. This work understands these phenomena theoretically. We analyze BN by using a basic block of neural networks, consisting of a kernel layer, a BN layer, and a nonlinear activation function. This basic network helps us unde…
Massive fermions help understand index theorems without chiral symmetry.
YouTube presents an unprecedented opportunity to explore how machine learning methods can improve healthcare information dissemination. We propose an interdisciplinary lens that synthesizes machine learning methods with healthcare informatics themes to address the critical issue of developing a scalable algorithmic sol…
Financial markets provide a natural quantitative lab for understanding some of the most advanced human behaviours. Among them is the use of mathematical tools known as financial instruments. Besides money, the two most fundamental financial instruments are bonds and equities. More than 30 years ago Mehra and Prescott f…
Encoder-decoder networks using convolutional neural network (CNN) architecture have been extensively used in deep learning literatures thanks to its excellent performance for various inverse problems. However, it is still difficult to obtain coherent geometric view why such an architecture gives the desired performance…
Proposes a supervised VAE to reveal model invariances for interpretability.
New theory explains how equivariant self-supervised learning improves feature extraction.
Humor is a unique and creative communicative behavior displayed during social interactions. It is produced in a multimodal manner, through the usage of words (text), gestures (vision) and prosodic cues (acoustic). Understanding humor from these three modalities falls within boundaries of multimodal language; a recent r…
Many modern Artificial Intelligence (AI) systems make use of data embeddings, particularly in the domain of Natural Language Processing (NLP). These embeddings are learnt from data that has been gathered "from the wild" and have been found to contain unwanted biases. In this paper we make three contributions towards me…
This review covers learning under concept drift, including detection, understanding, and adaptation.
CW normalizes and decorrelates neural network layers for better concept understanding.