BOIL updates model body only, showing better few-shot learning performance.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
New findings on representation changes in transfer learning.
An important part of many machine learning workflows on graphs is vertex representation learning, i.e., learning a low-dimensional vector representation for each vertex in the graph. Recently, several powerful techniques for unsupervised representation learning have been demonstrated to give the state-of-the-art perfor…
Intelligent agents should be able to learn useful representations by observing changes in their environment. We model such observations as pairs of non-i.i.d. images sharing at least one of the underlying factors of variation. First, we theoretically show that only knowing how many factors have changed, but not which o…
Paper proposes a method to improve circular coordinate representation for detecting changes in high-dimensional datasets.
DeepCCG adapts classifiers to representation shifts in one step.
We train multi-task autoencoders on linguistic tasks and analyze the learned hidden sentence representations. The representations change significantly when translation and part-of-speech decoders are added. The more decoders a model employs, the better it clusters sentences according to their syntactic similarity, as t…
The paper develops a new formula for financial pricing under multiple interest rates and collateralization.
Study reveals differences in medical image models' hidden representation refinement.
The paper analyzes MAML's representation using RSA, revealing that feature reuse is not the primary reason for its success.
New framework to test neural network representation similarity measures.
New method combines domain changes and sparse mixing for better latent variable learning.
A new geometric metric identifies true data changes from parametrization artifacts in high-dimensional representations.
Autoencoder detects subtle changes in time series data.
The paper detects changes in graph signal means offline.
This paper tackles causal representation learning from multiple distributions without hard interventions.
We consider the problem of building a state representation model in a continual fashion. As the environment changes, the aim is to efficiently compress the sensory state's information without losing past knowledge. The learned features are then fed to a Reinforcement Learning algorithm to learn a policy. We propose to …
Facial attribute editing aims to manipulate single or multiple attributes of a face image, i.e., to generate a new face with desired attributes while preserving other details. Recently, generative adversarial net (GAN) and encoder-decoder architecture are usually incorporated to handle this task with promising results.…
A crucial challenge in image-based modeling of biomedical data is to identify trends and features that separate normality and pathology. In many cases, the morphology of the imaged object exhibits continuous change as it deviates from normality, and thus a generative model can be trained to model this morphological con…
New method recovers causal DAGs from general environments without strict assumptions.
When a boudnary-parabolic representation of a link group to PSL(2,) is given, Inoue and Kabaya suggested a combinatorial method to obtain the developing map of the representation using the octahedral triangulation and the shadow-coloring of certain quandle. Quandle is an algebraic system closely related wit…
AdaRL adapts quickly to new environments with minimal data.
Innovative inequalities for divergences with applications in PAC-Bayesian bounds and Monte Carlo.
Tree-based regularization improves latent variable inference from related datasets.
New framework TDRL identifies latent causal variables from sequential data.
Model predicts travel time under rare conditions using a vector-space model.
Improves contrastive learning invariance with novel training objectives and feature averaging.
Study on bending knots and energy changes in 3D space.
Unified framework for disentangled representations using mechanistic independence.
Paper proposes semi-supervised learning using change points for sequence classification.
Simplified trust region method reduces representation change during fine-tuning.
New method extracts brain age from MRI sequences over time.
In the artificial intelligence field, learning often corresponds to changing the parameters of a parameterized function. A learning rule is an algorithm or mathematical expression that specifies precisely how the parameters should be changed. When creating an artificial intelligence system, we must make two decisions: …
We examine the influence of input data representations on learning complexity. For learning, we posit that each model implicitly uses a candidate model distribution for unexplained variations in the data, its noise model. If the model distribution is not well aligned to the true distribution, then even relevant variati…
Nowadays, with the availability of massive amount of trade data collected, the dynamics of the financial markets pose both a challenge and an opportunity for high frequency traders. In order to take advantage of the rapid, subtle movement of assets in High Frequency Trading (HFT), an automatic algorithm to analyze and …
A connection is made between the Krammer representation and the Birman-Murakami-Wenzl algebra. Inspired by a dimension argument, a basis is found for a certain irrep of the algebra, and relations which generate the matrices are found. Following a rescaling and change of parameters, the matrices are found to be identica…
Paper presents a new way to estimate model changes without full model evaluation.
We consider the problem of building a state representation model for control, in a continual learning setting. As the environment changes, the aim is to efficiently compress the sensory state's information without losing past knowledge, and then use Reinforcement Learning on the resulting features for efficient policy …
Recent progress in recommender system research has shown the importance of including temporal representations to improve interpretability and performance. Here, we incorporate temporal representations in continuous time via recurrent point process for a dynamical model of reviews. Our goal is to characterize how change…
Stability is a key aspect of data analysis. In many applications, the natural notion of stability is geometric, as illustrated for example in computer vision. Scattering transforms construct deep convolutional representations which are certified stable to input deformations. This stability to deformations can be interp…
Integrates inductive biases into VAEs using intermediary latent variables.
Humans and animals show remarkable flexibility in adjusting their behaviour when their goals, or rewards in the environment change. While such flexibility is a hallmark of intelligent behaviour, these multi-task scenarios remain an important challenge for machine learning algorithms and neurobiological models alike. We…
We survey generalisations of the Chang-Skjelbred Lemma for integral coefficients. Moreover, we construct examples of manifolds with actions of tori of rank > 2 whose equivariant cohomology is torsion-free, but not free. This answers a question of Allday's. The "mutants" we construct are obtained from compactified repre…
We present a new and easy-to-implement sequential sampling method for CGMY processes with either finite or infinite variation, exploiting the time change representation of the CGMY model and a decomposition of its time change. We find that the time change can be decomposed into two independent components. While the fir…
This paper addresses the problem of change-point detection on sequences of high-dimensional and heterogeneous observations, which also possess a periodic temporal structure. Due to the dimensionality problem, when the time between change-points is on the order of the dimension of the model parameters, drifts in the und…
New lattice path method for statistical inference of persistent diagrams.
Proposes FSM-IRL to learn invariant network representations considering feature and structural shifts.
Machine learning for healthcare often trains models on de-identified datasets with randomly-shifted calendar dates, ignoring the fact that data were generated under hospital operation practices that change over time. These changing practices induce definitive changes in observed data which confound evaluations which do…