Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

1.6%3.3%4.9%6.5% · Nov 201819922001200920172026
48 results for activation atlases

Wider networks learn more interpretable features and improve performance during fine-tuning.

problem Transferability of learned features between tasks and the effect of network width on feature learning.
method Activation atlases to visualize and analyze features learned by wide and narrow networks.
result The hidden state of a wide network contains more information about the inputs than a narrow network, leading to improved performance during fine-tuning.

Starting with some motivating examples (classical atlases for a manifold, space of leaves of a foliation, group orbits), we propose to view a Lie groupoid as a generalized atlas for the "virtual structure" of its orbit space, the equivalence between atlases being here the smooth Morita equivalence. This "structure" kee…

2007-11-13abs ↗pdf ↗

We present two related methods for deriving connectivity-based brain atlases from individual connectomes. The proposed methods exploit a previously proposed dense connectivity representation, termed continuous connectivity, by first performing graph-based hierarchical clustering of individual brains, and subsequently a…

2018-08-10abs ↗pdf ↗

We study the number of Darboux charts needed to cover a closed connected symplectic manifold (M,ω)(M,ω), and effectively estimate this number from below and from above in terms of the Lusternik--Schnirelmann category of MM and the Gromov width of (M,ω)(M,ω).

2006-05-13abs ↗pdf ↗

We construct an infinite sequence of projectively flat manifolds by using castling transformations of prehomogeneous vector spaces. We also give a classification of manifolds equipped with a flat projective structure obtained by a finite number of castling transformations, and describe these flat projective structures …

2013-01-06abs ↗pdf ↗

Given the notion of suborbifold of the second author (based on ideas of Borzellino/Brunsden) and the classical correspondence (up to certain equivalences) between (effective) orbifolds via atlases and effective orbifold groupoids, we analyze which groupoid embeddings correspond to suborbifolds and give classes of subor…

2018-09-11abs ↗pdf ↗

In this paper, the task-related fMRI problem is treated in its matrix factorization formulation, focused on the Dictionary Learning (DL) approach. The new method allows the incorporation of a priori knowledge associated both with the experimental design as well as with available brain Atlases. Moreover, the proposed me…

2018-02-05abs ↗pdf ↗

In this paper we compute the minimal number of Darboux chart needed to cover a Hermitian symmetric space of compact type in terms of the degree of their embeddings in CPN\mathbb{C} P^N. The proof is based on the recent work of Y. B. Rudyak and F. Schlenk [18] and on the symplectic geometry tool developed by the first au…

2014-11-06abs ↗pdf ↗

DET unifies geometric and functional alignment for high-dimensional scientific data.

problem Challenges in nonrigid registration for high-dimensional, irregular data.
method Domain Elastic Transform (DET) treats data as functions on irregular domains, using a Bayesian framework for elastic motion registration.
result DET achieves 92% topological preservation on MERFISH data and successfully registers whole-embryo Stereo-seq atlases.

We study the minimal number C(M,ξ) of contact charts that one needs to cover a closed connected contact manifold (M,ξ). Our basic result is C(M,ξ) \le \dim M + 1. We compute C(M,ξ) for all closed connected contact 3-manifolds: C (M,ξ) = 2 if M = S^3 and ξis tight, 3 if M = S^3 and ξis overtwisted or if M = #_k (S^2 \ti…

2008-07-18abs ↗pdf ↗

We analyze the possibility of defining infinite-dimensional manifolds as ringed spaces. More precisely, we consider three definitions of manifolds modeled on locally convex spaces: in terms of charts and atlases, in terms of ringed spaces, and in terms of functored spaces, as introduced by Douady in his thesis. It is s…

2014-03-23abs ↗pdf ↗

We propose a segmentation framework that uses deep neural networks and introduce two innovations. First, we describe a biophysics-based domain adaptation method. Second, we propose an automatic method to segment white and gray matter, and cerebrospinal fluid, in addition to tumorous tissue. Regarding our first innovati…

2018-10-11abs ↗pdf ↗

We study the family Ω1(1s)Ω^1(-1^s) of rational 1--forms on the Riemann sphere, having exactly s2-s \leq -2 simple poles. Three equivalent (2s1)(2s-1)--dimensional complex atlases on Ω1(1s)Ω^1(-1^s), using coefficients, zeros--poles and residues--poles of the 1--forms, are recognized. A rational 1--form is isochronous when all th…

2017-09-21abs ↗pdf ↗

The paper develops a theory of Ehresmann structures in positive characteristic.

problem Developing a theory for Ehresmann structures in positive characteristic.
method Comparing Frobenius-Ehresmann structures with Cartan geometries and studying their equivalence.
result Formulating and proving the Ehresmann-Weil-Thurston principle for Frobenius-Ehresmann structures.

Finding the biomarkers associated with ASD is helpful for understanding the underlying roots of the disorder and can lead to earlier diagnosis and more targeted treatment. A promising approach to identify biomarkers is using Graph Neural Networks (GNNs), which can be used to analyze graph structured data, i.e. brain ne…

2019-07-02abs ↗pdf ↗

Many activation functions have been proposed in the past, but selecting an adequate one requires trial and error. We propose a new methodology of designing activation functions within a neural network at each layer. We call this technique an "activation ensemble" because it allows the use of multiple activation functio…

2017-02-24abs ↗pdf ↗

This paper studies activation sparsity in large language models, finding key trends and implications.

problem Activation sparsity in large language models (LLMs) can be improved for efficiency and interpretability.
method Proposes PPL-p%p\% sparsity, analyzes trends with training data, width-depth ratio, and parameter scale.
result ReLU is more efficient for sparsity than SiLU, and deeper architectures can improve sparsity.

Many neural network architectures rely on the choice of the activation function for each hidden layer. Given the activation function, the neural network is trained over the bias and the weight parameters. The bias catches the center of the activation, and the weights capture the scale. Here we propose to train the netw…

2019-01-28abs ↗pdf ↗

BinaryDuo improves BNNs by coupling binary activations, outperforming state-of-the-art models.

problem Gradient mismatch in BNNs due to binarizing activations.
method Using gradient of smoothed loss function to estimate gradient mismatch, proposing BinaryDuo scheme with coupled ternary activations.
result BinaryDuo outperforms state-of-the-art BNNs on various benchmarks.

Evolutionary algorithms improve neural network performance by discovering better activation functions.

problem The choice of activation function affects neural network performance, but ReLU remains dominant.
method Defined a tree-based search space of candidate activation functions and used evolutionary algorithms (mutation, crossover, exhaustive search) to explore and discover better functions.
result Replacing ReLU with evolved activation functions statistically significantly increases network accuracy.

Collaborative filtering is a useful technique for exploiting the preference patterns of a group of users to predict the utility of items for the active user. In general, the performance of collaborative filtering depends on the number of rated examples given by the active user. The more the number of rated examples giv…

2012-07-11abs ↗pdf ↗

Bayesian adaptive designs can be biased by active learning, especially with misspecified models.

problem Active learning bias in Bayesian adaptive experimental designs.
method Analysis of linear and preference learning models, empirical testing.
result Model misspecification and noise influence active learning bias in Bayesian designs.

RAN model recognizes multiple activities from unlabeled sensor data.

problem Handling weakly labeled multi-activity data from wearable sensors.
method Recurrent Attention Networks (RAN) for sequential multi-activity recognition and localization.
result RAN model can infer multiple activities and determine activity locations from unlabeled data.

Active testing reduces label costs for efficient model evaluation.

problem Real-world applications require expensive test labels, disconnecting from existing model evaluation methods.
method Derives acquisition strategies to select test points efficiently, addressing label bias and variance.
result Active testing improves model evaluation efficiency without sacrificing accuracy.

Survey of trainable activation functions in neural networks.

problem Improving neural network performance through trainable activation functions.
method Taxonomy and comparison of recent and past models of trainable activation functions.
result Many trainable activation functions are equivalent to adding neuron layers with fixed activation functions and simple constraints.

This paper analyzes and improves active learning techniques for real-world projects.

problem Reducing labelling effort in machine learning models with real-world constraints.
method Systematic study of active learning issues, proposing techniques to address model convergence, annotation error, and dataset imbalance.
result Presentation of two techniques to speed up active learning: partial uncertainty sampling and larger query size.

Study active nematic forces on curved surfaces, revealing new coupling mechanisms.

problem Understanding active nematic forces on curved surfaces.
method Developed a thermodynamically consistent surface model with nematic activity, analyzed topological defects.
result Active defects contribute both tangential and normal forces on curved surfaces.