We identify spectral conditions for reliable neural probe interpretation.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
We define a notion of stability for chiral ring of four dimensional N=1 theory by introducing test chiral rings and generalized a maximization. We conjecture that a chiral ring is the chiral ring of a superconformal field theory if and only if it is stable. We then study N=1 field theory derived from D3 branes probing …
This two-part work puts forth the idea of engaging power electronics to probe an electric grid to infer non-metered loads. Probing can be accomplished by commanding inverters to perturb their power injections and record the induced voltage response. Once a probing setup is deemed topologically observable by the tests o…
Probe-level models have led to improved performance in microarray studies but the various sources of probe-level contamination are still poorly understood. Data-driven analysis of probe performance can be used to quantify the uncertainty in individual probes and to highlight the relative contribution of different noise…
A probing scheme is considered with an accessible and controllable qubit, used to probe an out-of equilibrium system consisting of a second qubit interacting with an environment. Quantum spontaneous synchronization between the probe and the system emerges in this model and, by tuning the probe frequency, can occur both…
The paper explores how AI systems use information geometry to encode semantic structure.
We explore the problem of selectively forgetting a particular subset of the data used for training a deep neural network. While the effects of the data to be forgotten can be hidden from the output of the network, insights may still be gleaned by probing deep into its weights. We propose a method for "scrubbing'" the w…
Optimal probing framework for scalable network monitoring.
We present a new variable selection method based on model-based gradient boosting and randomly permuted variables. Model-based boosting is a tool to fit a statistical model while performing variable selection at the same time. A drawback of the fitting lies in the need of multiple model fits on slightly altered data (e…
Paper introduces Manifold Probe for discovering representation manifolds in superposition.
OLPA optimizes online user-centric selection with probing, achieving near-optimal regret bounds.
This paper explores what causal structures can be distinguished by observational and interventional probing schemes.
Paper analyzes why deeper layers of ViTs perform worse on out-of-distribution tasks.
System guides freehand obstetric ultrasound probe movements.
The ability of modeling the other agents, such as understanding their intentions and skills, is essential to an agent's interactions with other agents. Conventional agent modeling relies on passive observation from demonstrations. In this work, we propose an interactive agent modeling scheme enabled by encouraging an a…
CwA optimizes search performance by jointly learning a balanced database partition and a neural probing function.
This paper focuses on the problem of estimating historical traffic volumes between sparsely-located traffic sensors, which transportation agencies need to accurately compute statewide performance measures. To this end, the paper examines applications of vehicle probe data, automatic traffic recorder counts, and neural …
Study examines flaws in probing LLMs' knowledge and introduces a new method.
We study the statistical behavior of reasoning probes in a stylized model of iterative computation inspired by neural algorithmic reasoning. The underlying computation is given by a looped Boolean circuit whose graph is a perfect -ary tree (), with outputs recursively fed back as inputs across computation ro…
Study of charged scalar fields on Reissner-Nordström spacetimes via energy estimates.
3D spheres with certain properties approach the round sphere.
This work incorporates topological features via persistence diagrams to classify point cloud data arising from materials science. Persistence diagrams are multisets summarizing the connectedness and holes of given data. A new distance on the space of persistence diagrams generates relevant input features for a classifi…
Distribution grids currently lack comprehensive real-time metering. Nevertheless, grid operators require precise knowledge of loads and renewable generation to accomplish any feeder optimization task. At the same time, new grid technologies, such as solar photovoltaics and energy storage units are interfaced via invert…
Improved unsupervised probing for ranking tasks using Contrast-Consistent Ranking.
This research discovers model architecture and training dataset characteristics through strategic input probing.
Researchers create holographic super-embeddings for M5 and M2 branes.
Noise Injection probes deep learning dynamics during training phases.
New method tightens federated probe-logit distillation rates under varying bandwidths.
We study supersymmetric probe M5-branes in the AdS_4 solution that arises from M5-branes wrapped on a hyperbolic 3-manifold M_3. This amounts to introducing internal defects within the framework of the 3d-3d correspondence. The BPS condition for a probe M5-brane extending along all of AdS_4 requires it to wrap a surfac…
Accumulation of standardized data collections is opening up novel opportunities for holistic characterization of genome function. The limited scalability of current preprocessing techniques has, however, formed a bottleneck for full utilization of contemporary microarray collections. While short oligonucleotide arrays …
PROBE algorithm efficiently solves sparse high-dimensional linear regression.
This work defines idealized SSL representations and improves existing methods.
Higher gauge theory via differential nonabelian cohomology
Method reduces categorical data to lower dimensions using density matrices.
Concept Hierarchies and Formal Concept Analysis are theoretically well grounded and largely experimented methods. They rely on line diagrams called Galois lattices for visualizing and analysing object-attribute sets. Galois lattices are visually seducing and conceptually rich for experts. However they present important…
This paper enhances language models with knowledge awareness.
New method predicts aphasia severity with narrower uncertainty intervals.
Entropy data replaces classical charts for smooth manifolds.
Calibrating classifiers reduces grouping loss using sufficiency criteria.
A key challenge in developing and deploying Machine Learning (ML) systems is understanding their performance across a wide range of inputs. To address this challenge, we created the What-If Tool, an open-source application that allows practitioners to probe, visualize, and analyze ML systems, with minimal coding. The W…
Neural network models have a reputation for being black boxes. We propose to monitor the features at every layer of a model and measure how suitable they are for classification. We use linear classifiers, which we refer to as "probes", trained entirely independently of the model itself. This helps us better understand …
Researchers propose a new SSL risk decomposition method to evaluate and improve self-supervised learning models.
We propose a novel confidence scoring mechanism for deep neural networks based on a two-model paradigm involving a base model and a meta-model. The confidence score is learned by the meta-model observing the base model succeeding/failing at its task. As features to the meta-model, we investigate linear classifier probe…
We present a new trace estimator of the matrix whose explicit form is not given but its matrix multiplication to a vector is available. The form of the estimator is similar to the Hutchison stochastic trace estimator, but instead of the random noise vectors in Hutchison estimator, we use small number of probing vectors…
PROBE optimizes best-arm identification with cheap proxies, improving sample complexity.
Self-supervised research improved greatly over the past half decade, with much of the growth being driven by objectives that are hard to quantitatively compare. These techniques include colorization, cyclical consistency, and noise-contrastive estimation from image patches. Consequently, the field has settled on a hand…
Classical learning assumes the learner is given a labeled data sample, from which it learns a model. The field of Active Learning deals with the situation where the learner begins not with a training sample, but instead with resources that it can use to obtain information to help identify the optimal model. To better u…
BoC probe assesses neural network confidence coherence, revealing architecture-specific uncertainty.