CwA optimizes search performance by jointly learning a balanced database partition and a neural probing function.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
We identify spectral conditions for reliable neural probe interpretation.
A probing scheme is considered with an accessible and controllable qubit, used to probe an out-of equilibrium system consisting of a second qubit interacting with an environment. Quantum spontaneous synchronization between the probe and the system emerges in this model and, by tuning the probe frequency, can occur both…
System guides freehand obstetric ultrasound probe movements.
We propose a new class of probabilistic neural-symbolic models, that have symbolic functional programs as a latent, stochastic variable. Instantiated in the context of visual question answering, our probabilistic formulation offers two key conceptual advantages over prior neural-symbolic models for VQA. Firstly, the pr…
This paper focuses on the problem of estimating historical traffic volumes between sparsely-located traffic sensors, which transportation agencies need to accurately compute statewide performance measures. To this end, the paper examines applications of vehicle probe data, automatic traffic recorder counts, and neural …
We explore the problem of selectively forgetting a particular subset of the data used for training a deep neural network. While the effects of the data to be forgotten can be hidden from the output of the network, insights may still be gleaned by probing deep into its weights. We propose a method for "scrubbing'" the w…
New RL method learns value function for many policies using few key states.
We study the statistical behavior of reasoning probes in a stylized model of iterative computation inspired by neural algorithmic reasoning. The underlying computation is given by a looped Boolean circuit whose graph is a perfect -ary tree (), with outputs recursively fed back as inputs across computation ro…
This two-part work puts forth the idea of engaging power electronics to probe an electric grid to infer non-metered loads. Probing can be accomplished by commanding inverters to perturb their power injections and record the induced voltage response. Once a probing setup is deemed topologically observable by the tests o…
Probe-level models have led to improved performance in microarray studies but the various sources of probe-level contamination are still poorly understood. Data-driven analysis of probe performance can be used to quantify the uncertainty in individual probes and to highlight the relative contribution of different noise…
Noise Injection probes deep learning dynamics during training phases.
BoC probe assesses neural network confidence coherence, revealing architecture-specific uncertainty.
Optimal probing framework for scalable network monitoring.
Paper introduces Manifold Probe for discovering representation manifolds in superposition.
OLPA optimizes online user-centric selection with probing, achieving near-optimal regret bounds.
This paper explores what causal structures can be distinguished by observational and interventional probing schemes.
Neural network models have a reputation for being black boxes. We propose to monitor the features at every layer of a model and measure how suitable they are for classification. We use linear classifiers, which we refer to as "probes", trained entirely independently of the model itself. This helps us better understand …
Improved loss functions adapt to weight-space anisotropy, outperforming isotropic counterparts.
New method certifies neural network function space norms from point evaluations.
We propose a novel confidence scoring mechanism for deep neural networks based on a two-model paradigm involving a base model and a meta-model. The confidence score is learned by the meta-model observing the base model succeeding/failing at its task. As features to the meta-model, we investigate linear classifier probe…
Bayesian optimization has recently emerged as a popular and efficient tool for global optimization and hyperparameter tuning. Currently, the established Bayesian optimization practice requires a user-defined bounding box which is assumed to contain the optimizer. However, when little is known about the probed objective…
Neural networks classify OOD images by their nearest neighbor in training data.
Paper analyzes why deeper layers of ViTs perform worse on out-of-distribution tasks.
The ability of modeling the other agents, such as understanding their intentions and skills, is essential to an agent's interactions with other agents. Conventional agent modeling relies on passive observation from demonstrations. In this work, we propose an interactive agent modeling scheme enabled by encouraging an a…
New framework to test neural network representation similarity measures.
This paper proposes GProp, a deep reinforcement learning algorithm for continuous policies with compatible function approximation. The algorithm is based on two innovations. Firstly, we present a temporal-difference based method for learning the gradient of the value-function. Secondly, we present the deviator-actor-cr…
Accumulation of standardized data collections is opening up novel opportunities for holistic characterization of genome function. The limited scalability of current preprocessing techniques has, however, formed a bottleneck for full utilization of contemporary microarray collections. While short oligonucleotide arrays …
Noise balance theory explains SGD's behavior in neural networks.
Entropy data replaces classical charts for smooth manifolds.
Study examines flaws in probing LLMs' knowledge and introduces a new method.
Amortizes MIPS by training neural networks to predict optimal keys.
We present a new trace estimator of the matrix whose explicit form is not given but its matrix multiplication to a vector is available. The form of the estimator is similar to the Hutchison stochastic trace estimator, but instead of the random noise vectors in Hutchison estimator, we use small number of probing vectors…
We study inverse problems consisting on determining medium properties using the responses to probing waves from the machine learning point of view. Based on the understanding of propagation of waves and their nonlinear interactions, we construct a deep convolutional neural network in which the parameters are used to cl…
Distribution grids currently lack comprehensive real-time metering. Nevertheless, grid operators require precise knowledge of loads and renewable generation to accomplish any feeder optimization task. At the same time, new grid technologies, such as solar photovoltaics and energy storage units are interfaced via invert…
Improved unsupervised probing for ranking tasks using Contrast-Consistent Ranking.
In this paper we present an algorithm for rapid Bayesian analysis that combines the benefits of nested sampling and artificial neural networks. The blind accelerated multimodal Bayesian inference (BAMBI) algorithm implements the MultiNest package for nested sampling as well as the training of an artificial neural netwo…
Proposes a method to create predictive sets from partially labeled data.
This research discovers model architecture and training dataset characteristics through strategic input probing.
Interactive framework improves understanding of deep neural networks.
Proves accuracy guarantees for self-supervised learning with correlated positive pairs.
Study quantifies information flow in neural networks using relative entropy and RG analogy.
Cosmic shear is a primary cosmological probe for several present and upcoming surveys investigating dark matter and dark energy, such as Euclid or WFIRST. The probe requires an extremely accurate measurement of the shapes of millions of galaxies based on imaging data. Crucially, the shear measurement must address and c…
Researchers create holographic super-embeddings for M5 and M2 branes.
Deep learning models outperform classical methods in forecasting neural activity.
New method tightens federated probe-logit distillation rates under varying bandwidths.
We study supersymmetric probe M5-branes in the AdS_4 solution that arises from M5-branes wrapped on a hyperbolic 3-manifold M_3. This amounts to introducing internal defects within the framework of the 3d-3d correspondence. The BPS condition for a probe M5-brane extending along all of AdS_4 requires it to wrap a surfac…
This work justifies neural collapse under MSE loss and analyzes the optimization landscape.