Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

4590135180 · Jun 202019922001200920172026
48 results for sparse configurations

Sparse Bayesian Optimization (SEBO) finds interpretable configurations.

problem Optimizing black-box functions for recommendation systems while maintaining interpretability.
method Regularization-based approaches, including a differentiable relaxation for L0L_0 regularization, and a hyperparameter-free method SEBO.
result SEBO efficiently optimizes for sparsity without hyperparameters.

Entropy regularization improves sparse model discovery in federated learning.

problem Sparse model discovery in federated learning with limited data.
method Entropy regularization of gate distributions for probabilistic sparse model exploration.
result Entropy regularization leads to better sparse model recovery and performance.

BONSAI optimizes parameters while respecting a default configuration, reducing unnecessary changes.

problem Standard BO pushes weakly relevant parameters to the boundary, making it hard to distinguish between important and spurious changes.
method BONSAI is a default-aware BO policy that prunes low-impact deviations from a default configuration while controlling acquisition value loss.
result BONSAI matches the GP-UCB regret rate while recovering the minimal-0\ell_0 solution, reducing the number of non-default parameters in recommended configurations.

Campfire simplifies sparse training for CNNs, achieving high accuracy with minimal pruning.

problem Training CNNs with sparse weights to maintain high accuracy and robustness.
method Gradual pruning technique with simplified sparsity structure, exploring various tradeoffs.
result Sparse ResNet-50 and ResNet-50 v1.5 achieve 75% top-1 accuracy with 70% sparsity, <1% accuracy loss.

Greedy algorithm performs well in online matching despite non-i.i.d. connections.

problem Online matching in sparse random graphs with fixed degree distributions.
method Approximating stochastic processes with partial differential equations.
result GREEDY algorithm can outperform RANKING in certain configurations.

Neuromorphic hardware tends to pose limits on the connectivity of deep networks that one can run on them. But also generic hardware and software implementations of deep learning run more efficiently for sparse networks. Several methods exist for pruning connections of a neural network after it was trained without conne…

2017-11-14abs ↗pdf ↗

Sparse point observations can provide useful local constraints, but their benefit for radar-like fields depends on the training loss, uncertainty representation, and how observation support is encoded in the model.

problem Improving dense radar-field forecasts with sparse point observations
method A multimodal graph neural network nowcasting system over the Nordic radar domain
result Each source improves a different part of the forecast problem

3BASiL-TM decomposes LLMs into sparse and low-rank matrices for efficient compression.

problem Efficiently compressing large language models without significant performance loss.
method 3-Block ADMM method and transformer-matching refinement step for sparse plus low-rank decomposition.
result 3BASiL-TM reduces perplexity gap by over 30% and speeds up compression by 2.5x.

New scheme for sparse feature selection in networked data.

problem Sparse feature selection in distributed, communication-restricted networks.
method Distributed sparse linear regression and feature selection method.
result True causal features can be reliably recovered with minimal bandwidth usage.

Generative model learns wireless channel distributions efficiently.

problem Learning precise wireless channel distributions for optimal communication.
method Physics-informed sparse Bayesian generative modeling (SBGM) with compressed data.
result Model learns channel parameters from compressed AP observations, is physically interpretable, and generalizes across different systems.

Entropy regularization improves interpretability of probabilistic clustering models.

problem Bayesian nonparametric mixture models often produce unbalanced cluster frequencies.
method Interpreting the posterior as penalized likelihood, entropy regularization reduces sparsely-populated clusters.
result The proposed entropy-regularized estimator enhances interpretability without sacrificing computational convenience.

A new method for training generative models with sparse supervision.

problem Training deep generative models with sparse and varying supervision.
method Caffeinated Wake-Sleep (CWS) method, combining reweighted wake-sleep and teacher-forcing.
result The CWS method is robust to variable length supervision and performs well on various datasets.

Proposes a robust 3D classification method for sparse point clouds.

problem Invariance to rotation, positional shift, scaling, and robustness to point sparsity in point cloud classification.
method Introduces a graph-based feature learning approach with an end-to-end neural network.
result Significantly improves 3D object classification and retrieval tasks with sparse point clouds.

This paper presents a spermwhale' localization architecture using jointly a bag-of-features (BoF) approach and machine learning framework. BoF methods are known, especially in computer vision, to produce from a collection of local features a global representation invariant to principal signal transformations. Our idea …

2013-06-13abs ↗pdf ↗

We study the configuration space of equilateral and equiangular spatial hexagons for any bond angle by giving explicit expressions of all the possible shapes. We show that the chair configuration is isolated, whereas the boat configuration allows one-dimensional deformations which form a circle in the configuration spa…

2011-05-25abs ↗pdf ↗

DCRL learns causal relationships from mixed-type discrete data.

problem Challenges in learning causal relationships from discrete, mixed-type data.
method Generative framework modeling directed acyclic graph and sparse bipartite graph, flexible measurement models for different types of data.
result Consistent recovery of latent causal structure from observed data distribution.

Study shows configuration spaces' homological dimension increases monotonically.

problem Understanding the homological properties of configuration spaces of manifolds.
method Analyzing the homological monotonicity of unordered configuration spaces of manifolds.
result Homological dimension of configuration spaces increases monotonically in each degree.

A new Bayesian model improves forecasting for intermittent demand.

problem Sparse observations, cold-start items, and obsolescence in intermittent demand forecasting.
method Hierarchical Bayesian TSB model with partial pooling and calibrated probabilistic configuration.
result TSB-HB achieves the lowest RMSE and RMSSE on the UCI Online Retail dataset.

Transformers exhibit sparse activation maps, reducing computational load and improving robustness.

problem Sparse activation in Transformer models.
method Extensive experiments on various Transformer architectures and tasks.
result Sparsity in Transformers is a prevalent phenomenon, reducing FLOP count and improving model robustness.

Tripod configurations of plane curves, formed by certain triples of normal lines coinciding at a point, were introduced by Tabachnikov, who showed that C2C^2 closed convex curves possess at least two tripod configurations. Later, Kao and Wang established the existence of tripod configurations for C2C^2 closed locally c…

2014-08-20abs ↗pdf ↗

We study the Orchard relation for generic configurations of points in the plane (also called order types). We introduce infinitesimally-close points and analyse the relation of this notion with the Orchard relation. The second part of the paper deals with monochromatic configurations (for the Orchard relation). We give…

2002-10-03abs ↗pdf ↗

This paper extends homological stability results for configuration spaces of manifolds.

problem Homological stability of configuration spaces of manifolds.
method Analyzing the cohomology of configuration spaces of manifolds, focusing on stability in odd and even degrees.
result The stable range for homology groups of configuration spaces depends on the dimension of the manifold and the number of configuration points.

Proposes a thermodynamic work minimization framework for guiding generative models.

problem Guiding generative models in sparse-data regimes with limited target samples or constraints.
method Regularization framework inspired by thermodynamic work, introducing Path Guidance and Observable Guidance.
result Improves sample efficiency and reduces bias in molecular simulations.

We study configurations of immersed curves in surfaces and surfaces in 3-manifolds. Among other results, we show that primitive curves have only finitely many configurations which minimize the number of double points. We give examples of minimal configurations not realized by geodesics in any hyperbolic metric.

1999-03-22abs ↗pdf ↗

Machine learning (ML) classification is increasingly used in safety-critical systems. Protecting ML classifiers from adversarial examples is crucial. We propose that the main threat is that of an attacker perturbing a confidently classified input to produce a confident misclassification. To protect against this we devi…

2019-09-19abs ↗pdf ↗

Low bit-width integer weights and activations are very important for efficient inference, especially with respect to lower power consumption. We propose Monte Carlo methods to quantize the weights and activations of pre-trained neural networks without any re-training. By performing importance sampling we obtain quantiz…

2019-05-29abs ↗pdf ↗

Solves Plateau-Douglas problem for singular configurations in general metric spaces.

problem Existence of minimal surfaces for singular configurations.
method Generalized approach via minimal sequences in metric spaces.
result Existence of minimal surfaces for singular configurations in general metric spaces.

Ensuring that all supposedly valid configurations of a software product line (SPL) lead to well-formed and acceptable products is challenging since it is most of the time impractical to enumerate and test all individual products of an SPL. Machine learning classifiers have been recently used to predict the acceptabilit…

2018-05-30abs ↗pdf ↗

Study maps surface configurations to Heisenberg homologies for mapping class groups.

problem Understanding Mapping Class Groups of punctured surfaces.
method Action of mapping classes on Heisenberg homologies of surface configurations.
result Representations of Mapping Class Groups derived from Heisenberg homologies.

Sharp upper bound for quasi polynomial degree of manifold configuration spaces.

problem Determining the exact degree of quasi-polynomial homology groups of configuration spaces.
method Analyzing extremal homology groups of unordered configuration spaces of manifolds.
result The upper bound for the degree of quasi-polynomials is sharp for every manifold.

We prove a conjecture of Crapo and Penne which characterizes isotopy classes of skew configurations with spindle-structure. We use this result in order to define an invariant, spindle-genus, for spindle-configurations. We also slightly simplify the exposition of some known invariants for configurations of skew lines an…

2002-05-23abs ↗pdf ↗

Optimizes glmnet configuration for better accuracy and efficiency.

problem Inappropriate glmnet configuration leads to inaccurate solutions and increased computation time.
method Data-driven framework using neural networks to predict accuracy and computation time from dataset characteristics and configuration.
result Automatic selection of optimal configuration maximizing accuracy under a time constraint.