The key idea of current deep learning methods for dense prediction is to apply a model on a regular patch centered on each pixel to make pixel-wise predictions. These methods are limited in the sense that the patches are determined by network architecture instead of learned from data. In this work, we propose the dense…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “dense prediction”
ARMA nets expand receptive fields for dense prediction tasks.
problem Global information in dense prediction problems is challenging for traditional convolutional layers.
method ARMA layers with adjustable autoregressive coefficients replace traditional convolutions.
result ARMA networks improve dense prediction tasks including video prediction and semantic segmentation.
Paper proposes dense average network for improved power load forecasting.
problem Improving power load forecasting accuracy to save millions for the power industry.
method Introduces dense average connection and constructs dense average network for power load forecasting.
result Proposed model outperforms existing methods on public datasets.
The design of neural network architectures is an important component for achieving state-of-the-art performance with machine learning systems across a broad array of tasks. Much work has endeavored to design and build architectures automatically through clever construction of a search space paired with simple learning …
We solve 6-DoF localisation and 3D reconstruction using deep state-space models.
problem 6-DoF localisation and dense 3D reconstruction in spatial environments.
method Approximate Bayesian inference in a deep state-space model combining learning and domain knowledge.
result Near state-of-the-art performance on UAV flight data.
PARMESAN learns from memory without parameters for fast, efficient continual learning.
problem Inflexibility in deep learning methods for continual learning.
method Transductive reasoning and memory search for parameter-free learning.
result 3-4 orders of magnitude faster than baselines, comparable performance.
Sparse butterfly network replaces dense layers in neural networks, improving expressibility and performance.
problem Improving expressibility and performance of neural networks with dense layers.
method Replacing dense layers with a butterfly network architecture.
result The proposed architecture significantly reduces the number of weights from quadratic to nearly linear, with comparable or better performance.
In this paper, we study the novel problem of not only predicting ingredients from a food image, but also predicting the relative amounts of the detected ingredients. We propose two prediction-based models using deep learning that output sparse and dense predictions, coupled with important semi-automatic multi-database …
Proposes a new method for ensembling neural subnetworks.
problem Computational expense and limited flexibility of traditional deep ensembles.
method Sequential Bayesian neural subnetwork ensembling.
result Outperforms traditional ensembles in various metrics.
Deep model learns protein interfaces from high-order interactions.
problem Predicting protein interfaces from amino acid pairs.
method Graph neural networks and convolutional neural networks for 2D dense predictions.
result Our method consistently improves interface prediction performance.
Study investigates deep learning for scalable long-term traffic predictions in large transport networks.
problem Scalable long-term traffic predictions in large transport networks.
method Investigated deep learning models for link-based predictions, including clustering and graph convolutional approaches.
result Deep learning models can be useful for long-term large-scale traffic prediction, but simpler predictors are satisfactory for short-term forecasting.
New method speeds up image denoising models without sacrificing performance.
problem Efficiently training models for image denoising tasks.
method Introduces superkernel techniques for fast training of dense prediction models.
result Demonstrates effectiveness on SIDD+ benchmark with 6-8 RTX2080 GPU hours.
Paper develops Dense NN models for temporal-spatial data with improved performance.
problem Improving predictive performance and robustness in temporal-spatial modeling.
method Fully connected neural networks with ReLU activation, non-asymptotic bounds, manifold modeling, short-range dependence.
result Demonstrates superior performance in temporal-spatial modeling across various synthetic functions.
Fast Learning Rate of Non-Sparse Multiple Kernel Learning and Optimal Regularization Strategiesstat.ML
In this paper, we give a new generalization error bound of Multiple Kernel Learning (MKL) for a general class of regularizations, and discuss what kind of regularization gives a favorable predictive accuracy. Our main target in this paper is dense type regularizations including \ellp-MKL. According to the recent numeri…
Generic Hitchin representations generate dense subgroups.
problem Understanding dense subgroups in SL_n(R) representations.
method Using a theorem by Rapinchuk, Benyash-Krivetz, and Chernousov.
result Generic Hitchin representations are strongly dense.
A new method uses sinusoidal functions to represent timestamps as dense vectors for improving irregularly sampled time series learning.
problem Challenges in supervised learning with irregularly sampled time series due to irregular time intervals.
method Proposes a novel method to represent timestamps as dense vectors using sinusoidal functions, called Time Embeddings.
result Improves LSTM-based and classical machine learning models, especially with very irregular data.
New lattices in higher dimensions have dense surface subgroups.
problem Finding dense subgroups in higher-dimensional arithmetic lattices.
method Exhibited nonuniform arithmetic lattices in SO(n,1).
result Contain Zariski-dense surface subgroups.
We discuss dense embeddings of surface groups and fully residually free groups in topological groups. We show that a compact topological group contains a nonabelian dense free group of finite rank if and only if it contains a dense surface group. Also, we obtain a characterization of those Lie groups which admit a dens…
A new beta-VAE based regression model accelerates oilfield optimization studies.
problem Computational expense of full-physics reservoir simulations.
method beta-VAE for interpretable latent space representation, probabilistic dense layers for uncertainty quantification.
result Interpretable latent representation and quantified uncertainty for optimization decisions.
Using a Bayesian approach, we consider the problem of recovering sparse signals under additive sparse and dense noise. Typically, sparse noise models outliers, impulse bursts or data loss. To handle sparse noise, existing methods simultaneously estimate the sparse signal of interest and the sparse noise of no interest.…
Efficient Solution of Portfolio Optimization Problems via Dimension Reduction and Sparsificationq-fin.PM
Efficiently solves large portfolio optimization problems by reducing and sparsifying covariance matrices.
problem Large and dense covariance matrices limit efficient portfolio optimization.
method Dimension reduction and increased sparsity based on machine learning predictions.
result Improved portfolio performance and reduced runtime compared to full dense covariance matrices.
Bi-Lipschitz rigidity theorem for dense subgroups of algebraic groups.
problem Characterizing dense subgroups of algebraic groups.
method Bi-Lipschitz rigidity theorem for Zariski dense discrete subgroups.
result No -smooth slim limit set for higher rank semisimple algebraic groups.
Deep neural network predicts traffic flow on city maps.
problem Short-term traffic flow prediction on high-resolution city maps.
method UNet-based deep convolutional neural network with densely connected layers.
result Best performance on the Traffic4cast challenge 2019.
The study finds conditions for certain groups to be dense in a specific mathematical space.
problem Conditions for linear reflection groups to be dense in a projective space.
method Analyzes necessary and sufficient conditions for Zariski-density, applies to Coxeter groups and surface subgroups.
result Establishes conditions for Zariski-dense subgroups in for various .
Plasmodium falciparum malaria still poses one of the greatest threats to human life with over 200 million cases globally leading to half-million deaths annually. Of these, 90% of cases and of the mortality occurs in sub-Saharan Africa, mostly among children. Although malaria prediction systems are central to the 2016-2…
Lottery tickets find good initializations for IMP with sparse training.
problem Finding good initializations for iterative magnitude pruning (IMP) in sparse networks.
method Empirical study of IMP performance with varying pre-training data and iterations.
result Training on a small fraction of data suffices to obtain good initializations for IMP.
VSPS creates flexible prediction regions for multi-target regression with guaranteed coverage.
problem Uncertainty quantification in multi-target regression with complex distributions.
method Conditional normalizing flows with conformal calibration to identify dense regions.
result VSPS produces smaller, more informative prediction regions with robust coverage guarantees.
New representations of hyperbolic 3-manifold groups into larger groups.
problem Finding representations of hyperbolic 3-manifold groups into larger matrix groups.
method Holonomy representations from projective deformations of hyperbolic structures.
result First examples of strongly dense representations into and .
Detects dense subhypergraphs in heterogeneous random hypergraphs.
problem Testing for the existence of a dense subhypergraph in heterogeneous random hypergraphs.
method Established detection boundaries and constructed asymptotically powerful and adaptive tests.
result Developed tests for distinguishing between null and alternative hypotheses.
Dense neural networks can't approximate all functions.
problem Approximation capabilities of dense neural networks.
method Model compression approach combining weak regularity lemma and graph neural networks.
result Existence of Lipschitz continuous functions not approximable by dense neural networks.
Paper provides statistical guarantees for GNNs in link prediction.
problem Link prediction accuracy in graph neural networks.
method Proposes a linear GNN architecture (LG-GNN) and derives statistical guarantees.
result LG-GNN produces consistent estimators for edge probabilities and has better detection of high-probability edges.
Odd-dimensional SL(n,Q) contains dense surface subgroups.
problem Finding dense subgroups in SL(n,Q) for odd n.
method Constructing a continuous path of representations.
result Existence of dense surface subgroups in SL(n,Q) for odd n.
Classifies manifolds with dense conjugacy classes in their mapping class groups.
problem Classifying manifolds based on conjugacy classes in their mapping class groups.
method Analyzing connected orientable 2-manifolds and their mapping class groups.
result Mapping class groups of certain manifolds have dense conjugacy classes.
New method uses product embeddings to predict bundle success.
problem Designing effective product bundles in large retail settings.
method Leverage historical purchases and clickstream data to generate product embeddings, then use heuristics for complementarity and substitutability.
result Embeddings-based heuristics predict bundle success, robust across categories and retailers.
The paper finds dense subgroups in certain Lie groups.
problem Finding dense subgroups in Lie groups.
method Constructing dense surface subgroups in specific Lie groups.
result Uniform lattices contain infinitely many dense Hitchin representations.
New examples of rigid Lie foliations with dense leaves found.
problem Infinitesimal rigidity of Lie foliations with dense leaves.
method Construction of specific Lie foliations.
result First examples of infinitesimally rigid Riemannian foliations with dense leaves.
Like most learning algorithms, the multilayer perceptrons (MLP) is designed to learn a vector of parameters from data. However, in certain scenarios we are interested in learning structured parameters (predictions) in the form of symmetric positive definite matrices. Here, we introduce a variant of the MLP, referred to…
Predicting human fixations from images has recently seen large improvements by leveraging deep representations which were pretrained for object recognition. However, as we show in this paper, these networks are highly overparameterized for the task of fixation prediction. We first present a simple yet principled greedy…
Sharp boundaries for detecting dense subhypergraphs established.
problem Detecting dense subhypergraphs in random hypergraphs.
method Established sharp detection boundaries for known and unknown edge probabilities.
result Sharp detectable regions differ significantly from graph counterparts.
Method generates dense fields from sparse measurements without needing spatial statistics or examples.
problem Generating dense physical fields from sparse measurements.
method Introduces a differentiable numerical simulator into neural network training.
result Superior results on fluid mechanics problems compared to statistical and neural network methods.
Paper tackles dense subgraph discovery with noisy feedback.
problem Discover dense subgraphs in edge-weighted graphs with noisy feedback.
method Proposes polynomial-time and scalable algorithms for dense subgraph discovery.
result Polynomial-time algorithm obtains nearly-optimal solution with high probability.
Deforms surface groups to be Zariski dense in SL(n,R)
problem Finding Zariski dense surface groups in SL(n,R)
method Deforming -integral representations of surface groups
result Generalizes Long and Thistlethwaite's method to SL(n,R)
The paper finds free semigroups in dense subgroups of Lie groups with critical exponents arbitrarily close to the subgroup's.
problem Finding free semigroups with critical exponents arbitrarily close to a subgroup's in dense subgroups of Lie groups.
method Analyzing Zariski dense discrete subgroups of Lie groups, showing the existence of free semigroups with critical exponents arbitrarily close to the subgroup's.
result The existence of free semigroups with critical exponents arbitrarily close to the subgroup's in dense subgroups of Lie groups.
Density of wave frontsmath.DG
Wave fronts on certain surfaces become dense.
problem Density of wave fronts on surfaces.
method Proof of density for specific surfaces.
result Wave fronts become dense on flat torus, square billiard, Klein bottle, and cube surface.
Example shows dense subgroup of SL5(Z) not finitely presented.
problem Finding dense subgroups of SL5(Z) that are not finitely presented.
method Discussing an example of a Zariski-dense finitely generated subgroup of SL5(Z).
result Example shows a subgroup that is dense but not finitely presented.
We prove that every Bers slice of quasi-Fuchsian space is Zariski dense in the character variety.
A dense amalgam connects boundaries of groups split by finite subgroups.
problem Understanding boundaries of groups split by finite subgroups.
method Introducing dense amalgam and applying it to -boundaries.
result Boundaries of groups split by finite subgroups have a dense amalgam structure.
Supervised Multivariate Learning with Simultaneous Feature Auto-grouping and Dimension Reductionstat.ML
CRL framework groups features for multivariate learning with sparse and dense problems.
problem Sparse and dense problems in supervised multivariate learning.
method Clustered reduced-rank learning (CRL) with joint matrix regularizations.
result CRL framework is more interpretable and relaxes sparsity assumption.