In this paper, a geometric framework for neural networks is proposed. This framework uses the inner product space structure underlying the parameter set to perform gradient descent not in a component-based form, but in a coordinate-free manner. Convolutional neural networks are described in this framework in a compact …
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “network framework”
Decision-Making Frameworks for Network Resilience -- Managing and Mitigating Systemic (Cyber) Riskq-fin.RM
Framework for managing cyber risks in networks.
problem Managing systemic cyber risks in digital networks.
method Three components: acceptable configurations, risk mitigation interventions, and cost function.
result Effective decision-making for network resilience.
We explore a framework called boosted Markov networks to combine the learning capacity of boosting and the rich modeling semantics of Markov networks and applying the framework for video-based activity recognition. Importantly, we extend the framework to incorporate hidden variables. We show how the framework can be ap…
Understanding theoretical properties of deep and locally connected nonlinear network, such as deep convolutional neural network (DCNN), is still a hard problem despite its empirical success. In this paper, we propose a novel theoretical framework for such networks with ReLU nonlinearity. The framework explicitly formul…
Framework captures neural network learning in large-width limit.
problem Understanding learning dynamics in large neural networks.
method Developed a rigorous framework for multilayer neural networks in mean field limit.
result Global convergence guarantees for various network architectures and initializations.
We present a probabilistic framework for nonlinearities, based on doubly truncated Gaussian distributions. By setting the truncation points appropriately, we are able to generate various types of nonlinearities within a unified framework, including sigmoid, tanh and ReLU, the most commonly used nonlinearities in neural…
Novel framework explains generalization in deep neural networks.
problem Understanding and improving generalization in deep neural networks.
method Topological Quantum Neural Networks as the semi-classical limit of Deep Neural Networks.
result Demonstrates that the perceptron, viewed as the semi-classical limit, achieves similar results to standard neural networks without training.
Unified statistical framework for LSTM model selection.
problem Model selection and hyperparameter tuning in LSTM networks is heuristic and computationally expensive.
method Proposes a statistical framework extending classical model selection ideas to LSTM networks.
result Improved performance of the proposed framework demonstrated on biomedical data.
New framework explains deep learning using signal processing techniques.
problem Lack of a rigorous mathematical theory explaining deep learning performance.
method Transform-domain sparse regularization, Radon transform, and approximation theory.
result Explains neural network properties and performance.
Deep RNNs compute American option prices and deltas efficiently.
problem Computing prices and deltas of high-dimensional American options.
method Two deep RNNs, one for price and one for delta, learn over spacetime.
result Linear time and constant memory cost compared to feedforward networks.
We propose a deep neural network framework for computing prices and deltas of American options in high dimensions. The architecture of the framework is a sequence of neural networks, where each network learns the difference of the price functions between adjacent timesteps. We introduce the least squares residual of th…
With the growth of deep learning, how to describe deep neural networks unifiedly is becoming an important issue. We first formalize neural networks mathematically with their directed graph representations, and prove a generation theorem about the induced networks of connected directed acyclic graphs. Then, we set up a …
Due to the rapid growth of machine learning tools and specifically deep networks in various computer vision and image processing areas, application of Convolutional Neural Networks for watermarking have recently emerged. In this paper, we propose a deep end-to-end diffusion watermarking framework (ReDMark) which can be…
Unified framework proves neural networks' ability to mimic complex tasks.
problem Lack of a single constructive framework for neural network universality.
method Introduces neural network approximate identity (nAI) and proves it leads to universality.
result Any nAI activation function is universal.
Active Learning of Spin Network Modelscond-mat.dis-nn
The inverse statistical problem of finding direct interactions in complex networks is difficult. In the natural sciences, well-controlled perturbation experiments are widely used to probe the structure of complex networks. However, our understanding of how and why perturbations aid inference remains heuristic, and we l…
A framework for designing and evaluating new GCN variants.
problem Designing and evaluating new graph convolutional network (GCN) variants.
method Propose a framework to compose networks using building blocks of GCN.
result Several newly composed variants are useful alternatives and competitive with original GCNs.
AI without networkscs.LG
New AI framework without networks outperforms traditional models.
problem The role of artificial neural networks (ANNs) in AI is unclear and raises ethical and legal concerns.
method Developed a parameter-free, statistically consistent data interpolation method for AI.
result Framework outperforms traditional mathematical models and ANN-based models in various applications.
An End-to-End Text-independent Speaker Verification Framework with a Keyword Adversarial Networkeess.AS
This paper presents an end-to-end text-independent speaker verification framework by jointly considering the speaker embedding (SE) network and automatic speech recognition (ASR) network. The SE network learns to output an embedding vector which distinguishes the speaker characteristics of the input utterance, while th…
Edge features contain important information about graphs. However, current state-of-the-art neural network models designed for graph learning, e.g. graph convolutional networks (GCN) and graph attention networks (GAT), adequately utilize edge features, especially multi-dimensional edge features. In this paper, we build…
Interpretable model for Granger causality using neural networks.
problem Inferring Granger causality in complex dynamical systems.
method Extension of self-explaining neural networks for multivariate Granger causality.
result Framework performs on par with baseline methods and better at inferring interaction signs.
Optimizes control interventions in real-world networks using deep-learning and network science.
problem Optimizing control over socioeconomic networks subject to constraints.
method Integrates optimization tools from deep-learning with network science.
result Characterizes vulnerability of corporate networks to takeovers.
A neural network learns to improve verification of neural networks.
problem Efficient verification of neural networks for safety-critical applications.
method A graph neural network (GNN) learns to imitate strong branching heuristics for effective branching in the Branch and Bound (BaB) formulation.
result Reduces the number of branches and verification time by roughly 50% compared to hand-designed strategies.
New framework generalizes neural network parameters to -algebra for more efficient feature learning.
problem Efficient feature learning and adaptability of neural network models.
method Generalizes neural network parameters to -algebra-valued parameters and combines models continuously.
result Shows improved feature learning with limited data using the new framework.
This paper clusters networks with annotated time-series data using kernel-ARMA and Grassmannian geometry.
problem Clustering networks with annotated time-series data, including state, node, and subnetwork clustering.
method Extract features from time-series data using kernel-ARMA, map onto Grassmannian, and cluster using Riemannian geometry.
result The proposed framework outperforms state-of-the-art clustering schemes on brain-network data.
A novel solve-training framework is proposed to train neural network in representing low dimensional solution maps of physical models. Solve-training framework uses the neural network as the ansatz of the solution map and train the network variationally via loss functions from the underlying physical models. Solve-trai…
Improved portfolio optimization reduces sensitivity to neural network initialization.
problem High sensitivity to neural network initialization in portfolio optimization.
method Robust end-to-end framework for risk budgeting portfolios.
result Enhanced stability in portfolio optimization without compromising performance.
A new framework for neural network classification using vector quantization.
problem Learning a neural network classifier under the IB principle.
method Aggregated Learning framework, combining vector quantization and variational techniques.
result The effectiveness of Aggregated Learning verified through experiments.
Framework predicts clinical severity from rs-fMRI data using network optimization.
problem Predicting clinical severity from rs-fMRI data.
method Joint network optimization framework combining sparse subnetworks and linear regression.
result Framework outperforms standard methods and identifies clinically relevant ASD networks.
A new framework explains mixed models by propagating Shapley values.
problem Making complex models like neural networks and stacked models explainable for healthcare applications.
method DeepSHAP framework for layer-wise propagation of Shapley values.
result DeepSHAP enables attributions for mixed models and theoretically justifies attributions with respect to a background distribution.
New framework analyzes deep neural networks using feature probabilities.
problem Degenerate situation in over-parameterized DNNs.
method Mean-field framework representing DNNs by feature probabilities and functions.
result Global convergence proof for over-parameterized Res-Net training.
Training deep networks is expensive and time-consuming with the training period increasing with data size and growth in model parameters. In this paper, we provide a framework for distributed training of deep networks over a cluster of CPUs in Apache Spark. The framework implements both Data Parallelism and Model Paral…
A framework for network embedding using VDS principles.
problem Challenges in systematically studying network embedding algorithms.
method Veridical Data Science (VDS) framework applied to network embedding.
result Potential for new research directions in network embedding.
As part of the new regulatory framework of Solvency II, introduced by the European Union, insurance companies are required to monitor their solvency by computing a key risk metric called the Solvency Capital Requirement (SCR). The official description of the SCR is not rigorous and has lead researchers to develop their…
Proposes a new information-theoretic framework for analyzing deep neural networks.
problem Difficulty in analyzing deep neural networks using existing theoretical frameworks.
method Introduces an information-theoretic framework with new notions of regret and sample complexity.
result Establishes sample complexity bounds for deep neural networks that are width-independent and linear in depth.
Develops a tensor network framework to reduce RNN complexity for high-dimensional sequence modeling.
problem Exponential parameter growth in RNNs for large multidimensional data.
method Embeds a multi-linear graph filter in a tensor network architecture to approximate RNN hidden states.
result Demonstrates superior performance and reduced complexity compared to traditional RNNs.
Unified framework for training SNNs using EP, faster convergence.
problem Training spiking neural networks with Expectation-Propagation.
method Message-passing framework for learning marginal distributions of SNN parameters.
result Faster convergence compared to gradient-based methods.
A new framework for lightweight BNNs learns heteroscedastic uncertainties efficiently.
problem Learning heteroscedastic uncertainties from BNNs for lightweight networks.
method Embedding heteroscedastic variances into BNN parameters and using moment propagation for inference.
result Improves predictive performance for lightweight BNNs without increasing parameter count.
A scalable framework preserves personalized higher-order network proximities.
problem Lack of expressive methods to preserve personalized higher-order network proximities.
method Incorporates random walk into a sound objective to preserve arbitrary higher-order proximities and introduces random walk with restart for personalized-weighted preservation.
result Consistently and substantially outperforms state-of-the-art methods on real-world networks.
A Data-Driven Probabilistic Framework for Cascading Urban Risk Analysis Using Bayesian Networkscs.LG
Bayesian network framework assesses urban risks across multiple domains.
problem Complex interdependencies in urban systems.
method Bayesian Belief Networks (BBNs) with DAGs, Hill-Climbing search, BIC, K2 scoring, synthetic data, SMOTE.
result Identifies key risk factors and quantifies likelihood of cascading failures.
Neural networks can learn distance metrics affecting model performance.
problem Understanding how neural networks learn and represent data.
method Experiments with six MNIST architectures, constrained to learn either distance or intensity representations.
result Distance-based learning affects model performance, validating the geometric framework.
Framework learns sentence order from paragraphs using attention and transformer networks.
problem Learning to order sentences from a paragraph.
method Bidirectional sentence encoder and self-attention transformer network for ranking.
result Framework outperforms state-of-the-art methods on sentence ordering and discrimination tasks.
Learning a similarity metric has gained much attention recently, where the goal is to learn a function that maps input patterns to a target space while preserving the semantic distance in the input space. While most related work focused on images, we focus instead on learning a similarity metric for neuroimages, such a…
Framework predicts and prepares for rain-induced microwave link attenuation.
problem Severe signal attenuation due to weather conditions degrades network performance.
method Predictive Network Reconfiguration (PNR) framework using LSTM for attenuation prediction and MSNR for dynamic routing.
result Framework improves network utilization by more than 200% compared to reactive algorithms.
Unified framework for complex financial networks using lattice theory.
problem Complex financial networks with multiple currencies and dependencies.
method Recast classical financial clearing model into lattice liability networks.
result Lattice-valued clearing sections form a complete lattice, enabling tractable analysis.
New framework tracks communities in dynamic networks.
problem Discovering and tracking communities in evolving networks.
method Spectral framework on Grassmann manifold for subspace tracking.
result Improved dynamic community detection results across various network types.
A General Framework for Complex Network Applicationsphysics.soc-ph
Complex network theory has been applied to solving practical problems from different domains. In this paper, we present a general framework for complex network applications. The keys of a successful application are a thorough understanding of the real system and a correct mapping of complex network theory to practical …
A new framework predicts links in time-dependent networks using Bernoulli autoregression.
problem Predicting links in time-dependent networks with additional auxiliary information.
method A Bernoulli autoregressive model with regularization for link discovery.
result The model can discover new links not present in the data.
A game-theoretic framework identifies influential hyperparameters for neural networks.
problem Understanding which hyperparameters are most important for neural network performance.
method Employing Shapley Effects for global sensitivity analysis and Pareto front sets for identifying effective configurations.
result Reveals which hyperparameters are most influential for different objectives in neural networks.