Predicts entity-wise topical behavior from network logs.
problem Predicting entity-wise topical behavior from network logs.
method Combines RNN and CNN learning architectures with reduction steps to form homogeneous topical metrics.
result Improves prediction accuracy with both temporal and spatial gains compared to MLP.
Wide networks with polynomial activations have proven asymptotic behavior.
problem Understanding the behavior of neural networks in the large width limit.
method Proving a conjecture for deep networks with polynomial activation functions.
result Tight bounds on the behavior of wide networks during stochastic gradient descent and derivation of their finite-width dynamics.
Calendar graph neural networks model user behavior with location and time data.
problem Modeling user behavior with location and time information for demographic prediction.
method Graph neural networks with a tripartite network of items, sessions, and locations, and a hierarchical calendar network.
result User embeddings preserve spatial and temporal patterns of various periodicity.
Economics examines social networks through externality effects.
problem Understanding how individual actions impact others in social networks.
method Analyzes network formation and interactions within networks from an economic perspective.
result Externalities are crucial in explaining network dynamics and behaviors.
Survey visual analytics methods for detecting anomalous user behaviors.
problem Understanding and detecting anomalous user behaviors in various domains.
method Survey and classification of visual analytics methods in four categories.
result Discussion of findings and potential research directions.
This paper reveals periodic behavior in neural network training with BN and weight decay.
problem Understanding the dynamics of neural network training with BN and weight decay.
method Rigorous investigation of empirical and theoretical mechanisms.
result Periodic behavior in training is a generalization of previously opposing perspectives.
The majority of real-world networks are dynamic and extremely large (e.g., Internet Traffic, Twitter, Facebook, ...). To understand the structural behavior of nodes in these large dynamic networks, it may be necessary to model the dynamics of behavioral roles representing the main connectivity patterns over time. In th…
Generative adversarial network creates motion templates for agent training.
problem Training reinforcement learning agents with meaningful behaviors.
method Trains a GAN to produce motion templates from raw pixel data.
result Generated motions enable training reinforcement learning agents in novel environments.
Network Lens identifies node behaviors in heterogeneous networks with high accuracy.
problem Identifying different behaviors in various parts of large heterogeneous networks.
method Zoom into network using different-sized lenses to capture local structure, weight signatures to predict node labels.
result Achieved a peak accuracy of ~42% on two networks with ~100,000 and ~1,000,000 nodes, significantly better than random.
Model captures neural activity related to behavior while separating internal computations.
problem Capturing neural activity related to behavior from complex brain recordings.
method Behavior-decomposed linear dynamical systems (b-dLDS) model.
result Improves over state-of-the-art models in disentangling behavior-related dynamics.
Neural networks improve scalability for agent-based modeling demonstrations.
problem Scalability issues in training models of dynamic systems from demonstrations.
method Use of neural networks to reduce the search space for agent-level parameters.
result More scalable architecture for reproducing emergent behavior from demonstrations.
The paper models social networks with varying levels of reciprocity.
problem Understanding diverse reciprocal behavior in social networks.
method Developed a preferential attachment model with heterogeneous reciprocity.
result Captures the heavy-tailed nature of empirical degree distributions and identifies multiple user groups.
Method uses Feynman diagrams to analyze wide network behavior.
problem Understanding the asymptotic behavior of wide networks.
method Adaptation of Feynman diagrams for multivariate Gaussian integrals.
result Closed-form expressions for higher-order terms in wide network training.
Gaussian process models simplify neural network behavior for easier understanding.
problem Understanding and predicting the behavior of deep learning systems.
method Constructing surrogate models using Gaussian processes from finite neural networks.
result Surrogate models capture phenomena like spectral bias and predict generalization well.
ProMoD models human race drivers with probabilistic movement primitives and neural networks.
problem Challenging task of modeling human driver behavior due to variability and complexity.
method Modular framework with Probabilistic Movement Primitives, clothoids, and neural networks.
result Significant advantages in imitation accuracy and robustness compared to other algorithms.
The paper develops personalized DAG models for web user behavior.
problem Understanding user behavior transitions between websites with user heterogeneity and network dependency.
method Personalized Binomial DAG models with network-structured covariates, embedding network structure into a dimension-reduced covariate, learning node neighborhoods, and exploring variance-mean relation.
result The proposed algorithm outperforms state-of-the-art competitors in heterogeneous data.
NTK theory fails to predict practical behavior of large-width neural networks.
problem Theoretical limits of NTK do not match practical neural network architectures.
method Empirical investigation of NTK's applicability to large-width architectures.
result Practically relevant behavior of large-width architectures differs from NTK theory.
MatchGNet detects malware by learning program behavior graphs.
problem Malware evasion through obfuscation and high false positives in traditional detection methods.
method Heterogeneous Graph Matching Network model that learns graph representation and similarity metrics.
result MatchGNet reduces false positives by 50% while maintaining zero false negatives.
GANs improve building performance model accuracy by integrating occupant behaviors.
problem Discrepancies between design and operation performance in buildings.
method Generative Adversarial Networks (GANs) to learn mixture models combining existing BPMs with occupant behaviors.
result Augmented BPMs significantly outperform existing BPMs in achieving specified performance targets.
Chemical networks outperform spiking neural networks in classification tasks.
problem Learning tasks with spiking neural networks require hidden layers, which are computationally expensive.
method Used deterministic mass-action kinetics to prove chemical reaction networks without hidden layers can solve tasks previously solved by spiking neural networks.
result A chemical reaction network without hidden layers outperforms a spiking neural network with hidden layers in a handwritten digit classification task.
Robots learn diverse behaviors to adapt to changing environments.
problem Robots struggle to adapt to new environments with unexpected changes.
method Generative adversarial policy networks to learn and sample a diverse set of behaviors.
result Robots can hit targets more often in changing environments.
Complex neural networks simplify to a mean field model as the number of neurons increases.
problem Understanding the behavior of multilayer neural networks with many neurons.
method Developed a mean field limit formalism for multilayer neural networks under stochastic gradient descent.
result The behavior of multilayer neural networks simplifies to a mean field model as the number of neurons grows large.
New framework to test neural network representation similarity measures.
problem Disagreements among dissimilarity measures in neural networks.
method Statistical testing framework to evaluate measures based on functional behavior.
result Current metrics have different weaknesses; a classical baseline performs surprisingly well.
Machine learning predicts criminal networks' missing partnerships and future behavior.
problem Predicting and understanding criminal networks' properties and future behavior.
method Combining graph representation learning and machine learning methods.
result Outstanding accuracy in predicting missing criminal partnerships and future behavior.
Agent-based simulation assesses tradable credit schemes for congestion reduction.
problem Simplistic modeling of TCS impacts in transportation research.
method Agent- and activity-based simulation framework within SimMobility.
result TCS stabilizes network and market performance over time, reducing congestion.
DMGE learns cross-domain user behavior embeddings using multi-graphs and GNNs.
problem Data sparsity in learning large-scale item embedding from individual domain data.
method Construct multi-graphs from users' behaviors across domains, use multi-graph neural networks to learn cross-domain representation.
result DMGE outperforms state-of-the-art embedding methods in various tasks.
Deep learning model predicts online fraud using customer behavior data.
problem Predicting online financial fraud from customer behavior data.
method Recurrent Neural Network (RNN) integrated with Markov Transition Field (MTF).
result The proposed model significantly improves fraud prediction compared to traditional methods.
Neural networks predict airport passenger behavior using WiFi traces.
problem Predicting airport passenger activity choices inside the terminal.
method Three neural network architectures: FNN, LSTM, and their combination. Inputs include static and dynamic passenger data. Real-world case study at Bologna Airport.
result LSTM approach, especially with short prediction horizons, outperforms FNN.
Proposes a graph-based system for personalized news recommendation considering multiple user behaviors.
problem Lack of considering multiple user behaviors in news recommendation systems.
method Builds an interaction behavior graph, applies DeepWalk and G-CNN for news and behavior sequence representations, introduces core and coritivity features.
result Achieves personalized news recommendation considering user's concentration degree of interests.
The paper characterizes averages of unlabeled networks and their asymptotic behavior.
problem Developing network-based analogues of basic tools for scalar and vector data.
method Characterizing a space of unlabeled, undirected networks, describing its topological and geometric properties, and using these to establish asymptotic behavior of empirical means.
result Asymptotic behavior of a generalized notion of an empirical mean under sampling from a distribution supported on the space of unlabeled networks.
The study reveals a transition in neural network performance from infinite-width to variance-limited behavior as dataset size increases.
problem Understanding the transition from infinite-width to variance-limited behavior in neural networks.
method Empirical study of the transition from infinite-width to variance-limited behavior as a function of sample size and network width.
result The critical sample size \( P^* \) is approximately \( \sqrt{N} \) for polynomial regression with ReLU networks.
CrescendoNet is a simple deep CNN outperforming others on benchmark datasets.
problem Improving performance of deep neural networks without residual connections.
method Stacking simple blocks with independent convolution paths, increasing depth linearly.
result CrescendoNet with 15 layers and 4.1M parameters outperforms DenseNet-BC with 250 layers and 15.3M parameters.
Behavior Transfer improves reinforcement learning by leveraging pre-trained policies.
problem Efficient transfer of knowledge in reinforcement learning.
method Behavior Transfer (BT) that uses pre-trained policies for exploration.
result BT combined with pre-training leads to better solutions than without pre-training.
New framework explains neural network behavior through geometric postulates.
problem Understanding neural network mechanisms and making them more transparent.
method Introducing the Pursuit of Subspaces (PoS) hypothesis as an axiomatic framework.
result Unified geometric perspective on neural network representation, computation, and generalization.
Researchers use statistical physics to model neural network learning dynamics.
problem Understanding the learning dynamics of ReLU neural networks.
method Developed a system of differential equations using statistical physics techniques.
result ReLU networks exhibit distinct learning behavior compared to sigmoidal networks.
Machine learning predicts phase behavior in active matter suspensions.
problem Predicting phase behavior in active matter systems using machine learning.
method Used deep learning techniques, including fully connected networks and graph neural networks, to predict motility-induced phase separation (MIPS) in ABP suspensions.
result Strong agreement between machine learning predictions and MIPS binodal from simulations, suggesting machine learning as an effective method for phase behavior determination.
There is a large amount of interest in understanding users of social media in order to predict their behavior in this space. Despite this interest, user predictability in social media is not well-understood. To examine this question, we consider a network of fifteen thousand users on Twitter over a seven week period. W…
Deep learning classifies animal behavior from wearable accelerometers.
problem Classifying animal behavior from accelerometer data.
method End-to-end deep neural network with IIR and FIR filters.
result Outperforms state-of-the-art algorithms in real-time classification.
MLDS dataset reveals hidden model behavior via weight-space analysis.
problem Neural networks' opacity makes them hard to evaluate.
method Presented MLDS dataset of trained neural networks.
result Weight-space analysis reveals meaningful divergence with small changes in training data.
Gradient descent dynamics in neural networks show quenching and activation phases.
problem Understanding training dynamics in neural networks.
method Numerical and phenomenological study of gradient descent algorithm for two-layer neural networks.
result Gradient descent dynamics exhibit quenching and activation phases in under-parametrized networks.
Analyzes neural networks using linear models to understand their behavior.
problem Understanding multi-layer neural networks through linear models.
method Recalls and reviews four models: linear regression with concentrated features, kernel ridge regression, random feature model, and neural tangent model.
result Highlights limitations of linear theory and discusses approaches to overcome them.
Unified facial behavior analysis network improves performance across tasks.
problem Independent study of facial behavior tasks.
method Single multi-task, multi-domain, multi-label network (FaceBehaviorNet).
result Joint training of facial behavior tasks yields better performance.
Modeling cascading behavior in complex systems using CTBNs.
problem Understanding which states trigger cascading events in complex systems.
method Continuous-time Bayesian networks (CTBNs) for modeling and identifying likely sentry states.
result Identification of likely sentry states that may lead to cascading behavior.
Deep neural networks are biased towards low frequencies, affecting global behavior.
problem Understanding the limitations of neural networks in capturing high-frequency patterns.
method Using Fourier analysis, the study examines the spectral bias of neural networks and their expressivity.
result Deep ReLU networks are biased towards low frequency functions, making it difficult to capture local fluctuations.
We analyze deep neural networks in the large size and iteration limit, revealing a deterministic system of equations.
problem Understanding the behavior of deep neural networks in the asymptotic regime of large network sizes and iterations.
method Sequential limit of each hidden layer and characterization of parameter evolution, using weak convergence and stochastic analysis.
result The limit neural network recovers a global minimum with zero loss for the objective function.
A deep network learns diverse contexts from multi-modal sensor data.
problem Recognizing diverse contexts and activities from multi-modal sensor data.
method Multi-stream temporal convolutional network with contextualization module.
result Deep network achieves optimal recognition rate.
The paper explores how structured representations influence learning dynamics in neural networks.
problem Understanding the training dynamics of deep neural networks.
method Investigates a family of enriched transformation layers with constrained pathways and adaptive corrections.
result Improved robustness, smoother optimization, and scalable depth behavior are achieved through structured representations.
The paper applies Information Bottleneck theory to CNNs and finds compression phase not always present.
problem Understanding the behavior of convolutional neural networks.
method Employed Information Bottleneck theory to analyze CNNs.
result Compression phase not observed in all CNN cases.