Develops a novel framework for activity shaping in social networks.
problem Controlling user activity spread in social networks.
method Optimizes the spectral radius of the Hazard matrix for local control actions.
result Minimizes the influence of information cascades through targeted resource allocation.
New findings connect shaped and unshaped neural networks using differential equations.
problem Understanding the behavior of neural networks with different activation scaling methods.
method Deriving differential equation-based asymptotic characterizations for shaped and unshaped neural networks.
result Two types of unshaped networks converge to the same infinite-depth-and-width limit at initialization.
New method allows sheets to morph into multiple shapes via spatially varying stimuli.
problem Limitation of current shape-programmed sheets to achieve only one target geometry.
method Patterning the stimulus itself for spatiotemporal control over local deformation magnitudes.
result A single physical sample can be induced to traverse a continuous family of target geometries.
Active-set algorithm improves Cox regression for shape-restricted covariates.
problem Improving Cox regression for shape-restricted covariates.
method Shape-restricted inference using active-set optimization for spline basis expansion.
result Active-set algorithm produces accurate linear covariate effect estimates.
Study on neural network initialization with shaped infinite depth-and-width networks.
problem Understanding the distribution of random covariance matrices in shaped infinite-depth-and-width networks.
method Introduced the Neural Covariance SDE to model the distribution of the random covariance matrix.
result Identified the precise scaling of the activation function necessary for a non-trivial limit.
New active learning methods for Gaussian process improve predictive modeling of composite fuselage.
problem Improving predictive modeling of composite fuselage with limited training samples and uncertainties.
method Proposed two new active learning algorithms for Gaussian process considering uncertainties.
result The proposed approach realizes better prediction performance for automatic shape control of composite fuselage.
This research optimizes fluid-dynamic designs using deep learning and active learning.
problem Expensive and limited empirical design verification for fluid dynamics.
method Applied a deep learning architecture to predict and optimize fluid dynamics performance.
result Reduced the number of required simulation data points from ~8000 to 625.
ESPRESSO segments time-series data for better human activity recognition.
problem Segmenting high-dimensional time-series data for applications like HAR.
method ESPRESSO combines entropy and shape analysis for multi-dimensional time-series segmentation.
result ESPRESSO outperforms four state-of-the-art methods across seven datasets.
Method analyzes deep neural network activations to explain adversarial examples.
problem Difficulty in interpreting deep neural network representations.
method Persistent homology over graphical activation structure.
result Adversarial examples are not semantic structure additions but dominant activation structure alterations.
Generator network replicates AAM's face recognition neuron responses.
problem Replicating AAM's face recognition neuron responses using a deep generative model.
method Using a variational auto-encoder, learned generator network from face images generated by AAM, capturing shape variations without explicit shape model.
result Inferred latent variables of the learned generator network have strong linear relationship with AAM's shape and appearance variables.
This paper provides an overview of activation functions in neural networks.
problem Confusion in activation function selection and properties in deep learning.
method Analytic review of popular activation functions.
result Clarification of activation function properties and selection.
Shape analysis methods have in the past few years become very popular, both for theoretical exploration as well as from an application point of view. Originally developed for planar curves, these methods have been expanded to higher dimensional curves, surfaces, activities, character motions and many other objects. In …
LineFlow is a framework for training RL agents to control production lines.
problem Designing control systems for production lines is challenging.
method Introduces LineFlow, an extensible Python framework for simulating and training RL agents.
result RL agents approach optimal performance in well-understood scenarios but face challenges in complex industrial lines.
Piecewise linear activations create many spurious local minima in neural networks.
problem Understanding the loss surface of neural networks with piecewise linear activations.
method Proved the existence of infinite spurious local minima and partitioned the loss surface into smooth cells.
result Piecewise linear activations create many spurious local minima that are invariant under a continuous path.
Researchers infer gene activity in dividing cells, accounting for protein inheritance and division history.
problem Inferring protein production kinetics in dividing cells due to protein inheritance and division history.
method Adapted conditional normalizing flows to approximate intractable likelihoods from simulated data.
result Glc3 gene is mostly inactive under stress, with brief and transient expression.
A new geometric perceptron model improves 3D shape classification.
problem Challenges in geometric tasks involving point clouds using machine learning.
method Introduces multilayer geometric perceptron (MLGP) with geometric neurons.
result MLGP outperforms vanilla MLP in 3D shape classification and noise resistance.
Adapts neural network neurons' activation functions for better predictions.
problem Training neural networks with fixed activation functions limits their performance.
method Proposes training over a shape parameter, allowing neurons to adapt their own activation functions.
result Improves prediction accuracy by allowing neurons to tune their activation functions.
Active inference enhances RL by balancing exploration and exploitation.
problem Traditional RL's balance between exploration and exploitation is often suboptimal.
method Developed a new decision-making objective based on active inference.
result The new algorithm successfully balances exploration and exploitation on various RL benchmarks.
We design a new nonparametric method that allows one to estimate the matrix of integrated kernels of a multivariate Hawkes process. This matrix not only encodes the mutual influences of each nodes of the process, but also disentangles the causality relationships between them. Our approach is the first that leads to an …
New activation function SERLU improves neural network performance.
problem Improving neural network performance and avoiding overfitting.
method Introducing a new activation function (SERLU) that breaks monotonicity while preserving self-normalizing property and developing shift-dropout for regularization.
result SERLU-based neural networks provide consistently promising results compared to other activation functions.
ABUs learn and adapt activation functions for deep neural networks.
problem Lack of a unified theory connecting task and network properties with activation functions.
method Introduce Adaptive Blending Units (ABUs) as a trainable linear combination of activation functions.
result Advantages of ABUs over common activation functions across various network specifications.
Improves functional linear regression with shape transfer learning.
problem Data scarcity in functional linear models.
method Shape-based transfer learning from auxiliary to target domains.
result Enhances robustness and generalizability of functional linear models.
Paper proposes active learning for structured output design, improving Gaussian process model predictions.
problem Finding optimal input parameters for achieving desired structured outputs.
method Developed new acquisition functions to minimize prediction error of Gaussian process model, incorporating output correlations.
result Effectiveness demonstrated in synthetic and real data experiments, including materials informatics.
This research improves neural network performance with adaptive activation functions in sparse data settings.
problem Limited data availability in scientific and engineering problems.
method Investigation of two types of adaptive activation functions with individual trainable parameters.
result Adaptive activation functions, especially with individual trainable parameters, enhance prediction accuracy and confidence in sparse data settings.
Improves active learning efficiency by warping input space based on observed outputs.
problem Insensitivity of Gaussian process uncertainty to actual observations.
method Input warping with learned monotone reparameterization to adjust acquisition function behavior.
result Significantly improved sample efficiency across various benchmarks, especially in non-stationary conditions.
Unified model explains volatility memory in stocks and forex.
problem Understanding the components of volatility memory in financial markets.
method Developed a three-dimensional decomposition of volatility memory into level, shape, and tempo.
result Unified model shows that volatility memory is state-dependent, with different gates prevailing in equities and forex.
Paper tackles unsupervised learning of 3D shapes from single images.
problem Learning 3D shapes from single images without supervision.
method Generative models, variational auto-encoders, adversarial methods.
result Model learns 3D shapes and poses from single images, showing potential for various datasets.
Financial models shape markets through performativity, creating self-fulfilling prophecies.
problem Lack of mathematical formulation for performativity in financial markets.
method Embedding the model in the market process, creating a closed feedback loop.
result Performative market makers can reverse engineer dominant strategies and arbitrage them.
New bounds for shallow neural networks with deterministic parameters.
problem Developing generalisation bounds for shallow neural networks.
method PAC-Bayesian theory applied to shallow neural networks with deterministic parameters.
result Empirical non-vacuous bounds for shallow neural networks trained with vanilla SGD.
New dataset and techniques detect money laundering patterns in crypto.
problem Detecting money laundering in cryptocurrency networks.
method Subgraph representation learning using scalable GNNs.
result Accurately classify new criminal activity in cryptocurrency.
New method to estimate doctors' effort in annotating medical images.
problem High effort and expense in annotating medical images.
method Proposes a new criterion to evaluate effort, uses active learning and U-shape network for annotation strategy, and fine annotation platform to reduce effort.
result State-of-the-art segmentation performance achieved with only 60% annotation candidates, reducing effort by 44-47%.
Deep Random Splines model neural activity data with better dimensionality.
problem Modeling neural population data with shape constraints.
method Deep neural network transforming Gaussian noise into spline parameters.
result Better dimensionality reduction of neural spiking activity.
Building models, or maps, of robot environments is a highly active research area; however, most existing techniques construct unstructured maps and assume static environments. In this paper, we present an algorithm for learning object models of non-stationary objects found in office-type environments. Our algorithm exp…
This survey/expository article covers a variety of topics related to the "topology at infinity" of noncompact manifolds and complexes. In manifold topology and geometric group theory, the most important noncompact spaces are often contractible, so distinguishing one from another requires techniques beyond the standard …
Active subspaces on Riemannian manifolds generalize Euclidean principles.
problem Understanding how scalar-valued quantities change over Riemannian manifolds.
method Generalization of active subspaces from Euclidean to Riemannian spaces using parallel transport.
result The method provides a new way to study scalar-valued quantities on manifolds, differing from extrinsic approaches.
Paper proposes HTAF for stable training of binary neural networks.
problem Challenges in training binary neural networks with gradient-based optimization.
method HTAF is a smooth approximation to the Heaviside function that enables stable training.
result HTAF enables stable training of various binary neural networks with gradient-based optimization.
Curvature penalties improve interpretability of KANs without sacrificing accuracy.
problem Pathologically high-curvature oscillations in KANs activations make them hard to interpret.
method Derived a curvature penalty and proved an upper bound on model curvature.
result KANs with curvature penalties achieve substantially smoother activations while maintaining accuracy.
Neural networks encode inputs deterministically and categorically, behaving like hash encoders.
problem Understanding the encoding properties of neural networks.
method Analyzed the input space partitioned by ReLU-like activations in neural networks.
result Neural networks can be represented by unique activation patterns, similar to hash encoders.
ProtoNAM models tabular data with neural networks, making predictions transparent.
problem Tabular data analysis using neural networks lacks transparency and accuracy compared to tree-based methods.
method ProtoNAM introduces prototypes into neural networks to model tabular data while maintaining explainability.
result ProtoNAM outperforms existing NN-based GAMs and provides insights into learned feature patterns.
Emergent misalignment is influenced by training dynamics, model priors, and data.
problem Emergent misalignment in models
method Exploring training dynamics, model priors, and data
result Activation deltas before and after narrow fine-tuning correlate with their similarities when measured with the last prompt-token activations.
New MMM captures hierarchical marketing effects and sign restrictions.
problem Measuring effectiveness of marketing activities with hierarchical structure and sign constraints.
method Proposes a constrained maximum likelihood approach using Hamiltonian Monte Carlo algorithm.
result Demonstrates superior performance on real datasets compared to multi-stage methods.
Neural networks require a careful design in order to perform properly on a given task. In particular, selecting a good activation function (possibly in a data-dependent fashion) is a crucial step, which remains an open problem in the research community. Despite a large amount of investigations, most current implementat…
PDBAL targets experiments for probabilistic models to maximize insights.
problem Designing experiments to yield valuable insights efficiently.
method Combines user-specified risk function with probabilistic model to adaptively choose designs.
result PDBAL consistently outperforms standard approaches in simulations and real-world drug screen data.
We analyse the behaviour of the implied volatility smile for options close to expiry in the exponential Lévy class of asset price models with jumps. We introduce a new renormalisation of the strike variable with the property that the implied volatility converges to a non-constant limiting shape, which is a function of …
The study analyzes ETFs' portfolio optimization and tail-risk management.
problem Analyzing the performance of actively managed ETFs in managing risk and diversification.
method Daily Bloomberg data for 30 funds, evaluating various strategies under long-only and long-short constraints.
result Tangency-type portfolios generally outperform buy-and-hold benchmarks, while minimum-variance and CVaR-minimizing portfolios sacrifice upside for downside control.
Shaped by structural forces of change, banking in emerging markets has recently experienced a decline in its traditional activities, leading banks to diversify into new business strategies. This paper examines whether the observed shift into non-interest based activities improves financial performance. Using a sample o…
New algorithms solve large-scale convex regression problems.
problem Large-scale convex regression with subgradient regularization.
method Active set type algorithm on dual QP, approximate optimization, randomized augmentation.
result Solves problems with n=10^5 and d=10 in minutes.
It is often hypothesized that a crucial role for recurrent connections in the brain is to constrain the set of possible response patterns, thereby shaping the neural code. This implies the existence of neural codes that cannot arise solely from feedforward processing. We set out to find such codes in the context of one…