New GCNs improve graph classification with deeper multi-scale information.
problem Limited expressive power of existing GCNs.
method Generalized spectral graph convolution and deep GCN architectures, showing equivalence under certain conditions.
result Two new architectures achieve better performance on node classification tasks.
MCFNet recovers spatial detail and fuses it with semantic information for real-time segmentation.
problem Recovering spatial detail information and fusing it with semantic information in real-time.
method Proposes a new architecture (MCFNet) with feature refinement and fusion modules, and a gating unit.
result Achieves competitive performance with high speed (75.5% mIOU, 151.3 FPS on Cityscapes).
Paper introduces multi-scale methods to improve CATE estimation from EO data.
problem Challenges in balancing fine-grained and contextual information in EO-based causal inference.
method Multi-Scale Representation Concatenation, combining Vision Transformer and Causal Forests.
result Multi-scale approach captures effect heterogeneity better than single-scale models.
Embed nodes with multi-scale attributes for robust network analysis.
problem Capturing complex node attributes across different scales.
method Multi-scale attributed node embedding (AE & MUSAE) using Skip-gram approach.
result Proves node-feature mutual information is implicitly factorized by embeddings.
New PINN architectures learn high-frequency features using Fourier features.
problem PINNs struggle with high-frequency or multi-scale features.
method Employ spatio-temporal and multi-scale random Fourier features.
result Effective PINN models for multi-scale PDEs.
Topology-enhanced loss improves 3D object reconstruction from 2D images.
problem Challenges in reconstructing 3D objects from 2D images, especially capturing shape information.
method Integrates multi-scale topological features into the reconstruction loss using cubical complexes and optimal transport distance.
result Topology-aware loss substantially improves 3D reconstruction quality.
Framework for multi-scale clustering using phase transitions.
problem Clustering datasets with multi-scale structures.
method Cascade of phase transitions in simulated annealing of Expectation-Maximisation algorithm with weighted local covariance.
result Approximation of the number and size of clusters at different scales.
CrossAD detects anomalies in time series data by considering cross-scale associations and cross-window modeling.
problem Anomaly detection in time series data is challenging due to varying patterns at different scales and fixed window sizes.
method CrossAD incorporates cross-scale reconstruction and a query library to capture dynamic cross-scale associations and comprehensive context.
result CrossAD achieves state-of-the-art performance in anomaly detection across multiple real-world datasets.
We construct a new map from a convex function to a distribution on its domain, with the property that this distribution is a multi-scale exploration of the function. We use this map to solve a decade-old open problem in adversarial bandit convex optimization by showing that the minimax regret for this problem is $\tild…
Improves speaker verification for variable-duration utterances using a feature pyramid module.
problem Improving robustness for variable-duration utterances in speaker verification.
method Integrates a feature pyramid module into multi-scale aggregation to enhance speaker-discriminative information from multiple layers.
result Improves performance for both short and long utterances compared to state-of-the-art approaches.
A new deep learning framework captures multi-scale spatio-temporal dependencies.
problem Designing and analyzing deep learning models for complex spatio-temporal analytics.
method Developed an I2DRNN model with three modules for integrating and learning multi-scale spatio-temporal data. result The I2DRNN model outperforms classical and state-of-the-art models in capturing meaningful multi-scale spatio-temporal dependencies. Proposes a deep multi-scale neural network for EEG signal representation learning.
problem Capturing multi-frequency properties in EEG signals for better brain-computer interface.
method A novel deep multi-scale neural network that discovers feature representations in multiple frequency/time ranges and extracts spatial relationships.
result Improved performance in various active/passive BCI datasets compared to state-of-the-art methods.
We introduce a method called multi-scale local shape analysis, or MLSA, for extracting features that describe the local structure of points within a dataset. The method uses both geometric and topological features at multiple levels of granularity to capture diverse types of local information for subsequent machine lea…
Proposes OC4Seq for detecting anomalies in discrete event sequences.
problem Challenges in detecting anomalies in discrete event sequences, including data imbalance, discrete events, and sequential nature.
method Integrates anomaly detection with recurrent neural networks (RNNs) to embed sequences into latent spaces and designs a multi-scale RNN framework to capture multi-scale sequential patterns.
result OC4Seq consistently outperforms various baselines on three benchmark datasets.
Network embedding represents nodes in a continuous vector space and preserves structure information from the Network. Existing methods usually adopt a "one-size-fits-all" approach when concerning multi-scale structure information, such as first- and second-order proximity of nodes, ignoring the fact that different scal…
Paper improves multi-step chord prediction in jazz music.
problem Chord sequence prediction accuracy is poor in multi-step scenarios.
method Aggregated multi-scale encoder-decoder network architecture.
result Our model outperforms state-of-the-art methods in accuracy and perplexity.
A multi-scale model predicts atomic-scale properties using both local and long-range information.
problem Inability of machine-learning schemes to capture long-range physical effects.
method Combines local and non-local information in a multipole expansion framework.
result Demonstrates the ability to model electrostatics, polarization, and dispersion.
Novel framework for systemic risk analysis in financial markets.
problem Systemic risk in financial markets.
method Multi-scale network dynamics, transfer entropy networks, agent-based modeling, wavelet decomposition, Model Context Protocol (MCP).
result Multi-scale approach reveals hidden systemic risk patterns.
Temporal Normalizing Flows enhance density estimation of time-dependent data.
problem Accurate and robust density estimation of time-dependent stochastic data.
method Leveraging normalizing flows for temporal data, tNFs estimate multi-scale distributions without prior scale knowledge.
result Temporal Normalizing Flows improve density estimation of time-dependent data, including multi-scale distributions.
Novel neural network solves PDEs with multi-scale resolution.
problem Solving time-dependent PDEs with varying spatial and temporal scales.
method Multi-scale message passing neural network with temporal and spatial gating modules.
result Outperforms baselines on PDEs with diverse scales.
This study presents a new lossy image compression method that utilizes the multi-scale features of natural images. Our model consists of two networks: multi-scale lossy autoencoder and parallel multi-scale lossless coder. The multi-scale lossy autoencoder extracts the multi-scale image features to quantized variables a…
Improved recurrent neural networks learn long-term dependencies through multi-scale memory.
problem Capturing long-term dependencies in recurrent neural networks.
method Incremental training of a modular RNN architecture with multi-scale hidden states.
result Incremental training and multi-scale memory enhance RNNs' ability to learn long-term dependencies.
Paper proposes a new hierarchical attention mechanism for multi-scale data.
problem Challenges in applying neural attention to multi-scale, multi-modal data.
method Developed a mathematical framework for multi-modal, multi-scale data and derived optimal neural attention mechanics.
result Proposed hierarchical attention mechanism improves transformer performance in multi-scale, multi-modal settings.
Voxel-FPN detects 3D objects from point clouds using raw LIDAR data.
problem 3D object detection in point cloud data for autonomous driving.
method Bottom-up voxel extraction and top-down feature fusion.
result Voxel-FPN outperforms baselines on the KITTI-3D benchmark.
Transformer-based multi-scale model outperforms traditional methods in solving PDEs on irregular domains.
problem Solving partial differential equations on irregular domains using deep learning.
method Introduces Multi-Scale Attention Transformer (\msat{}) for solving PDEs.
result Achieves state-of-the-art generalization on complex geometry problems with significant speedup.
UMRL network tackles single image de-raining by learning rain content at different scales.
problem De-raining single images with varying rain streaks of different sizes, directions, and densities.
method UMRL network learns rain content at different scales and uses confidence measures to guide learning.
result UMRL achieves significant improvements over state-of-the-art methods.
We introduce an event based framework of directional changes and overshoots to map continuous financial data into the so-called Intrinsic Network - a state based discretisation of intrinsically dissected time series. Defining a method for state contraction of Intrinsic Network, we show that it has a consistent hierarch…
Topological data analysis offers a rich source of valuable information to study vision problems. Yet, so far we lack a theoretically sound connection to popular kernel-based learning techniques, such as kernel SVMs or kernel PCA. In this work, we establish such a connection by designing a multi-scale kernel for persist…
New method disentangles sources of different timescales in planetary seismic data.
problem Unsupervised source separation of multi-scale seismic data from planetary missions.
method Wavelet scattering spectra for multi-scale clustering and variational autoencoder for source separation.
result Disentangles sources with different timescales in InSight mission seismic data.
Proposes MscaleDNN for solving high-dimensional PDEs efficiently.
problem Solving high-dimensional PDEs efficiently.
method Radial scaling in frequency domain and compact support activation functions.
result Increased power in multi-scale resolution and high frequency capturing.
Boosting theory explains why multi-scale GNNs work.
problem Over-smoothing in graph neural networks.
method Gradient boosting and transductive learning analysis.
result Test error bound decreases with more node aggregations.
Spectral clustering algorithms typically require a priori selection of input parameters such as the number of clusters, a scaling parameter for the affinity measure, or ranges of these values for parameter tuning. Despite efforts for automating the process of spectral clustering, the task of grouping data in multi-scal…
Recently, Convolution Neural Networks (CNNs) obtained huge success in numerous vision tasks. In particular, DenseNets have demonstrated that feature reuse via dense skip connections can effectively alleviate the difficulty of training very deep networks and that reusing features generated by the initial layers in all s…
Convolutional Neural Network (CNN) has demonstrated impressive ability to represent hyperspectral images and to achieve promising results in hyperspectral image classification. However, traditional CNN models can only operate convolution on regular square image regions with fixed size and weights, so they cannot univer…
This paper proposes a multi-scale Markov-Switching GARCH model for EUR/USD volatility.
problem Non-stationary financial volatility requires models that capture changing market conditions across multiple timescales.
method Triple-timeframe Markov-Switching GARCH (MS-GARCH) framework with AR(1)-MS-GARCH models and TVTP for short horizons.
result The proposed model produces statistically distinct regimes and superior volatility forecasting performance.
A new EBM trained with multi-scale denoising score matching outperforms GANs in high-dimensional data synthesis.
problem Training EBMs in high-dimensional spaces is slow and challenging.
method Multi-scale denoising score matching to train EBMs.
result The proposed EBM achieves comparable performance to GANs in high-dimensional data synthesis.
We propose the Lanczos network (LanczosNet), which uses the Lanczos algorithm to construct low rank approximations of the graph Laplacian for graph convolution. Relying on the tridiagonal decomposition of the Lanczos algorithm, we not only efficiently exploit multi-scale information via fast approximated computation of…
CAST improves spectral clustering for multi-scale data by integrating reachability similarity.
problem Applying spectral clustering to multi-scale data where clusters vary in size and density.
method CAST integrates reachability similarity with distance-based similarity to derive a coefficient matrix, then applies trace Lasso regularization.
result CAST provides excellent performance and robustness across various multi-scale data test cases.
HKT improves sequence processing with multi-scale attention and kernel analysis.
problem Processing sequences at multiple scales with efficient attention mechanisms.
method Trainable causal downsampling and convex weights for level-specific score matrices.
result HKT achieves consistent gains over standard attention across various tasks.
Modern audio source separation techniques rely on optimizing sequence model architectures such as, 1D-CNNs, on mixture recordings to generalize well to unseen mixtures. Specifically, recent focus is on time-domain based architectures such as Wave-U-Net which exploit temporal context by extracting multi-scale features. …
TelePiT improves S2S forecasting by integrating physics and teleconnections.
problem Challenges in subseasonal-to-seasonal climate forecasting due to chaotic dynamics and complex interactions.
method Integrates physics and teleconnections into a transformer architecture with spherical embedding and multi-scale physics-informed neural ODE.
result Significantly outperforms state-of-the-art methods across all forecast horizons.
Proposes a new multi-scale architecture for generative flows to improve log-likelihood and sampling quality.
problem Challenges of high-dimensional latent space in flow models.
method Data-dependent dimension factorization based on likelihood contribution heuristic.
result Improvements in log-likelihood score and sampling quality on image benchmarks.
The analysis of temporal networks has a wide area of applications in a world of technological advances. An important aspect of temporal network analysis is the discovery of community structures. Real data networks are often very large and the communities are observed to have a hierarchical structure referred to as mult…
A new multi-scale vector quantization method for unsupervised data.
problem Efficiently reconstructing unsupervised data with minimal distortion.
method Reconstruction trees, inspired by decision trees, explore data in a multi-scale fashion.
result Analysis of expected distortion under fixed unknown distribution, with asymptotic and finite sample results.
End-to-end model for time series classification with missing data.
problem Time series classification with missing data.
method End-to-end neural network that unifies imputation and representation learning.
result Proposed model outperforms state-of-the-art approaches for incomplete time series classification.
EvoMSN tackles time series forecasting under distribution shifts by evolving multi-scale normalization.
problem Accurate long-term time series forecasting under complex distribution shifts.
method EvoMSN framework with multi-scale statistics prediction and adaptive ensembling for collaborative updating.
result Improves forecasting performance of five mainstream methods on benchmark datasets.
Compactifies moduli spaces of abelian differentials with specific zeroes and poles.
problem Constructing a compactification of moduli spaces of abelian differentials.
method Using a blowup of the incidence variety compactification, defining families of projectivized multi-scale differentials, and performing a real oriented blowup.
result The moduli space of multi-scale differentials is a complex orbifold with normal crossing boundary.
Paper tackles leverage effect estimation from noisy data.
problem Estimating leverage effect from high-frequency data with microstructure noise.
method Holistic multi-scale framework operating directly on leverage effect, using Subsampling-and-Averaging Leverage Effect (SALE) and Multi-Scale Leverage Effect (MSLE) estimators.
result Holistic multi-scale framework achieves substantial efficiency gains over existing benchmarks.