Develops new tests for high-dimensional models with mixed signal strengths.
problem Challenges in testing models with many signals and high-dimensional data.
method Moment matching formulation for developing new tests.
result Demonstrates optimality of GRIP test for various model types.
New algorithms improve sparse learning for high signal strength.
problem Sparse statistical learning problems with L0 regularization. method Coordinate descent and local combinatorial optimization algorithms.
result Combinatorial optimization algorithms perform better for high signal strength.
Two algorithms learn Gaussian graphical models from Glauber dynamics trajectories, achieving optimal performance.
problem Learning Gaussian graphical models from a single trajectory of a dependent stochastic process.
method Two algorithms based on dueling-neighborhood search and local statistics built from the update sequence of Glauber dynamics.
result Achieve κ−2 dependence of the information-theoretic lower bounds, mixing-free and signal-optimal. Mixed-SCORE+ improves community detection in weak signal networks.
problem Detecting communities in weak signal networks.
method Proposes Mixed-SCORE+ combining properties of Mixed-SCORE and SCORE+.
result Significantly improves detection error rates on Polblogs and weak signal networks.
Spectral methods improve signal recovery in mixed GLMs with precise asymptotics.
problem Estimating multiple signals from unlabeled observations in mixed GLMs.
method Developed exact asymptotics for spectral methods in a proportional regime.
result Optimized spectral method combined with a linear estimator minimizes estimation error.
Factor analysis is broadly used as a powerful unsupervised machine learning tool for reconstruction of hidden features in recorded mixtures of signals. In the case of a linear approximation, the mixtures can be decomposed by a variety of model-free Blind Source Separation (BSS) algorithms. Most of the available BSS alg…
New AMP algorithm estimates signals and latent variables in mixed regression models.
problem Estimating signals and latent variables in mixed regression models.
method Approximate Message Passing (AMP) algorithm for matrix GLM.
result State evolution recursion and optimal denoising functions for precise error minimization.
SLOE speeds up logistic regression in high dimensions with accurate signal strength estimation.
problem Poor performance of logistic regression in high-dimensional settings.
method SLOE reparameterizes the signal strength for faster and more accurate estimation.
result SLOE provides a fast and accurate method for dimensionality correction in logistic regression.
We propose a scheme to employ backpropagation neural networks (BPNNs) for both stages of fingerprinting-based indoor positioning using WLAN/WiFi signal strengths (FWIPS): radio map construction during the offline stage, and localization during the online stage. Given a training radio map (TRM), i.e., a set of coordinat…
New method separates mixed distributions without requiring samples of each source.
problem Separating mixed distributions in machine learning and signal processing.
method Neural Egg Separation method iteratively learns to separate known from unknown distributions.
result Neural Egg Separation outperforms current methods in audio and image separation tasks.
Paper presents a simple method for accurate user localization in urban areas.
problem Poor GPS performance in dense urban environments.
method Localization based on pathloss using base station signal strengths and RadioUNet approximations.
result Accurate user location extraction in urban environments.
A new framework uses an Incremental Transformer to design geopolymer mixtures efficiently.
problem Designing geopolymer mixtures with limited data and physical constraints.
method Topology-aware surrogate framework guided by Incremental Transformer.
result The design space is redundant, with fewer effective mixture regimes.
This work improves mixing rates for Bayesian CART, a key component of BART.
problem Understanding and improving mixing rates for Bayesian inference with MCMC.
method Derived upper bounds on mixing times, provided sufficient conditions for polynomial mixing, and proposed Twiggy Bayesian CART.
result Twiggy Bayesian CART achieves polynomial mixing without assuming signal connectivity.
Generative model separates mixed signals on multiple graphs.
problem Inference methods often assume all data fits a single graph.
method Heat diffusion process on multiple graphs, EM algorithm.
result Successfully separates signals into corresponding groups.
Proposes Population Difference Criterion for visually observed subpopulation differences.
problem Statistical significance of visually observed subpopulation differences in high-dimensional and high-signal contexts.
method Balanced permutation approach and bootstrap confidence interval for quantifying uncertainty.
result Balanced permutation approach is more powerful in high-signal contexts.
Nonnegative matrix factorization (NMF) factorizes a non-negative matrix into product of two non-negative matrices, namely a signal matrix and a mixing matrix. NMF suffers from the scale and ordering ambiguities. Often, the source signals can be monotonous in nature. For example, in source separation problem, the source…
CausalMix generates synthetic data with causal controls for mixed-type tables.
problem Synthetic data for causal inference with mixed-type and multimodal tabular data.
method CausalMix combines Gaussian latent priors with data-type-specific decoders for control over overlap, confounding, and treatment effect heterogeneity.
result CausalMix achieves state-of-the-art distributional metrics and stable causal control.
New algorithms detect and estimate rank-one signals with prior directional information.
problem Detecting and estimating rank-one signals with directional prior information.
method Construct nonlinear Laplacians and examine top eigenvalues and eigenvectors.
result Nonlinear Laplacian algorithms outperform direct spectral methods for biased signals.
This paper reviews state-of-the-art mixed data clustering algorithms.
problem Clustering mixed data is challenging due to the difficulty in applying mathematical operations to feature values.
method Taxonomy and state-of-the-art review of mixed data clustering algorithms.
result Identification of five major research themes and analysis of strengths and weaknesses of methods.
A new method for blind source separation using hierarchical structure and KL divergence.
problem Blind source separation of complex interacting signals.
method Hierarchical log-linear model with KL divergence minimization.
result Superior performance compared to existing techniques on images and time series data.
DDICA separates nonlinear mixed signals robustly.
problem Blind source separation of nonlinear mixed signals.
method Deep deterministic neural network with matrix-based entropy function.
result DDICA effectively separates independent components with high accuracy.
Wi-GATr learns to simulate wireless signals with high accuracy and speed.
problem Inaccurate wireless signal propagation models limit modern communication system design.
method Wi-GATr uses a Geometric Algebra Transformer to learn from scene primitives.
result Wi-GATr achieves more accurate predictions than existing methods.
Inference in general Ising models is difficult, due to high treewidth making tree-based algorithms intractable. Moreover, when interactions are strong, Gibbs sampling may take exponential time to converge to the stationary distribution. We present an algorithm to project Ising model parameters onto a parameter set that…
HuMaINs combines human and machine strengths for better inference tasks.
problem Improving inference performance through human-machine collaboration.
method Novel signal processing and machine learning solutions for HuMaINs architecture.
result HuMaINs achieves higher performance than either humans or machines individually.
Study on signal-plus-noise decomposition in nonlinear spiked random matrices.
problem Nonlinear spiked random matrix models with rank-one signal and noise.
method Signal-plus-noise decomposition and phase transition analysis.
result Identified precise phase transitions in signal components at critical thresholds.
Paper explores statistical and computational limits of estimating low-rank Gaussian mixtures.
problem Estimating low-rank matrix-variate observations with optimal statistical and computational limits.
method Low-rank Gaussian mixture model (LrMM) and minimax lower bounds.
result Minimax optimality of maximum likelihood estimator and spectral aggregation method.
New algorithm predicts missing matrix entries using side information, outperforming existing methods.
problem Learning a partially observed matrix with side information.
method Mixed-projection ADMM algorithm for optimization.
result Our algorithm achieves 2.3% lower objective value and 41% lower reconstruction error than benchmarks.
New framework relaxes independence assumption for graph-mixing dependencies.
problem Tackles limitations of existing generalization results for graph-mixing dependencies.
method Proposes a framework where dependencies decay with graph distance, derives generalization bounds leveraging online-to-PAC framework.
result Derives high-probability generalization guarantees that depend on mixing rate and graph's chromatic number.
New ICA method for sources with mixed spectra.
problem Inaccurate separation of sources with temporal autocorrelations and mixed spectra.
method Estimates spectral density functions and line spectra using cubic splines and indicator functions, then maximizes the Whittle likelihood function.
result Outperforms existing ICA methods in simulations and EEG data applications.
2D-PT improves sampling in constrained optimization problems.
problem Sampling Boltzmann distributions with soft constraints.
method Two-dimensional extension of parallel tempering.
result 2D-PT achieves near-ideal mixing in constrained problems.
GPMM recovers latent signals from noisy mixtures using Bayesian inference.
problem Recovering latent signals from noisy mixed measurements.
method Gaussian process mixture of measurements (GPMM) with Bayesian inference.
result GPMM outperforms standard GP in signal recovery.
Paper introduces MSA for weakly supervised covariance alignment in MEG signals.
problem Limited labeled signals in target datasets for MEG applications.
method Mixing model Stiefel Adaptation (MSA) leveraging unlabeled data.
result MSA outperforms recent methods in brain-age regression with MEG signals.
We consider the problem of estimating the phases of K mixed complex signals from a multichannel observation, when the mixing matrix and signal magnitudes are known. This problem can be cast as a non-convex quadratically constrained quadratic program which is known to be NP-hard in general. We propose three approaches t…
Independent Component Analysis (ICA) is a popular model for blind signal separation. The ICA model assumes that a number of independent source signals are linearly mixed to form the observed signals. We propose a new algorithm, PEGI (for pseudo-Euclidean Gradient Iteration), for provable model recovery for ICA with Gau…
OLS estimator nearly optimally identifies linear systems from single trajectory.
problem Identifying linear dynamical systems from a single observed trajectory.
method Generalized small-ball method for dependent data, avoiding mixing-time arguments.
result OLS estimator nearly matches minimax optimal performance for linear systems.
New method separates and deconvolves signals from single-channel mixtures.
problem Separating and deconvolving individual sources from a single-channel mixture.
method Synthesizing-decomposition (S-D) approach using GAN for sources and optimization for filters and sources.
result Achieves PSNR improvements over existing methods in various tasks.
A multiple classifiers fusion localization technique using received signal strengths (RSSs) of visible light is proposed, in which the proposed system transmits different intensity modulated sinusoidal signals by LEDs and the signals received by a Photo Diode (PD) placed at various grid points. First, we obtain some {\…
New insights into statistical and computational limits for mixed sparse linear regression.
problem Recovering two sparse signals from noisy linear measurements.
method Analysis of low-degree polynomials and a simple thresholding algorithm.
result Identification of a smooth information-computation tradeoff and order-optimality of the thresholding algorithm.
New method learns disentangled signals without prior or model constraints.
problem Learning disentangled signals from data without prior or model constraints.
method Minimizes conditional KL divergence using a sequential algorithm to learn de-mixing flow models.
result Method learns self-sufficient signals that can reconstruct missing values.
Landmark2Vec maps unknown landmarks without GPS.
problem Estimate positions of unknown landmarks without GPS.
method Unsupervised neural network trained on landmark signals.
result Maps landmarks up to scale, rotation, and shift.
Temporal Causal Prior-Data Fitted Networks (TCPFN) for industrial time series causal discovery
problem Estimating causal effects in industrial time series
method Temporal Causal Prior-Data Fitted Networks
result Zero-shot causal discovery with explicit reliability signals
Noise-ignorant empirical risk minimization achieves state-of-the-art performance on noisy data.
problem Learning with noisy labels in multi-class classification problems.
method Introducing relative signal strength (RSS) to quantify transferability and applying Noise Ignorant Empirical Risk Minimization (NI-ERM).
result NI-ERM achieves state-of-the-art performance on CIFAR-N data challenge.
Paper analyzes agnostic learning of mixed linear regression without generative models.
problem Learning mixed linear regression without assuming stochastic generation.
method Expectation Maximization (EM) and Alternating Minimization (AM) algorithms.
result AM and EM algorithms converge to population loss minimizers under standard conditions.
New method uncovers small but significant local activities in time-series data.
problem Reconstructing small but important local activities in time-series data.
method Neural state-space models with latent causal-effect disentanglement.
result Demonstrated proof-of-concept on reconstructing ectopic foci in cardiac electrical propagation.
MPTE uses Transformer attention to estimate mixed-frequency factor models.
problem Estimating factor models in panel datasets with mixed frequencies and nonlinear signals.
method Mixed-Panels-Transformer Encoder (MPTE) with attention mechanisms.
result MPTE achieves competitive performance in nonlinear forecasting environments.
PLS-SVD struggles with missing data in multimodal datasets, showing a phase transition in performance.
problem Missing data in PLS-SVD for multimodal datasets.
method Replica-symmetric analysis of spiked rectangular random matrices with missing entries.
result PLS-SVD performance transitions from uninformative to informative singular vectors at a critical signal-to-noise threshold.
The paper detects entrance positions using Wi-Fi and GPS signals.
problem Accurate detection of building entrance positions.
method Combines GPS signal drop and Wi-Fi RSS to detect entrances.
result The system's accuracy is one meter.
Develops a new trend power indicator using DSP techniques.
problem Determining the strength and reversibility of trends.
method Derives a novel indicator using digital signal processing.
result Accuracy of the new indicator correlates with PNL performance.