Estimates the upper bound of linear regions in spheres centered at specific data points in ReLU neural networks.
problem Bounding the number of linear regions in specific areas of neural networks using ReLU activations.
method Developed a method to estimate the upper bound of linear regions in any sphere within the input space of a ReLU neural network.
result The boundaries of linear regions move away from training data points during training, and spheres centered at these points contain more regions than arbitrary points.
In label-noise learning, \textit{noise transition matrix}, denoting the probabilities that clean labels flip into noisy labels, plays a central role in building \textit{statistically consistent classifiers}. Existing theories have shown that the transition matrix can be learned by exploiting \textit{anchor points} (i.e…
Proves critical points of ADM mass correspond to specific initial data sets.
problem Finding initial data sets with fixed Bartnik boundary data.
method Proves existence of critical points on a Banach manifold.
result Critical points of ADM mass correspond to initial data sets with generalized Killing vector fields.
Data augmentation is a ubiquitous technique for increasing the size of labeled training sets by leveraging task-specific data transformations that preserve class labels. While it is often easy for domain experts to specify individual transformations, constructing and tuning the more sophisticated compositions typically…
This work defines observation-specific explanations for black-box models.
problem Assigning importance to data points in black-box model predictions.
method Surrogate model construction using scattered data approximation and orthogonal matching pursuit.
result Validated approach on simulated and real-world datasets.
This paper proposes a centroid-based clustering algorithm which is capable of clustering data-points with n-features, without having to specify the number of clusters to be formed. The core logic behind the algorithm is a similarity measure, which collectively decides whether to assign an incoming data-point to a pre-e…
Captures data influence changes during training.
problem Traditional influence functions fail for modern training methods.
method Formalized trajectory-specific LOO influence, using data value embedding.
result Data influence varies by training stage, early and late stages have greater impact.
The paper classifies circle actions on 6D manifolds with isolated fixed points.
problem Classifying circle actions on 6D manifolds with isolated fixed points.
method Performing equivariant connected sums at fixed points with specific manifolds.
result A sequence of operations can reduce the fixed point data to the empty collection.
The paper develops methods to create private synthetic spatial point patterns.
problem Generating private synthetic spatial point patterns.
method Developed differentially private Poisson and Cox point synthesizers.
result The synthesizers effectively maintain privacy and utility of synthetic data.
A new method clusters rows of a matrix of point processes.
problem Challenges in analyzing structured point process data.
method Mixture model of multi-level marked point processes, combined with ES algorithm and FPCA.
result An efficient method for clustering rows of a matrix of point processes.
Gradient ascent method successfully removes specific data points from neural networks without retraining.
problem Addressing privacy and ethical concerns by removing specific data points from trained models.
method Gradient ascent approach to unlearning, leveraging the implicit bias of gradient descent towards margin maximization conditions.
result Gradient ascent method can successfully unlearn specific data points from two-layer ReLU neural networks without retraining.
We design a general framework for answering adaptive statistical queries that focuses on providing explicit confidence intervals along with point estimates. Prior work in this area has either focused on providing tight confidence intervals for specific analyses, or providing general worst-case bounds for point estimate…
Develops a faster model selection method using influence functions.
problem Time-consuming and computationally inefficient model selection.
method Model-specific data subsampling guided by influence functions.
result Empirically shows improved selection of high-quality models.
We study the relationship between social media output and National Football League (NFL) games, using a dataset containing messages from Twitter and NFL game statistics. Specifically, we consider tweets pertaining to specific teams and games in the NFL season and use them alongside statistical game data to build predic…
Proposes a new method to unlearn from specific data points in conformal predictors.
problem Challenges of existing unlearning methods in conformal predictors.
method Formalizes conformal unlearning, introduces practical metrics, and presents an optimization algorithm.
result Demonstrates effective removal of targeted information while preserving utility.
New privacy framework tailored to specific data distributions.
problem Protecting individual data points in decision-making processes.
method Introducing tangent differential privacy, a new form of differential privacy.
result Entropic regularization guarantees tangent differential privacy under general conditions.
Improved local multivariable regression for better inference with limited data.
problem Limited sample size hampers local polynomial/multivariable regression.
method Prediction-Powered Inference (PPI) algorithm for local multivariable regression.
result Significantly reduces estimation variance without increasing error.
We study parameter estimation and asymptotic inference for sparse nonlinear regression. More specifically, we assume the data are given by y=f(x⊤β∗)+ε, where f is nonlinear. To recover β∗, we propose an ℓ1-regularized least-squares estimator. Unlike classical linear regression, the correspondin…
High-dimensional data often lie in low-dimensional subspaces corresponding to different classes they belong to. Finding sparse representations of data points in a dictionary built using the collection of data helps to uncover low-dimensional subspaces and address problems such as clustering, classification, subset sele…
The paper is devoted to elaboration of a novel specific indicator based on the modified Holder exponents. This indicator has been used for forecasting critical points of financial time series and crashes of the USA stock market. The proposed approach is based on the hypothesis, which claims that before market critical …
Evaluates change point detection algorithms on real-world data.
problem Insufficient evaluation of change point detection algorithms on real-world time series.
method Developed a data set of 37 time series from various domains, annotated by human experts, and evaluated 14 algorithms using consistency metrics.
result Demonstrates the need for better evaluation methods in change point detection.
Proposes first privacy-preserving method for estimating Hawkes processes.
problem Estimating point process models with sensitive personal data raises privacy concerns.
method Proposes differential privacy for event stream data and two optimization algorithms.
result Efficiently estimates Hawkes process models with privacy and utility guarantees.
Deep learning models can infer individual trajectories from sparse data.
problem Learning individual dynamics from limited data points.
method Combining variational autoencoders (VAEs) with ordinary differential equations (ODEs) for dynamic modeling.
result Deep learning can recover individual trajectories from sparse data, but requires careful adaptation.
Gaussian processes (GPs) are flexible non-parametric models, with a capacity that grows with the available data. However, computational constraints with standard inference procedures have limited exact GPs to problems with fewer than about ten thousand training points, necessitating approximations for larger datasets. …
Deep neural networks predict prostate motion from MR images.
problem Predicting prostate motion during ultrasound-guided interventions.
method Biomechanically-trained deep neural networks on unstructured nodes.
result Trained networks yield near real-time inference with 0.017 mm error.
The paper develops a neural network-based method for detecting change points in large-scale time-evolving data.
problem Detecting and locating change points in multivariate time-evolving data.
method Two-step procedure involving neural network training and test error function calibration over moving windows.
result Consistent estimates for the number and locations of change points under temporal dependence.
This paper extends the analysis of Muni Toke and Yoshida (2020) to the case of marked point processes. We consider multiple marked point processes with intensities defined by three multiplicative components, namely a common baseline intensity, a state-dependent component specific to each process, and a state-dependent …
Bayesian method detects outliers and uncertain points in data.
problem Detecting outliers and uncertain points in data using Bayesian methods.
method Generative model of data curation for aleatoric uncertainty, combining with epistemic uncertainty and outlier exposure.
result Principled Bayesian approach outperforms methods using aleatoric or epistemic uncertainty alone.
This paper describes a novel approach to change-point detection when the observed high-dimensional data may have missing elements. The performance of classical methods for change-point detection typically scales poorly with the dimensionality of the data, so that a large number of observations are collected after the t…
The problem of clustering noisy and incompletely observed high-dimensional data points into a union of low-dimensional subspaces and a set of outliers is considered. The number of subspaces, their dimensions, and their orientations are assumed unknown. We propose a simple low-complexity subspace clustering algorithm, w…
The fuzzy ROC extends Receiver Operating Curve (ROC) visualization to the situation where some data points, falling in an indeterminacy region, are not classified. It addresses two challenges: definition of sensitivity and specificity bounds under indeterminacy; and visual summarization of the large number of possibili…
The paper explores how to select data points for optimal learning performance.
problem Optimizing data selection for empirical risk minimizers.
method Fixing a learning rule and focusing on optimizing the training data selection.
result Achieving performance comparable to training on the entire population with a small subset of data points.
Score matching fails for general point processes, a new estimator improves accuracy.
problem Score matching estimators fail for general point processes.
method Introduced a weighted score matching estimator for point processes.
result The weighted score matching estimator accurately estimates model parameters on synthetic and real data.
Improved modeling of persistence diagrams for data analysis.
problem Determining significant outliers in persistence diagrams.
method Modification of the RST (Replicating Statistical Topology) model using MCMC Metropolis-Hastings algorithm.
result The modified RST model improves the goodness of fit in persistence diagram analysis.
We present a novel technique based on deep learning and set theory which yields exceptional classification and prediction results. Having access to a sufficiently large amount of labelled training data, our methodology is capable of predicting the labels of the test data almost always even if the training data is entir…
It is a key to construct a similarity graph in graph-oriented subspace learning and clustering. In a similarity graph, each vertex denotes a data point and the edge weight represents the similarity between two points. There are two popular schemes to construct a similarity graph, i.e., pairwise distance based scheme an…
New method helps interpret complex models by visualizing feature shifts.
problem Interpreting complex models like blackbox models is hard.
method Quantile Shift Method (QSM) to visualize feature shifts.
result Changes in predictions can be interpreted as neighborhoods of classes.
Graph change-point detection method learns graph similarity from data.
problem Detect abrupt changes in dynamic networks.
method Siamese graph neural network for graph similarity learning.
result Method detects changes in diverse types of networks with minimal data history.
We continue our computation, using a combinatorial method based on Gronthendieck's dessins d'enfant, of the number of (weak) equivalence classes of surface branched covers matching certain specific branch data. In this note we concentrate on data with the surface of genus g as source surface, the sphere as target surfa…
NDDV estimates data point value from a single stochastic trajectory.
problem Estimating marginal contributions of data points over stochastic training paths.
method Introduces Neural Dynamic Data Valuation (NDDV) using stochastic state and adjoint equations.
result NDDV provides a one-run, trajectory-conditioned estimator of data point value.
This research tackles data deletion in linear regression with noisy SGD, finding perfect deleted points.
problem Finding points to delete from a dataset without significantly affecting the training result.
method Signal-to-noise ratio and an algorithm based on it.
result The perfect deleted point is crucial for maintaining model performance and privacy budget.
We propose a family of near-metrics based on local graph diffusion to capture similarity for a wide class of data sets. These quasi-metametrics, as their names suggest, dispense with one or two standard axioms of metric spaces, specifically distinguishability and symmetry, so that similarity between data points of arbi…
Repo dealers' market power affects bond prices by up to 2 percentage points.
problem Market power of repo dealers impacts bond prices and liquidity.
method Proprietary data on repo and reverse-repo trades analyzed.
result Market power of repo dealers accounts for 0.5-1.3 percentage points of bond yield deviation.
New method estimates data influence efficiently by leveraging test samples.
problem Efficiently estimating influence of training data on model predictions.
method Mirrored Influence Hypothesis, forward pass for test samples.
result Significant improvement in efficiency over existing methods.
In an earlier work we identified the types and numbers of static equilibrium points of solids arising from fine, equidistant n-discretrizations of smooth, convex surfaces. We showed that such discretizations carry equilibrium points on two scales: the local scale corresponds to the discretization, the global scale to…
New method detects text changes under dependencies, outperforming baselines.
problem Detecting structural changes in m-dependent text data. method Kernel change-point detection under m-dependence. result Consistent and weakly consistent detection of change points in m-dependent text. Fair active learning selects data points to balance model accuracy and fairness.
problem Ensuring fairness in machine learning models used in high-stakes applications.
method Designing algorithms for fair active learning that select data points to balance model accuracy and fairness, focusing on demographic parity.
result Demonstrated the effectiveness of the proposed fair active learning approach over benchmark datasets.
Study minimax estimation of stratified structure from i.i.d. samples.
problem Estimating stratified structure from i.i.d. samples of stratified mixtures of immersed manifolds.
method Ascending hierarchical co-detection of points belonging to different layers, identifying number of layers and their dimensions, assigning points to layers accurately, estimating tangent spaces optimally.
result Achieves optimal estimation of mixture components at their optimal dimension-specific rates adaptively.