New method unifies and formalizes data partitioning using a single vector.
problem Data partitioning and clustering methods.
method Rank-one matrix factorization and denoising of piecewise constant signals.
result Demonstrates robustness of denoising step in partitioning.
Rectangular Bounding Process (RBP) improves partitioning efficiency in multi-dimensional spaces.
problem Creating many unnecessary divisions in sparse regions when describing dense regions.
method Introduces Rectangular Bounding Process (RBP) to efficiently partition multi-dimensional spaces using a bounding strategy.
result The RBP is self-consistent and can be extended to infinite space, offering rich yet parsimonious expressiveness.
New method improves nearest neighbor search using neural networks and graph partitioning.
problem Efficient nearest neighbor search in high-dimensional spaces.
method Developed a new framework for space partitioning using neural networks and graph partitioning.
result Neural LSH partitions outperform existing methods on standard benchmarks.
Paper proposes a method to predict optimal data partitioning based on query execution costs.
problem Finding optimal data partitioning for improved system performance and scalability.
method Formal model abstraction of workload queries, genetic algorithm for optimization, evaluation using PostgreSQL's query optimizer.
result The approach effectively reduces workload execution cost and improves system performance.
Differentially private method for synthetic data generation from vertically partitioned data.
problem Generating synthetic data from vertically partitioned data while preserving privacy.
method Differentially private stochastic gradient descent (DP-SGD) algorithm combined with secure multiparty computation (MPC).
result Comparable accuracy to non-partitioned data, demonstrating privacy-preserving synthetic data generation.
Efficiently calculates PL model likelihood for partitioned preference data.
problem Computational infeasibility of calculating PL model likelihood for partitioned preference data.
method Random utility model formulation and efficient numerical integration approach.
result Proposed method outperforms existing LTR baselines and scales to real-world tasks.
Asynchronous federated learning for vertically partitioned data improves efficiency and privacy.
problem Efficiently train models on vertically partitioned data without a trusted third party.
method Proposed AFSGD-VP and its SVRG and SAGA variants for asynchronous federated learning.
result AFSGD-VP and its variants achieve higher efficiency than synchronous algorithms.
This research designs a data-driven partition to test independence between continuous variables.
problem Testing independence between continuous random variables.
method Empirical log-likelihood statistic and data-driven tree-structured partition.
result Strongly consistent test of independence over probability families.
This paper presents Sparse Partitioning, a Bayesian method for identifying predictors that either individually or in combination with others affect a response variable. The method is designed for regression problems involving binary or tertiary predictors and allows the number of predictors to exceed the size of the sa…
This work proposes a method to optimize hyperparameters without validation data.
problem Optimizing hyperparameters for neural networks with limited data.
method Neural network partitioning and subnetwork optimization.
result The method optimizes hyperparameters efficiently and without validation data.
Extends partitioned local depth concept with probabilistic considerations.
problem Uncertain, variable, and conflicting information in data.
method Partitioned local depth with probabilistic concepts of local relevance and support division.
result Extends original ideas to handle uncertain data.
initKmix generates better initial partitions for k-means clustering of mixed datasets.
problem Random initial partitions lead to inconsistent clustering results.
method initKmix runs k-means multiple times, using different attributes to create initial clusters, then combines results.
result initKmix produces more accurate and consistent clustering results.
SplitNN-driven Vertical Partitioning enables distributed learning from diverse data sources.
problem Learning from vertically distributed features across institutions.
method A configuration of SplitNN that does not share raw data or model details.
result Flexibility in merging split model outputs and resource efficiency.
The fundamental aim of clustering algorithms is to partition data points. We consider tasks where the discovered partition is allowed to vary with some covariate such as space or time. One approach would be to use fragmentation-coagulation processes, but these, being Markov processes, are restricted to linear or tree s…
Online BSP-Forest improves space partitioning for large-scale classification and regression.
problem Efficient space partitioning for large-scale classification and regression problems.
method Developed an online BSP-Forest framework that expands space coverage and refines partition structure in real-time.
result Guaranteed universal consistency for both classification and regression problems.
FDSKL algorithm trains vertically partitioned data with kernels securely and efficiently.
problem Training vertically partitioned data with kernels while maintaining privacy.
method FDSKL algorithm using random features and doubly stochastic gradients for federated learning.
result FDSKL achieves sublinear convergence and guarantees data security.
Random Tessellation Process improves multi-dimensional data analysis.
problem Axis-aligned cuts limit flexibility in space partitioning methods.
method Proposes Random Tessellation Process (RTP) for non-axis aligned cuts.
result Improved accuracies in gene expression data analysis.
GRAF uses global partitioning to improve ensemble classifier performance.
problem Improving ensemble classifier performance.
method GRAF extends oblique decision trees to global partitioning.
result GRAF reduces generalization error and improves performance on benchmark datasets.
Bayesian approach for multifile record linkage and duplicate detection.
problem Challenges in merging overlapping datafiles with duplicates.
method Bayesian approach with novel partition representation and loss functions.
result Proposes a flexible prior for partitions and uncertain unresolved portions.
Distributed sparse learning with a cluster of multiple machines has attracted much attention in machine learning, especially for large-scale applications with high-dimensional data. One popular way to implement sparse learning is to use L1 regularization. In this paper, we propose a novel method, called proximal \mb…
Improved supervised EM learning for shared kernel models with feature space partitioning.
problem Lack of rigour in EM derivation and high computational complexity.
method Detailed derivation of EM for Gaussian shared kernel model, feature space partitioning to reduce complexity.
result Improved performance at reduced complexity achieved.
Bayesian nonparametric method partitions shapes using curves.
problem Capturing complex shapes in multi-dimensional data.
method Proposes a novel spline partitioning approach using curves.
result Demonstrates improved shape modeling compared to existing methods.
Improved neural network robustness certification through tighter convex relaxations.
problem Certifying neural network robustness to perturbed and adversarial inputs.
method Exploiting ReLU network structure, novel partition-based certification procedure.
result Tightens existing linear programming relaxations to achieve zero relaxation error asymptotically.
HyDaP clusters mixed-type data efficiently.
problem Clustering data with mixed types (continuous and categorical).
method Two-step hybrid approach: density-based and partition-based for continuous variables, partition-based for mixed data.
result HyDaP outperforms existing methods in clustering electronic health records.
We explore the geometrical interpretation of the PCA based clustering algorithm Principal Direction Divisive Partitioning (PDDP). We give several examples where this algorithm breaks down, and suggest a new method, gap partitioning, which takes into account natural gaps in the data between clusters. Geometric features …
Partition Tree estimates conditional densities for mixed continuous and categorical variables.
problem Estimating conditional densities for mixed data types.
method Tree-based framework modeling conditional distributions as piecewise-constant densities on adaptive partitions, minimizing conditional negative log-likelihood.
result Improved probabilistic prediction compared to CART-style trees and state-of-the-art methods.
The beta-negative binomial process (BNBP), an integer-valued stochastic process, is employed to partition a count vector into a latent random count matrix. As the marginal probability distribution of the BNBP that governs the exchangeable random partitions of grouped data has not yet been developed, current inference f…
Unsupervised space partitioning improves ANNS performance without pre-processing.
problem Efficient nearest neighbor search in high-dimensional spaces.
method Custom unsupervised learning framework for space partitioning and learning-to-search.
result Our method outperforms state-of-the-art approaches on ANNS benchmarks.
Proposes a new BSP-Tree process for flexible space partition modeling.
problem Limited modelling flexibility of axis-aligned partitions in Mondrian process.
method Introduces a self-consistent Binary Space Partitioning (BSP)-Tree process with oblique cuts.
result Clear inferential improvements over standard Mondrian process and related methods.
DCSVM efficiently classifies multi-class data using SVMs with smart partitioning.
problem Multi-class classification using SVMs with high computational cost.
method Divide and conquer approach with smart partitioning of data.
result Reduces the number of classes in each step, making final decisions in logarithmic or linear steps.
New classifiers converge under large data, simplifying complex models.
problem Complex predictive models under large datasets.
method Convergence of simultaneous and marginal classifiers under partition exchangeability.
result Asymptotic convergence of classifiers with large data reduces computational complexity.
In this paper, we investigate a divide and conquer approach to Kernel Ridge Regression (KRR). Given n samples, the division step involves separating the points based on some underlying disjoint partition of the input space (possibly via clustering), and then computing a KRR estimate for each partition. The conquering s…
We construct new multivariate copulas on the basis of a generalized infinite partition-of-unity approach. This approach allows - in contrast to finite partition-of-unity copulas - for tail-dependence as well as for asymmetry. A possibility of fitting such copulas to real data from quantitative risk management is also p…
Study on estimating Gaussian mean from coarse data, resolving identifiability and computational efficiency questions.
problem Estimating the mean of a Gaussian distribution from coarse data (sets containing true samples rather than exact values).
method Analyzes the conditions for mean identifiability and computable estimation under convex partitions.
result Resolves the identifiability and computational efficiency questions for Gaussian mean estimation from coarse data.
Paper recovers lattice signal partitions efficiently.
problem Estimating lattice partition from noisy data.
method Uses dyadic CART for computationally-efficient partition recovery.
result Consistently estimates partition with optimal error rate.
This paper addresses clustering with missing data using Rubin's rules.
problem How to pool partitions and assess instability when data are incomplete after multiple imputation.
method Consensus clustering and bootstrap theory are used to address the problem.
result New rules for pooling partitions and assessing instability are proposed and validated.
We present a new approach for learning compact and intuitive distributed representations with binary encoding. Rather than summing up expert votes as in products of experts, we employ for each variable the opinion of the most reliable expert. Data points are hence explained through a partitioning of the variables into …
We present a constructive and self-contained approach to data driven general partition-of-unity copulas that were recently introduced in the literature. In particular, we consider Bernstein-, negative binomial and Poisson copulas and present a solution to the problem of fitting such copulas to highly asymmetric data.
Enhances robustness of multi-view clustering via partition fusion.
problem Dealing with noises and inconsistency in multi-view data.
method Generates multiple partitions, integrates them, and co-evolves graph learning, partition generation, and view weight learning.
result Empirical results verify the effectiveness and robustness of the proposed approach.
Backdoor attacks are possible in feature-partitioned collaborative learning, even without labels.
problem Backdoor attacks in feature-partitioned collaborative learning.
method Demonstrated the feasibility of backdoor attacks and introduced defense techniques.
result Backdoor attacks can be blocked without significantly affecting main task accuracy.
In this paper we propose a novel Bayesian methodology for Value-at-Risk computation based on parametric Product Partition Models. Value-at-Risk is a standard tool to measure and control the market risk of an asset or a portfolio, and it is also required for regulatory purposes. Its popularity is partly due to the fact …
MREC efficiently matches and aligns point clouds, useful for single cell molecular data.
problem Comparing and aligning large datasets across various domains.
method Recursive decomposition algorithm for matching data sets, optimizing over partitioning and matching algorithms.
result Demonstrates flexibility and power in applying MREC to single cell molecular data alignment problems.
Proposes a novel multi-view clustering method by aligning partitions.
problem Challenges of integrating multi-view information and information loss.
method Aligns partitions through rotation matrices and assigns weights to views.
result Significant improvement over state-of-the-art methods on real datasets.
This study proposes a graph partitioning method to improve spatial prediction models.
problem Improving interpretability of spatial prediction models in industries.
method Graph partitioning problem to minimize within-segment variances, formulated as mixed-integer quadratic programming.
result Approximation scheme efficiently identifies spatial segments, improving computational efficiency.
We present Random Partition Kernels, a new class of kernels derived by demonstrating a natural connection between random partitions of objects and kernels between those objects. We show how the construction can be used to create kernels from methods that would not normally be viewed as random partitions, such as Random…
Fitting statistical models is computationally challenging when the sample size or the dimension of the dataset is huge. An attractive approach for down-scaling the problem size is to first partition the dataset into subsets and then fit using distributed algorithms. The dataset can be partitioned either horizontally (i…
Survey of Bayesian nonparametric space partition models and their applications.
problem Partitioning high-dimensional spaces into homogeneous regions.
method Various strategies for generating partitions in a D-dimensional space.
result Review of current progress in BNSP research.
We study the problem of learning to choose from m discrete treatment options (e.g., news item or medical drug) the one with best causal effect for a particular instance (e.g., user or patient) where the training data consists of passive observations of covariates, treatment, and the outcome of the treatment. The standa…