Hypergraph partitioning lies at the heart of a number of problems in machine learning and network sciences. Many algorithms for hypergraph partitioning have been proposed that extend standard approaches for graph partitioning to the case of hypergraphs. However, theoretical aspects of such methods have seldom received …
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,341 papers · 148 categories
Trend · papers per month
48 results for “partition modeling”
The study examines the balancedness of random partition models and finds the rich-get-richer characteristic is a result of model assumptions.
problem The balancedness of random partition models is largely neglected in the literature.
method Formulated a framework to define and study the balancedness of exchangeable random partition models, analyzed using product-form exchangeability and projectivity assumptions.
result The 'rich-get-richer' characteristic is an inevitable consequence of the model assumptions.
Rectangular Bounding Processstat.ML
Rectangular Bounding Process (RBP) improves partitioning efficiency in multi-dimensional spaces.
problem Creating many unnecessary divisions in sparse regions when describing dense regions.
method Introduces Rectangular Bounding Process (RBP) to efficiently partition multi-dimensional spaces using a bounding strategy.
result The RBP is self-consistent and can be extended to infinite space, offering rich yet parsimonious expressiveness.
Efficiently calculates PL model likelihood for partitioned preference data.
problem Computational infeasibility of calculating PL model likelihood for partitioned preference data.
method Random utility model formulation and efficient numerical integration approach.
result Proposed method outperforms existing LTR baselines and scales to real-world tasks.
GAP uses deep learning to efficiently partition graphs.
problem Graph partitioning to minimize edge cut.
method Deep learning approach with a differentiable loss function.
result GAP achieves competitive partitions and generalizes to unseen graphs.
Proposes a new BSP-Tree process for flexible space partition modeling.
problem Limited modelling flexibility of axis-aligned partitions in Mondrian process.
method Introduces a self-consistent Binary Space Partitioning (BSP)-Tree process with oblique cuts.
result Clear inferential improvements over standard Mondrian process and related methods.
Partition-wise Linear Modelsstat.ML
Region-specific linear models are widely used in practical applications because of their non-linear but highly interpretable model representations. One of the key challenges in their use is non-convexity in simultaneous optimization of regions and region-specific models. This paper proposes novel convex region-specific…
Constant-time approximation of partition functions for dense models.
problem Approximating partition functions in dense graphical models efficiently.
method Combining techniques from Markov Chain Monte Carlo and Variational Methods.
result An additive approximation of the log partition function found in constant time.
Standard bubbles and partitions are stable in various model spaces.
problem Stability of standard bubbles and partitions in different model spaces.
method New conjugated Brascamp-Lieb inequality and conformally flattening boundary potential.
result Stability of standard bubbles and partitions in , , and .
Algorithm for exact partitioning of high-order models using convex tensor relaxation.
problem Exact partitioning of high-order models.
method Defining a general class of -degree Homogeneous Polynomial Models, relaxing the high-order combinatorial problem to a convex conic form problem, defining the Carathéodory symmetric tensor cone, and constructing a primal-dual certificate.
result The solution of the convex relaxation is correct and provides a statistical upper bound for exact partitioning.
The paper develops mixed-integer formulations for neural networks using partitioning.
problem Optimizing trained ReLU neural networks with balanced model size and tightness.
method Partitioning node inputs into groups, forming the convex hull via disjunctive programming.
result The proposed formulations outperform existing ones, especially with fewer partitions.
New partition designs reduce star discrepancy in high-dimensional sampling.
problem Improving the expected star discrepancy in high-dimensional sampling.
method Developed non-equal volume partitions to achieve lower expected star discrepancy.
result Explicit upper bounds for expected star discrepancy under non-equal volume partitions.
Dynamic Partition Modelsstat.ML
Dynamic partition models learn compact binary representations from data.
problem Learning accurate distributed representations of high-dimensional data.
method The approach involves partitioning variables into expert supports, dynamically adapting partitions based on active experts, and using a smoothed version of the model with separate mixtures for each data dimension.
result Accurate reconstructions of high-dimensional data points achieved with a dozen experts.
New model of vague knowledge without strict partitions or transitivity.
problem Standard economic models of information fail to capture real-world vague knowledge.
method Relaxing assumptions of transitivity and partition structure to formalize vague knowledge.
result Vague knowledge can distinguish some states but not partition the state space.
Survey of Bayesian nonparametric space partition models and their applications.
problem Partitioning high-dimensional spaces into homogeneous regions.
method Various strategies for generating partitions in a D-dimensional space.
result Review of current progress in BNSP research.
Bayesian nonparametric method partitions shapes using curves.
problem Capturing complex shapes in multi-dimensional data.
method Proposes a novel spline partitioning approach using curves.
result Demonstrates improved shape modeling compared to existing methods.
This paper presents Sparse Partitioning, a Bayesian method for identifying predictors that either individually or in combination with others affect a response variable. The method is designed for regression problems involving binary or tertiary predictors and allows the number of predictors to exceed the size of the sa…
SPP improves partitioning of sparse regions in multi-dimensional arrays.
problem Existing partition models cause unnecessary dissections in sparse regions.
method SPP uses an 'enclosing' strategy to attach patches to dense regions, making it self-consistent for infinite arrays.
result SPP outperforms state-of-the-arts in relational modeling.
New algorithms for efficient hypergraph partitioning in computer vision.
problem Efficiently partitioning weighted uniform hypergraphs for computer vision tasks.
method Provable tensor methods and sampling techniques.
result Rigorous analysis justifies practical sampling techniques.
A new framework DECO for distributed sparse regression reduces model dimensionality and improves accuracy.
problem Sparse regression challenges in high-dimensional datasets.
method DECO framework for feature space partitioning, decorrelating features, and distributed computation.
result DECO achieves consistent variable selection and parameter estimation with nearly optimal convergence rate.
YASENN interprets neural networks by partitioning activation sequences.
problem Interpreting complex neural network decisions.
method YASENN uses layer-wise gradient boosting decision trees to distill and partition neuron activation sequences.
result YASENN provides interpretable partitions of the input space, revealing neural network decision artifacts.
Paper proposes a new method to learn EBMs and their partition function.
problem Intractability of exact MLE for EBMs due to partition function computation.
method Jointly learns an energy model and its log-partition function using neural networks.
result First tractable method for optimizing sparsemax loss in large spaces.
The paper proves that certain price paths with jumps have consistent quadratic variation.
problem Understanding the quadratic variation of price paths with jumps in financial models.
method Proving the quadratic variation is consistent across different partitions of time.
result The quadratic variation of model-free price paths with mild jumps is consistent and independent of partitions.
Paper compares graph and set partition measures for graph clustering.
problem Comparing graph clustering methods using different similarity measures.
method Introduces graph-aware partition similarity measures and compares them with set partition measures.
result Graph-aware measures provide complementary information to set partition measures.
In this paper we propose a novel Bayesian methodology for Value-at-Risk computation based on parametric Product Partition Models. Value-at-Risk is a standard tool to measure and control the market risk of an asset or a portfolio, and it is also required for regulatory purposes. Its popularity is partly due to the fact …
In this paper we relate the partition function to the max-statistics of random variables. In particular, we provide a novel framework for approximating and bounding the partition function using MAP inference on randomly perturbed models. As a result, we can use efficient MAP solvers such as graph-cuts to evaluate the c…
New sampling scheme and estimator for efficient partition function computation in log-linear models.
problem Intractable partition function calculation in large log-linear models.
method Locality Sensitive Hashing (LSH) for efficient sampling and unbiased estimator.
result Accurate estimation of partition function in sub-linear time.
New model generates clusters with sublinear growth, useful for sparse multigraphs.
problem Cluster sizes grow linearly with sample size, limiting applicability in some cases.
method Non-exchangeable random partition models based on completely random measures and Poisson embedding.
result Model generates partitions with sublinearly growing cluster sizes, controlled by parameters.
New methods reveal consensus and dissensus in network partitions.
problem Degenerate community detection methods often yield multiple competing answers.
method Comprehensive set of methods to characterize and summarize complex populations of partitions.
result It is not possible to obtain a consistent answer from point estimates when the distribution is heterogeneous.
Graph-partitioning-based DCRNN improves traffic forecasting for large highways.
problem Challenges in accurately forecasting traffic on large highway networks.
method Graph-partitioning method to decompose large networks into smaller, independent networks.
result Demonstrated improved traffic forecasting on a large California highway network.
FairGP uses graph partitioning to make Graph Transformers fair and scalable.
problem Fairness issues in Graph Transformers, especially against sensitive features.
method Graph partitioning to minimize the influence of higher-order nodes and optimize attention mechanisms.
result FairGP improves fairness in Graph Transformers while reducing computational complexity.
New method estimates partition functions for complex distributions.
problem Computing partition functions for complex and multimodal distributions.
method Rao-Blackwellized Tempered Sampling
result Empirically more accurate than Annealed Importance Sampling.
New methods approximate partition functions for Ising models using convex programming hierarchies.
problem Approximating partition functions for Ising models.
method Combining Sherali-Adams and Lasserre convex programming hierarchies with variational methods.
result New, non-trivial approximation guarantees for partition functions, beyond correlation decay.
The study limits how many parts regular simplicial partitions can overlap.
problem Bounding the intersection number of regular simplicial partitions.
method Analyzing the properties of regular simplicial partitions.
result Established a maximum limit for the intersection number.
A dependent partition-valued process for multitask clustering and time evolving network modellingstat.ML
The fundamental aim of clustering algorithms is to partition data points. We consider tasks where the discovered partition is allowed to vary with some covariate such as space or time. One approach would be to use fragmentation-coagulation processes, but these, being Markov processes, are restricted to linear or tree s…
Partition Tree estimates conditional densities for mixed continuous and categorical variables.
problem Estimating conditional densities for mixed data types.
method Tree-based framework modeling conditional distributions as piecewise-constant densities on adaptive partitions, minimizing conditional negative log-likelihood.
result Improved probabilistic prediction compared to CART-style trees and state-of-the-art methods.
Exact partitioning of high-order planted models achieved through convex optimization.
problem Efficiently partitioning hypergraphs generated by high-order planted models.
method Solving a computationally efficient convex optimization problem with a tensor nuclear norm constraint.
result Exact recovery of true underlying cluster structures with high probability.
Enhances robustness of multi-view clustering via partition fusion.
problem Dealing with noises and inconsistency in multi-view data.
method Generates multiple partitions, integrates them, and co-evolves graph learning, partition generation, and view weight learning.
result Empirical results verify the effectiveness and robustness of the proposed approach.
Beta-Negative Binomial Process and Exchangeable Random Partitions for Mixed-Membership Modelingstat.ME
The beta-negative binomial process (BNBP), an integer-valued stochastic process, is employed to partition a count vector into a latent random count matrix. As the marginal probability distribution of the BNBP that governs the exchangeable random partitions of grouped data has not yet been developed, current inference f…
Differentially private method for synthetic data generation from vertically partitioned data.
problem Generating synthetic data from vertically partitioned data while preserving privacy.
method Differentially private stochastic gradient descent (DP-SGD) algorithm combined with secure multiparty computation (MPC).
result Comparable accuracy to non-partitioned data, demonstrating privacy-preserving synthetic data generation.
Proposes SPFB method for optimizing partition functions in stochastic learning.
problem Optimizing partition functions in stochastic learning settings.
method Stochastic Gradient Bound (SPFB) method based on upper-bounding the partition function with a quadratic surrogate.
result Sub-linear convergence rate of SPFB method and efficient training of deep learning models.
New method approximates partition function of graphical models using gauge functions and polynomials.
problem Computing the partition function of graphical models is computationally challenging.
method Combines gauge function technique with real stable polynomials to approximate partition function.
result Belief Propagation estimations in the sequence do not decrease and low-bound the partition function.
New method improves nearest neighbor search using neural networks and graph partitioning.
problem Efficient nearest neighbor search in high-dimensional spaces.
method Developed a new framework for space partitioning using neural networks and graph partitioning.
result Neural LSH partitions outperform existing methods on standard benchmarks.
New copulas based on general partitions-of-unity (part III) - the continuous case (extended version)q-fin.RM
The paper extends copulas for continuous data, enabling tail dependence.
problem Modeling continuous data with tail dependence.
method Generates copulas using empirical data and a simple algorithm.
result Allows for positive tail dependence in copula modeling.
Efficiently resolves entities via scaled Ewens--Pitman model.
problem Entity resolution in large datasets.
method Microclustering Ewens--Pitman model with variational inference.
result Significant speed-up in entity resolution with competitive performance.
This study proposes a graph partitioning method to improve spatial prediction models.
problem Improving interpretability of spatial prediction models in industries.
method Graph partitioning problem to minimize within-segment variances, formulated as mixed-integer quadratic programming.
result Approximation scheme efficiently identifies spatial segments, improving computational efficiency.
Asynchronous federated learning for vertically partitioned data improves efficiency and privacy.
problem Efficiently train models on vertically partitioned data without a trusted third party.
method Proposed AFSGD-VP and its SVRG and SAGA variants for asynchronous federated learning.
result AFSGD-VP and its variants achieve higher efficiency than synchronous algorithms.
SplitNN-driven Vertical Partitioning enables distributed learning from diverse data sources.
problem Learning from vertically distributed features across institutions.
method A configuration of SplitNN that does not share raw data or model details.
result Flexibility in merging split model outputs and resource efficiency.