For statistical learning, categorical variables in a table are usually considered as discrete entities and encoded separately to feature vectors, e.g., with one-hot encoding. "Dirty" non-curated data gives rise to categorical variables with a very high cardinality but redundancy: several categories reflect the same ent…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “dirty categories”
Vectorizing string entries for data processing on tables: when are larger language models better?stat.ML
New research shows larger language models improve data processing for diverse entries.
problem Optimizing data processing for tables with diverse string entries.
method Analytical tasks on tables with varying language model sizes and a fuzzy join benchmark.
result Larger language models improve data processing for diverse entries, but fine-tuning is necessary.
Study on AutoML robustness with dirty data.
problem Robustness of AutoML-generated pipelines with noisy data.
method Investigated TPOT, H2O, and AutoKeras systems; analyzed accuracy and pipeline structure.
result Dirty data can improve robustness of AutoML solutions.
A new method detects outliers in dirty data using a leave-out strategy.
problem Outliers in training data skew support vector machine performance.
method Leave-out strategy: temporarily omit one candidate at a time for outlier detection.
result The leave-out strategy improves outlier detection compared to existing methods.
In this paper, we study the sum rate maximization for successive zero-forcing dirty-paper coding (SZFDPC) with per-antenna power constraint (PAPC). Although SZFDPC is a low-complexity alternative to the optimal dirty paper coding (DPC), efficient algorithms to compute its sum rate are still open problems especially und…
Data quality issues have attracted widespread attention due to the negative impacts of dirty data on data mining and machine learning results. The relationship between data quality and the accuracy of results could be applied on the selection of the appropriate algorithm with the consideration of data quality and the d…
In this article, we present an integration of any real finite-dimensional Leibniz algebra as a Lie rack which reduces in the particular case of a Lie algebra to the ordinary connected simply connected Lie group. The construction is not functorial.
Satellite-based positioning system such as GPS often suffers from large amount of noise that degrades the positioning accuracy dramatically especially in real-time applications. In this work, we consider a data-mining approach to enhance the GPS signal. We build a large-scale high precision GPS receiver grid system to …
The simulator is an R package that streamlines the process of performing simulations by creating a common infrastructure that can be easily used and reused across projects. Methodological statisticians routinely write simulations to compare their methods to preexisting ones. While developing ideas, there is a temptatio…
We derive a closed-form formula for computing bond prices between coupon payments. Our results cover both the `Treasury' and the `Street' pricing methods used by sovereign and corporate issuers. We apply our formulas to two UK gilts, the 8% Treasury Gilt 2015, and the 0.5% Treasury Gilt 2022, and show that we can obtai…
We consider axisymmetric stationary dirty black holes with regular non-extremal or extremal horizons, and compute their on-horizon Petrov types. The Petrov type (PT) in the frame of the observer crossing the horizon can be different from that formally obtained in the usual (but singular in the horizon limit) frame of a…
Industry datasets used for text classification are rarely created for that purpose. In most cases, the data and target predictions are a by-product of accumulated historical data, typically fraught with noise, present in both the text-based document, as well as in the targeted labels. In this work, we address the quest…
Correctly detecting the semantic type of data columns is crucial for data science tasks such as automated data cleaning, schema matching, and data discovery. Existing data preparation and analysis systems rely on dictionary lookups and regular expression matching to detect semantic types. However, these matching-based …
Studies amenable category's monotonicity and its relation to topological complexity.
problem Monotonicity of amenable category for degree-one maps.
method Uses amenable covers and compares with topological complexity.
result Establishes a relation between amenable category and topological complexity.
Trimming helps in conformal prediction when it separates anomaly scores.
problem Effectiveness of trimming in conformal prediction under contamination.
method Analyse fixed-threshold trimming as a replacement of the contaminated calibration law with a retained law.
result Trimming helps when it separates anomaly scores, reducing clean-target coverage to a one-dimensional score-CDF transfer problem.
Formal Contact Categoriesmath.GT
To each oriented surface S, we associate a differential graded category Ko(S). The homotopy category Ho(Ko(S)) is a triangulated category which satisfies properties akin to those of the contact categories studied by K. Honda. These categories are also related to the algebraic contact categories of Y. Tian and to the bo…
Formulates a new connection between topological and geometric categories.
problem No specific problem stated; focuses on category formulation.
method Formulates a connection between a topological and geometric category.
result Provides a more precise and improved version of a previous proposal.
We continue the program of structural differential geometry that begins with the notion of a tangent category, an axiomatization of structural aspects of the tangent functor on the category of smooth manifolds. In classical geometry, having an affine structure on a manifold is equivalent to having a flat torsion-free c…
Paper explores how poisoning data can increase privacy risks in machine learning models.
problem Increasing privacy risks of benign training samples through data poisoning attacks.
method Proposes generic and optimization-based attacks to amplify membership exposure.
result Demonstrates substantial increase in membership inference precision with minimal model performance degradation.
We introduce semisimple 2-categories, fusion 2-categories, and spherical fusion 2-categories. For each spherical fusion 2-category, we construct a state-sum invariant of oriented singular piecewise-linear 4-manifolds.
The paper defines new TQFTs from non-semisimple categories and proves spherical categories are chromatic.
problem Defining non-compact TQFTs from non-semisimple categories.
method Introducing admissible skein modules, chromatic categories, and using Juhász's cobordism presentation.
result Non-compact (2+1)-TQFTs can be defined from chromatic categories, extending Turaev-Viro TQFTs.
Spider category comparison proves equivalence to Sikora's quotient category.
problem Comparing skein theories of .
method Proved equivalence between spider category and Sikora's quotient category.
result Spider category is equivalent to Sikora's quotient category.
We generalize the notion of monetary value measures developed with category theory in [Adachi, 2014] by extending their base category from the category \c{hi} to the category of probability spaces Prob introduced in [Adachi and Ryu, 2016].
ETQFTs created from non-semisimple modular categories.
problem Constructing ETQFTs from non-semisimple modular categories.
method Explicitly identify linear categories and functors in the image of ETQFTs constructed from modular categories.
result The circle category of ETQFTs is equivalent to the full subcategory of projective objects of the underlying modular category, which need not be semisimple.
Studies modules over a category of Jacobi diagrams in handlebodies.
problem Understanding modules over a specific category of Jacobi diagrams.
method Generalizes adjunctions and studies subquotient modules.
result Generalizes adjunctions between modules and Casimir Lie algebra modules.
Comparative Smootheologymath.DG
We compare various different definitions of "the category of smooth objects". The definitions compared are due to Chen, Frölicher, Sikorski, Smith, and Souriau. The method of comparison is to construct functors between the categories that enable us to see how the categories relate to each other. This produces a diagram…
We define a symmetric monoidal (4,3)-category with duals whose objects are certain enriched multi-fusion categories. For every modular tensor category , there is a self enriched multi-fusion category giving rise to an object of this symmetric monoidal (4,3)-category. We conjecture that the e…
We show that once-extended anomalous 3-dimensional topological quantum field theories valued in the 2-category of k-linear categories are in canonical bijection with modular tensor categories equipped with a square root of the global dimension in each factor.
This is the second in a series of papers intended to set up a framework to study categories of modules in the context of non-commutative geometries. In \cite{mem} we introduced the basic DG category $\Pc_{\A^\bullet}$, the perfect category of $\A^\bullet$, which corresponded to the category of coherent sheaves on a com…
New 4-manifold invariant defined from trisection diagrams.
problem Defining a new 4-manifold invariant from trisection diagrams.
method Algebraic data from bimodule categories and spherical fusion categories, described diagrammatically.
result Includes Hopf algebraic invariants and modular fusion category invariants.
We study the transverse Lusternik-Schnirelmann category of a Riemannian foliation on a compact manifold. We obtain a necessary and sufficient condition when the transverse LS category is finite. We also introduce a variation on the concept of transverse LS category, the essential transverse category, and show that this…
It is well-known that reduced smooth orbifolds and proper effective foliation Lie groupoids form equivalent categories. However, for certain recent lines of research, equivalence of categories is not sufficient. We propose a notion of maps between reduced smooth orbifolds and a definition of a category in terms of mark…
TXtract extracts structured knowledge from thousands of product categories.
problem Extracting structured knowledge from diverse product categories in e-commerce.
method TXtract uses a taxonomy-aware model with category conditional self-attention and multi-task learning.
result TXtract outperforms state-of-the-art approaches by up to 10% in F1 and 15% in coverage across all categories.
Paper proposes CNE-net to tackle incremental learning in (T)ACSA tasks.
problem Catastrophic forgetting in multi-task incremental learning for (T)ACSA.
method Category Name Embedding network (CNE-net) with shared encoder and decoder.
result State-of-the-art performance on (T)ACSA benchmark datasets.
Dualizable tensor categoriesmath.QA
We investigate the relationship between the algebra of tensor categories and the topology of framed 3-manifolds. On the one hand, tensor categories with certain algebraic properties determine topological invariants. We prove that fusion categories of nonzero global dimension are 3-dualizable, and therefore provide 3-di…
Generative model for morphisms in free categories learns from wiring diagrams.
problem Learning and generating morphisms in free monoidal categories.
method Probabilistic generative model using variational inference and maximum likelihood.
result The model achieves competitive performance on the Omniglot dataset.
3D HQFTs constructed using graded monoidal categories.
problem Constructing 3D HQFTs with specific targets.
method Using spherical χ-fusion categories and the state sum method.
result 3D HQFTs constructed with target Bχ.
We consider colored operads and their actions on categories. As a special example we construct a cobordism category with a colored operad action arising from oriented planar arc diagrams. This is used to construct an invariant of oriented tangle diagrams with values in the homotopy category attached to the cobordism ca…
New categories help understand knot algebra.
problem Understanding the action of on knot homology.
method Introducing and equating two new supercategories.
result Equivalence of categories for .
This paper extends link invariants using functors on nanophrases.
problem Link invariants are less informative in certain categories.
method Introduces functors from nanophrases to virtual strings, pseudolinks, quasilinks, and free links.
result Extends the Jones pseudolink polynomial to general nanophrases.
Theory for algebraic data on categories via concentration structures.
problem Defining algebraic structures on categories.
method Introducing concentration structures and concentration monoids.
result Every group can be represented as a concentration monoid of a trivial category.
New skein categories for non-semisimple settings, extending existing theory.
problem Extending skein theory to non-semisimple settings.
method Introducing skein categories based on tensor ideals in linear ribbon categories.
result Skein categories coincide with factorization homology in non-semisimple settings.
Completes reduction scheme in Lagrange-Poincaré category.
problem Lagrangian reduction by stages in the whole category.
method Analyzes Noether theorem, Hamiltonian reduction, geometric aspects.
result Affirmative answer to open question of Lagrangian reduction.
Using methods inspired from algebraic -theory, we give a new proof of the Genauer fibration sequence, relating the cobordism categories of closed manifolds with cobordism categories of manifolds with boundaries, and of the Bökstedt-Madsen delooping of the cobordism category. Unlike the existing proofs, this approach…
We generalize Cohen & Jones & Segal's flow category whose objects are the critical points of a Morse function and whose morphisms are the Morse moduli spaces between the critical points to an n-category. The n-category construction involves repeatedly doing Morse theory on Morse moduli spaces for which we have to const…
We construct what we call a Kirby category, a monoidal category whose morphisms are smooth 4-manifolds, projecting down to another monoidal category whose morphisms are orientable 3-manifolds, the projection being induced by the boundary map on manifolds. We construct a higher categorical generalization of such concept…
This paper introduces a new distance metric for filtered A-infinity categories, focusing on Lagrangian submanifolds.
problem Measuring the distance between filtered A-infinity categories associated with Lagrangian submanifolds.
method Developed a Gromov-Hausdorff distance to measure the difference between these categories.
result Established that the sequence of filtered A-infinity categories forms a Cauchy sequence in Gromov-Hausdorff distance.
We propose a generalization of quantization as a categorical way. For a fixed Poisson algebra quantization categories are defined as subcategories of R-module category with the structure of classical limits. We construct the generalized quantization categories including matrix regularization, strict deformation quantiz…