A new property fixes look-ahead bias in backtesting and trading pipelines.
problem Fixing look-ahead bias in backtesting and trading pipelines.
method Developed a pipeline calculus separating availability from reference time, and a type-and-effect system for the value-independent fragment.
result The check scales linearly and catches all leaks, including those missed by differential and tiling detectors.
The evaluation of machine learning (ML) pipelines is essential during automatic ML pipeline composition and optimisation. The previous methods such as Bayesian-based and genetic-based optimisation, which are implemented in Auto-Weka, Auto-sklearn and TPOT, evaluate pipelines by executing them. Therefore, the pipeline c…
Hyperparameter tuning of multi-stage pipelines introduces a significant computational burden. Motivated by the observation that work can be reused across pipelines if the intermediate computations are the same, we propose a pipeline-aware approach to hyperparameter tuning. Our approach optimizes both the design and exe…
Classical Machine Learning (ML) pipelines often comprise of multiple ML models where models, within a pipeline, are trained in isolation. Conversely, when training neural network models, layers composing the neural models are simultaneously trained using backpropagation. We argue that the isolated training scheme of ML…
Study proposes a statistical testing framework for evaluating clustering pipelines.
problem Quantifying the statistical reliability of clustering results from data analysis pipelines.
method Selective inference-based statistical testing framework for clustering pipelines.
result The proposed test controls the type I error rate and is effective in validating clustering results.
Study embedding calculus and link invariants using functor calculus.
problem Detect Milnor invariants using embedding towers of string links.
method Use functor calculus and Goodwillie-Weiss embedding calculus.
result Embedding tower detects Milnor invariants.
Investigates fairness in pipeline models where individuals may drop out.
problem Fairness in pipeline models where individuals may drop out and subsequent stages depend on remaining individuals.
method Rigorous framework for evaluating fairness guarantees, showing that naïve auditing is insufficient and dependence must exist between stages.
result Fairness in pipelines can be arbitrary, even with just two stages, and requires dependence between stages.
Embedding calculus proves convergence for surfaces.
problem Proving convergence of embedding calculus for surfaces.
method Goodwillie-Weiss' embedding calculus for spaces of embeddings into a manifold of dimension at most two.
result Relates Johnson filtration of mapping class group to embedding calculus.
Study geometric characterization of asymptotic pseudodifferential calculus on spinor bundles.
problem Geometric characterization of asymptotic pseudodifferential calculus on spinor bundles.
method Groupoid approach to pseudodifferential calculus, rescaled bundle.
result Rescaled bundle provides geometric characterization to asymptotic pseudodifferential calculus on spinor bundles.
We explain that general differential calculus and Lie theory have a common foundation: Lie Calculus is differential calculus, seen from the point of view of Lie theory, by making use of the groupoid concept as link between them. Higher order theory naturally involves higher algebra (n-fold groupoids).(conceptual, topol…
Secondary Calculus formalizes PDEs using cohomology, simplifying their study.
problem Formalizing and simplifying the study of partial differential equations (PDEs).
method Using cohomology of diffieties to formalize PDEs and their properties.
result Differential calculus on PDE solution spaces is homotopy calculus on horizontal De Rham algebras of diffieties.
In arXiv:1207.0332 [cs.LO] was proposed a graphic lambda calculus formalism, which has sectors corresponding to untyped lambda calculus and emergent algebras. Here we explore the sector covering knot diagrams, which are constructed as macros over the graphic lambda calculus.
Data science relies on pipelines that are organized in the form of interdependent computational steps. Each step consists of various candidate algorithms that maybe used for performing a particular function. Each algorithm consists of several hyperparameters. Algorithms and hyperparameters must be optimized as a whole …
Extends differential calculus to triole algebras.
problem No specific problem stated; focuses on extending differential calculus.
method Generalizes diolic differential calculus to triole algebras with fiber metrics.
result Established a conceptual framework for calculus on bundles with vector-valued fiber metrics.
Introduces tractors for basic examples and modern differential calculus.
problem None explicitly stated, focuses on introduction.
method Classical examples and modern invariant differential calculus.
result Introduction to tractors and related modern differential calculus.
A diagrammatic language for 3D manifolds with boundary.
problem Representing and manipulating 3D manifolds with boundary.
method Diagrammatic calculus and local moves.
result Completeness of the diagrammatic calculus proved.
Unified Lie structures in homotopy and isotopy calculus.
problem Compatibility of Lie structures in homotopy and isotopy calculus.
method New technical tool: bracket on total homotopy fibres of collapsing cubes of wedge sums.
result Unified understanding of Lie structures in homotopy and isotopy calculus.
Automates supervised learning pipeline design with matrix and tensor factorization.
problem Designing effective supervised learning pipelines with many choices.
method Uses matrix and tensor factorization to model pipeline search space and develops greedy experiment design protocols.
result Demonstrates the effectiveness of the approach on real-world classification problems.
We examine the N-Koszul calculus for the N-symmetric algebras. The case N=2 corresponds to the Elie Cartan calculus. We conjecture that, as in the case N=2, the N-Cartan calculus extends to manifolds when N>2, which would provide a new type of noncommutative differential geometry.
Data science relies on pipelines that are organized in the form of interdependent computational steps. Each step consists of various candidate algorithms that maybe used for performing a particular function. Each algorithm consists of several hyperparameters. Algorithms and hyperparameters must be optimized as a whole …
This paper is concerned with pseudodifferential calculus on manifolds with fibred corners. Following work of Connes, Monthubert, Skandalis and Androulidakis, we associate to every manifold with fibred corners a longitudinally smooth groupoid which algebraic and differential structure is explicitely described. This grou…
This memoir deals with the hypoelliptic calculus on Heisenberg manifolds, or Heisenberg calculus. The Heisenberg manifolds generalize CR and contact manifolds and in this context the main differential operators at stake include the Hörmander's sum of squares, the Kohn Laplacian, the horizontal sublaplacian and its conf…
Simplified calculus for semimartingales makes complex transformations easier.
problem Complex transformations of semimartingales.
method Unified treatment of transformations for real and complex semimartingales.
result Unified calculus for semimartingales simplifies various transformations.
New model optimizes oil product distribution via pipelines.
problem Optimizing oil product distribution via pipelines.
method Discrete-time mixed integer linear programming model.
result Significant reductions in pipeline operational cost.
Pipeline decomposes portfolio optimization problems into smaller, solvable subproblems.
problem Large-scale portfolio optimization with constraints.
method Decomposition pipeline with preprocessing, clustering, and risk rebalancing.
result Pipeline reduces problem size by 80% and computation time.
Euler calculus is based on integrating simple functions with respect to the Euler characteristic. This paper makes the case for extending Euler calculus to continuous integrands by integrating with respect to (Gaussian) curvature. This requires a metric but is nevertheless defined within any O-minimal theory. It satisf…
Paper proposes a statistical test for feature selection pipelines using selective inference.
problem Assessing the significance of feature selection pipelines in data analysis.
method Selective inference technique applied to feature selection pipelines composed of various algorithms.
result The proposed statistical test controls false positive feature selection probabilities.
This is a short description of graphic lambda calculus, with special emphasis on a duality suggested by the two different appearances of knot diagrams, in lambda calculus and emergent algebra sectors of the graphic lambda calculus respectively. This duality leads to the introduction of the dual of the graphic beta move…
Develops symmetric Cartan calculus linking to Patterson-Walker metric.
problem No specific problem stated; focuses on developing a new calculus.
method Symmetric Cartan calculus, using torsion-free affine connections.
result Symmetric Cartan calculus is a complete analogue of classical Cartan calculus.
New algebraic formalism for differential calculus in Diolic algebras.
problem Studying differential calculus in vector bundles.
method Introducing functors of differential calculus over arbitrary graded commutative algebras (DCGCA) and applying this to Diolic algebras.
result Recovery of well-known objects and notions from ordinary differential, symplectic, and Poisson geometry, with unique aspects.
New calculus solves boundary value problems for elliptic operators.
problem Boundary value problems for 0-elliptic operators.
method Developed a new calculus called symbolic 0-calculus to handle boundary value problems.
result Construct left and right parametrices for 0-elliptic operators with boundary conditions.
New integration theory on topological spaces, including fractals.
problem Developing a universal integration theory for arbitrary topological spaces.
method Introducing a new integration framework using unital magma valued functions and measures.
result Integration, differentiation, and orientation defined for arbitrary topological spaces.
New approach identifies and explains errors in machine learning pipelines.
problem Challenges in identifying and explaining errors in complex machine learning pipelines.
method Uses iteration and provenance to automatically infer root causes of failures.
result Significantly improves precision and recall compared to state-of-the-art methods.
Following the programme set out in Part I of this work, we develop a conceptual higher order differential calculus. The '' local linear algebra '' defined in Part I is generalized by '' higher order local linear algebra ''. The underlying combinatorial object of such higher algebra is the natural n-dimensional hyper-cu…
Pipelined Backpropagation trains large models without batches efficiently.
problem Training large models efficiently on hardware with limited batch sizes.
method Fine-grained Pipelined Backpropagation with Spike Compensation and Linear Weight Prediction.
result Fine-grained Pipelined Backpropagation with a batch size of one matches the accuracy of SGD for multiple networks.
Cartan calculus applied to string topology homology.
problem Understanding the structure of free loop spaces.
method Introduced Cartan calculus on loop homology, linked to string topology operations.
result Loop product and bracket behavior under Hodge decomposition.
Develops a graphical calculus for stable curvature invariants.
problem Calculating stable curvature invariants of Riemannian manifolds.
method Graphical calculus based on trivalent graphs with colored edges.
result Derives a curvature identity for compact Einstein manifolds.
Simplified calculus for manifold operators, proving index theorems.
problem Developing calculus for manifold operators and proving index theorems.
method Introducing a simplified pseudo-differential calculus for zero-order operators on manifolds with a tangent Lie structure.
result Proving index theorems for `h-elliptic' operators on manifolds with a tangent Lie structure.
Derives optimal control conditions using calculus of variations.
problem Optimizing Markov control in stochastic control problems.
method Calculus of variations approach to derive necessary conditions.
result Solves the Merton portfolio optimization problem.
The calculus correspondence has been known to exist between generic pedal evolutions and generic wave front evolutions. In this paper, we first extend the known results on the calculus correspondence to evolutions with multi-parameters, and then give applications of calculus correspondence. Moreover, we discuss the pos…
To give a Cartan calculus on the extended quantum 3d space, the noncommutative differential calculus on the extended quantum 3d space is extended by introducing inner derivations and Lie derivatives.
Quantum calculus models stock liquidity issues.
problem Capturing illiquidity in stock price distributions.
method Quantum stochastic calculus applied to finance.
result Modeling the impact of widened bid-ask spreads.
Study reveals similarities in knowledge flows between pharmaceutical and AI industries.
problem Understanding the dynamics of drug pipelines in global pharmaceutical industry.
method Multilayer network analysis of drug pipeline, global supply chain, and ownership data.
result Proven similarities in knowledge flows between pharmaceutical and AI industries.
Modyn automates continuous ML model training on growing datasets.
problem Continuous model retraining is costly and impractical.
method Data-centric ML platform with policies for continuous training.
result Modyn enables high throughput training with sample-level data selection.
TODS automates time series outlier detection with customizable pipelines.
problem Automated detection of outliers in time series data.
method Modular system with 70 primitives for data processing, time series analysis, and detection algorithms. GUI and data-driven searcher for pipeline design.
result Automated discovery and construction of effective outlier detection pipelines.
Hungarian text processing improved with efficient, accurate NLP pipelines.
problem Improving text processing for Hungarian language.
method Implemented in spaCy framework, focusing on efficiency and accuracy.
result Near state-of-the-art performance in all text preprocessing steps.
We introduce and study graphic lambda calculus, a visual language which can be used for representing untyped lambda calculus, but it can also be used for computations in emergent algebras or for representing Reidemeister moves of locally planar tangle diagrams.
Develops calculus for tamed Dirichlet spaces using measure theory.
problem Defines calculus for measure spaces with Dirichlet forms.
method Introduces first and second order calculus on tamed Dirichlet spaces.
result Defines various geometric objects on tamed Dirichlet spaces.