The paper explores the difficulty of robust machine learning models.
problem Understanding the vulnerability of machine learning models to adversarial attacks.
method The study uses computational learning theory to analyze the feasibility of robust learning from both sample and computational complexity perspectives.
result No non-trivial concept class can be robustly learned in the distribution-free setting against a single-bit adversary, and the class of monotone conjunctions cannot be robustly learned under the uniform distribution against an adversary that can perturb ω(logn) bits. Trivial links are unique up to number of link components, but they can be hard to recognize from arbitrary diagrams. We define a new measure of the complexity of a link embedding, the crumple, and show how this may be used to measure progress toward a trivial embedding. In conjunction with a modified form of arc presen…
Bayesian deep learning predicts satellite collisions.
problem Space debris poses planetary risk.
method Bayesian deep learning with LSTM networks.
result Predicts conjunction event evolution with uncertainties.
Analytical results bound the approach to oligarchy in a modified asset exchange model.
problem Analyzing economic inequality in a modified asset exchange model.
method Analytical results using Gini coefficient and differential inequalities.
result The Gini coefficient is bounded by a first-order differential inequality.
Space debris warnings follow a predictable pattern, allowing timely satellite maneuvers.
problem Estimating when fresh information about space debris will arrive.
method Statistical learning model of the message arrival process, specifically a Bayesian Poisson process.
result The average prediction error for the next message arrival time is smaller than baseline predictions.
We consider a Black-Scholes market in which a number of stocks and an index are traded. The simplified Capital Asset Pricing Model is the conjunction of the usual Capital Asset Pricing Model, or CAPM, and the statement that the appreciation rate of the index is equal to its squared volatility plus the interest rate. (T…
The paper addresses monotonicity in machine learning models for fairness and accountability.
problem Ensuring fairness and accountability in transparent machine learning models.
method Study of three types of monotonicity (individual, weak pairwise, strong pairwise) and propose monotonic groves of neural additive models.
result Monotonic groves of neural additive models maintain transparency, accountability, and fairness.
The paper tackles non-monotonic learning performance and proposes algorithms to make models more monotone.
problem Non-monotonic learning performance where more data does not always improve model quality.
method Proposes three algorithms to make supervised learning models more monotone, proving consistency and monotonicity with high probability.
result The algorithm MT-HT reduces less than 1% non-monotonic decisions on MNIST while maintaining competitive error rates.
Probit Monotone BART estimates binary outcomes using monotonic functions.
problem Estimating conditional mean functions for binary outcomes with monotonicity constraints.
method Proposes a new BART variant that incorporates monotonicity constraints for binary outcomes.
result Allows for more precise estimation of monotonic functions in binary outcome models.
Monotone neural networks can approximate and interpolate functions efficiently.
problem Understanding the efficiency and expressiveness of monotone neural networks.
method Solving the monotone interpolation problem using depth-4 networks and comparing size bounds with arbitrary networks.
result Monotone neural networks can approximate and interpolate functions efficiently, but may require exponential size in high dimensions.
Improves k-NN for monotonic data with robustness against noise.
problem Class noise in real-life data violates monotonic constraints in k-NN.
method Monotonic Fuzzy k-NN (MonFkNN) with new fuzzy membership calculation.
result Significant accuracy improvements and robustness against monotonic noise.
Study examines explainable machine learning for monotonic models, finding Integrated gradients better for strong monotonicity.
problem Applying explainable machine learning to science-informed models.
method Proposed axioms for monotonicity, tested Shapley value and Integrated gradients methods.
result Integrated gradients provides better explanations for strong monotonicity.
Formula proves monotonicity for anisotropic minimal hypersurfaces.
problem Understanding anisotropic minimal hypersurfaces.
method Proved a monotonicity formula under a sign assumption on the Minkowski norm.
result Monotonicity formula for anisotropic minimal hypersurfaces.
The paper develops algorithms to restore monotonicity in non-monotone functions.
problem Non-monotone solutions from heuristic algorithms need to be corrected.
method Develops algorithms to restore monotonicity with limited queries.
result Restores monotonicity while degrading the function value by at most ε.
New example of manifolds with monotonic heat kernels found.
problem Understanding monotonicity of heat kernels on manifolds.
method Analyzing new examples and classifying flat tori.
result Generic metrics fail monotonicity at large times.
Nonnegative matrix factorization (NMF) factorizes a non-negative matrix into product of two non-negative matrices, namely a signal matrix and a mixing matrix. NMF suffers from the scale and ordering ambiguities. Often, the source signals can be monotonous in nature. For example, in source separation problem, the source…
In [S. Basu, A. Gabrielov, N. Vorobjov, Semi-monotone sets. arXiv:1004.5047v2 (2011)] we defined semi-monotone sets, as open bounded sets, definable in an o-minimal structure over the reals, and having connected intersections with all translated coordinate cones in R^n. In this paper we develop this theory further by d…
COMET learns monotonic neural networks by incorporating counterexamples.
problem Enforcing monotonicity constraints in neural networks for real-world tasks.
method Counterexample-guided learning technique for ReLU neural networks.
result COMET achieves state-of-the-art results and improves model quality.
New estimator improves off-policy evaluation for large action spaces.
problem Conventional importance-weighting approaches suffer from excessive variance in off-policy evaluation for large discrete action spaces.
method Proposes OffCEM estimator based on conjunct effect model (CEM), applying importance weighting only to action clusters and using model-based reward estimation for residual effects.
result Proposed estimator is unbiased under local correctness condition, providing substantial improvements in OPE especially with many actions.
Monotonic differentiable sorting networks improve upon previous methods.
problem Non-monotonicity in differentiable sorting networks.
method Relaxation of conditional swap operations using sigmoid functions to ensure monotonicity.
result Monotonic differentiable sorting networks improve upon previous methods.
We prove three new monotonicity formulas for manifolds with a lower Ricci curvature bound and show that they are connected to rate of convergence to tangent cones. In fact, we show that the derivative of each of these three monotone quantities is bounded from below in terms of the Gromov-Hausdorff distance to the neare…
Proves monotonicity of parabolic frequency on all manifolds without curvature assumptions.
problem Monotonicity of parabolic frequency on manifolds.
method Analyzes parabolic frequency function on manifolds, proving monotonicity without curvature assumptions.
result Monotonicity of parabolic frequency on all manifolds, no curvature assumption needed.
Paper introduces algorithms for explaining monotonic classifiers.
problem Need for explanations of monotonic classifiers.
method Polynomial algorithms for formal explanations of monotonic classifiers.
result Efficient model-agnostic algorithm for enumerating explanations.
Develops monotone tree-based GAMI models using XGBoost.
problem Incorporating monotonicity into GAMI models based on boosted trees.
method Adapting XGBoost algorithm to fit monotone GAMI-Tree models, filtering interactions, and parsing results.
result Fits monotone GAMI-Tree models that are directly interpretable and visualizable.
The paper evaluates the importance of monotonicity in AI fairness across various fields.
problem Ensuring fairness in AI applications across criminology, education, health care, and finance.
method Theoretical reasoning, simulation, and extensive empirical analysis of monotonic neural additive models (MNAMs).
result Monotonicity is essential for fairness in AI ethics and society, especially in criminology, education, health care, and finance.
The paper calculates how much data is needed to learn decision lists in the presence of evasion attacks.
problem Quantifying sample complexity for robust learning of decision lists against evasion attacks.
method PAC learning framework, Lipschitz condition on distributions, lower and upper bounds on sample complexity.
result Upper and lower bounds on sample complexity for robust learning of decision lists, showing exponential vs polynomial dependence on adversary's budget.
We introduce large scale analogues of topological monotone and light maps, which we call coarsely monotone and coarsely light maps respectively. We show that these two classes of maps constitute a factorization system on the coarse category. We also show how coarsely monotone maps arise from a reflection in a similar w…
Study on biharmonic map heat flow with monotonicity formula.
problem Properties of biharmonic heat kernel and extrinsic biharmonic map heat flow.
method Derived an entropy type quantity exhibiting monotonicity behaviors.
result Monotonicity formula for extrinsic biharmonic map heat flow.
A local monotonicity formula for the Yang-Mills-Higgs flow on G-bundles over Rn (n>4) is proved. It is shown that the monotone quantity coïncides on certain self-similar solutions with that appearing in existing non-local monotonicity formulæ for the Yang-Mills and Yang-Mills-Higgs flows.
This paper benchmarks monotone-constrained models for credit PD across datasets and finds constraints are mostly costless.
problem Aligning machine learning model behavior with domain knowledge in credit risk.
method Benchmarked monotone-constrained versus unconstrained gradient boosting models across five datasets and three libraries, defining the Price of Monotonicity (PoM) as the relative change in AUC.
result Monotonicity constraints are almost costless on large datasets and most costly on smaller datasets, with PoM ranging from essentially zero to about 2.9 percent.
Study on pairwise counter-monotonicity, a type of negative dependence.
problem Understanding and quantifying extremal negative dependence structures.
method Established stochastic representation and invariance property; showed implications and connections.
result Pairwise counter-monotonicity implies negative association and joint mix dependence.
We propose a new framework for imposing monotonicity constraints in a Bayesian nonparametric setting based on numerical solutions of stochastic differential equations. We derive a nonparametric model of monotonic functions that allows for interpretable priors and principled quantification of hierarchical uncertainty. W…
This paper introduces a novel monotone curve estimation framework based on convex duality.
problem Estimating smooth, continuous, and monotonic curves in data.
method Convex duality and optimal transport theories.
result Established statistical guarantees for monotone curve estimates.
Classical Hurwitz numbers count branched covers of the Riemann sphere with prescribed ramification data, or equivalently, factorisations in the symmetric group with prescribed cycle structure data. Monotone Hurwitz numbers restrict the enumeration by imposing a further monotonicity condition on such factorisations. In …
Study derives new equation for reserves in non-monotone information scenarios.
problem Modeling reserves in situations where information is not always increasing.
method Infinitesimal approach to derive generalized stochastic Thiele equation.
result New equation allows for information discarding and solves open problems.
Study on MMV in jump-diffusion models resolves MV's non-monotonicity issues.
problem Non-monotonicity and free cash flow stream problems in MV preferences.
method Explicit solution for MMV preferences in jump-diffusion models, proving non-negative potential measures.
result MMV resolves MV's non-monotonicity and free cash flow stream issues.
In this paper we generalize the monotonicity formulas of [C] for manifolds with nonnegative Ricci curvature. Monotone quantities play a key role in analysis and geometry; see, e.g., [A], [CM1] and [GL] for applications of monotonicity to uniqueness. Among the applications here is that level sets of Green's function on …
The paper investigates quantitative rigidity using Colding's monotonicity formulas for Ricci curvature.
problem Quantifying rigidity in manifolds with nonnegative Ricci curvature.
method Investigates pinching of Colding's monotone functionals and constructs k-splitting functions. result Quantitative control of splitting functions by pinching at independent points controls the distance to the nearest cone.
We propose learning deep models that are monotonic with respect to a user-specified set of inputs by alternating layers of linear embeddings, ensembles of lattices, and calibrators (piecewise linear functions), with appropriate constraints for monotonicity, and jointly training the resulting network. We implement the l…
Investigates polar tangential angles of curves and their monotonicity.
problem Behavior of polar tangential angles of plane curves.
method Proof of monotonicity for certain curves of monotone curvature.
result Nonexistence results for an obstacle problem involving free elasticae.
We propose an algorithm for a family of optimization problems where the objective can be decomposed as a sum of functions with monotonicity properties. The motivating problem is optimization of hyperparameters of machine learning algorithms, where we argue that the objective, validation error, can be decomposed as mono…
The problem of existence of arbitrage free and monotone CDO term structure models is studied. Conditions for positivity and monotonicity of the corresponding Heath-Jarrow-Morton-Musiela equation for the x-forward rates with the use of the Milian type result are formulated. Two state spaces are taken into account - of…
In this paper, we introduce a monotonicity formula for the mean curvature flow. We also apply this monotonicity formula to study the asymptotic behavior of eternal solutions.
New models ensure monotonicity in preference learning, improving accuracy especially with limited data.
problem Failure of widely used preference learning models to maintain monotonicity.
method Proposed Linear Generalized Bradley-Terry models with Diffusion Priors.
result New models improve accuracy, especially with limited data.
The study finds monotonic properties of harmonic functions on 3-manifolds with a flat end.
problem Understanding harmonic functions on 3-manifolds with specific ends.
method Derives monotonic properties of positive harmonic functions on 3-manifolds with nonnegative scalar curvature and asymptotically flat ends.
result Rigidity characterization of spatial Schwarzschild manifolds with two ends.
We investigate monotonicity properties of p-harmonic vector bundle-valued k-forms by studying the energy-momentum tensor associated with such a form. As a consequence, we obtain a unified proof of the monotonicity formulæ for p-harmonic maps and Yang-Mills connections, proving a monotonicity formula for p-Yang-…
Under certain topological assumptions, we show that two monotone Lagrangian submanifolds embedded in the standard symplectic vector space with the same monotonicity constant cannot link one another and that, individually, their smooth knot type is determined entirely by the homotopy theoretic data which classifies the …
Researchers propose a non-monotone quantum natural gradient for quantum systems.
problem Applying natural gradient methods to quantum systems without monotonicity.
method Introducing a non-monotone quantum natural gradient (QNG) and demonstrating its superiority over conventional QNG.
result Non-monotone QNG outperforms conventional QNG in terms of convergence speed.