Deep neural networks are vulnerable to adversarial attacks. The literature is rich with algorithms that can easily craft successful adversarial examples. In contrast, the performance of defense techniques still lags behind. This paper proposes ME-Net, a defense method that leverages matrix estimation (ME). In ME-Net, i…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “MES”
Study creates web interface to elicit user-preferred metrics.
problem Eliciting classification metrics that align with user preferences.
method Developed a web-based interface and conducted a user study.
result Users preferred metrics that align with their task and context.
In this paper the notion of Measure Equivalence (ME) of countable groups is studied. ME was introduced by Gromov as a measure-theoretic analog of quasi-isometries. All lattices in the same locally compact group are Measure Equivalent; this is one of the motivations for this notion. The main result of this paper is ME r…
New method forecasts systemic risk with improved precision.
problem Improving the estimation of systemic risk measures.
method De-volatilizing observations and using extreme value theory for forecasting.
result Valid MES forecasts with good coverage in simulations and empirical applications.
A new acquisition function RMES improves Bayesian optimization performance.
problem Improper evaluation of mutual information in MES leads to suboptimal performance.
method Developed rectified MES (RMES) and used stochastic gradient ascent with reparameterization.
result RMES shows consistent improvement over MES in benchmarks and real-world problems.
Entropy Search (ES) and Predictive Entropy Search (PES) are popular and empirically successful Bayesian Optimization techniques. Both rely on a compelling information-theoretic motivation, and maximize the information gained about the of the unknown function; yet, both are plagued by the expensive computatio…
The paper calculates MES bounds for systemic risk contributions under uncertain dependence.
problem Measuring systemic risk contributions of financial firms under uncertainty in dependence structure.
method Derives worst-case and best-case bounds for MES under known individual firm risks and partial dependence information.
result Improved MES bounds derived for various types of dependence models.
In a standard setting of Bayesian optimization (BO), the objective function evaluation is assumed to be highly expensive. Multi-fidelity Bayesian optimization (MFBO) accelerates BO by incorporating lower fidelity observations available with a lower sampling cost. In this paper, we focus on the information-based approac…
Multi-instance data, in which each object (bag) contains a collection of instances, are widespread in machine learning, computer vision, bioinformatics, signal processing, and social sciences. We present a maximum entropy (ME) framework for learning from multi-instance data. In this approach each bag is represented as …
MES-LSTM hybrid method improves multivariate time series forecasting and mortality modeling.
problem Challenges in applying hybrid forecast methods to multivariate data.
method Generalized multivariate extension of ES-RNN, utilizing vectorized implementation.
result MES-LSTM shows significant improvement over pure statistical and deep learning methods in forecast accuracy and prediction interval construction.
Matrix estimation improves individual fairness without sacrificing performance.
problem Ensuring fairness in algorithmic decision-making.
method Using singular value thresholding (SVT) to preprocess data.
result SVT pre-processing improves IF guarantees and maintains performance.
Unified framework for active learning problems using information theory.
problem Combining level set estimation and Bayesian optimization.
method Information-theoretic criterion and acquisition function.
result Unified framework achieves state-of-the-art performance.
New functional ME models for predicting heterogeneous functional data.
problem Statistical analysis of heterogeneous functional data for prediction.
method Functional Mixtures-of-Experts (FME) models with Lasso-like regularization for sparsity.
result Accurate capture of complex nonlinear relationships and clustering of heterogeneous regression data.
Proposes DR-ME test for interpretable distributional treatment effects.
problem Detects invisible differences in treatment effects on distributional outcomes.
method Semiparametrically efficient finite-location test using kernel witnesses and orthogonal features.
result DR-ME reveals causal-discrepancy coordinates and has noncentral chi-square local power.
We focus on the challenge of finding a diverse collection of quality solutions on complex continuous domains. While quality diver-sity (QD) algorithms like Novelty Search with Local Competition (NSLC) and MAP-Elites are designed to generate a diverse range of solutions, these algorithms require a large number of evalua…
We present a novel approach for parallel computation in the context of machine learning that we call "Tell Me Something New" (TMSN). This approach involves a set of independent workers that use broadcast to update each other when they observe "something new". TMSN does not require synchronization or a head node and is …
Risk contagion concerns any entity dealing with large scale risks. Suppose (X,Y) denotes a risk vector pertaining to two components in some system. A relevant measurement of risk contagion would be to quantify the amount of influence of high values of Y on X. This can be measured in a variety of ways. In this paper, we…
This work extends ME-RL using diffusion models to sample optimal policies.
problem Sampling from the optimal policy trajectory distribution in ME-RL.
method Introducing Diffusion-Augmented Markov Decision Processes (DA-MDPs) to minimize reverse KL divergence.
result DA-MDPs enable seamless integration into various ME-RL methods and outperform baselines.
A standard form of master equations for general non-Markovian jump processes: the Laplace-space embedding framework and asymptotic solutioncond-mat.stat-mech
Unified analytical tool for non-Markovian jump processes.
problem Analyzing history-dependent jump processes with non-Markovian behavior.
method Developed a standard form of master equations using Laplace-space embedding and asymptotic solution.
result Unified analytical toolset for general non-Markovian processes, leading to the GLE approximation.
Develops a functional mix-of-experts model for multiclass classification.
problem Multiclass classification with univariate functional predictors.
method Functional mix-of-experts model with regularization and sparsity constraints.
result Regularized maximum likelihood estimation yields interpretable coefficient functions.
Unified proof for scalable personalized federated learning.
problem Personalized federated learning under asynchronous updates.
method Unified proof for asynchronous federated learning with bounded staleness applied to MAML and ME personalization frameworks.
result Unified proof for convergence to first-order stationary point for smooth and non-convex functions.
This paper assesses tail risk and systemic risk in cryptocurrencies using expectiles and MES.
problem Quantifying tail risk and systemic risk in cryptocurrencies.
method The study uses expectiles and Marginal Expected Shortfall (MES) to assess tail risk and systemic risk of cryptocurrencies.
result The expectile-based approach and MES provide a dynamic method to evaluate the impact of single assets on systemic risk.
A new algorithm reduces memory and computational needs for reinforcement learning.
problem Memory and computational inefficiency in model-free reinforcement learning.
method Memory-Efficient Nash Q-Learning (ME-Nash-QL) for two-player zero-sum games.
result Proves ME-Nash-QL reduces space and sample complexity for tabular and long-horizon cases.
Here I give a description of Alexandrov 4-point comparison via quadratic forms and then propose a natural 5-point condition which might have some future. Consider this note as a letter from me --- do not take it seriously.
VES-Gamma adapts EI using information-theoretic principles.
problem Optimizing black-box functions using Bayesian optimization.
method Variational Entropy Search (VES) and VES-Gamma algorithm.
result VES-Gamma improves EI by incorporating information-theoretic concepts.
With the usual definition of a super Hilbert space and a super unitary representation, it is easy to show that there are lots of super Lie groups for which the left-regular representation is not super unitary. I will argue that weakening the definition of a super Hilbert space (by allowing the super scalar product to b…
This paper introduces a new systemic risk measure, JMES, and its associated contribution measures.
problem Measuring systemic risk and its contributions among entities.
method Proposes JMES and associated contribution measures, studies their properties, and compares them with existing measures.
result Established sufficient conditions for comparing JMES and other measures under different copula structures and stress levels.
The main theorem of the paper shows that a smooth manifold which is homeomorphic to S^2xS^2 and has nonvanishing Ozsvath-Szabo invariant does not admit a perfect Morse function. I am withdrawing the paper because it is unclear to me if such a manifold exists.
Open geometry puzzles keep the author engaged.
problem Open problems in geometry that challenge the author.
method Collection of open problems based on puzzle-charm.
result No spare hands in solving the problems.
Let be a compact irreducible hyperkahler manifold, from Bogomolov inequality [V1] we obtain forbidden values of the second Betti number in arbitrary dimension. UPD: Unfortunately, decomposition of dual to BBF-form is not right in the main theorem. Instead of this work, take a look on recent preprints of Sawon…
Unified framework connects EI and information-theoretic acquisition functions.
problem Distinguish between Expected Improvement and information-theoretic acquisition functions.
method Introduces Variational Entropy Search (VES) to unify EI and information-theoretic approaches.
result EI can be seen as a variational inference approximation of Max-value Entropy Search (MES).
We show that Jacobi's bound for the order of a system of ordinary differential equations stands in the case of a diffiety defined by a quasi-regular system. We extend the result when there are less equations than variables and characterize the case when the bound is reached.
In mixtures-of-experts (ME) model, where a number of submodels (experts) are combined, there have been two longstanding problems: (i) how many experts should be chosen, given the size of the training data? (ii) given the total number of parameters, is it better to use a few very complex experts, or is it better to comb…
We prove that every homomorphism from the elementary Chevalley group over a finitely generated unital commutative ring associated with reduced irreducible classical root system of rank at least 2, and ME analogues of such groups, into acylindrically hyperbolic groups has an absolutely elliptic image. This result provid…
Mixed effects (ME) models inform a vast array of problems in the physical and social sciences, and are pervasive in meta-analysis. We consider ME models where the random effects component is linear. We then develop an efficient approach for a broad problem class that allows nonlinear measurements, priors, and constrain…
New metrics defined on SPD matrices link to divergences and curvature.
problem Defining and characterizing metrics on SPD matrices.
method Developed a principle of deformed metrics and introduced balanced bilinear forms.
result Introduce Mixed-Euclidean metrics with negative sectional curvature.
Some group theory problemsmath.GR
This is a survey of some problems in geometric group theory which I find interesting. The problems are from different areas of group theory. Each section is devoted to problems in one area. It contains an introduction where I give some necessary definitions and motivations, problems and some discussions of them. For ea…
Curvature and Computationmath.GR
When undergraduates ask me what geometric group theorists study, I describe a theorem due to Gromov which relates the groups with an intrinsic geometry like that of the hyperbolic plane to those in which certain computations can be efficiently carried out. In short, I describe the close but surprising connection betwee…
When I first encountered PAC-Bayesian concentration inequalities they seemed to me to be rather disconnected from good old-fashioned results like Hoeffding's and Bernstein's inequalities. But, at least for one flavour of the PAC-Bayesian bounds, there is actually a very close relation, and the main innovation is a cont…
This paper reformulates systemic risk measures and finds new properties and estimators.
problem Understanding and measuring systemic risk in financial networks.
method Representation of systemic risk measures in terms of univariate risk measures and quantiles determined by copulas. Empirical properties and estimators derived.
result MES is not suitable for measuring extreme risks. ES-based measures are more sensitive to power-law tails and large losses.
The paper examines higher moments in insurance, focusing on coskewness and its impact on actuarial quantities.
problem The impact of higher-order moments on actuarial applications, particularly expected shortfall and life annuity valuation.
method Derives analytical bounds for mixed moments under unspecified dependence structure, applies copula-based mixture model.
result Coskewness and odd-order mixed moments exhibit a monotonic relationship with expected shortfall and annuity premiums.
Paper reveals a surprising connection between curl and Dirac operators on 3-manifolds.
problem Understanding the spectrum and properties of the curl operator on 3-manifolds.
method Relating the curl operator to the Dirac operator on spin structures and proving ellipticity.
result Eigenvalues of curl are always lower bounded by those of the Dirac operator, with equality on the round 3-sphere.
Homogeneous Special Geometrymath.DG
Motivated by the physical concept of special geometry two mathematical constructions are studied, which relate real hypersurfaces to tube domains and complex Lagrangean cones respectively. Me\-thods are developed for the classification of homogeneous Riemannian hypersurfaces and for the classification of linear transit…
Study tackles causal structure learning in linear models with unobserved variables and measurement error.
problem Challenges of unobserved common causes and measurement error in causal structure learning.
method Introduces LV-SEM-ME model with four types of variables and characterizes identifiability under separability condition.
result Establishes form of identification robustness for target effect in broader LV-SEM-ME model.
The divergence theorem in its usual form applies only to suitably smooth vector fields. For vector fields which are merely piecewise smooth, as is natural at a boundary between regions with different physical properties, one must patch together the divergence theorem applied separately in each region. We give an elegan…
We propose a general model explanation system (MES) for "explaining" the output of black box classifiers. This paper describes extensions to Turner (2015), which is referred to frequently in the text. We use the motivating example of a classifier trained to detect fraud in a credit card transaction history. The key asp…
This survey of some of the more topological aspects of the placement problem for complex curves in complex surfaces was originally published in L'Enseignement Mathematique 29 (1983). The present LaTeXed redaction corrects several typographical errors without, I hope, introducing new ones; some minor emendations and ref…
New approaches estimate recommendation metrics using sampling.
problem Understanding and resolving the use of sampling for recommendation evaluation.
method MLE and ME principles for empirical rank distribution recovery.
result Advantages of new approaches for top-k metrics estimation.