Sparse neural networks training is difficult due to optimization failures and energy landscape issues.
problem Training sparse neural networks leads to suboptimal solutions and optimization failures.
method Investigated optimization dynamics and energy landscape in sparse neural networks.
result Sparse neural networks have a linear path with a monotonically decreasing objective from initialization to a good solution, but not from a bad solution.
Research uses CPS to estimate uncertainty in ML radio metric models.
problem Estimating uncertainty in machine learning models for radio metrics and path loss.
method Conformal Prediction (CP) in Conformal Predictive Systems (CPS) with diverse difficulty estimators.
result CPS models maintain high coverage and reliability across different cities.
Computes transition probability between learning tasks, decomposing it into geometry and path difficulty.
problem Predicting success in transfer learning between different learning tasks.
method Decomposes transition probability into two factors: geometry of loss landscapes and path difficulty.
result Derives strict lower bounds on learning complexity, showing that geometry alone is insufficient.
In this paper we first show that the necessary condition introduced in our previous paper is also a sufficient condition for a path to be a geodesic in the group $\Ham^c(M)$ of compactly supported Hamiltonian symplectomorphisms. This applies with no restriction on M. We then discuss conditions which guarantee that su…
Efficient routing algorithms learn from feedback to minimize path lengths.
problem Optimizing online shortest path routing with end-to-end feedback.
method Adaptive exploration algorithms leveraging networked structure.
result Achieves nearly optimal instance-dependent and worst-case regret for directed acyclic networks.
Paper introduces a new gradient estimator for SNNs.
problem High variance in score function gradient estimator impedes SNNs training.
method Developed a differentiable point process to derive path-wise gradient estimator.
result Demonstrated effectiveness of path-wise gradient estimator through simulations.
New method optimizes share buyback contracts without optimal control's limitations.
problem High-dimensional state spaces and risk penalty selection issues in traditional methods.
method Applies optimized heuristic strategies and classical pricing methods.
result Maximizes contract value and disentangles repurchase from hedging.
Interstellar searches for recurrent architecture to enhance KG embedding.
problem Learning long-term information in KGs.
method Recurrent neural architecture search for relational paths.
result Effectiveness and efficiency of searched models.
Paper proves global optimality of a simple optimization scheme for learning DAG models.
problem Learning acyclic directed graphical models from data.
method Path-following optimization scheme for bivariate setting.
result Simple optimization scheme globally converges to global minimum.
Reasoning models generate differently based on problem difficulty, not just length.
problem Understanding how reasoning models handle different problem difficulties.
method Examined hidden-state trajectories across competitive programming, mathematics, and Boolean satisfiability.
result Corrected trajectory geometry shows difficulty-dependent differences in reasoning models, with stronger effects in the code domain.
A new graph kernel uses LCS and Wasserstein distance for better graph comparisons.
problem Graph learning methods can be limited by information from distant vertices and path length constraints.
method Proposes a Graph Kernel based on LCS similarity and Wasserstein distance in a novel metric space.
result The new kernel emphasizes comparisons between similar paths and reduces information loss.
The paper develops a deep signature approach for option pricing under non-Markovian stochastic volatility models.
problem Pricing options under non-Markovian stochastic volatility models is challenging due to the dependence on historical paths.
method Reformulate the asset dynamics as a rough stochastic differential equation and represent rough paths via signatures. Apply standard analytical tools to solve the transformed equation.
result The deep signature approach provides a theoretically grounded and computationally efficient framework for option pricing.
Fractional processes have gained popularity in financial modeling due to the dependence structure of their increments and the roughness of their sample paths. The non-Markovianity of these processes gives, however, rise to conceptual and practical difficulties in computation and calibration. To address these issues, we…
C-Learning estimates reachability over time to solve multi-goal tasks.
problem Multi-goal reaching challenges in reinforcement learning.
method Cumulative accessibility functions and recurrence relations.
result Optimal cumulative accessibility functions are monotonic in horizon.
Distance weighted discrimination (DWD) was originally proposed to handle the data piling issue in the support vector machine. In this paper, we consider the sparse penalized DWD for high-dimensional classification. The state-of-the-art algorithm for solving the standard DWD is based on second-order cone programming, ho…
This research formalizes inductive generalization and proposes a new learning paradigm called Inductive Learning.
problem Generalization from easy to hard tasks, especially out-of-domain generalization.
method Formalizes inductive generalization, introduces Inductive Learning, and outlines steps to adapt techniques for learning model successors.
result A new learning paradigm (Inductive Learning) that emphasizes induction and universal properties of learning and computation.
CR-AIS improves AIS efficiency by constant rate annealing.
problem Efficiently sample from intractable distributions.
method Constant rate annealing schedule for AIS.
result CR-AIS outperforms existing Adaptive AIS methods.
Proximal Mediation Analysis with Hidden Recanting Witnesses
problem Identifying path-specific effects in mediation analysis when recanting witnesses are unknown
method Proximal causal inference and semiparametric inference framework
result Developed three novel identification strategies and a semiparametric inference framework
The paper analyzes time-inconsistent strategies in financial markets with rough volatility.
problem Time-inconsistency in financial markets with rough volatility.
method Functional Itô calculus and game-theoretic framework to solve path-dependent Hamilton-Jacobi-Bellman equations.
result Explicit solutions to MVP problems under rough volatility, showing performance benefits.
DDAT framework improves machine learning by dynamically adjusting difficulty.
problem Improving time-continuous emotion prediction models.
method Dynamic Difficulty Awareness Training (DDAT) framework.
result DDAT framework outperforms existing methods in emotion prediction.
Predicts unseen links in graphs using motifs of 3-5 nodes.
problem Predicting new links in graphs for various applications.
method Uses motifs of 3-5 nodes for link prediction, optimizing feature construction and negative example sampling.
result Higher classification accuracy compared to prior methods.
Improves neural networks by adjusting labels to reduce overfitting to noisy data.
problem Reduces overfitting to mislabeled or non-representative samples in neural networks.
method Combines self-adaptive training with mixup to improve accuracy and robustness.
result Achieves state-of-the-art accuracy on image recognition datasets with label noise.
Deep networks prioritize easier examples over harder ones, leading to faster training.
problem Understanding how deep networks prioritize examples of varying difficulty.
method Investigated the effect of linear vs non-linear learning modes on example difficulty.
result Non-linear dynamics tend to sequentialize the learning of examples of increasing difficulty.
Owing to the rapid growth of touchscreen mobile terminals and pen-based interfaces, handwriting-based writer identification systems are attracting increasing attention for personal authentication, digital forensics, and other applications. However, most studies on writer identification have not been satisfying because …
Paper reconciles different Ricci flow approaches and proves weak solutions.
problem Proving weak solutions for Ricci flows with singularities.
method Introducing a novel hitting estimate for Brownian motion, compensating for lack of lower heat kernel bounds.
result Every noncollapsed limit of Ricci flows and singular Ricci flows are weak solutions.
This paper tackles graph translation challenges by predicting both node and edge attributes simultaneously.
problem Challenges in predicting both node and edge attributes in graph translation, especially in interactive, iterative, and asynchronous processes.
method Developed a novel framework integrating both node and edge translations seamlessly, using spectral graph regularization to maintain consistency.
result Demonstrated the effectiveness of the proposed method on both synthetic and real-world application data.
Paper proposes a method to predict EL difficulty using consensus-based labels.
problem Challenges in automatically identifying and resolving ambiguous entity mentions.
method Consensus-based method to generate difficulty labels, supervised classification with various features.
result EL difficulty can be accurately predicted with high accuracy.
Some statistical models are specified via a data generating process for which the likelihood function cannot be computed in closed form. Standard likelihood-based inference is then not feasible but the model parameters can be inferred by finding the values which yield simulated data that resemble the observed data. Thi…
New measure quantifies task difficulty for machine learning models.
problem Quantifying the inherent difficulty of machine learning tasks.
method Inductive bias complexity measure.
result Tasks requiring generalization over many dimensions are more difficult.
Graph neural network predicts natural paths in graphs.
problem Predicting natural paths in graphs.
method Graph Neural Network (Gretel) for path extrapolation.
result Gretel efficiently predicts and samples from future path distributions.
The paper develops methods to price and hedge options in path-dependent stock models.
problem Pricing and hedging options under complex stock models.
method Develops a path-dependent PDE for option pricing and differentiability of path-dependent SDE solutions.
result Provides formulas for option Greeks and differentiability of path-dependent SDE solutions.
Extend classical theory of affine processes to path-dependent setting
problem Path-dependent affine processes
method Introduce path-dependent coefficients and provide analytic formulas for their Fourier--Laplace transform
result Define path-dependent affine processes through their exponential-affine Fourier--Laplace transform and establish a characterization theorem
New ensemble models classify mouse movement trajectories to assess survey question difficulty.
problem Assessing survey question difficulty based on respondents' interaction data.
method Ensemble models combining semi-metric-based weak learners to classify multivariate functional data.
result Improved survey data quality through better identification of respondent difficulty.
New capacity measure for ReLU networks reduces generalization error.
problem Improper influence of path norm on ReLU network capacity.
method Basis-path Norm, optimization algorithms.
result Basis-path Norm better explains ReLU network generalization.
Simpler method derived for path geometries on surfaces, characterizing projective path geometries.
problem Characterizing projective path geometries on surfaces.
method Solving the equivalence problem of sub-Riemannian geometry of signature (1,1) on a contact 3-manifold.
result Characterization of projective path geometries in terms of their chains.
Sparse Attentive Backtracking selectively backpropagates long-term dependencies in recurrent networks.
problem Difficulty in learning long-term dependencies in BPTT due to computational impracticality and biased gradient estimates.
method Sparse Attentive Backtracking learns an attention mechanism over past hidden states and selectively backpropagates through high-weight paths.
result Model learns long-term dependencies with fewer backpropagation steps, addressing biased gradient issues.
NTP struggles to learn relationships without increased exploration.
problem NTP's performance in extracting true relationships among data is poor.
method Created synthetic logical datasets with injected relationships to test NTP's performance and identify algorithmic issues.
result Increasing exploration in NTP's algorithm improves its performance in recovering relationships.
Proposes a novel path generation and evaluation method for video games.
problem Generating and evaluating realistic navigation paths for video games.
method Combines nonparametric model-free transformations and copula models.
result Demonstrates precise and interpretable generation of diverse navigation paths.
Partial covariance factorizes in path diagrams, simplifying analysis.
problem Understanding partial covariance in complex diagrams.
method Factorization of partial covariance over nodes and edges.
result Simpson's paradox cannot occur in singly-connected diagrams.
Introduces q-paths for generalizing geometric annealing paths in machine learning.
problem Limited applicability of existing path methods in machine learning.
method Develops a family of paths derived from a generalized mean, including geometric and arithmetic mixtures.
result Empirical gains in Bayesian inference and generative model evaluation.
This paper improves tail dependence analysis by introducing a path-based approach.
problem The classical tail dependence coefficient fails to capture non-exchangeable features of tail dependence.
method The paper introduces a path-based maximal tail dependence approach to capture the most pronounced feature of dependence over all possible paths.
result The paper proves the existence and provides an explicit characterization of the path-based maximal TDC, improving analytical and computational tractability.
Predicts path failures in evolving networks using deep learning.
problem Predicting path failures in time-evolving graphs.
method LRGCN, SAPE
result LRGCN outperforms other methods in path failure prediction.
This paper considers possible price paths of a financial security in an idealized market. Its main result is that the variation index of typical price paths is at most 2, in this sense, typical price paths are not rougher than typical paths of Brownian motion. We do not make any stochastic assumptions and only assume t…
In the first quarter of 2006 Chicago Board Options Exchange (CBOE) introduced, as one of the listed products, options on its implied volatility index (VIX). This created the challenge of developing a pricing framework that can simultaneously handle European options, forward-starts, options on the realized variance and …
One-shot path planning for multiple agents using neural networks.
problem Efficiently generating optimal or near-optimal paths for multiple agents in robotics.
method Utilizes fully convolutional neural networks for one-shot multi-agent path planning.
result Demonstrates successful generation of optimal or near-optimal paths in over 85% of cases for multi-path planning.
Foundation for robust finance using rough path theory.
problem Mathematical models of financial markets under Knightian uncertainty.
method Introducing Property (RIE) for càdlàg paths, proving existence of rough integrals, verifying admissibility of trading strategies.
result Existence and stability of rough path integrals for non-gradient integrands.
GANs improve path planning for smart mobility applications.
problem Improving path planning for smart mobility applications.
method Generative Adversarial Networks (GANs) for path planning.
result Generated paths are correct and reliable with high accuracy and quality.
DiffQue estimates relative difficulty of questions in CQA services.
problem Estimating relative difficulty of questions in community Q&A services.
method Network-aided edge directionality prediction.
result DiffQue outperforms state-of-the-art methods by significant margins.