New results on inferring hidden states in trackable weak models.
problem Inferring hidden states in trackable weak models.
method Analyzing strongly-connected trackable weak models and reconstructing branch choices.
result The number of hypotheses in strongly-connected trackable models is bounded by a constant.
AOPU stabilizes NN training by approximating natural gradient, improving stability and convergence.
problem Stability and interpretability in online NN training for industrial soft sensors.
method AOPU truncates gradient backpropagation, optimizing trackable parameters, and approximating natural gradient.
result AOPU achieves stable convergence and superior performance on chemical process datasets.
New method learns from subgroup feedback in complex systems.
problem Optimizing complex systems with heterogeneous components.
method Decomposed Gaussian Process (GP) regression and optimization algorithm.
result Proved lower variance and improved accuracy in subgroup feedback.
RAVEN improves weak-to-strong generalization under distribution shifts.
problem Weak models fail to supervise strong models effectively under distribution shifts.
method RAVEN dynamically learns optimal combinations of weak models and strong model parameters.
result RAVEN outperforms existing methods by over 30% on out-of-distribution tasks.
New model shows weak teachers can help strong students learn even with imperfect labels.
problem Improving strong student's performance with weak teacher's imperfect pseudolabels.
method Stylized overparameterized spiked covariance model with Gaussian covariates, proving two phases of generalization.
result Provable successful and random guessing phases of strong student's generalization.
Subset selection improves weak supervision performance.
problem Optimizing the use of weakly-labeled data.
method Combining pretrained data representations with the cut statistic for subset selection.
result Subset selection improves weak supervision performance by up to 19%.
Combines foundation models with weak supervision to improve NLP and video tasks.
problem Leveraging weak supervision with foundation models without labeled data.
method Liger, a combination of foundation model embeddings and weak supervision techniques.
result Liger outperforms existing weak supervision methods by 14.1 points on benchmark NLP and video tasks.
Sharp bounds on weak convergence rate for rough volatility models.
problem Understanding the convergence rate in discretizing rough volatility models.
method Analyzing general and linear models to derive bounds.
result Sharper bound of \(H + 1/2\) for linear models.
The study explores the strengths and weaknesses of models that generalize from weak to strong supervision.
problem Understanding the limitations and capabilities of models that generalize from weak to strong supervision.
method Theoretical analysis and experimental validation in both classification and regression settings.
result Theoretical bounds reveal the importance of strong generalization and calibration of the weak model and a careful balance in the training process.
Random feature models can outperform a weak teacher with early stopping.
problem Generalization from a weak to a strong model in random feature networks.
method Random feature models, early stopping, proving weak-to-strong generalization.
result Random feature models can outperform a weak teacher with early stopping.
Study approximates weak error for specific stochastic models with rough and Gaussian mean-reverting volatility.
problem Approximating weak error for specific stochastic models with rough and Gaussian mean-reverting volatility.
method Used Euler type scheme with integrated kernels to study weak convergence rate.
result Obtained weak convergence rate of min(3α−1,1) for discretised rough Ornstein-Uhlenbeck process and stochastic rough volatility model. Generative models enhance weak supervision for better image classification.
problem Lack of labeled data in supervised learning.
method Fusion of generative adversarial networks and weak supervision.
result Model improves multiclass image classification performance.
Weak diffusion priors can still perform well in inverse problems.
problem Using mismatched or low-fidelity diffusion priors in inverse problems.
method Extensive experiments and theoretical analysis combining Bayesian-consistency theory and local-correlation analysis.
result Weak priors succeed when measurements are highly informative, and they fail in other regimes.
Faster weak supervision framework using triplet methods.
problem Computational inefficiency in weak supervision models.
method Closed-form solution for latent variable models, avoiding iterative methods.
result Orders of magnitude faster than previous approaches.
Formalizes weak and strong verification for LLMs, controlling errors without assumptions.
problem Balancing cost and reliability in reasoning with LLMs.
method Formalizes weak-strong verification policies, introduces metrics, develops online algorithm.
result Optimal policies admit a two-threshold structure, and calibration and sharpness govern value of weak verifiers.
New framework transfers latent knowledge from weak to strong models.
problem Aligning superhuman LLMs with human feedback.
method Transfer learning framework using refinement approach.
result Proves weak-to-strong generalization is possible.
New research shows label refinement and weak training have limitations for aligning LLMs.
problem Limitations of refinement methods for aligning large language models.
method Analyzed probabilistic assumptions and alternative approaches to label refinement and weak training.
result Label refinement and weak training suffer from irreducible error, leaving a performance gap.
New theory explains how strong models can learn from weak ones.
problem Learning from weak, incomplete, or incorrect labels.
method New bounds based on data distribution and student hypothesis class.
result Existing weak supervision theory fails to account for pseudolabel correction and coverage expansion.
A new method for weakly supervised learning that improves model accuracy.
problem Training machine learning models with precise labels is expensive; weak supervision provides a low-cost alternative.
method Data consistent weak supervision algorithm that searches over classifiers to find plausible labelings, considering features of the training data and estimating labels for low/no coverage data.
result Empirically, the method significantly outperforms state-of-the-art weak supervision methods on text and image classification tasks.
Paper analyzes weak-to-strong generalization in CNNs, identifying data-scarce and data-abundant regimes.
problem Weak-to-strong generalization in CNNs trained on weak models.
method Formal analysis of gradient descent dynamics in data-scarce and data-abundant regimes.
result Identifies two regimes and distinct mechanisms of generalization in each.
Study uses weak transport for non-convex costs in fixed-income markets.
problem Characterizing optimal caplet pricing in fixed-income markets.
method Introduced weak optimal transport for non-convex costs, reduced general costs to convex problems.
result Established robust super-replication results for fixed-income markets.
Proves weak convergence equals mean convergence in GGC.
problem Proving convergence in GGC distributions.
method Using generalized gamma convolution (GGC) and expected utility maximization.
result Weak convergence implies mean convergence in GGC.
New mechanism detects overlap density for weak-to-strong generalization.
problem Understanding what aspects of data enable weak-to-strong generalization.
method Data-centric mechanism and overlap detection algorithm.
result Overlap density is a key factor in weak-to-strong generalization.
Proposes indifference pricing to estimate weak information value.
problem Estimating the value of weak information in financial models.
method Tractable framework quantifying additional information, stability analysis.
result Sharp conditions for stability with counterexamples, including replicable claims.
Study improves weak error estimates for rough volatility models.
problem Efficient numerical schemes for non-Markovian stochastic processes with rough volatility.
method Analyzes weak rates for a class of stochastic processes with rough stochastic volatility.
result Weak rate is of order min{3H+0.5, 1} for a large class of test functions.
ASTRA uses unlabeled data and weak rules to train deep models effectively.
problem Learning with weak supervision rules is challenging due to their heuristic and noisy nature.
method ASTRA framework that considers contextualized representations and pseudo-labels for unlabeled data, and a rule attention network to aggregate labels.
result Significant improvements over state-of-the-art baselines on text classification benchmarks.
Characterizes toroidal and semi-toric compactifications as log minimal models and applies to weak K-moduli.
problem Characterizing and applying toroidal and semi-toric compactifications to weak K-moduli.
method Characterizes toroidal and semi-toric compactifications as log minimal models and applies to weak K-moduli.
result Different proof of a theorem of Alexeev-Engel on weak K-moduli compactifications.
W2S FT often outperforms weak teachers due to low intrinsic dimensionality.
problem Understanding why weak-to-strong finetuning outperforms weak models.
method Analyzing W2S in ridgeless regression setting, focusing on variance reduction.
result Weak teacher's variance is inherited by strong student in shared feature subspace, reduced in discrepancy subspace.
Active WeaSuL uses active learning to improve weak supervision for better model performance.
problem Limited labelled data in machine learning.
method Combines active learning with weak supervision to improve probabilistic labels.
result Active WeaSuL outperforms weak supervision and active learning with limited labelled data.
New method estimates model performance bounds without ground truth labels.
problem Evaluation of weakly supervised models without direct access to ground truth labels.
method Formulates model evaluation as a partial identification problem and uses Fréchet bounds for performance estimation.
result Derives accurate and computationally efficient bounds for key metrics like accuracy, precision, recall, and F1-score.
End-to-end approach for weak supervision improves downstream model performance.
problem Data-labeling bottleneck in machine learning applications.
method Directly learning the downstream model by maximizing its agreement with probabilistic labels generated from weak supervision sources.
result Improved performance over prior work in terms of downstream model performance and robustness.
Weak correlations explain linear dynamics in deep learning models.
problem Understanding the linear structure in gradient-based learning algorithms.
method Characterization of weak correlations between derivatives and parameters.
result Weak correlations are the underlying principle for linearization in deep learning models.
Weak supervision challenges black-box models, suggesting fusion of modeling cultures.
problem Challenges of strong supervision in achieving accurate predictions.
method Integrating data modeling into algorithmic modeling for weak supervision.
result Integration of data modeling culture improves model stability and accuracy.
Mitigates bias in weakly supervised datasets.
problem Bias in weakly supervised datasets.
method Proposes a counterfactual fairness-based technique to mitigate bias.
result Improves accuracy by up to 32% while reducing demographic parity gap by 82.5%.
We discuss general notions of metrics and of Finsler structures which we call weak metrics and weak Finsler structures. Any convex domain carries a canonical weak Finsler structure, which we call its tautological weak Finsler structure. We compute distances in the tautological weak Finsler structure of a domain and we …
The paper explores generalized Riemannian manifolds with weak metric structures.
problem Understanding weak metric structures on generalized Riemannian manifolds.
method Study of generalized metric connections, weak metric structures, and skew-symmetric torsion.
result Generalized Riemannian manifolds can be split into nearly Kähler manifolds.
Optimizes shapes on non-standard manifolds.
problem Optimization on non-standard infinite-dimensional manifolds.
method Develops gradient descent on weak Riemannian manifolds.
result Establishes foundational properties for optimization on various weak Riemannian manifolds.
Tensoring p-weak differentiable structures preserves their properties.
problem Tensorization of p-weak differentiable structures. method Proving the product of p-weak charts is a p-weak chart, and showing isometric embeddings. result Tensorization of p-weak differentiable structures is possible under certain conditions. New structures defined for studying contact foliations and their geometry.
problem Understanding dynamics of contact foliations and their applications.
method Define and study weak nearly S- and weak nearly C-structures.
result Characterize weak nearly S- and weak nearly C- submanifolds in weak nearly Kähler manifolds.
Study improves cryptocurrency price prediction using unlabeled text data.
problem Predicting cryptocurrency returns from unlabelled text data.
method Introduced weak learning approach to finetune BERT on unlabeled text data.
result Finetuning pretrained NLP models with weak labels enhances forecast accuracy.
Establishes a microstructural foundation for a rough log-normal volatility model.
problem Developing a robust model for financial volatility under microstructural effects.
method Introduced a sequence of order-driven financial market models with Poisson process arrivals and analyzed their convergence to a log-normal rough volatility model.
result Weak convergence of price-volatility process to a log-normal rough volatility model with established weak error rates.
The study examines conditions for weak nearly cosymplectic manifolds to split into products.
problem Understanding the curvature and topology of weak nearly cosymplectic manifolds.
method Analyzes the conditions for splitting and characterizes specific manifolds.
result Conditions for weak nearly cosymplectic manifolds to become Riemannian products are identified.
ProbKT uses probabilistic logical reasoning to train object detection models with weak supervision.
problem Training object detection models requires instance-level annotations, which are often unavailable.
method ProbKT, a framework based on probabilistic logical reasoning, uses arbitrary types of weak supervision.
result ProbKT leads to significant improvement and better generalization compared to existing baselines.
Defines weak geodesics on specific subsets of manifolds.
problem Characterizing geodesics on prox-regular subsets of Riemannian manifolds.
method Defining weak geodesics as continuous curves with weak regularities, and characterizing them as viscosity critical points of the energy functional.
result Characterizes weak geodesics on prox-regular subsets of Riemannian manifolds.
Log minimality proven for weak K-moduli compactifications of Calabi-Yau varieties.
problem Constructing weak K-moduli compactifications of Calabi-Yau varieties.
method Revisiting classical problem, proving log minimality of normalizations under conditions.
result Log minimality of weak K-moduli compactifications under certain conditions.
Study weak conjugacy in surface homeomorphisms.
problem Understanding weak conjugacy in homeomorphisms of surfaces.
method Exploring the group of homeomorphisms isotopic to the identity.
result New insights into weak conjugacy relations.
Introduces weak (p,k)-Dirac structures in geometric settings.
problem Defining and analyzing new geometric structures.
method Introducing and studying weak (p,k)-Dirac structures in TM⊕ΛpT∗M. result Weak (p,k)-Dirac structures contain more information than (p,k)-Lagrangian structures. Study weak f-K-contact manifolds, finding Einstein-type metrics and solitons.
problem Characterize and study geometric properties of weak f-K-contact manifolds. method Analyzing weak metric f-structures, using Killing vector fields, and Jacobi operators. result Einstein weak f-K-contact manifolds are Ricci flat.