LIT compresses deep networks by training intermediate representations, outperforming traditional methods.
problem Reducing the computational overhead of deep network inference.
method LIT trains a student model with the same width but shallower depth, using the intermediate representations from the teacher model.
result LIT achieves substantial network depth reductions without accuracy loss, outperforming traditional methods.
A framework to explain decoder-only sequence classification models using intermediate predictions.
problem Explaining predictions of decoder-only sequence classification models.
method Progressive Inference framework with Single Pass-Progressive Inference and Multi Pass-Progressive Inference methods.
result Significantly better attributions compared to prior work on text classification tasks.
This paper introduces a novel approach to measuring privacy risks in deep computer vision models based on intermediate outputs.
problem The exposure of intermediate results in hidden layers of deep computer vision models poses significant privacy concerns.
method The approach leverages Degrees of Freedom (DoF) to evaluate the amount of information retained in each layer and combines this with the rank of the Jacobian matrix to assess sensitivity to input variations.
result The proposed framework provides deeper insights into privacy risks associated with intermediate representations without requiring adversarial attack simulations.
Improved U-Nets with various intermediate blocks enhance singing voice separation.
problem Improving singing voice separation accuracy using U-Net architectures.
method Implemented and compared U-Nets with different intermediate spectrogram transformation blocks.
result A specific block type achieves state-of-the-art SDR by 0.9 dB.
This paper generalizes the envelope of mid-lines to intermediate lines for a plane curve.
problem Understanding the envelope of intermediate lines for a plane curve.
method Using singularity theory techniques to analyze the local behavior of the envelope of intermediate lines.
result The envelope of intermediate lines (EIL) is formed by three disconnected sets: AEIL, the curve itself, and IPTL. Polyhedral semantics for intermediate logics; Nerve Criterion ensures completeness.
problem Characterize polyhedrally-complete intermediate logics.
method Developed Nerve Criterion to characterize polyhedrally-complete logics combinatorially.
result Nerve Criterion provides a necessary and sufficient condition for polyhedrally-completeness.
A new approach for pricing FX options that uses a single model for all markets.
problem Consistent pricing of FX options across different markets.
method Intermediate currency approach, calibrating to domestic market volatility smile.
result Model automatically reproduces correct foreign market volatility smiles.
Study on rigidity with non-negative intermediate curvature on low-dimensional manifolds.
problem Extending non-existence theorem of positive scalar curvature to product manifolds.
method Introduced intermediate curvature and studied rigidity conditions.
result Rigidity when intermediate curvature is non-negative in low dimensions.
Preserves positive intermediate curvature on manifolds.
problem Obstructs positive intermediate curvature on partial tori.
method Shows smooth interpolation of metrics with positive intermediate curvature.
result Proves non-existence of certain manifolds with positive intermediate curvature.
Gradual domain adaptation improves model transfer between domains with intermediate training.
problem Challenges in unsupervised domain adaptation when distribution shifts are large.
method Gradual self-training using intermediate domains along the Wasserstein geodesic.
result GOAT framework generates intermediate domains for improved adaptation.
The study connects manifold topology to metrics with positive intermediate curvature.
problem Understanding the relationship between manifold topology and metrics with positive intermediate curvature.
method Formulated a conjecture and proved it for specific dimensions and conditions.
result Closed, aspherical 6-manifolds cannot admit metrics with positive 4-intermediate curvature.
New rigidity results for manifolds with maximal symmetry rank and positive intermediate Ricci curvature.
problem Understanding the structure of manifolds with maximal symmetry rank and positive intermediate Ricci curvature.
method Recovering stronger topological rigidity results using higher intermediate Ricci curvatures and nontrivial fundamental groups.
result Stronger topological rigidity results for manifolds with maximal symmetry rank and positive intermediate Ricci curvature.
Study on spaces of metrics with intermediate curvature bounds.
problem Understanding spaces of metrics with lower bounds on intermediate curvatures.
method Analyzing spaces of Riemannian metrics with specific curvature bounds on high-dimensional Spin-manifolds.
result Spaces of metrics with positive p-curvature and k-positive Ricci curvature have non-trivial homotopy groups.
Proves metrics with positive intermediate Ricci curvature on complex manifolds.
problem Establishing metrics with positive intermediate Ricci curvature on complex manifolds.
method Canonical variation and surgery techniques.
result Existence of metrics with positive intermediate Ricci curvature on various examples.
Enhances adversarial example transferability by fine-tuning existing examples.
problem Adversarial examples are often overfit to a source model, limiting black-box transferability.
method Intermediate Level Attack (ILA) fine-tunes adversarial examples on a pre-specified layer of the source model.
result ILAs achieve high transferability to target models without knowledge of their architecture.
Extends Perelman's theorem to positive intermediate curvature conditions.
problem Positive intermediate curvature conditions and their implications.
method Generalization of Perelman's gluing theorem to positive intermediate curvature conditions.
result Observer moduli space can have non-trivial higher homotopy groups.
The study proves that certain manifolds with boundary cannot have metrics with positive intermediate curvatures.
problem Proving the nonexistence of metrics with positive intermediate curvatures on manifolds with boundary.
method Curvature obstruction theorems for manifolds with boundary.
result Topologically nontrivial compact manifolds with boundary cannot have metrics of positive m-intermediate curvature if the boundary is m-convex. A new recommendation system model tackles unreliable user behavior.
problem Creating effective recommendation systems in the presence of unreliable user behavior.
method A novel modification of Multi-Armed Bandits with an unreliable intermediate.
result Proved fundamental theorems and developed an Explore-Commit algorithm close to optimal performance.
New models improve language generation by sharing intermediate states.
problem Language models struggle with past mistakes in sequence generation.
method Integrate second-order terms in hidden-state update, sharing intermediate states.
result Shared parametrization improves language modeling performance.
Study finds metrics with positive intermediate Ricci curvature on specific low-dimensional manifolds.
problem Existence of invariant metrics with positive intermediate Ricci curvature on low-dimensional cohomogeneity one manifolds.
method Construction of invariant metrics with positive intermediate Ricci curvature on specific manifolds.
result Invariant metrics with positive 4th-intermediate Ricci curvature exist but not for 3rd-intermediate Ricci curvature on certain manifolds.
Symmetry rank bound for manifolds with positive intermediate Ricci curvature.
problem Bounding the symmetry rank of manifolds with positive intermediate Ricci curvature.
method Local argument and effective isometric action on manifolds.
result Symmetry rank bound r≤⌊2n+kfloor for positive intermediate Ricci curvature. Sharp dimension constraints for positive intermediate curvature metrics are established.
problem Proving sharp dimension constraints for metrics with positive intermediate curvature.
method Constructing counterexamples and extending rigidity results.
result Sharp dimension constraints for positive intermediate curvature metrics are established.
The paper proves manifold splitting theorems with nonnegative intermediate curvature.
problem Proving rigidity results for manifolds with nonnegative intermediate curvatures.
method New recursion theorem for spectral intermediate curvatures and cylindrical splitting theorems.
result Smooth metrics with uniformly positive intermediate curvature constructed.
We consider a problem of optimal investment with intermediate consumption in the framework of an incomplete semimartingale model of a financial market. We show that a necessary and sufficient condition for the validity of key assertions of the theory is that the value functions of the primal and dual problems are finit…
Ensemble models struggle with detecting mild faults.
problem Difficulty in detecting Intermediate-Severity faults due to their resemblance to normal conditions.
method Extensive experiments with ensemble models to identify and address common pitfalls.
result Designing more effective ensemble models for IS fault detection and diagnosis.
We give a homological construction of aperiodic tiles for certain open Riemannian surfaces admitting actions of Grigorchuk groups of intermediate growth.
A cost-effective framework for gradual domain adaptation using multifidelity.
problem Degrading prediction performance due to large domain distance.
method Combines multifidelity and active domain adaptation.
result Improves prediction performance with reduced sample cost.
We consider the problem of optimal investment with intermediate consumption in a general semimartingale model of an incomplete market, with preferences being represented by a utility stochastic field. We show that the key conclusions of the utility maximization theory hold under the assumptions of no unbounded profit w…
Study shows Gromov's Betti number bound fails for certain intermediate Ricci curvatures.
problem Gromov's Betti number bound for sectional curvature bounded below does not hold for intermediate Ricci curvatures.
method Established a surgery result for Riemannian metrics with Rick>0 and showed failure of Gromov's bound for specific ranges of k. result Gromov's Betti number bound fails for Rick>0 when ⌊n/2floor+2≤k≤n−1. Study analyzes financial intermediation costs in decentralized lending protocols.
problem Understanding the cost of financial intermediation in decentralized lending protocols.
method Analysis of publicly available data on rates, supply, borrow activity, and accounts.
result Ex-post margins are 1% and lower for stablecoin markets.
Intermediate logic of all convex polyhedra is axiomatized.
problem Defining and axiomatizing intermediate logic for convex polyhedra.
method Using Jankov-Fine formulas, classical polyhedral geometry, and p-morphic images to establish completeness.
result A finite axiomatisation of PL for all convex polyhedra.
Study estimates heterogeneous principal causal effects with binary treatments and intermediate variables.
problem Estimating subgroup effects within strata defined by potential values of an intermediate variable.
method Proposes a framework for estimating and forming confidence intervals for heterogeneous principal causal effects under principal ignorability assumption. Develops several estimators with varying robustness properties.
result Established large-sample theory and analyzed bias contributions of each approach.
Log-Sobolev inequality proven for submanifolds in specific types of manifolds.
problem Proving Log-Sobolev inequality for submanifolds in asymptotic non-negative intermediate Ricci curvature manifolds.
method Extending previous results, proving inequality for submanifolds in specific types of manifolds.
result Sharp Log-Sobolev inequality proven for submanifolds in complete non-compact Riemannian manifolds with asymptotic non-negative intermediate Ricci curvature and Euclidean volume growth.
Transformers solve parity problems efficiently with step-by-step reasoning.
problem Training transformers to solve complex, recursive problems like parity.
method Training a one-layer transformer to solve k-parity, incorporating intermediate parities into the loss function, and using teacher forcing or augmented data. result Transformers can learn parity in one gradient update with intermediate supervision or self-consistency checks.
Optimizes transport on submanifolds for curvature inequalities.
problem Proving Michael-Simon-Sobolev inequalities in manifolds with intermediate Ricci curvature bounds.
method Generalizes optimal transport theory to submanifolds and applies to curvature inequalities.
result Proves a variant of the Michael-Simon-Sobolev inequality in manifolds with nonnegative intermediate Ricci curvatures.
AP-Calculus offers a new framework for causal inference in Bayesian networks.
problem Causal inference in Bayesian networks with complex architectures.
method Introduces Attribution Projection Calculus (AP-Calculus) to determine causal relationships.
result Proves that for each label, exactly one intermediate node acts as a deconfounder.
Extends metric properties over surgeries to higher codimensions.
problem Extending metrics of positive scalar curvature over surgeries in higher codimensions.
method Generalizes Gromov-Lawson, Schoen-Yau, and Walsh's construction to (p,n)-intermediate scalar curvature. result Shows infinitely many path components for certain metrics on (4n−1)-manifolds. Proves positive Euler characteristic for certain manifolds with positive second intermediate Ricci curvature.
problem Hopf's conjecture on positive sectional curvature and its failure under relaxed conditions.
method Non-trivial extension of the Four Periodicity Theorem to higher degrees.
result Proves positive Euler characteristic for specific manifolds with positive second intermediate Ricci curvature.
Study improves understanding of Ricci curvature in manifolds.
problem Understanding Ricci curvature in manifolds with specific assumptions.
method Exploring m-intermediate Ricci curvature and proving comparison theorems.
result Stable weighted slicing in manifolds with non-negative m-intermediate Ricci curvature has almost non-negative Ricci curvature.
Freezing intermediate layers reduces DNN inference latency.
problem High latency in deep learning inference due to computationally expensive models.
method Introduce approximate caching at each intermediate layer to avoid running all layers for many inference requests.
result Reduces the number of effective layers by half for 91.58% of CIFAR-10 requests.
Neural network models have a reputation for being black boxes. We propose to monitor the features at every layer of a model and measure how suitable they are for classification. We use linear classifiers, which we refer to as "probes", trained entirely independently of the model itself. This helps us better understand …
Study connects Chern class components to Kato surface germs.
problem Understanding intermediate Kato surfaces through Chern class components.
method Relates coefficients of Chern classes to birational germs.
result Established relations between Chern class components and Kato surface germs.
Study on Lane-Emden equation on curved spaces, revealing new existence and non-existence phenomena.
problem Existence and non-existence of positive solutions for the Lane-Emden equation on Riemannian models.
method Analysis of the subcritical Lane-Emden equation on various Riemannian manifolds with polynomial volume growth.
result Subcritical regime divides into three ranges with distinct existence and non-existence phenomena.
New method uses SoS densities and α-divergences for efficient sequential transport maps.
problem Efficiently generating samples from approximated densities.
method Sequential transport maps using Sum-of-Squares (SoS) densities and α-divergences.
result Convex optimization problems with efficient semidefinite programming solutions.
Study liquidity dynamics in dealer markets with quadratic costs.
problem Understanding price formation in dealer markets with liquidity costs.
method Solve for competitive equilibrium prices in a continuous-time model with quadratic inventory costs.
result Endogenous transient price impact due to gradual position transfer.
Study finds almost contact structures in thermal QCD-like theories at intermediate coupling.
problem Understanding (Almost) Contact Structures in thermal QCD-like theories.
method Explicitly obtained (Almost) Contact Structures and SU(3) structures.
result Subspaces of C3S and AC3S are not mutually 'N-path connected' in the Infra-Red.
Study manifolds with positive intermediate Ricci curvature and large symmetry rank.
problem Closed, simply connected manifolds with positive 2nd-intermediate Ricci curvature and large symmetry rank.
method New tools for studying isometric actions on closed manifolds with positive kth-intermediate Ricci curvature, including isotropy rank lemma, symmetry rank bound, and connectedness principle.
result Even dimensional manifolds with large symmetry rank must have trivial odd degree integral cohomology and are either spheres or complex projective spaces.
New model-independent compact representations of imaginary-time data are presented in terms of the intermediate representation (IR) of analytical continuation. This is motivated by a recent numerical finding by the authors [J. Otsuki et al., arXiv:1702.03056]. We demonstrate the efficiency of the IR through continuous-…