Improved neural networks by averaging late-stage weights.
problem Improving the performance of neural networks.
method Ensemble late-stage weights and average them.
result Augmenting standard models with late-phase weights improves generalization.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “LATE”
New method finds precise late-time behavior of wave equations.
problem Analyzing late-time behavior of wave equations with inverse-square potentials.
method Physical-space-based method for deriving late-time asymptotics.
result Sharp, uniform decay estimates in time for asymptotic late-time tails.
Study assesses drought and late-frost risks in Bavaria using vine copulas.
problem Assessing risks of late-frost and drought in Bavaria due to climate change.
method Used vine copula models for non-Gaussian and asymmetric dependencies, with univariate and bivariate regression analyses.
result Identified 'at-risk' regions for forest adaptation.
Second part of series studying charged scalar fields on Reissner--Nordström spacetimes.
problem Analyzing late-time behavior and stability of charged scalar fields on black hole backgrounds.
method Purely physical-space based methods, energy estimates, inverse-power laws.
result First pointwise decay estimates for charged scalar fields on black hole backgrounds.
New framework optimizes deep learning training by deferring large batch sizes to late stages.
problem Optimizing batch size scheduling for deep learning training efficiency.
method Introduced the functional scaling law (FSL) framework to analyze and optimize batch size scheduling.
result Large batch sizes can be deferred to late training stages without sacrificing performance.
LITE models improve query-document relevance with learnable late interactions.
problem Improving query-document relevance with lower latency and storage.
method Proposes learnable late-interaction models (LITE) that use factorized query and document embeddings followed by a learnable scorer.
result Empirically, LITE outperforms previous late-interaction models in re-ranking tasks.
SAM selects flatter minima late in training, improving generalization.
problem Improving neural network generalization under various settings.
method Sharpness-Aware Minimization (SAM) applied late in training.
result SAM efficiently selects flatter minima late in training, improving generalization.
A lot of attention has been devoted to multimedia indexing over the past few years. In the literature, we often consider two kinds of fusion schemes: The early fusion and the late fusion. In this paper we focus on late classifier fusion, where one combines the scores of each modality at the decision level. To tackle th…
Late fusion of clinical notes and physiological data improves ICU mortality prediction.
problem Improving ICU mortality prediction using multimodal data.
method Late fusion of clinical notes and physiological time series data with a deep learning architecture.
result Late fusion approach provides statistically significant improvement in mortality prediction performance.
Estimates LATE using combined datasets, overcoming data limitations.
problem Estimating LATE when compliance is incomplete and data is split.
method Combines separately observed datasets to estimate LATE using direct and weighted least squares methods.
result Proposes a stable and practical estimator for LATE.
In the past few years, a lot of attention has been devoted to multimedia indexing by fusing multimodal informations. Two kinds of fusion schemes are generally considered: The early fusion and the late fusion. We focus on late classifier fusion, where one combines the scores of each modality at the decision level. To ta…
Do Pension Benefits Accelerate Cognitive Decline in Late Adulthood? Evidence from Rural Chinaecon.GN
Pension benefits in rural China lead to cognitive decline among the elderly.
problem Cognitive decline in late adulthood among rural Chinese elderly.
method Examined the effects of a new pension scheme on cognitive performance.
result Pension benefits negatively impact cognitive functioning, particularly delayed recall.
Deep Convolutional Neural Networks (CNN) enforces supervised information only at the output layer, and hidden layers are trained by back propagating the prediction error from the output layer without explicit supervision. We propose a supervised feature learning approach, Label Consistent Neural Network, which enforces…
The late-stage training dynamics of (stochastic) subgradient descent on homogeneous neural networkscs.LG
SGD converges to critical points of normalized margin in late-stage training for homogeneous neural networks.
problem Analyzing the implicit bias of SGD on homogeneous neural networks.
method Interpreting SGD dynamics as an Euler-like discretization of a conservative field flow associated with the normalized classification margin.
result Normalized SGD iterates converge to the set of critical points of the normalized margin at late-stage training.
We prove the existence of a perimeter-minimizing partition of R^n into regions of unit volume. We conclude with a short tribute to the late Manuel A. Fortes.
Study fusion methods for financial image views to improve robustness against attacks.
problem Improving robustness of financial image views for next-day direction prediction.
method Same-source multi-view learning with early fusion and late fusion, using OHLCV and technical-indicator views, and evaluating pixel-space L-infinity attacks.
result Early fusion can suffer negative transfer under noisy settings, while late fusion is more reliable once labels stabilize.
Enhances the Bishop-Gromov theorem for curved spaces, especially at late times.
problem The Bishop-Gromov theorem's volume growth upperbound is often too loose, especially at late times.
method Identified and quantified the effect of shear, using higher curvature invariants to improve the upperbound.
result Tighter upper bounds on late-time growth rates of geodesic balls in homogeneous spaces with non-positive sectional curvature.
New method uses SBI to infer magnetorotational properties of isolated pulsars.
problem Constrain magnetorotational properties of isolated Galactic radio pulsars.
method Combines population synthesis with SBI to model neutron star birth and evolution.
result Inferred , for lognormal distributions.
Framework for multi-task learning with semiparametric models and nuisance parameters.
problem Improving parameter estimation from diverse, heterogeneous datasets.
method Late fusion multi-task learning framework with two-step process: individual task learning followed by adaptive aggregation.
result The method achieves faster convergence rates compared to individual task learning when tasks share similar parametric components.
One of the core tasks in multi-view learning is to capture relations among views. For sequential data, the relations not only span across views, but also extend throughout the view length to form long-term intra-view and inter-view interactions. In this paper, we present a new memory augmented neural network model that…
This is a review article for Encyclopedia of Complexity and System Science, to be published by Springer http://refworks.springer.com/complexity/. The paper reviews statistical models for money, wealth, and income distributions developed in the econophysics literature since late 1990s.
In this study, we investigated multi-modal approaches using images, descriptions, and titles to categorize e-commerce products on Amazon. Specifically, we examined late fusion models, where the modalities are fused at the decision level. Products were each assigned multiple labels, and the hierarchy in the labels were …
The Giroux correspondence and the notion of a near force-free magnetic field are used to topologically characterize near force-free magnetic fields which describe a variety of physical processes, including plasma equilibrium. As a byproduct, the topological characterization of force-free magnetic fields associated with…
We give examples of closed orientable graph 3-manifolds with fundamental group which is not a subgroup of GL(4,k) for any field k. This answers a question in the Kirby problem list from 1977 which is credited to the late William Thurston.
Human Activity Recognition (HAR) based on motion sensors has drawn a lot of attention over the last few years, since perceiving the human status enables context-aware applications to adapt their services on users' needs. However, motion sensor fusion and feature extraction have not reached their full potentials, remain…
Large learning rates improve neural network generalization, study shows.
problem Understanding why large learning rates lead to better neural network generalization.
method Visual analysis of training and testing loss landscapes, introduction of a nonlinear model.
result Extended phase with large learning rates leads to near-optimal generalization.
We prove that an isoparametric hypersurface with four principal curvatures and multiplicity pair is either the one constructed by Ozeki and Takeuchi, or one of the two constructed by Ferus, Karcher, and Münzner. This completes the classification of isoparametric hypersurfaces in spheres that É. Cartan initiated…
In this paper we seek methods to effectively detect urban micro-events. Urban micro-events are events which occur in cities, have limited geographical coverage and typically affect only a small group of citizens. Because of their scale these are difficult to identify in most data sources. However, by using citizen sens…
In recent years cryptocurrency trading has captured the attention of practitioners and academics. The volume of the exchange with standard currencies has known a dramatic increasing of late. This paper addresses to the need of models describing a bitcoin-US dollar exchange dynamic and their use to evaluate European opt…
Paper proves Penrose inequality with a weaker late-time condition.
problem Penrose's inequality under the black hole final state conjecture.
method Developed a new late-time condition called quasi final state hypothesis and proved the inequality.
result Proved the spacetime Penrose inequality under the quasi final state hypothesis.
The study examines the dynamic behavior of RMSprop and Adam algorithms.
problem Understanding the training loss curve patterns of adaptive gradient algorithms.
method Careful numerical experiments and theoretical explanations using the signGD flow.
result Adam converges smoother and faster when momentum factors are close to each other.
The Acoustic Camouflage Phenomenon: Re-evaluating Speech Features for Financial Risk Predictioncs.SD
Study shows integrating acoustic features in financial forecasting models can degrade performance.
problem Predicting stock market volatility from corporate earnings calls using speech features.
method Empirical investigation of acoustic feature extraction in teleconference environments using a two-stream late-fusion architecture.
result Integrating acoustic features via late fusion significantly degraded performance, reducing recall to 47.08%.
The purpose of this article is to give a proof of the Orbifold Theorem announced by Thurston in late 1981: If is a compact, connected, orientable, irreducible and topologically atoroidal 3-orbifold with non-empty ramification locus, then is geometric. As a corollary, any smooth orientation preserving non-free f…
This study benchmarks algorithms for automatic segmentation of LGE-MRI images of the left atrium.
problem Challenging segmentation of LGE-MRI images due to low contrast.
method Organized a large-scale benchmarking challenge with 154 3D LGE-MRIs and 27 teams.
result Top method achieved 93.2% dice score and 0.7 mm mean surface to surface distance.
Let (X,ω) be a compact Kähler manifold. As discovered in the late 1980s by Mabuchi, the set H_0 of Kähler forms cohomologous to ωhas the natural structure of an infinite dimensional Riemannian manifold. We address the question whether any two points in H_0 can be connected by a smooth geodesic, and show that the answer…
DMFAW improves multi-view clustering with adaptive weights and feature selection.
problem Lack of effective feature selection and empirical hyperparameter selection in existing deep matrix factorization methods.
method Introduces Deep Matrix Factorization with Adaptive Weights (DMFAW) for multi-view clustering, incorporating feature selection and dynamically updating weights using Control Theory.
result DMFAW outperforms state-of-the-art methods in clustering performance.
We briefly review statistical models for the probability distribution of money developed in the econophysics literature since the late 1990s. In these models, economic transactions are modeled as random transfers of money between the agents in payment for goods and services. We focus on conceptual foundations for this …
Hyperfitting improves LLM generation quality by enhancing diversity, contrary to simple temperature scaling.
problem Improving open-ended generation quality of LLMs with minimal fine-tuning effort.
method Demonstrates that hyperfitting, a phenomenon where LLMs are fine-tuned to near-zero training loss, enhances generation quality and mitigates repetition.
result Hyperfitting is distinct from temperature scaling and involves a dynamic, context-dependent rank reordering mechanism in the final transformer block.
Efficient dispatching rule in manufacturing industry is key to ensure product on-time delivery and minimum past-due and inventory cost. Manufacturing, especially in the developed world, is moving towards on-demand manufacturing meaning a high mix, low volume product mix. This requires efficient dispatching that can wor…
Much has been said lately about entrepreneurship, so it seems important to leave here some personal analysis on this topic. The issues outlined here result from a work in about a year in which because a personal and professional obligations it was doing some research on these issues. This is an interesting topic that h…
Sensor Fusion using Backward Shortcut Connections for Sleep Apnea Detection in Multi-Modal Datacs.LG
Sleep apnea is a common respiratory disorder characterized by breathing pauses during the night. Consequences of untreated sleep apnea can be severe. Still, many people remain undiagnosed due to shortages of hospital beds and trained sleep technicians. To assist in the diagnosis process, automated detection methods are…
Submanifolds of finite type were introduced by the author during the late 1970s. The first results on this subject had been collected in author's book [Total mean curvature and sub manifolds of finite type, World Scientific, NJ, 1984]. A list of ten open problems and three conjectures on submanifolds of finite type was…
In this paper, we studied the dynamics of the log-return distribution of the Korean Composition Stock Price Index (KOSPI) from 1992 to 2004. Based on the microscopic spin model, we found that while the index during the late 1990s showed a power-law distribution, the distribution in the early 2000s was exponential. This…
Paper classifies special slant surfaces with varying curvature.
problem Classifying surfaces with non-constant mean curvature.
method Analyzing special slant surfaces in complex space forms.
result Complete classification of surfaces with non-constant mean curvature.
IGSD separates task-specific content channels in transformer components by comparing activation replacement with zero ablation.
problem Mechanistic interpretability of transformer components
method IGSD: paired-intervention framework for comparing activation replacement with zero ablation
result IGSD identifies an early-layer content channel in transformer components that standard importance methods underestimate.
New tribrackets defined to count link homotopy invariants.
problem Counting invariants of link homotopy.
method Defined -tribrackets and showed their invariants.
result Counting invariants for certain tribrackets are trivial.
DRAGON improves learning for rare classes in unbalanced datasets using class descriptions.
problem Learning rare classes in unbalanced datasets with deep models.
method DRAGON is a late-fusion architecture that corrects bias towards frequent classes and fuses class-descriptions to improve tail-class accuracy.
result DRAGON outperforms state-of-the-art models on new benchmarks for long-tail learning with class descriptors.
ABS dynamically adjusts batch size based on policy stability, improving RL performance.
problem Diminishing returns with large batch sizes in RL due to non-stationary data.
method Adaptive Batch Scaling (ABS) with Behavioral Divergence metric.
result Larger batch sizes can improve RL performance, contrary to conventional wisdom.