Adaptive weights improve physics-informed neural networks and deep operator networks.
problem Training physics-informed neural networks and deep operator networks can be challenging, leading to unsatisfactory accuracy and efficiency.
method Proposes a pointwise adaptive weighting method that balances the residual decay rate across different training points.
result Our proposed approach of balanced residual decay rates offers advantages including bounded weights, high prediction accuracy, fast convergence rate, low training uncertainty, low computational cost, and ease of hyperparameter tuning.
Framework calculates positional influence in causal residual Transformers.
problem Understanding positional influence in causal residual Transformers.
method Adjoint-sensitivity framework for positional influence in causal residual Transformers.
result Exact evolution of adjoint-energy influence density and decomposition into residual transmission, nonlocal Volterra, and local channels.
AANets balance stability and plasticity in CIL.
problem Stability-plasticity dilemma in class-incremental learning.
method Adaptive Aggregation Networks (AANets) with stable and plastic residual blocks.
result AANets improve performance on CIL benchmarks.
Boosted GFlowNets improve exploration by sequentially training GFlowNets with residual rewards.
problem GFlowNets struggle to evenly explore reward landscapes, leading to poor coverage of high-reward areas.
method Sequential training of an ensemble of GFlowNets, each optimizing a residual reward.
result Boosted GFlowNets achieve better exploration and sample diversity on multimodal benchmarks and peptide design tasks.
To have a superior generalization, a deep learning neural network often involves a large size of training sample. With increase of hidden layers in order to increase learning ability, neural network has potential degradation in accuracy. Both could seriously limit applicability of deep learning in some domains particul…
In a flat space, the global topology of comoving space can induce a weak acceleration effect similar to dark energy. Does a similar effect occur in the case of the Poincare dodecahedral space S^3/I^*? Does the effect distinguish the Poincare space from other well-proportioned spaces? The residual acceleration effect in…
The paper analyzes how to combine self-protection and self-insurance for risk reduction.
problem Combining self-protection and self-insurance for risk reduction when market insurance is absent.
method The approach uses Value-at-Risk and Tail Value-at-Risk to evaluate residual risk and solves the problem using isoquant geometry based on marginal-balance curves.
result The analysis identifies the conditions under which self-protection and self-insurance behave as substitutes or complements.
The paper analyzes how open-end fund sales affect prices and returns.
problem How open-end fund sales impact prices and returns.
method Continuous-time market-clearing model to derive expected-return restrictions.
result Forced-sale pressure predicts actual fund selling and positive returns.
Automates debiasing for large language model evaluations through Fisher random walk.
problem Rigorous and scalable evaluation of large language models.
method Semiparametric efficient estimator using Fisher random walk for weighted residual balancing.
result Efficient estimation of contextual preference scores for large language models.
Mobile crowdsourcing has become easier thanks to the widespread of smartphones capable of seamlessly collecting and pushing the desired data to cloud services. However, the success of mobile crowdsourcing relies on balancing the supply and demand by first accurately forecasting spatially and temporally the supply-deman…
We present a new approach to the problems of evaluating and learning personalized decision policies from observational data of past contexts, decisions, and outcomes. Only the outcome of the enacted decision is available and the historical policy is unknown. These problems arise in personalized medicine using electroni…
SA-PEF improves federated learning efficiency by correcting gradient mismatches.
problem Slow decay of residual error in federated learning under non-IID data.
method Integrates step-ahead correction with partial error feedback.
result Achieves faster convergence and target accuracy compared to standard EF.
ImpFlows generalize normalizing flows by implicitly defining transformations.
problem Creating flexible and tractable probability distributions.
method Implicitly defined invertible transformations using roots of equations.
result ImpFlows can represent functions that ResFlows cannot, with comparable parameters.
In this paper we formulate a geometric theory of the mechanics of growing solids. Bulk growth is modeled by a material manifold with an evolving metric. Time dependence of metric represents the evolution of the stress-free (natural) configuration of the body in response to changes in mass density and "shape". We show t…
Synthetic augmentation helps but not always in imbalanced learning.
problem Imbalanced learning causes poor performance on rare classes.
method Developed a statistical framework for synthetic augmentation in imbalanced learning.
result Synthetic augmentation is not always beneficial and depends on the imbalance regime.
Convolutional neural networks (CNNs) are effective at solving difficult problems like visual recognition, speech recognition and natural language processing. However, performance gain comes at the cost of laborious trial-and-error in designing deeper CNN architectures. In this paper, a genetic programming (GP) framewor…
Background: Three-dimensional, whole heart, balanced steady state free precession (WH-bSSFP) sequences provide delineation of intra-cardiac and vascular anatomy. However, they have long acquisition times. Here, we propose significant speed ups using a deep learning single volume super resolution reconstruction, to reco…
Optimizes cryptocurrency portfolios using MNTS GARCH model.
problem Optimizing cryptocurrency portfolios with non-Gaussian return dynamics.
method Multivariate normal tempered stable (MNTS) GARCH model for non-Gaussian returns, Foster-Hart risk optimization.
result Foster-Hart optimization yields a more profitable portfolio with better risk-return balance.
Abstract: Non-residually finite hyperbolic groups imply non-residually finite rigid hyperbolic groups.
problem Existence of non-residually finite hyperbolic groups
method Direct implication
result Existence of non-residually finite rigid hyperbolic groups
We describe a new approach for managing aleatoric uncertainty in the Reinforcement Learning (RL) paradigm. Instead of selecting actions according to a single statistic, we propose a distributional method based on the second-order stochastic dominance (SSD) relation. This compares the inherent dispersion of random retur…
Residual finiteness is known to be an important property of groups appearing in combinatorial group theory and low dimensional topology. In a recent work [2] residual finiteness of quandles was introduced, and it was proved that free quandles and knot quandles are residually finite. In this paper, we extend these resul…
In this note, residual finiteness of quandles is defined and investigated. It is proved that free quandles and knot quandles of tame knots are residually finite and Hopfian. Residual finiteness of quandles arising from residually finite groups (conjugation, core and Alexander quandles) is established. Further, residual…
Every non-trivial knot group is fully residually perfect.
problem Understanding the residual properties of knot groups.
method Analyzing the residual properties of knot groups using group theory.
result Every non-trivial knot group is fully residually perfect.
AGCA approximates angular variation on the unit sphere, reducing extremal dependence problems to eigenanalysis.
problem Approximating angular variation in multivariate extremes.
method Anchored geodesic component analysis (AGCA) approximates angular variation by great subspheres constrained to pass through a chosen reference direction.
result AGCA finds concentrated tail directions in daily equity-portfolio losses, explaining about 91% of anchored variation.
Residual flows are shown to approximate MMD well.
problem Lack of theoretical understanding of normalizing flows' expressiveness.
method Proved residual flows are universal approximators in MMD.
result Residual flows can approximate MMD with a bounded number of blocks.
Let p be a prime. In this paper, we classify the geometric 3-manifolds whose fundamental groups are virtually residually p. Let M=M3 be a virtually fibered 3-manifold. It is well-known that G=π1(M) is residually solvable and even residually finite solvable. We prove that G is always virtually residually p…
Researchers identify critical protein residues using advanced graph theory.
problem Identifying essential residues in proteins for function.
method Learning Random Geometric Graphs (RGG) with Cramer's V correlation and organic thresholding.
result Advanced RGG methods accurately identify critical residues compared to existing techniques.
Defines Wodzicki residue using groupoids and fibered distributions.
problem Defining and understanding the Wodzicki residue in noncommutative geometry.
method Using groupoid language and filtered manifolds, defining the residue and showing its properties.
result The groupoidal residue is a trace on pseudodifferential operators and matches the usual residue in certain cases.
In this work we prove a Baum-Bott type residue theorem for flags of holomorphic foliations. We prove some relations between the residues of the flag and the residues of their correspondent foliations. We define the Nash residue for flags and we give a partial answer to the Baum-Bott type rationality conjecture in this …
We revisit residual algorithms in both model-free and model-based reinforcement learning settings. We propose the bidirectional target network technique to stabilize residual algorithms, yielding a residual version of DDPG that significantly outperforms vanilla DDPG in the DeepMind Control Suite benchmark. Moreover, we…
Wide residual networks generalize well with uniform convergence to RNTK as width increases.
problem Understanding the generalization ability of wide residual networks.
method Uniform convergence of residual network kernel to residual neural tangent kernel (RNTK).
result Generalization error converges to kernel regression error with respect to RNTK.
Heart disease is one of the most common diseases causing morbidity and mortality. Electrocardiogram (ECG) has been widely used for diagnosing heart diseases for its simplicity and non-invasive property. Automatic ECG analyzing technologies are expected to reduce human working load and increase diagnostic efficacy. Howe…
The paper studies residues of manifolds and their applications in geometry.
problem Understanding the residues of manifolds and their geometric implications.
method Analytic continuation and Möbius invariance of residues, introduction of relative and weighted residues.
result Scalar curvature, mean curvature, and Euler characteristic can be expressed in terms of residues.
Given a prime p, a group is called residually p if the intersection of its p-power index normal subgroups is trivial. A group is called virtually residually p if it has a finite index subgroup which is residually p. It is well-known that finitely generated linear groups over fields of characteristic zero are …
We show that Out(G) is residually finite if G is a one-ended group that is hyperbolic relative to virtually polycyclic subgroups. More generally, if G is one-ended and hyperbolic relative to proper residually finite subgroups, the group of outer automorphisms preserving the peripheral structure is residually finite. We…
Simplifies residual flows to make flow-based modeling more practical.
problem Extremely high computational cost of residual flows limits their applicability.
method Introduces Quasi-Autoregressive (QuAR) approach to residual flows.
result Significantly reduces compute time and memory requirements for flow-based modeling.
Study on endomorphism and automorphism groups of specific quandles.
problem Characterizing endomorphism and automorphism groups of residually finite and profinite quandles.
method Proved properties of endomorphism monoids and automorphism groups for residually finite and profinite quandles.
result Endomorphism and automorphism groups of residually finite quandles are residually finite.
Unified ODE model explains residual and non-residual networks.
problem Unclear relationship between residual and non-residual networks.
method Introducing a damping term in an ODE model to interpolate between ResNet and CNN architectures.
result Unified framework for understanding residual and non-residual networks.
Defines and proves generalized noncommutative residue theorems for specific dimensions.
problem Defining and proving residue theorems for noncommutative geometry.
method Defined generalized noncommutative residue of Dirac operator; proved Kastler-Kalau-Walze type theorems.
result Validated Kastler-Kalau-Walze type theorems for 4D and 6D compact manifolds.
Batch normalization makes deep residual networks train faster.
problem Training deep residual networks with large depths.
method Downscaling the residual branch by a normalizing factor early in training.
result Normalized residual blocks compute functions close to the identity function early in training.
Proves Singer conjecture for graph manifolds with residually finite groups.
problem Proving the Singer conjecture for graph manifolds with specific properties.
method Used residual finiteness and graph manifold properties to prove the conjecture.
result Proved the Singer conjecture for extended graph manifolds and pure complex-hyperbolic higher graph manifolds.
Study excess logarithmic residues for foliations to bound invariant hypersurfaces and test log canonicity.
problem Bounding invariant hypersurfaces and testing log canonicity of singularities.
method Introduce excess logarithmic residues, prove residue formula, derive Poincaré-type bound, and use them to recover log discrepancies.
result Componentwise logarithmic residues of a lifted foliation along the exceptional divisor recover log discrepancies of singularities.
Fair market valuations ignore future worker profits in employee-owned firms.
problem Ignoring future worker profits in fair market valuations for employee-owned firms.
method Analyzing property rights and residual claimants in employee-owned firms.
result Fair market valuations are inappropriate for employee-owned firms.
We conduct mathematical analysis on the effect of batch normalization (BN) on gradient backpropogation in residual network training, which is believed to play a critical role in addressing the gradient vanishing/explosion problem, in this work. By analyzing the mean and variance behavior of the input and the gradient i…
ResGCN detects anomalies in attributed networks by capturing sparsity and nonlinearity.
problem Detecting anomalous nodes in attributed networks.
method Attention-based deep residual modeling using Graph Convolutional Networks.
result ResGCN effectively detects anomalies in attributed networks.
Proposes a neural network method to correct residual distortions in coordinate transformations.
problem Nonlinear and spatially dependent distortions in coordinate transformation models.
method Residual-based neural network approach focusing on systematic distortions.
result The method improves accuracy and stability in challenging conditions.
New method selects neural network architectures without needing data.
problem Choosing efficient deep neural network architectures.
method Developed the deep frame potential to quantify network capacity.
result Deep frame potential correlates with generalization error.
In this paper we propose the use of continuous residual modules for graph kernels in Graph Neural Networks. We show how both discrete and continuous residual layers allow for more robust training, being that continuous residual layers are those which are applied by integrating through an Ordinary Differential Equation …