Algorithm solves robust linear regression with block Lewis weights.
problem Group distributionally robust least squares problem.
method Algorithm based on geometric construction and block Lewis weights, using accelerated proximal methods.
result Improves over known methods for moderate accuracy regimes and matches state-of-the-art guarantees.
The paper proposes a method to solve L1 regression with fewer labels using Lewis weights.
problem Finding an approximate solution to L1 regression with limited labels.
method Sampling rows of the data matrix X according to its Lewis weights and using the empirical minimizer. result The method succeeds with high probability and has an optimal error bound.
Designs efficient algorithms for online and sliding window models of subspace embeddings for all p.
problem Design efficient algorithms for online and sliding window models of subspace embeddings for all p.
method Develops nearly optimal ℓp subspace embeddings for all p∈(0,∞) in the online coreset and sliding window models. result First nearly optimal ℓp subspace embeddings for all p∈(0,∞) in the online coreset and sliding window models. Defines Lewy curves in para-CR geometry and characterizes their path geometries.
problem Characterizing path geometries defined by para-CR Lewy curves.
method Definition and characterization of para-CR Lewy curves in various dimensions.
result Lewy curves determine the para-CR structure up to sign in flat cases.
RHMC improves sampling polytopes defined by inequalities with barriers.
problem Sampling polytopes defined by inequalities efficiently.
method Riemannian Hamiltonian Monte Carlo (RHMC) with a hybrid of Lewis weights and logarithmic barriers.
result RHMC achieves mixing rate of ildeO(m1/3n4/3) for polytopes defined by m inequalities in Rn. The study compares DLS method with machine learning for cricket match result prediction.
problem Improving accuracy of Duckworth-Lewis-Stern method for cricket match result prediction.
method Comparison of Duckworth-Lewis-Stern method with various supervised learning algorithms and optimization of DLS resource table.
result Development of Unpredictability Index to rank nations based on unpredictability in ODI matches.
Improved subsampling bounds for ℓp sensitivity sampling using ℓ2 augmentation.
problem Efficiently approximating large data sets by small representative proxies.
method Optimized sampling based on ℓp and ℓ2 sensitivities. result Optimal linear ildeO(ε−2(S+d)) sampling complexity for all p∈[1,2]. LEWIS merges LLMs without training, improving performance on specific tasks.
problem Limited performance improvement of merged models on specific benchmarks.
method Guided model merging using layer-wise sparsity and task-vector pruning.
result Improved model performance by up to 11.3% on math-solving tasks.
We generalize the stochastic block model to the important case in which edges are annotated with weights drawn from an exponential family distribution. This generalization introduces several technical difficulties for model estimation, which we solve using a Bayesian approach. We introduce a variational algorithm that …
A neural network and evolutionary algorithm framework designs nonlinear optical molecules.
problem Designing efficient nonlinear optical materials.
method Multi-stage Bayesian neural network (msBNN) and corrected Lewis-mode group contribution method (cLGC) combined with evolutionary algorithm (EA).
result Accurately and efficiently designs molecules with different optical properties using a small data set.
New method for optimization on Hadamard manifolds with curvature-independent guarantees.
problem Curvature-dependent complexity in geodesic convex optimization.
method Introducing horospherical convexity and developing algorithms for optimization.
result Curvature-independent convergence of subgradient descent and Nesterov's method.
New method improves sampling from logconcave distributions truncated on polytopes.
problem Sampling from logconcave distributions with polytope constraints.
method Regularized Dikin walks, using Lewis weights.
result Improved mixing time guarantees for various distributions and polytopes.
Community detection is an important task in network analysis, in which we aim to learn a network partition that groups together vertices with similar community-level connectivity patterns. By finding such groups of vertices with similar structural roles, we extract a compact representation of the network's large-scale …
This paper examines MEV attacks in dynamic AMMs and proposes new protections.
problem Dynamic AMMs introduce new MEV attack vectors due to inter-block weight changes.
method Analyzed inter-block weight changes as analogous to trades, conducted simulations.
result New inter-block protections are required to guard against multi-block MEV attacks.
Novel model detects communities in noisy multilayer networks.
problem Understanding communities in noisy multilayer networks.
method Hierarchical variational inference for joint detection and typologizing.
result Discover communities of subjects with co-occurrent psychopathologies.
New model for detecting communities in weighted bipartite networks.
problem Lack of models for weighted bipartite networks.
method Introducing Bipartite Distribution-Free model and its extension.
result Spectral algorithms for consistent estimation of node labels.
Proves conjecture linking WRT invariants and homological blocks for plumbed 3-manifolds.
problem Proving a conjecture about Witten-Reshetikhin-Turaev invariants and homological blocks for plumbed 3-manifolds.
method Developed a new technique for asymptotic expansions to compare WRT invariants and homological blocks, proving vanishing of weighted Gauss sums.
result Proved conjecture stating WRT invariants are radial limits of homological blocks.
This paper proposes a discrimination technique for vertices in a weighted network. We assume that the edge weights and adjacencies in the network are conditionally independent and that both sources of information encode class membership information. In particular, we introduce a edge weight distribution matrix to the s…
Method selects number of communities in weighted networks.
problem Selecting the number of communities in weighted networks.
method Proposes a novel weighted DCSBM and uses a sequential testing framework with spectral clustering and matrix scaling.
result Method is consistent in estimating the true number of communities under mild conditions.
We present a Bayesian formulation of weighted stochastic block models that can be used to infer the large-scale modular structure of weighted networks, including their hierarchical organization. Our method is nonparametric, and thus does not require the prior knowledge of the number of groups or other dimensions of the…
In continuing the study of harmonic mapping from 2-dimensional Riemannian simplicial complexes in order to construct minimal surfaces with singularity, we obtain an a-priori regularity result concerning the real analyticity of the free boundary curve. The free boundary is the singular set along which three disk-type mi…
Recurrent Neural Networks (RNNs) are used in state-of-the-art models in domains such as speech recognition, machine translation, and language modelling. Sparsity is a technique to reduce compute and memory requirements of deep learning models. Sparse RNNs are easier to deploy on devices and high-end server processors. …
Proposes a new model for clustering multiplex networks with compositional data.
problem Clustering multiplex networks with multiple types of relations and compositional data.
method Multiplex Dirichlet stochastic block model for compositional networks.
result Validated through simulation and applied to international export data.
We investigate local configuration controllability for mechanical control systems within the affine connection formalism. Extending the work by Lewis for the single-input case, we are able to characterize local configuration controllability for systems with n degrees of freedom and n−1 input forces.
We study the misclassification error for community detection in general heterogeneous stochastic block models (SBM) with noisy or partial label information. We establish a connection between the misclassification rate and the notion of minimum energy on the local neighborhood of the SBM. We develop an optimally weighte…
A new SBM for non-negative zero-inflated edge weights in networks.
problem Modeling international trading networks with non-negative zero-inflated edge weights.
method Restricted Tweedie distribution and nodal information accounting.
result Efficient two-step algorithm for estimating covariate effects.
A free action of the direct product of two copies of the symmetric group on 3 elements on the cartesian product of two copies of the 3-sphere is constructed. This nonlinear action is constructed using surgery. The action provides a counterexample to a conjecture of Lewis made in 1968.
New model detects communities in networks with signed, continuous weights.
problem Detect communities in networks with signed, continuous weights.
method Heterogeneous Block Covariance Model (HBCM) with variational EM algorithm.
result Provable consistent estimates of group memberships.
We prove an existence theorem for Spin(7)-instantons, which are highly concentrated near a Cayley submanifold; thus giving a partial converse to Tian's foundational compactness theorem. As an application, we show how to construct Spin(7)-instantons on Spin(7)-manifolds with suitable local K3 Cayley fibrations. This rec…
Starting from the candidate Bloch-Beilinson filtration on Chow groups of 0-cycles constructed by J. Lewis, we develop and describe geometrically a series of Hodge-theoretic invariants defined on the graded pieces. Explicit formulas (in terms of currents and membrane integrals) are given for certain quotients of the inv…
New algorithm detects communities in weighted networks, improving on binary ones.
problem Few methods exist for detecting communities in weighted networks.
method Pseudo-likelihood approach for weighted stochastic block model.
result The method is consistent and works well for both homogeneous and heterogeneous networks.
This paper proves a conjecture linking quantum modular forms and WRT invariants for specific graphs.
problem Proving a conjecture about quantum modular forms and WRT invariants for unimodular H-graphs.
method Constructed finite sums of rational functions, studied weighted Gauss sums, and combined results to prove the conjecture.
result WRT invariants of H-graphs yield quantum modular forms of depth two and weight one.
New ODE-Block handles stateful layers with continuous-in-depth functions using basis functions.
problem Handling stateful layers in ODE-Nets.
method Formulate ODE-Block using continuous-in-depth functions with basis function expansions.
result Enables state-of-the-art performance and reduces memory footprint.
This paper introduces GLT for better input data representation in BNN and proposes a compact topology with block pruning.
problem Improving input data representation for Binary Neural Networks (BNN).
method Generic Learned Thermometer (GLT) for encoding, block pruning and Knowledge Distillation for compact topology.
result Significant accuracy gains and lightweight fully-binarized models with limited accuracy degradation.
New method detects communities in complex hypergraphs, matching theoretical limits.
problem Detecting communities in non-uniform hypergraphs with varying hyperedge sizes.
method Developed a spectral theory for weighted non-backtracking operators on non-uniform hypergraphs.
result Achieved the Kesten-Stigum bound for weak recovery in a general class of non-uniform HSBMs.
The CGMY model's ATM call-price asymptotics are derived using characteristic function.
problem Deriving short-time asymptotics for the CGMY model's ATM call prices.
method Using the characteristic function, derived short-time asymptotics for the CGMY model's ATM call prices. Extracted higher-order coefficients by dynamic cutoff partitioning.
result Higher-order coefficients are derived for the CGMY model's ATM call prices.
Softmax is found ineffective for NL block, leading to improved performance.
problem Inefficiency of softmax in NL block for global context modeling.
method Empirical analysis and replacement of softmax with scaling factor.
result Improved performance on various datasets with reduced computational cost.
The current leading computer vision models are typically feed forward neural models, in which the output of one computational block is passed to the next one sequentially. This is in sharp contrast to the organization of the primate visual cortex, in which feedback and lateral connections are abundant. In this work, we…
Dynamic sparseness reduces neural network computation by selectively omitting parts of computations.
problem Reducing the computational and memory footprint of neural networks.
method Combining dynamic sparseness with block-wise matrix-vector multiplications to selectively omit parts of computations.
result The proposed method outperforms static sparseness and achieves similar perplexities at half the computational cost.
We give a fast oblivious L2-embedding of A∈Rnxd to B∈Rrxd satisfying (1−ε)∥Ax∥22≤∥Bx∥22<=(1+ε)∥Ax∥22. Our embedding dimension r equals d, a constant independent of the distortion ε. We use as a black-box any L2-embedding $Π…
AANets balance stability and plasticity in CIL.
problem Stability-plasticity dilemma in class-incremental learning.
method Adaptive Aggregation Networks (AANets) with stable and plastic residual blocks.
result AANets improve performance on CIL benchmarks.
LoCo learns local representations without end-to-end synchronization, improving performance on complex tasks.
problem Learning local representations without end-to-end synchronization constraints.
method Overlap local blocks to increase decoder depth and allow feedback from upper to lower layers.
result LoCo closes the performance gap between local learning and end-to-end contrastive learning.
Considering the use of Fully Connected (FC) layer limits the performance of Convolutional Neural Networks (CNNs), this paper develops a method to improve the coupling between the convolution layer and the FC layer by reducing the noise in Feature Maps (FMs). Our approach is divided into three steps. Firstly, we separat…
In this work, we extend the SchNet architecture by using weighted skip connections to assemble the final representation. This enables us to study the relative importance of each interaction block for property prediction. We demonstrate on both the QM9 and MD17 dataset that their relative weighting depends strongly on t…
New algorithm reduces bias and variance in weighted least-squares solutions.
problem Inconsistent linear least-squares problems with rapidly decaying singular values.
method Regularized block Kaczmarz (ReBlocK) algorithm.
result ReBlocK outperforms RBK and minibatch SGD for inconsistent problems.
Entity resolution seeks to merge databases as to remove duplicate entries where unique identifiers are typically unknown. We review modern blocking approaches for entity resolution, focusing on those based upon locality sensitive hashing (LSH). First, we introduce k-means locality sensitive hashing (KLSH), which is b…
PSiLON Net uses L1 weight normalization and 1-path-norm regularization for efficient learning and sparsity.
problem Efficient learning and sparsity in neural networks with limited data.
method PSiLON Net employs L1 weight normalization and 1-path-norm regularization to simplify the 1-path-norm and achieve efficient learning and near-sparse parameters. result PSiLON Net achieves reliable optimization and strong performance in the small data regime.
In this paper, we revisit the analyses of Antonie Stern (1925) and Hans Lewy (1977) devoted to the construction of spherical harmonics with two or three nodal domains. Our method yields sharp quantitative results and a better understanding of the occurrence of bifurcations in the families of nodal sets.This paper is a …