A new encoding framework predicts brain activity from visual stimuli and intrinsic brain connections.
problem Traditional encoding models ignore brain inner states, limiting their performance in natural image identification.
method Proposes a novel encoding framework combining external stimuli and brain inner states, using a forward encoding model and an inner state model.
result The framework achieves better performance on natural image identification from fMRI responses than traditional models.
Teaches sequential learners with changing inner states to improve future performance.
problem Teaching sequential learners with evolving inner states.
method Introduces an optimal control approach for multi-agent learning.
result Optimal control approach improves future performance of learners.
New vector quantization method reduces relevance of parallel components in database points.
problem Scaling maximum inner product search to massive databases.
method Developed anisotropic vector quantization loss functions.
result Achieves state-of-the-art results on public benchmarks.
We propose a quantization based approach for fast approximate Maximum Inner Product Search (MIPS). Each database vector is quantized in multiple subspaces via a set of codebooks, learned directly by minimizing the inner product quantization error. Then, the inner product of a query to a database vector is approximated …
Paper proposes a method to generate adversarial perturbations for black-box attacks without accessing inner states.
problem Generating adversarial perturbations for black-box attacks without accessing inner states of a DNN.
method Matrix-free generation method that requires fewer query trials.
result The proposed method successfully deceives a DNN for semantic segmentation more effectively than random noise.
Signature Isolation Forest removes constraints from FIF by using rough path theory's signature transform.
problem Challenges in FIF's linear inner product and dictionary choices leading to unreliable results.
method Introduces Signature Isolation Forest using rough path theory's signature transform to remove linearity constraints.
result Demonstrates relevance of methods through numerical experiments and real-world applications.
Estimates latent inner products from an anisotropic Gaussian graph with improved spectral method.
problem Recovering latent inner products from an anisotropic Gaussian random geometric graph.
method Doubly centered adjacency matrix, rank-d spectral approximation, Hermite expansion, decoupling argument.
result Estimator achieves mean squared error rate matching state of the art for isotropic case and ill-conditioned covariance matrices.
A new pruning method improves neural network efficiency and accuracy.
problem Optimizing neural network efficiency and accuracy through pruning.
method Formulated as a Knapsack Problem, the method optimizes trade-off between neuron importance and computational cost. Channels are pruned while maintaining network structure, and fine-tuned using inner knowledge distillation from parent network.
result State-of-the-art pruning results on ImageNet, CIFAR-10, and CIFAR-100.
There has been substantial research on sub-linear time approximate algorithms for Maximum Inner Product Search (MIPS). To achieve fast query time, state-of-the-art techniques require significant preprocessing, which can be a burden when the number of subsequent queries is not sufficiently large to amortize the cost. Fu…
GPU-accelerates multiuser detection for 5G URLLC systems.
problem Efficiently detecting payloads in OFDM frames with ultra-low latency.
method Implemented partially linear multiuser detection in RKHSs on a GPU-accelerated platform.
result Sub-millisecond latency detection in 5G URLLC systems.
Fewer data weight updates lead to faster convergence in machine learning models.
problem Improving robustness of machine learning models through data mixing.
method Analyzing convergence behavior of data mixing with a finite number of inner steps.
result The optimal number of inner steps scales with the budget and type of gradients used.
Study higher rank inner products and their tilings to describe tori degenerations.
problem Understanding metric degenerations of tori.
method Introduce higher rank inner products and their tilings, use to describe degenerations.
result Describe metric degenerations of polarized tori and Hausdorff limits of tilings.
Characterizes quandles with abelian inner automorphisms.
problem Understanding quandles with specific automorphism properties.
method Generalizes previous work to construct new quandles.
result Homogeneous quandles with abelian inner automorphisms are abelian extensions of trivial quandles.
New spectral functionals for Dirac operators with inner fluctuations computed.
problem Spectral functionals and Dirac operators with inner fluctuations.
method Extension of spectral functionals for Dirac operators with inner fluctuations.
result Computed spectral Einstein functional for Dirac operator with inner fluctuations on even-dimensional spin manifolds.
A new algorithm tackles bilevel optimization with multiple inner minima.
problem Challenges in bilevel optimization with multiple inner minima.
method Reformulated as constrained optimization, solved via primal-dual bilevel optimization (PDBO) algorithm.
result First non-asymptotic convergence guarantee for bilevel optimization with multiple inner minima.
The paper proposes an efficient nested simulation design using likelihood ratio method.
problem Designing nested simulations with fixed outer scenarios and minimizing simulation effort.
method Proposes a bi-level optimization problem to decide inner replications and pooling strategies.
result Optimized design achieves $\cO(Γ^{-1})$ mean squared error of estimators.
This paper constructs quandles with abelian inner automorphism groups from graphs, proving their homogeneity.
problem Finding quandles with specific automorphism properties.
method Starting from simple graphs, the paper constructs quandles with abelian inner automorphism groups and proves their homogeneity.
result Homogeneous quandles with abelian inner automorphism groups are constructed from vertex-transitive graphs.
Groups with specific properties have vanishing ℓ2-Betti numbers.
problem Understanding ℓ2-Betti numbers for certain groups. method Introduced cheap 1-rebuilding property and used structure theorem of Tucker-Drob.
result First ℓ2-Betti numbers vanish for specified groups. The author reviews his results on locally compact homogeneous spaces with inner metric, in particular, homogeneous manifolds with inner metric. The latter are isometric to homogeneous (sub-)Finslerian manifolds; under some additional conditions they are isometric to homogeneous (sub)-Riemannian manifolds. The class Ω…
Researchers prove inner product recovery is impossible in latent space models.
problem Recovering inner products in latent space models with random geometric graphs.
method Rate-distortion theory applied to Gaussian or spherical latent locations.
result Impossible to recover inner products if dimensionality exceeds nh(p), matching positive results' conditions. Paper proposes a new method to optimize feature coordinates for better image classification.
problem Improving feature extraction for better machine learning classification.
method Mutual-energy inner product optimization method.
result The method enhances low-frequency features and suppresses high-frequency noise, leading to better classification results.
We classify homotopes of classical symmetric spaces (studied in Part I of this work). Our classification uses the fibered structure of homotopes: they are fibered as symmetric spaces, with flat fibers, over a non-degenerate base; the base spaces correspond to inner ideals in Jordan pairs. Using that inner ideals in cla…
In this paper we study isometry-invariant Finsler metrics on inner product spaces over R or C, i.e. the Finsler metrics which do not change under the action of all isometries of the inner product space. We give a new proof of the analytic description of all such metrics. In this article the most g…
The paper challenges the belief that more inner iterations at test time improve performance in implicit deep learning.
problem The performance improvement of implicit deep learning models with increased inner iterations at test time.
method Theoretical analysis of a simple setting, validation on implicit deep learning problems.
result Overparametrization plays a key role; increasing the number of iterations at test time does not improve performance for overparametrized networks.
Study of Gaussian distributions using entropic Gromov-Wasserstein and inner product Gromov-Wasserstein.
problem Optimal transportation between Gaussian distributions with different dimensions.
method Entropic Gromov-Wasserstein and inner product Gromov-Wasserstein, with closed-form expressions and von Neumann's trace inequality.
result Closed-form expressions for the entropic IGW and its unbalanced variant between Gaussian distributions.
We introduce a proximal version of the stochastic dual coordinate ascent method and show how to accelerate the method using an inner-outer iteration procedure. We analyze the runtime of the framework and obtain rates that improve state-of-the-art results for various key machine learning optimization problems including …
ANIL adapts only a subset of parameters, reducing computational cost.
problem Efficiently adapt model parameters in meta-learning.
method Adapts only a small subset of parameters in the inner loop of ANIL.
result Theoretical convergence and computational complexity analysis for ANIL.
Quantum kernels can be efficiently embedded into classical feature spaces.
problem Can all quantum kernels be efficiently embedded into classical feature spaces?
method Invoking computational universality and using techniques like random Fourier features, the authors show that certain classes of quantum kernels can be efficiently embedded.
result For shift-invariant and composition kernels, embedding quantum kernels are universal and efficient.
Study bounds the index of minimal submanifolds using energy measures and Yang-Mills-Higgs equations.
problem Bounding the index of codimension 2 minimal submanifolds.
method Second inner variation of energy, convergence of energy measures, and stress-energy tensors.
result Bound the Morse index of the submanifold by the index of critical points.
Each market has its singular characteristic. Its inner structure is directly responsible for the observed distributions of returns though this fact is widely overlooked. Big orders lead to doubling the tails. The behavior of a market maker with many or few ``friends'' who can reliably loan money or stock to him is quit…
Introduces PPMM algorithm for nonconvex robust regression problems.
problem Nonconvex tuning-free robust regression problems.
method PPMM algorithm with inner subproblems solved by SSN-PPA.
result Converges to d-stationary point with KL property.
Study on singularities of specific polynomial functions.
problem Characterizing the topology of singularities of mixed functions.
method Introduced inner non-degenerate mixed functions and used Newton boundary to characterize links.
result Links of singularities can be completely characterized under certain conditions.
Develops implicit MAML for efficient few-shot learning.
problem Efficient few-shot learning with limited data.
method Implicit differentiation for inner loop optimization.
result Agrees with inner loop optimizer choice and handles many gradient steps.
Graphs with stronger curvature grow faster.
problem Understanding volume growth on graphs with various curvatures.
method Examined inner-outer and Ricci-Ollivier curvatures to relate them to volume growth.
result Graphs with stronger inner-outer curvature growth have faster volume growth.
The paper explores harmonic maps and their properties in symmetric spaces.
problem Understanding harmonic maps in symmetric spaces.
method Discussion of associated family of harmonic maps from Riemann surfaces into symmetric spaces.
result Comparison and conjecture on harmonic maps and totally symmetric harmonic maps.
Study on kernel regression risk in high dimensions using Pinsker bound.
problem Kernel regression risk in high-dimensional inner product spaces.
method Investigation of Pinsker bound for kernel regression on sphere Sd with sample size n=αdγ(1+od(1)). result Exact minimax risk and Pinsker constant identified for kernel regression.
We point out that the Homfly polynomial (that is to say, Ocneanu's trace functional) contains two polynomial-valued inner products on the Hecke algebra representation of Artin's braid group. These bear a close connection to the Morton-Franks-Williams inequality. In these structures, the sets of positive, respectively n…
We study one extremal problem on the product of power of generalized inner radii of non-overlapping domains in Cn.
We consider a regularized least squares problem, with regularization by structured sparsity-inducing norms, which extend the usual ℓ1 and the group lasso penalty, by allowing the subsets to overlap. Such regularizations lead to nonsmooth problems that are difficult to optimize, and we propose in this paper a suit…
The paper solves the Andreadakis problem for specific groups using inner automorphisms.
problem Solving the Andreadakis problem for specific groups.
method Generalizing tools from [Dar19b] to study subgroups of IAn, focusing on the behavior of the Andreadakis problem with inner automorphisms.
result The Andreadakis equality holds for the pure braid group and the mapping class group of the n-punctured sphere.
Efficient Maximum Inner Product Search (MIPS) is an important task that has a wide applicability in recommendation systems and classification with a large number of classes. Solutions based on locality-sensitive hashing (LSH) as well as tree-based solutions have been investigated in the recent literature, to perform ap…
New SVRG and SARAH schemes reduce tuning effort for variance reduction.
problem Optimal performance of SVRG and SARAH requires tuning of parameters.
method Introduces Barzilai-Borwein step sizes, averaging, and adaptive inner loop length.
result Improves SVRG, SARAH, and BB variants' convergence rates and performance.
Convex learning for diverse invariances in semi-inner-product space.
problem Efficiently learning invariant representations for a wide range of invariances.
method Developed a convex representation learning algorithm for generalized invariances modeled as semi-norms, introducing Euclidean embeddings for kernel representers in a semi-inner-product space.
result Accurate invariant representations learned efficiently and effectively, validated by experiments.
We present the first provably sublinear time algorithm for approximate \emph{Maximum Inner Product Search} (MIPS). Our proposal is also the first hashing algorithm for searching with (un-normalized) inner product as the underlying similarity measure. Finding hashing schemes for MIPS was considered hard. We formally sho…
Neyshabur and Srebro proposed Simple-LSH, which is the state-of-the-art hashing method for maximum inner product search (MIPS) with performance guarantee. We found that the performance of Simple-LSH, in both theory and practice, suffers from long tails in the 2-norm distribution of real datasets. We propose Norm-rangin…
A new method for efficient nested Monte Carlo simulations in financial modeling.
problem Computational challenges in nested stochastic modeling for financial risk assessment.
method Sample recycling approach to speed up inner loop estimations.
result Significantly more efficient than traditional techniques.
Study on naked singularities without symmetry, forming incomplete future null infinity and singular inner Cauchy horizon.
problem Formation of naked singularities in Einstein-scalar field system without symmetry assumptions.
method Employing four-type differences and scale-invariant weighted norms to control geometry.
result Global naked singularity structure with incomplete future null infinity and singular inner Cauchy horizon.
In this paper, we develop a loop group description of harmonic maps F:M→G/K ``of finite uniton type", from a Riemann surface M into inner symmetric spaces of compact or non-compact type. This develops work of Uhlenbeck, Segal, and Burstall-Guest to non-compact inner symmetric spaces. To be mo…