Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

18355370 · Feb 202019922001200920172026
48 results for Overhead Line Insulators

Generically, topological insulators have conical points leading to Dirac-like currents.

problem Understanding the conical structure of degeneracies in topological phases of matter.
method Analyzing Hermitian matrices with three parameters to show conical points.
result Adiabatic deformations of topological insulators result in Dirac-like currents whose total conductivity equals the chiral number of conical points.

Recently we introduced T-duality in the study of topological insulators. In this paper, we study the bulk-boundary correspondence for three phenomena in condensed matter physics, namely, the quantum Hall effect, the Chern insulator, and time reversal invariant topological insulators. In all of these cases, we show that…

2015-05-20abs ↗pdf ↗

Study of spectral flow in symmetric Toeplitz operator families.

problem Understanding spectral flow in families of symmetric Toeplitz operators.
method Analog of Atiyah-Singer-Robbin-Salamon theorem for Z2\mathbb{Z}_2-valued spectral flow.
result Graded secondary spectral flow equals secondary index of a Callias-type operator.

Ensuring differential privacy of models learned from sensitive user data is an important goal that has been studied extensively in recent years. It is now known that for some basic learning problems, especially those involving high-dimensional data, producing an accurate private model requires much more data than learn…

2018-03-27abs ↗pdf ↗

SOTERIA optimizes neural networks for secure inference with minimal overhead.

problem Protecting user privacy in ML-as-a-service models with low overhead.
method Neural architecture search with dual objectives of accuracy and cryptographic efficiency.
result SOTERIA constructs efficient models for secure inference.

Training modern deep learning models requires large amounts of computation, often provided by GPUs. Scaling computation from one GPU to many can enable much faster training and research progress but entails two complications. First, the training library must support inter-GPU communication. Depending on the particular …

2018-02-15abs ↗pdf ↗

The subtle interplay between local and global charges for topological semimetals exactly parallels that for singular vector fields. Part of this story is the relationship between cohomological semimetal invariants, Euler structures, and ambiguities in the torsion of manifolds. Dually, a topological semimetal can be rep…

2016-11-28abs ↗pdf ↗

FedLog reduces communication in federated learning by sharing data summaries.

problem Significant communication overhead in federated learning with large model parameters.
method Shares minimal sufficient statistics via Bayesian inference and differential privacy.
result High learning accuracy with low communication overhead.

We consider the problem of learning a binary classifier from nn different data sources, among which at most an ηη fraction are adversarial. The overhead is defined as the ratio between the sample complexity of learning in this setting and that of learning the same hypothesis class on a single data distribution. We pr…

2018-05-12abs ↗pdf ↗

We show that the (graded) spectral flow of a family of Toeplitz operators on a complete Riemannian manifold is equal to the index of a certain Callias-type operator. When the dimension of the manifold is even this leads to a cohomological formula for the spectral flow. As an application, we compute the spectral flow of…

2018-03-29abs ↗pdf ↗

We study the collaborative PAC learning problem recently proposed in Blum et al.~\cite{BHPQ17}, in which we have kk players and they want to learn a target function collaboratively, such that the learned function approximates the target function well on all players' distributions simultaneously. The quality of the col…

2018-05-23abs ↗pdf ↗

New unsupervised method selects hard negative samples for contrastive learning.

problem How to select good negative examples for contrastive learning without using true similarity information.
method Developed a new family of unsupervised sampling methods for hard negative selection.
result Improves downstream performance across multiple modalities.

Federated LIDAR aided beam selection reduces mmWave beam search overhead.

problem Efficient link configuration in mmWave communication systems with reduced beam search overhead.
method Federated learning of LIDAR data to train a shared neural network for beam selection.
result Proposed method significantly outperforms previous works in performance and complexity.

Randomized matrix compression techniques, such as the Johnson-Lindenstrauss transform, have emerged as an effective and practical way for solving large-scale problems efficiently. With a focus on computational efficiency, however, forsaking solutions quality and accuracy becomes the trade-off. In this paper, we investi…

2015-10-16abs ↗pdf ↗

The computation of convolution layers in deep neural networks typically rely on high performance routines that trade space for time by using additional memory (either for packing purposes or required as part of the algorithm) to improve performance. The problems with such an approach are two-fold. First, these routines…

2018-09-20abs ↗pdf ↗

Turbo-Aggregate reduces secure aggregation time from quadratic to nearly linear.

problem Quadratic overhead in secure model aggregation for federated learning.
method Multi-group circular strategy, additive secret sharing, and coding techniques.
result Achieves O(NlogN)O(N\log{N}) overhead, compared to O(N2)O(N^2), for up to 50% user dropout.

Robotic vision is a field where continual learning can play a significant role. An embodied agent operating in a complex environment subject to frequent and unpredictable changes is required to learn and adapt continuously. In the context of object recognition, for example, a robot should be able to learn (without forg…

2019-07-08abs ↗pdf ↗

The study analyzes how wartime controls influenced zaibatsu stock prices in Japan.

problem How wartime economic controls affected zaibatsu stock prices in Japan.
method Developed a four-portfolio asset-pricing model and used a CAPM-AR(p)-SV event-study framework.
result Wartime economic controls influenced stock prices through financing wedges and zaibatsu affiliation.

Efficient FPGA virtualization for deep learning reduces user isolation and overhead.

problem Poor isolation and heavy re-compilation overhead in FPGA-based DNN accelerators.
method Two-level instruction dispatch module, multi-core hardware resources pool, tiling-based instruction frame package, two-stage static-dynamic compilation.
result 1.07-1.69x and 1.88-3.12x throughput improvement over previous designs.

ISAAC Newton uses input-based curvature for efficient training.

problem Efficient training in small-batch stochastic regimes.
method ISAAC Newton conditions gradients using selected second-order information based on input.
result Effective training even in small-batch stochastic regimes, competitive to first-order and second-order methods.

HCBM improves deep learning explainability by non-linear concept aggregation.

problem Lack of explainable and accurate predictions in deep learning for high-stake decisions.
method Introduce Hoeffding Concept Bottleneck Models (HCBM) using Hoeffding functional decomposition of gradient-boosted trees for non-linear and sparse concept aggregation.
result HCBM outperforms standard linear CBM and is robust to interconcept leakage.

Generative Adapter adapts LMs with a single forward pass, reducing inference overhead.

problem Efficient adaptation of large language models for new contexts.
method Generative Adapter directly maps new contexts to low-rank LM adapters via self-supervised learning.
result Significant reduction in inference overhead with no need for fine-tuning.

TorchGAN is a PyTorch based framework for writing succinct and comprehensible code for training and evaluation of Generative Adversarial Networks. The framework's modular design allows effortless customization of the model architecture, loss functions, training paradigms, and evaluation metrics. The key features of Tor…

2019-09-08abs ↗pdf ↗

Information-theoretic Bayesian optimisation techniques have demonstrated state-of-the-art performance in tackling important global optimisation problems. However, current information-theoretic approaches require many approximations in implementation, introduce often-prohibitive computational overhead and limit the choi…

2017-11-02abs ↗pdf ↗

Certified training improves robustness against adversarial attacks.

problem Certified training's gap with empirical robustness limits its practical utility.
method Combining adversarial attacks with network over-approximations.
result Certified training can prevent catastrophic overfitting and bridge the gap to multi-step baselines.

Adaptive gradient-based optimizers such as Adagrad and Adam are crucial for achieving state-of-the-art performance in machine translation and language modeling. However, these methods maintain second-order statistics for each parameter, thus introducing significant memory overheads that restrict the size of the model b…

2019-01-30abs ↗pdf ↗

Paper introduces a new adaptive gradient method with gradient compression for distributed training.

problem Communication overhead in distributed machine learning systems.
method Adaptive gradient method with gradient compression, scalable system BytePS-Compress.
result Convergence rate of O(1/T)\mathcal{O}(1/\sqrt{T}) for non-convex problems.

Low-precision training reduces computational cost and produces efficient models. Recent research in developing new low-precision training algorithms often relies on simulation to empirically evaluate the statistical effects of quantization while avoiding the substantial overhead of building specific hardware. To suppor…

2019-10-09abs ↗pdf ↗