MAC Net is a compositional attention network designed for Visual Question Answering. We propose a modified MAC net architecture for Natural Language Question Answering. Question Answering typically requires Language Understanding and multi-step Reasoning. MAC net's unique architecture - the separation between memory an…
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
A new machine learning framework called machine collaboration improves prediction accuracy.
Survey on ML for wireless network optimization across PHY, MAC, and network layers.
Study on statistical estimation over Gaussian MAC, comparing analog and digital schemes.
We propose a new algorithm, Mean Actor-Critic (MAC), for discrete-action continuous-state reinforcement learning. MAC is a policy gradient algorithm that uses the agent's explicit representation of all action values to estimate the gradient of the policy, rather than using only the actions that were actually executed. …
Paper addresses FL over MAC with DP constraints, proposing a novel consensus scheme.
In this paper, we consider the joint design of data compression and 802.15.4-based medium access control (MAC) protocol for smartgrids with renewable energy. We study the setting where a number of nodes, each of which comprises electricity load and/or renewable sources, report periodically their injected powers to a da…
MAC combines models without locking them, improving ensemble performance.
DSGD with OAC-MAC scheme achieves better convergence in noisy wireless networks.
Paper introduces a modified Allen-Cahn equation for better energy equipartition.
Effective coordination is crucial to solve multi-agent collaborative (MAC) problems. While centralized reinforcement learning methods can optimally solve small MAC instances, they do not scale to large problems and they fail to generalize to scenarios different from those seen during training. In this paper, we conside…
Edge devices learn a global model collaboratively over wireless channels.
Deep neural networks (DNN) are increasingly being accelerated on application-specific hardware such as the Google TPU designed especially for deep learning. Timing speculation is a promising approach to further increase the energy efficiency of DNN accelerators. Architectural exploration for timing speculation requires…
We consider a distributed learning problem over multiple access channel (MAC) using a large wireless network. The computation is made by the network edge and is based on received data from a large number of distributed nodes which transmit over a noisy fading MAC. The objective function is a sum of the nodes' local los…
Unified derivation of PAC-Bayes and MI bounds for general VC classes with fast rates.
The paper shows non-aspherical path components in G2-moduli spaces.
Let X be a subcomplex of the standard CW-decomposition of the n-dimensional torus. We exhibit an explicit optimal motion planning algorithm for X. This construction is used to calculate the topological complexity of complements of general position arrangements and Eilenberg-Mac Lane spaces associated to right-angled Ar…
Unified framework sparsifies GNNs for faster inference on large graphs.
An almost-direct product of free groups is an iterated semidirect product of finitely generated free groups in which the action of the constituent free groups on the homology of one another is trivial. We determine the structure of the cohomology ring of such a group. This is used to analyze the topological complexity …
C3 compresses images and videos with low complexity and high performance.
A new method predicts non-Markovian closure terms for complex systems.
New RL method MAC improves performance in sparse reward settings.
Integrally splits L-spectra of integers into simpler components.
Abstract sketches historical development of Lie brackets, crossed modules, and Lie-Rinehart algebras.
Big data is one of the cornerstones to enabling and training deep neural networks (DNNs). Because of the lack of expertise, to gain benefits from their data, average users have to rely on and upload their private data to big data companies they may not trust. Due to the compliance, legal, or privacy constraints, most u…
In science and engineering, intelligent processing of complex signals such as images, sound or language is often performed by a parameterized hierarchy of nonlinear processing layers, sometimes biologically inspired. Hierarchical systems (or, more generally, nested systems) offer a way to generate complex mappings usin…
We show that for closed orientable manifolds the -dimensional stable systole admits a metric-independent volume bound if and only if there are cohomology classes of degree that generate cohomology in top-degree. Moreover, it turns out that in the nonorientable case such a bound does not exist for stable systoles…
The notion of highly structured ring spectra of prime characteristic is made precise and is studied via the versal examples S//p for prime numbers p. These can be realized as Thom spectra, and therefore relate to other Thom spectra such as the unoriented bordism spectrum MO. We compute the Hochschild and André-Quillen …
New methods for -transform inversion and Wiener-Hopf factorization.
Many powerful machine learning models are based on the composition of multiple processing layers, such as deep nets, which gives rise to nonconvex objective functions. A general, recent approach to optimise such "nested" functions is the method of auxiliary coordinates (MAC). MAC introduces an auxiliary coordinate for …
Share prices of financial companies from the S&P 500 list have been modeled by a linear function of consumer price indices in the USA. The Johansen and Engle-Granger tests for cointegration both demonstrated the presence of an equilibrium long-term relation between observed and predicted time series. Econometrically, t…
Belief networks are a new, potentially important, class of knowledge-based models. ARCO1, currently under development at the Atlantic Richfield Company (ARCO) and the University of Southern California (USC), is the most advanced reported implementation of these models in a financial forecasting setting. ARCO1's underly…
We introduce the new task of Acoustic Question Answering (AQA) to promote research in acoustic reasoning. The AQA task consists of analyzing an acoustic scene composed by a combination of elementary sounds and answering questions that relate the position and properties of these sounds. The kind of relational questions …
New probabilistic invariants bound classical topological complexity and category.
WMPG reduces policy gradient variance using world models.
Developing a differentially private deep learning algorithm is challenging, due to the difficulty in analyzing the sensitivity of objective functions that are typically used to train deep neural networks. Many existing methods resort to the stochastic gradient descent algorithm and apply a pre-defined sensitivity to th…
In the last decade, there has been a great technological advance in the infrastructure of mobile technologies. The increase in the use of wireless local area networks and the use of satellite services are also noticed. The high utilization rate of mobile devices for various purposes makes clear the need to track wirele…
We study the tradeoff between computational effort and classification accuracy in a cascade of deep neural networks. During inference, the user sets the acceptable accuracy degradation which then automatically determines confidence thresholds for the intermediate classifiers. As soon as the confidence threshold is met,…
The paper derives formulas for option pricing and random walk expectations.
Develops a graphical calculus for stable curvature invariants.
The recent success of natural language understanding (NLU) systems has been troubled by results highlighting the failure of these models to generalize in a systematic and robust way. In this work, we introduce a diagnostic benchmark suite, named CLUTRR, to clarify some key issues related to the robustness and systemati…
Neural approximate computing gains enormous energy-efficiency at the cost of tolerable quality-loss. A neural approximator can map the input data to output while a classifier determines whether the input data are safe to approximate with quality guarantee. However, existing works cannot maximize the invocation of the a…
Study improves survival analysis for credit risk by accounting for data drift.
This paper evaluates debiasing methods on word embeddings to reduce religious bias.
New method for efficient pricing of double barrier options in Lévy models.
In the area of credit risk analytics, current Bankruptcy Prediction Models (BPMs) struggle with (a) the availability of comprehensive and real-world data sets and (b) the presence of extreme class imbalance in the data (i.e., very few samples for the minority class) that degrades the performance of the prediction model…
Compressing DNNs is important for the real-world applications operating on resource-constrained devices. However, we typically observe drastic performance deterioration when changing model size after training is completed. Therefore, retraining is required to resume the performance of the compressed models suitable for…
Resource is an important constraint when deploying Deep Neural Networks (DNNs) on mobile and edge devices. Existing works commonly adopt the cell-based search approach, which limits the flexibility of network patterns in learned cell structures. Moreover, due to the topology-agnostic nature of existing works, including…