Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,932 papers · 148 categories

Trend · papers per month

25.0%50.0%75.0%100.0% · Jun 199319922001200920172026
48 results for frequent directions

Improved ridge regression with Frequent Directions for large-scale tasks.

problem Improving performance of ridge regression for large-scale data.
method Combines Frequent Directions with iterative optimization schemes.
result Achieves high accuracy in estimating bias and variance for sketched ridge regression.

Paper improves tensor approximation for streaming data.

problem Challenges in finding accurate low-tubal-rank tensor approximations in streaming settings.
method Extends Frequent Directions for efficient low-tubal-rank tensor approximation.
result The new algorithm achieves arbitrarily small approximation error with linear sketch size growth.

Sketchy reduces memory and compute requirements for adaptive regularization in deep learning.

problem Prohibitive memory and running time for adaptive regularization methods in deep learning.
method Low-rank sketching approach using Frequent Directions (FD) to reduce memory and compute requirements.
result Efficient interpolation between resource requirements and degradation in regret guarantees with rank kk.

A new algorithm reduces the time and space complexity for multinomial logistic bandits.

problem High-dimensional feedback in multinomial logistic bandits makes existing algorithms inefficient.
method Integrates frequent directions matrix sketching into OFUL-MLogB to reduce time and space complexity.
result Achieves a regret bound of ildeO(ΔT(KdlnΔT+m)T) ilde{\mathcal{O}}(Δ_T(Kd\lnΔ_T+m)\sqrt{T}).

Paper introduces a method for continual learning using online leverage scores.

problem Avoiding forgetting and interference of previous knowledge in continual learning.
method Uses statistical leverage scores to measure data importance and a frequent directions approach for online continual learning.
result Demonstrates effectiveness in avoiding catastrophic forgetting and computational efficiency.

Frequent Itemsets (FIs) mining is a fundamental primitive in data mining. It requires to identify all itemsets appearing in at least a fraction θθ of a transactional dataset D\mathcal{D}. Often though, the ultimate goal of mining D\mathcal{D} is not an analysis of the dataset \emph{per se}, but the understanding of …

2013-01-07abs ↗pdf ↗

The agent-based model of stock price dynamics on a directed evolving complex network is suggested and studied by direct simulation. The stationary regime is maintained as a result of the balance between the extremal dynamics, adaptivity of strategic variables and reconnection rules. The inherent structure of node agent…

2007-01-13abs ↗pdf ↗

Proposes a new method for finding frequent closed patterns in transaction bases.

problem Frequent closed patterns in transaction bases.
method Partitioning the search space into subcontexts and updating frequent closed patterns with their minimal generators.
result Proposed approach called UFCIGs-DAC for efficient search of frequent closed itemsets.

Identification of causal direction between a causal-effect pair from observed data has recently attracted much attention. Various methods based on functional causal models have been proposed to solve this problem, by assuming the causal process satisfies some (structural) constraints and showing that the reverse direct…

2019-05-23abs ↗pdf ↗

This paper investigates to identify the requirement and the development of machine learning-based mobile big data analysis through discussing the insights of challenges in the mobile big data (MBD). Furthermore, it reviews the state-of-the-art applications of data analysis in the area of MBD. Firstly, we introduce the …

2018-08-02abs ↗pdf ↗

The paper proposes using low rank assumption to improve causal structure learning in DAGs.

problem Challenges in learning causal structures in high-dimensional, non-sparse DAGs.
method Exploits low rank assumption of DAG adjacency matrix to adapt causal structure learning methods.
result Maximum rank is highly related to hubs, suggesting low rank for scale-free networks.

The problem of frequent pattern mining has been studied quite extensively for various types of data, including sets, sequences, and graphs. Somewhat surprisingly, another important type of data, namely rank data, has received very little attention in data mining so far. In this paper, we therefore addresses the problem…

2018-06-15abs ↗pdf ↗

Bayesian ARMA model with directional shifts captures structural breaks in compositional time series.

problem Structural breaks in compositional time series due to external shocks or policy changes.
method Developed a Bayesian Dirichlet ARMA model augmented with a directional-shift intervention mechanism.
result The model captures structural breaks through interpretable parameters and produces coherent probabilistic forecasts.

Paper characterizes and represents pairwise causal background knowledge for improved causal inference.

problem Improving causal inference by handling pairwise causal constraints.
method Graphical characterization, direct causal clause (DCC), unified representation, MPDAG, polynomial-time algorithms.
result Pairwise causal background knowledge uniquely decomposes into MPDAG and DCCs, improving causal effect identification.

New method trims network data to resist adversarial contamination.

problem Adversarial contamination in network data affects statistical and algorithmic performance.
method Proposes a new trimming method operating in model space to address both block and white noise contamination.
result Demonstrates superior performance in simulations compared to direct trimming.

Flexible framework for CMTF with ADMM for various constraints and couplings.

problem Challenges in data fusion from multiple sources with varying characteristics.
method Flexible algorithmic framework using AO and ADMM for various constraints, loss functions, and couplings.
result Accurate and computationally efficient results for various loss functions, including KL divergence.

We consider the problem of finding anomalies in high-dimensional data using popular PCA based anomaly scores. The naive algorithms for computing these scores explicitly compute the PCA of the covariance matrix which uses space quadratic in the dimensionality of the data. We give the first streaming algorithms that use …

2018-04-09abs ↗pdf ↗

Sparse activations in neural models correlate with frequent words, suggesting sparsity is natural.

problem Interpretability and resource efficiency in neural language models.
method Used the Taxi-Euclidean norm to measure sparsity and analyzed gradients and activations of frequent words.
result Frequent input words are associated with sparse activations, while frequent target words are associated with dispersed activations.

Batch uniformization improves anomaly detection in sound data.

problem Anomaly scores for rare and frequent normal sounds are not uniform.
method Propose batch uniformization to minimize anomaly scores by weighting samples based on their density.
result Improves performance of unsupervised anomaly detection in sound data.

Improves deep transfer learning by preventing performance degradation.

problem Deep transfer learning can degrade performance when using inappropriate pre-trained weights.
method Proposes a novel strategy to compute new descent directions that preserve regularization effects.
result DTNH strategy improves performance of deep transfer learning tasks by 0.1%--7%.

Study automates detection of visitation disruptions in ICU patients.

problem Difficulty in detecting frequent visitation disruptions in ICU patients.
method Used DensePose R-CNN model to count people in video frames, analyzed disruptions and patient outcomes.
result Automated method detects visitation disruptions, impacts on pain and length of stay examined.

Momentum is a simple and widely used trick which allows gradient-based optimizers to pick up speed along low curvature directions. Its performance depends crucially on a damping coefficient ββ. Large ββ values can potentially deliver much larger speedups, but are prone to oscillations and instability; hence one typic…

2018-04-01abs ↗pdf ↗

Blockchain scaling reduces gas fees, allowing more frequent liquidity updates and concentration.

problem Adverse selection risk and high gas fees on decentralized exchanges.
method Instrumental variables analysis using blockchain scaling solutions (Arbitrum, Polygon) as instruments.
result Higher repositioning intensity and precision lead to greater liquidity concentration, benefiting small trades.

Properties of data are frequently seen to vary depending on the sampled situations, which usually changes along a time evolution or owing to environmental effects. One way to analyze such data is to find invariances, or representative features kept constant over changes. The aim of this paper is to identify one such fe…

2012-03-01abs ↗pdf ↗

A model predicts influential nodes in complex networks by considering indirect interactions.

problem Identifying influential nodes in complex networks using indirect interactions.
method Proposes MOGen, a multi-order generative model that considers all indirect influences up to a maximum distance.
result MOGen consistently outperforms network models and path-based approaches in predicting influential nodes.

This paper introduces the combinatorial Boolean model (CBM), which is defined as the class of linear combinations of conjunctions of Boolean attributes. This paper addresses the issue of learning CBM from labeled data. CBM is of high knowledge interpretability but naïve learning of it requires exponentially large compu…

2017-11-07abs ↗pdf ↗

Proposes using frequent sequences to improve sequential recommendation models.

problem Combining user history and recent actions for personalized recommendations.
method Uses frequent sequences to identify relevant parts of user history, embedding items based on preferences and dynamics in a unified metric model.
result Outperforms state-of-the-art methods, especially on sparse datasets.

Framework evaluates privacy cost of non-private pre-processing in DP pipelines.

problem Privacy cost of non-private data-dependent pre-processing in DP machine learning pipelines.
method Establishes upper bounds on overall privacy guarantees using Smooth DP and bounded sensitivity.
result Explicit overall privacy guarantees for various pre-processing algorithms.

Mixed data comprises both numeric and categorical features, and mixed datasets occur frequently in many domains, such as health, finance, and marketing. Clustering is often applied to mixed datasets to find structures and to group similar objects for further analysis. However, clustering mixed data is challenging becau…

2018-11-11abs ↗pdf ↗

SGE learns symbolic node representations from relational data.

problem Mining insights from complex, real-world systems.
method SGE uses frequent pattern mining on a node's neighborhood to learn symbolic node representations.
result SGE outperforms shallow node embedding methods on a venue classification task.