Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

54109163217 · Jun 202019922001200920172026
48 results for iterative intelligence

Theoretical study shows AI models can recover from contaminated training data.

problem Data contamination in AI training can degrade model performance.
method Theoretical analysis and experiments on various data types.
result Models converge to true distribution under mild conditions, with rate dependent on real data fraction.

In this paper, we consider the problem of machine teaching, the inverse problem of machine learning. Different from traditional machine teaching which views the learners as batch algorithms, we study a new paradigm where the learner uses an iterative algorithm and a teacher can feed examples sequentially and intelligen…

2017-05-30abs ↗pdf ↗

Intelligent Transportation Systems (ITSs) are envisioned to play a critical role in improving traffic flow and reducing congestion, which is a pervasive issue impacting urban areas around the globe. Rapidly advancing vehicular communication and edge cloud computation technologies provide key enablers for smart traffic …

2018-12-03abs ↗pdf ↗

POCAII optimizes hyperparameters with a new approach, showing superior performance.

problem Hyperparameter optimization with limited resources.
method Explicitly separates search and evaluation phases, focusing on exploration and exploitation.
result POCAII outperforms state-of-the-art HPO algorithms in low-budget scenarios.

Data application developers and data scientists spend an inordinate amount of time iterating on machine learning (ML) workflows -- by modifying the data pre-processing, model training, and post-processing steps -- via trial-and-error to achieve the desired model performance. Existing work on accelerating machine learni…

2018-08-03abs ↗pdf ↗

Theoretical model for iterative user discovery in recommender systems.

problem Iterative feedback loops in recommender systems and their biases.
method Theoretical framework to model system evolution and convergence properties.
result Theoretical bounds and convergence properties on user discovery and blind spots.

RE enhances DL by learning model behavior, enabling iterative self-improvement.

problem Static data representations limit DL's potential for evolving models.
method RE uses multiple mappings of data through identical deep architectures, analyzing internal representations and performance signals.
result Models can gain insight from predecessors, leading to iterative self-improvement.

Crowdsourcing platforms emerged as popular venues for purchasing human intelligence at low cost for large volume of tasks. As many low-paid workers are prone to give noisy answers, a common practice is to add redundancy by assigning multiple workers to each task and then simply average out these answers. However, to fu…

2017-02-28abs ↗pdf ↗

A new method uses heat diffusion to efficiently solve combinatorial optimization problems.

problem Challenges in combinatorial optimization due to discrete nature and limited search scope.
method Transforming the target function through heat diffusion to enable information flow and more efficient navigation.
result Superior performance across various combinatorial optimization problems.

Traditionally, most complex intelligence architectures are extremely non-convex, which could not be well performed by convex optimization. However, this paper decomposes complex structures into three types of nodes: operators, algorithms and functions. Iteratively, propagating from node to node along edge, we prove tha…

2018-01-09abs ↗pdf ↗

The paper addresses human-like decision-making in multi-agent systems using bounded risk-sensitive Markov Games.

problem Modeling human-like decision-making in multi-agent systems with risk-seeking and loss-aversion behaviors.
method Forward policy design and inverse reward learning with iterative reasoning and cumulative prospect theory.
result The proposed algorithms demonstrate both risk-averse and risk-seeking behaviors in multi-agent systems.

Paper presents a new training method for overparametrized neural networks that reduces time per iteration.

problem Scalability issue in training overparametrized neural networks.
method Uses a new view of neural networks as binary search trees, modifying a small subset of nodes per iteration.
result Reduces amortized time per iteration to m1αnd+n3m^{1-α} n d + n^3 from previous mnd+n3mnd + n^3.

AI learns market manipulation through simulation, suggesting regulation.

problem Regulating AI to prevent market manipulation.
method Used a genetic algorithm in an artificial market simulation.
result AI discovered market manipulation as an optimal strategy.

Dynamic sample pruning speeds up spatio-temporal forecasting models.

problem Training deep learning models on large, redundant datasets is computationally expensive.
method Dynamic sample pruning based on real-time learning state.
result Significant acceleration of training speed with improved performance.

Mathematical framework using Riemannian geometry for intelligence and consciousness.

problem Lack of a unified mathematical framework for intelligence and consciousness.
method Conceptualizes intelligence as tokens in a high-dimensional space, using Riemannian geometry to describe structure and dynamics.
result Integrates geometric concepts to offer a unified framework for intelligence and consciousness.

Artificial intelligence has impacted many aspects of human life. This paper studies the impact of artificial intelligence on economic theory. In particular we study the impact of artificial intelligence on the theory of bounded rationality, efficient market hypothesis and prospect theory.

2015-07-01abs ↗pdf ↗

This work improves the convergence theory of diffusion models for generating samples from complex distributions.

problem Improving theoretical understanding of diffusion models, particularly their convergence analysis.
method Developed an instance-dependent convergence rate that adapts to the smoothness of target distributions.
result Established an iteration complexity of min{d,d2/3L1/3,d1/3L}ε2/3\min\{d,d^{2/3}L^{1/3},d^{1/3}L\}\varepsilon^{-2/3} for generating high-quality samples.

BED-LLM uses Bayesian experimental design to improve LLMs' information gathering.

problem Improving LLMs' ability to gather information adaptively.
method Iteratively choosing questions to maximize expected information gain using a probabilistic model.
result BED-LLM achieves substantial performance gains compared to other adaptive design strategies.

This thesis explores emergent intelligence in disordered systems like spin glasses and neural networks.

problem Understanding the principles behind emergent intelligent behaviors in disordered systems.
method Statistical physics approach to charting learning mechanisms and dynamics.
result Uncovering relationships between learning mechanisms and physical dynamics.

SIM-Shapley improves SV approximation efficiency and stability.

problem High computational costs of Shapley value methods in high-dimensional settings.
method Stochastic Iterative Momentum for Shapley Value Approximation (SIM-Shapley).
result Reduced computation time by up to 85% while maintaining feature attribution quality.

This brief note highlights some basic concepts required toward understanding the evolution of machine learning and deep learning models. The note starts with an overview of artificial intelligence and its relationship to biological neuron that ultimately led to the evolution of todays intelligent models.

2017-11-15abs ↗pdf ↗

As systems are getting more autonomous with the development of artificial intelligence, it is important to discover the causal knowledge from observational sensory inputs. By encoding a series of cause-effect relations between events, causal networks can facilitate the prediction of effects from a given action and anal…

2020-01-15abs ↗pdf ↗

This research improves online learning by correcting for target shift in machine learning.

problem Online learning struggles with distributional shift, especially in target values.
method Derives closed-form expressions for online and offline learning, and target correction.
result Online kernel-based learning can learn the same predictor as offline learning with target correction.

We discuss the objectives of automation equipped with non-trivial decision making, or creating artificial intelligence, in the financial markets and provide a possible alternative. Intelligence might be an unintended consequence of curiosity left to roam free, best exemplified by a frolicking infant. For this unintenti…

2019-11-03abs ↗pdf ↗

This survey presents a review of state-of-the-art deep neural network architectures, algorithms, and systems in vision and speech applications. Recent advances in deep artificial neural network algorithms and architectures have spurred rapid innovation and development of intelligent vision and speech systems. With avai…

2019-08-16abs ↗pdf ↗

This paper tackles URLLC in 6G networks with deep learning.

problem Stringent requirements on end-to-end delay and reliability for mission-critical applications.
method Develops a multi-level architecture combining theoretical models and real-world data, using deep transfer learning and federated learning.
result Demonstrates improved performance in URLLC for mission-critical applications.

Future autonomous systems need reliable world models and complex action sequences.

problem Current automated systems lack reliable world models and complex action sequences.
method Introduce energy-based and latent variable models combined in a hierarchical joint embedding predictive architecture (H-JEPA).
result Combining energy-based and latent variable models in H-JEPA can lead to reliable world models and complex action sequences.

The paper proposes an AI and IIoT framework for improved maintenance.

problem Current maintenance practices need improvement with AI and IIoT.
method Review of reliability modeling, introduction of Intelligent Maintenance framework, and novel probabilistic deep learning approach.
result Demonstrated novel probabilistic deep learning reliability modelling in Turbofan Engine Degradation Dataset.

The paper shows how uncertainty quantification improves counterfactual explainability in AI.

problem Lack of foundational concepts in transparency research.
method Integrates uncertainty quantification into counterfactual explainability.
result Demonstrates competitive performance of an uncertainty-based explainer.

Framework predicts melt pool geometry with AI, improving manufacturing quality.

problem Achieving consistent product quality in Metal Additive Manufacturing.
method Surprise-guided sequential learning framework integrating CTGAN for limited data.
result Enhanced predictive accuracy for melt pool dimensions.