Learning with feature evolution studies the scenario where the features of the data streams can evolve, i.e., old features vanish and new features emerge. Its goal is to keep the model always performing well even when the features happen to evolve. To tackle this problem, canonical methods assume that the old features …
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “feature evolution”
Graph neural network using Beltrami flow for feature and topology evolution.
problem Efficient feature learning and topology evolution on graphs.
method Discretized Beltrami flow applied to graph neural networks with positional encodings.
result Achieves state-of-the-art results on various benchmarks.
In automatic financial feature construction task, the state-of-the-art technic leverages reverse polish expression to represent the features, then use genetic programming (GP) to conduct its evolution process. In this paper, we propose a new framework based on neural network, alpha discovery neural network (ADNN). In t…
We analyse second order (in Riemann curvature) geometric flows (un-normalised) on locally homogeneous three manifolds and look for specific features through the solutions (analytic whereever possible, otherwise numerical) of the evolution equations. Several novelties appear in the context of scale factor evolution, fix…
Graph neural networks (GNNs) have become increasingly popular for classification tasks on graph-structured data. Yet, the interplay between graph topology and feature evolution in GNNs is not well understood. In this paper, we focus on node-wise classification, illustrated with community detection on stochastic block m…
New approach for feature evolution in streaming data with limited storage.
problem Rarely-provided labels in feature evolving streams.
method Incorporates manifold regularization and a buffer to adapt to different storage budgets.
result Preserves the performance of feature evolving learning across different storage budgets.
Analyzes feature learning in neural networks using a self-consistent dynamical field theory.
problem Feature learning in infinite-width neural networks.
method Constructs deterministic dynamical order parameters as inner-product kernels for hidden unit activations and gradients.
result Reveals the hidden layer activation distribution, neural tangent kernel evolution, and output predictions.
Genetic programming (GP) is the state-of-the-art in financial automated feature construction task. It employs reverse polish expression to represent features and then conducts the evolution process. However, with the development of deep learning, more powerful feature extraction tools are available. This paper proposes…
A generative recurrent neural network is quickly trained in an unsupervised manner to model popular reinforcement learning environments through compressed spatio-temporal representations. The world model's extracted features are fed into compact and simple policies trained by evolution, achieving state of the art resul…
Random forests classify Pokemon names based on evolutionary status.
problem Classifying Pokemon names into pre-evolution and post-evolution categories.
method Trained random forests using sound symbolism from Pokemon names, conducted experiments with human participants.
result Random forests outperform human participants in classifying Pokemon names.
Neural networks' feature geometry evolves like discrete Ricci flow.
problem Understanding neural feature representations and their geometric transformations.
method Approximating input manifold with geometric graphs and analyzing their evolution during training.
result Neural feature geometry evolves like discrete Ricci flow, with nonlinear activations playing a crucial role.
Quantum computer method for pricing lookback options with jumps.
problem Pricing lookback options with discrete monitoring and jump conditions.
method Variational Quantum Imaginary Time Evolution (VarQITE) method to solve non-Hermitian Schrodinger equation.
result Quantum algorithm can handle jump conditions in lookback options pricing.
Gradient descent solves rank-one matrix estimation problem with detailed time evolution analysis.
problem Estimating a rank-one symmetric matrix corrupted by noise.
method Gradient descent on a sphere, using local versions of the semi-circle law.
result Explicit formulas for the time evolution of the estimator and cost function, revealing phase transitions.
Lectures on surface evolution through singularities.
problem Analyzing the mean curvature flow of surfaces and their singularities.
method Analysis of neck and conical singularities, using monotonicity formulas, epsilon-regularity, weak solutions, and blowup techniques.
result Unique evolution through neck singularities, nonuniqueness through conical singularities.
We propose a class of Markovian agent based models for the time evolution of a share price in an interactive market. The models rely on a microscopic description of a market of buyers and sellers who change their opinion about the stock value in a stochastic way. The actual price is determined in realistic way by match…
Temporal-difference and Q-learning learn feature representations that converge to optimal ones.
problem Understanding how feature representations evolve in temporal-difference and Q-learning with neural networks.
method Mean-field theory applied to overparameterized two-layer neural networks.
result The feature representation converges to the optimal one, generalizing previous results.
We develop a simple theoretical framework for the evolution of weighted networks that is consistent with a number of stylized features of real-world data. In our framework, the Barabasi-Albert model of network evolution is extended by assuming that link weights evolve according to a geometric Brownian motion. Our model…
CoMGNN models heterogeneous graphs with evolving nodes and edges.
problem Modeling complex, evolving graphs with diverse information.
method Meta graph attention on co-evolving heterogeneous graphs.
result Significant improvement over state-of-the-art methods.
This paper introduces SS-MAMP to address convergence issues in AMP algorithms.
problem Convergence issues in AMP algorithms for signal reconstruction.
method Proposes SS-MAMP algorithm framework for right-unitarily invariant sensing matrices and Lipschitz-continuous local processors.
result Covariance matrices of SS-MAMP are L-banded and convergent, ensuring optimal convergence.
DeepStreamCE detects new classes in streaming deep neural networks.
problem Detecting new classes in deep neural networks in a streaming environment.
method Uses autoencoder and MCOD stream-based clustering for real-time concept evolution detection.
result DeepStreamCE outperforms OpenMax in identifying concept evolution.
The complex and computationally expensive nature of landscape evolution models pose significant challenges in the inference and optimisation of unknown parameters. Bayesian inference provides a methodology for estimation and uncertainty quantification of unknown model parameters. In our previous work, we developed para…
We propose and investigate two model classes for forward power price dynamics, based on continuous branching processes with immigration, and on Hawkes processes with exponential kernel, respectively. The models proposed exhibit jumps clustering features. Models of this kind have been already proposed for the spot price…
Approximate message passing (AMP) refers to a class of efficient algorithms for statistical estimation in high-dimensional problems such as compressed sensing and low-rank matrix estimation. This paper analyzes the performance of AMP in the regime where the problem dimension is large but finite. For concreteness, we co…
New self-exciting random evolutions (SEREs) for modeling traffic and transport processes.
problem Modeling self-exciting and clustering effects in traffic and transport processes.
method Introducing a new process based on a superposition of a Markov chain and a Hawkes process, and constructing self-exciting random evolutions (SEREs).
result Developed new models and limit theorems for SEREs, including averaging and diffusion approximation.
Learning to fail: Predicting fracture evolution in brittle material models using recurrent graph convolutional neural networkscond-mat.mtrl-sci
We propose a machine learning approach to address a key challenge in materials science: predicting how fractures propagate in brittle materials under stress, and how these materials ultimately fail. Our methods use deep learning and train on simulation data from high-fidelity models, emulating the results of these mode…
Method estimates parameters for disease spread models robustly.
problem Estimating parameters for disease spread models.
method Statistical Learning applied to Approximate Bayesian Computation.
result Qualitative properties of disease evolution can be assessed.
Structured Monte Carlo Sampling for Nonisotropic Distributions via Determinantal Point Processescs.LG
We propose a new class of structured methods for Monte Carlo (MC) sampling, called DPPMC, designed for high-dimensional nonisotropic distributions where samples are correlated to reduce the variance of the estimator via determinantal point processes. We successfully apply DPPMCs to problems involving nonisotropic distr…
Quantum neural networks generalize better due to flatter parameter space.
problem Generalization in quantum neural networks.
method Mapped feature data to a quantum state, applied unitary evolution, and measured for classification.
result Quantum neural networks have better generalization than classical networks.
New algorithm estimates intrinsic dimension of discrete datasets.
problem Inaccuracies in using continuous methods for discrete datasets.
method Introduced an algorithm to infer intrinsic dimension of discrete spaces.
result Demonstrated accuracy on benchmark datasets and found a small intrinsic dimension in a metagenomic dataset.
The majority of cancer treatments end in failure due to Intra-Tumor Heterogeneity (ITH). ITH in cancer is represented by clonal evolution where different sub-clones compete with each other for resources under conditions of Darwinian natural selection. Predicting the growth of these sub-clones within a tumour is among t…
The Kinetics of Wealth and the Origin of the Pareto Lawphysics.soc-ph
An important class of economic models involve agents whose wealth changes due to transactions with other agents. Several authors have pointed out an analogy with kinetic theory, which describes molecules whose momentum and energy changes due to interactions with other molecules. We pursue this analogy and derive a Bolt…
In the framework of Lorentzian warped products, we study the Friedmann-Robertson-Walker cosmological model to investigate non-smooth curvatures associated with multiple discontinuities involved in the evolution of the universe. In particular we analyze non-smooth features of the spatially flat Friedmann-Robertson-Walke…
Steerable neural ODEs on homogeneous spaces for equivariant feature dynamics.
problem Learning continuous-time equivariant dynamics of vector-valued features on homogeneous spaces.
method Introduces steerable neural ordinary differential equations on homogeneous spaces, interpreting features as sections of associated vector bundles over .
result Steerable NODEs are -equivariant when the flow and connection are -invariant, and they incorporate existing models.
The calculus correspondence has been known to exist between generic pedal evolutions and generic wave front evolutions. In this paper, we first extend the known results on the calculus correspondence to evolutions with multi-parameters, and then give applications of calculus correspondence. Moreover, we discuss the pos…
Few attempts have been proposed in order to describe the statistical features and historical evolution of the export bipartite matrix countries/products. An important standpoint is the introduction of a products network, namely a hierarchical forest of products that models the formation and the evolution of commodities…
We consider the two problems of predicting links in a dynamic graph sequence and predicting functions defined at each node of the graph. In many applications, the solution of one problem is useful for solving the other. Indeed, if these functions reflect node features, then they are related through the graph structure.…
Paper assesses how features influence classification of COVID-19 patients.
problem Evaluating the influence of features on classification problems.
method Introduced a measure of feature influence using Shapley value of cooperative games, with axiomatic characterisation.
result Validated the performance of the measure through experiments on COVID-19 patients.
Investigates spectral properties of neural networks, showing invariance under certain conditions.
problem Understanding the spectral evolution and invariance in linear-width neural networks.
method Empirical and theoretical analysis of spectra of weight matrices in high-dimensional settings.
result Spectra of weight matrices are invariant under certain training conditions, with implications for feature learning.
A (reactive) lattice-gas approach to economic cyclescond-mat.stat-mech
A microscopic approach to macroeconomic features is intended. A model for macroeconomic behavior under heterogeneous spatial economic conditions is reviewed. A birth-death lattice gas model taking into account the influence of an economic environment on the fitness and concentration evolution of economic entities is nu…
Financial market is an example of complex system, which is characterized by a highly intricate organization and the emergence of collective behavior. In this paper, we quantify this emergent dynamics in the financial market by using concepts of network synchronization. We consider networks constructed by the correlatio…
Study material evolution using groupoids to track intrinsic properties.
problem Tracking material evolution without considering the whole body.
method Construct a groupoid encoding intrinsic properties and characteristic foliations.
result Define the evolution equation for material points.
We introduce a new Self-Organized Criticality (SOC) model for simulating price evolution in an artificial financial market, based on a multilayer network of traders. The model also implements, in a quite realistic way with respect to previous studies, the order book dy- namics, by considering two assets with variable f…
Reduced Order Modeling of Energetic Materials Using Physics-Aware Recurrent Convolutional Neural Networks in a Latent Space (LatentPARC)cond-mat.mtrl-sci
Reduced order modeling of energetic materials using physics-aware neural networks.
problem Simulating complex spatiotemporal dynamics in energetic materials.
method Physics-aware recurrent convolutions (PARC) combined with latent space projection to accelerate model training and inference.
result Significant decrease in training and inference time with comparable accuracy.
For the problem of binary linear classification and feature selection, we propose algorithmic approaches to classifier design based on the generalized approximate message passing (GAMP) algorithm, recently proposed in the context of compressive sensing. We are particularly motivated by problems where the number of feat…
The evolution of personal income distribution (PID) in four countries: Canada, New Zealand, the UK, and the USA follows a unique trajectory. We have revealed precise match in the shape of two age-dependent features of the PID: mean income and the portion of people with the highest incomes (2 to 5% of the working age po…
The combination of high-dimensionality and disparity of time scales encountered in many problems in computational physics has motivated the development of coarse-grained (CG) models. In this paper, we advocate the paradigm of data-driven discovery for extract- ing governing equations by employing fine-scale simulation …
Employing a recent technique which allows the representation of nonstationary data by means of a juxtaposition of locally stationary patches of different length, we introduce a comprehensive analysis of the key observables in a financial market: the trading volume and the price fluctuations. From the segmentation proce…
Analysis of deep neural networks under various learning rules reveals dynamics of feature and prediction learning.
problem Understanding how different learning rules affect feature and prediction dynamics in deep neural networks.
method Analysis of infinite-width deep networks trained with gradient descent and various learning rules.
result The evolution of the output function is governed by an effective neural tangent kernel (eNTK), which varies depending on the learning rule and training regime.