Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

6351,2701,9042,539 · Jun 202019922001200920172026
48 results for linear and nonlinear relationships

Proposes a partially linear structure to capture nonlinear relationships in mixture of experts models.

problem Suboptimal estimates due to linearity assumption in mixture of experts models.
method Introduces a partially linear structure that incorporates unspecified functions to capture nonlinear relationships.
result Establishes the identifiability of the proposed model under mild conditions and introduces a practical estimation algorithm.

JULIA combines multi-linear and nonlinear models for tensor completion.

problem Complex patterns in real-world tensors require a unified model.
method JULIA unifies multi-linear and nonlinear models with flexible component assignment and efficient alternating optimization.
result JULIA outperforms existing methods in large-scale tensor completion.

In many compressive sensing problems today, the relationship between the measurements and the unknowns could be nonlinear. Traditional treatment of such nonlinear relationships have been to approximate the nonlinearity via a linear model and the subsequent un-modeled dynamics as noise. The ability to more accurately ch…

2013-01-29abs ↗pdf ↗

New deep learning model for matrix completion combining linear and nonlinear relationships.

problem Matrix completion considering only linear or nonlinear relations, ignoring latent relationships.
method Combines linear and nonlinear models in a latent variables framework, using a deep neural network with two branches for columns and rows, and manifold learning as an auxiliary task.
result Experimental results show the proposed method outperforms state-of-the-art matrix completion methods.

Extends RRR to capture nonlinear interactions in multi-response regression.

problem Complex relationships in real-world data cannot be adequately modeled by linear interactions.
method Introduces Higher Order Reduced Rank Regression (HORRR) using tensor representations and Tucker decomposition.
result HORRR can capture nonlinear interactions in multi-response regression.

A framework uses preprocessing to improve psychiatric questionnaire predictions while maintaining interpretability.

problem Weak predictive accuracy and limited interpretability of psychiatric questionnaires.
method Two-stage method: stable preprocessing followed by a linear mapping.
result REFINE outperforms other interpretable approaches in psychiatric and non-psychiatric prediction tasks.

LGB+ improves macroeconomic forecasting by combining linear and tree models.

problem Efficiency in small samples for forecasting with mixed linear and nonlinear dynamics.
method LGB+ is a boosting procedure that evaluates both tree and linear candidates at each step, advancing only the winner. It decomposes forecasts into linear and nonlinear contributions.
result LGB+ delivers strong gains for targets with pronounced autoregressive dynamics or mixed signals.

Paper develops a method to learn causal networks with non-invertible functions.

problem Identifying causal relationships from observational data with non-invertible functional relationships.
method Proposes a test for non-invertible bivariate causal models and develops a method to incorporate this test in structure learning of DAGs.
result Our algorithms outperform existing DAG learning methods in identifying causal graphical structures.

This paper contains a thorough introduction to the basic geometric properties of the manifold of Lagrangian subspaces of a linear symplectic space, known as the Lagrangian Grassmannian. It also reviews the important relationship between hypersurfaces in the Lagrangian Grassmannian and second-order PDEs.

2018-05-11abs ↗pdf ↗

This note explores the consequences of nonlinear price impact functions on price dynamics within the chartist-fundamentalist framework. Price impact functions may be nonlinear with respect to trading volume. As indicated by recent empirical studies, a given transaction may cause a large (small) price change if market d…

2004-03-30abs ↗pdf ↗

Proposes σσ-PCA to learn identifiable linear transformations without whitening.

problem Cannot identify axes with equal variances in PCA.
method Unified model for linear and nonlinear PCA, introducing a missing piece to eliminate rotational indeterminacy.
result Eliminates subspace rotational indeterminacy in PCA.

Key to multitask learning is exploiting relationships between different tasks to improve prediction performance. If the relations are linear, regularization approaches can be used successfully. However, in practice assuming the tasks to be linearly related might be restrictive, and allowing for nonlinear structures is …

2017-05-23abs ↗pdf ↗

This study compares various superlearner and deep learning architectures (machine-learning-based and neural-network-based) for classification problems across several simulated and industrial datasets to assess performance and computational efficiency, as both methods have nice theoretical convergence properties. Superl…

2017-08-21abs ↗pdf ↗

Proposes a new AFT model for nonlinear survival data.

problem Limited ability of classical AFT models to represent nonlinear relationships and handle complex covariate structures.
method Structured nonparametric extension using Kolmogorov--Arnold representations and unified censoring-adjusted losses.
result Method captures nonlinear effects and recovers linear structure when appropriate.

Proposes a new method for nonlinear models with robustness guarantees.

problem Distributional robustness in nonlinear models with causality.
method Representation learning and identifiable representation learning.
result First causality-inspired robustness method with finite-radius guarantees in nonlinear settings.

New method tests independence with single nonstationary time series.

problem Testing independence in nonstationary nonlinear time series.
method Time-varying nonlinear regression, local long-run covariance estimation, strong Gaussian approximation.
result First framework for conditional independence testing with a single realization of a nonstationary nonlinear process.

The prediction of workers' safety behaviour can help identify vulnerable workers who intend to undertake unsafe behaviours and be useful in the design of management practices to minimise the occurrence of accidents. The latest literature has evidenced that there is within-population diversity that leads people's intend…

2019-12-11abs ↗pdf ↗

Linear regression studies the problem of estimating a model parameter βRpβ^* \in \mathbb{R}^p, from nn observations {(yi,xi)}i=1n\{(y_i,\mathbf{x}_i)\}_{i=1}^n from linear model yi=xi,β+εiy_i = \langle \mathbf{x}_i,β^* \rangle + ε_i. We consider a significant generalization in which the relationship between $\langle \mathbf{x}_i,β^* \ran…

2015-05-13abs ↗pdf ↗

It is generally accepted that many time series of practical interest exhibit strong dependence, i.e., long memory. For such series, the sample autocorrelations decay slowly and log-log periodogram plots indicate a straight-line relationship. This necessitates a class of models for describing such behavior. A popular cl…

2007-06-13abs ↗pdf ↗

Develops a new method for nonlinear dimension reduction using random features.

problem Statistical challenges in generalizing Gaussian process-based latent variable models to non-Gaussian data.
method Random feature latent variable models (RFLVMs) that approximate nonlinear relationships with linear functions of random features.
result RFLVMs produce comparable results to state-of-the-art methods on various data types.

Classical methods such as Principal Component Analysis (PCA) and Canonical Correlation Analysis (CCA) are ubiquitous in statistics. However, these techniques are only able to reveal linear relationships in data. Although nonlinear variants of PCA and CCA have been proposed, these are computationally prohibitive in the …

2014-02-01abs ↗pdf ↗

Study of financial models using PIDEs with and without market liquidity.

problem Financial models under illiquid markets and their PIDEs.
method Investigation of linear and nonlinear PIDEs, including Lévy processes, using abstract semilinear parabolic equation theory.
result Existence and uniqueness of solutions to PIDEs for admissible Lévy measures.

Mixed effects (ME) models inform a vast array of problems in the physical and social sciences, and are pervasive in meta-analysis. We consider ME models where the random effects component is linear. We then develop an efficient approach for a broad problem class that allows nonlinear measurements, priors, and constrain…

2019-09-24abs ↗pdf ↗

New method estimates convergence bounds for nonlinear Markov chains.

problem Difficulty in describing properties of nonlinear Markov chains.
method Coupling Markov chains to reconstitute distribution relationships and estimate convergence bounds.
result Estimation of convergence bounds is more precise than existing results.

Deep neural networks (DNNs) are computationally/memory-intensive and vulnerable to adversarial attacks, making them prohibitive in some real-world applications. By converting dense models into sparse ones, pruning appears to be a promising solution to reducing the computation/memory cost. This paper studies classificat…

2018-10-23abs ↗pdf ↗

New method identifies causal relationships from interventions in complex systems.

problem Learning causal representations from unknown, latent interventions with general nonlinear mixing.
method Strong identifiability results with unknown single-node interventions, using geometric structure of transformed data.
result First instance of causal identifiability from non-paired interventions for deep neural network embeddings.

A new knockoff statistic using conditional prediction function improves variable selection in complex models.

problem Controlling false discovery rate in complex models with nonlinear relationships.
method Introducing a knockoff statistic based on the conditional prediction function for use with machine learning models.
result The CPF statistics provide superior power in detecting prognostic variables over existing knockoff statistics.

Kernel methods and MLPs perform similarly to linear models in high dimensions.

problem Understanding the performance of kernel methods and MLPs in high-dimensional settings.
method Analysis of kernel methods and MLPs in a high-dimensional regime with proportional asymptotics.
result Linear models are optimal in high-dimensional settings when data is generated by kernel models with nonlinear relationships.

Paper uses machine learning to uncover nonlinear dynamics in CAT bond pricing.

problem Traditional linear models miss nonlinear relationships in CAT bond pricing.
method Advanced machine learning techniques applied to CAT bond transaction records.
result Machine learning enhances CAT bond pricing accuracy and reveals complex risk interactions.