In recent work on both generative and discriminative score to log-likelihood-ratio calibration, it was shown that linear transforms give good accuracy only for a limited range of operating points. Moreover, these methods required tailoring of the calibration training objective functions in order to target the desired r…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “Non-linear Objective”
Optimizes non-linear outcomes from summed contributions.
problem Maximizing a non-linear function of summed small contributions.
method Derives a scalable descent algorithm leveraging concentration properties.
result Directly optimizes for stated objective, e.g., A/B test success criterion.
This work interprets SFA through variational inference, relaxing linearity constraints.
problem Recover non-linear SFA from variational inference.
method Probabilistic interpretation of SFA through variational inference, relaxing linearity constraints.
result Reinterprets SFA as a variational framework, allowing slowness as a regularizer to reconstruction loss.
Method orders Pareto solutions using transformed objective scores.
problem Lack of orderability in multi-objective optimization solutions.
method Probability integral transform to map objectives to scores.
result Pareto efficient solutions can be ordered in score space.
Reinforce-Ada improves RL for language models by adaptively sampling difficult prompts.
problem Signal loss in RL for large language models due to undersampling.
method Adaptive sampling based on a non-linear RL objective, optimizing prompt difficulty weighting.
result Reinforce-Ada significantly outperforms uniform sampling, recovering lost signals and accelerating convergence.
Reliable measures of statistical dependence could be useful tools for learning independent features and performing tasks like source separation using Independent Component Analysis (ICA). Unfortunately, many of such measures, like the mutual information, are hard to estimate and optimize directly. We propose to learn i…
Combining neural networks and multiscale decomposition for financial market analysis.
problem Financial markets' complexity and mainstream models' limitations in capturing non-linear structures.
method Neural networks for non-linear associations combined with multiscale decomposition.
result Improved understanding of financial market data substructures.
A method for constructing explicit Calabi-Yau metrics in six dimensions in terms of an initial hyperkahler structure is presented. The equations to solve are non linear in general, but become linear when the objects describing the metric depend on only one complex coordinate of the hyperkahler 4-dimensional space and i…
We present a general framework for solving a large class of learning problems with non-linear functions of classification rates. This includes problems where one wishes to optimize a non-decomposable performance metric such as the F-measure or G-mean, and constrained training problems where the classifier needs to sati…
We present an approach to learn the dynamics of multiple objects from image sequences in an unsupervised way. We introduce a probabilistic model that first generate noisy positions for each object through a separate linear state-space model, and then renders the positions of all objects in the same image through a high…
GP-KAN uses Gaussian Processes in KANs for robust, parameter-efficient non-linear modeling.
problem Non-linear modeling with limited parameters and uncertainty estimates.
method Integrates Gaussian Processes into Kolmogorov Arnold Networks (KANs) for robust non-linear modeling.
result GP-KAN achieves 98.5% accuracy on MNIST with 80k parameters compared to 1.5M for state-of-the-art models.
Finding optimal policies which maximize long term rewards of Markov Decision Processes requires the use of dynamic programming and backward induction to solve the Bellman optimality equation. However, many real-world problems require optimization of an objective that is non-linear in cumulative rewards for which dynami…
The construction (by Kapranov) of the space of infinitesimal paths on a manifold is extended to include higher dimensional infinitesimal objects, encoding contractions of infinitesimal loops. This full infinitesimal groupoid is shown to have the algebra of polyvector fields as its non-linear cohomology.
This paper introduces a new scalable multi-objective deep reinforcement learning (MODRL) framework based on deep Q-networks. We develop a high-performance MODRL framework that supports both single-policy and multi-policy strategies, as well as both linear and non-linear approaches to action selection. The experimental …
Geometrical Objects on the First Order Jet Space Produced by the Lorenz Atmospheric DEs Systemmath.DG
The aim of this paper is to construct natural geometrical objects on the 1-jet space J^1(T,R^5), where , like a non-linear connection, a generalized Cartan connection, together with its d-torsions and d-curvatures, a jet electromagnetic d-field and a jet Yang-Mills energy, starting from the given Lorenz atm…
Adequate evaluation of an information retrieval system to estimate future performance is a crucial task. Area under the ROC curve (AUC) is widely used to evaluate the generalization of a retrieval system. However, the objective function optimized in many retrieval systems is the error rate and not the AUC value. This p…
Complex problems may require sophisticated, non-linear learning methods such as kernel machines or deep neural networks to achieve state of the art prediction accuracies. However, high prediction accuracies are not the only objective to consider when solving problems using machine learning. Instead, particular scientif…
Training recurrent neural networks (RNNs) is a hard problem due to degeneracies in the optimization landscape, a problem also known as vanishing/exploding gradients. Short of designing new RNN architectures, previous methods for dealing with this problem usually boil down to orthogonalization of the recurrent dynamics,…
We provide a pointwise confidence bound for non-linear least-squares with fixed design.
problem Confidence estimation in non-linear -regularized least squares.
method Pointwise confidence bound for local minimizers, using weighted norm involving inverse-Hessian.
result The proposed confidence bound scales with the test input's similarity to the training data.
Paper proposes a novel SVM method for creating survival trees.
problem Creating non-linear survival trees for right-censored data.
method L2-regularized dipole splitting criteria with kernel methods.
result Non-linear splits using polynomial and Gaussian kernels show similar predictive power but often smaller tree sizes.
HCBM improves deep learning explainability by non-linear concept aggregation.
problem Lack of explainable and accurate predictions in deep learning for high-stake decisions.
method Introduce Hoeffding Concept Bottleneck Models (HCBM) using Hoeffding functional decomposition of gradient-boosted trees for non-linear and sparse concept aggregation.
result HCBM outperforms standard linear CBM and is robust to interconcept leakage.
Paper tackles robust control of SDEs with ambiguity, proving value function existence and applying to investment problems.
problem Robust control of SDEs with ambiguity parameters and non-Lipschitz coefficients.
method Existence and uniqueness of value function established through BSDEs with non-linear growth conditions.
result Existence and uniqueness of value function in proper space, verified through BSDEs.
We consider a general class of non-linear Bellman equations. These open up a design space of algorithms that have interesting properties, which has two potential advantages. First, we can perhaps better model natural phenomena. For instance, hyperbolic discounting has been proposed as a mathematical model that matches …
A new clustering method estimates non-linear boundaries and automatically selects the number of clusters.
problem Discriminative clustering with non-linear boundaries and data abnormalities.
method Regularized mutual information objective function with a mixture of Gaussian and uniform distributions.
result Automatic selection of the number of components and estimation of non-linear boundaries.
Combining simple elements from the literature, we define a linear model that is geared toward sparse data, in particular implicit feedback data for recommender systems. We show that its training objective has a closed-form solution, and discuss the resulting conceptual insights. Surprisingly, this simple model achieves…
Tree ensemble method tackles multi-objective constrained optimization in energy systems.
problem Complex, multi-objective, and constrained optimization problems in energy systems.
method Data-driven tree ensemble approach for black-box problems with heterogeneous variable spaces.
result Competitive performance and sampling efficiency compared to state-of-the-art tools.
New algorithm achieves nearly optimal regret with one-pass updates for GLB problems.
problem Generalized linear bandits with non-linear reward distributions.
method Jointly efficient algorithm using OMD estimator with one-pass updates.
result Nearly optimal regret bound with time and space complexities per round.
Investigates financial and economic systems using statistical mechanics and information theory.
problem Complexity, asymmetry, stochasticity, and non-linearity in financial and economic systems.
method Model-based and empirical analyses using statistical mechanics and information theory.
result Derives probability distribution functions for better understanding of financial and economic dynamics.
Paper uses RL and diffusion models to solve Bayesian inverse problems.
problem Bayesian inverse problems with latent biases.
method Relative Trajectory Balance (RTB) for RL, conditional diffusion models, off-policy backtracking exploration.
result RTB improves diffusion model posteriors for inverse problems.
This article addresses the problem of derivative-free (single- or multi-objective) optimization subject to multiple inequality constraints. Both the objective and constraint functions are assumed to be smooth, non-linear and expensive to evaluate. As a consequence, the number of evaluations that can be used to carry ou…
In this paper, we demonstrate how to learn the objective function of a decision-maker while only observing the problem input data and the decision-maker's corresponding decisions over multiple rounds. We present exact algorithms for this online version of inverse optimization which converge at a rate of $ \mathcal{O}(1…
Contrastive learning properties studied, including feature suppression and hierarchical learning.
problem Feature suppression and hierarchical learning in contrastive learning.
method Generalized contrastive loss, instance-based contrastive learning, explicit and controllable competing features.
result Contrastive learning can suppress and prevent the learning of competing features.
This paper takes a step towards temporal reasoning in a dynamically changing video, not in the pixel space that constitutes its frames, but in a latent space that describes the non-linear dynamics of the objects in its world. We introduce the Kalman variational auto-encoder, a framework for unsupervised learning of seq…
Canonical Correlation Analysis (CCA) is widely used for multimodal data analysis and, more recently, for discriminative tasks such as multi-view learning; however, it makes no use of class labels. Recent CCA methods have started to address this weakness but are limited in that they do not simultaneously optimize the CC…
A novel tracking algorithm models dynamic objects as ellipsoids with time-varying orientation.
problem Tracking dynamic objects with time-varying orientation.
method Random matrix framework with variational Bayes for non-linear inference.
result The method outperforms state-of-the-art methods in accuracy and robustness.
Improved classification model for high-cardinality categorical predictors.
problem Handling high-cardinality categorical predictors and non-linear data.
method Data-driven binning of spline functions and shrinkage estimators.
result Improved classification precision with interpretable predictors.
New algorithm for online learning in episodic MDPs with convex objectives.
problem Online episodic convex reinforcement learning.
method Online mirror descent algorithm with varying constraint sets and exploration bonus.
result Near-optimal regret bounds for online CURL without prior knowledge of transition function.
Introduces neural network for interval-censored survival analysis.
problem Lack of non-linear regression algorithms for interval-censored data.
method Sparse neural network architecture for feature selection and AFT model for prediction.
result Outperforms traditional AFT algorithms in non-linear scenarios.
Kernel k-Means algorithm improves clustering of non-linear data.
problem Non-convexity of kernel k-Means objective function leads to local minima.
method Generalizes MM approach to solve non-convex problem in kernel and multi-kernel settings.
result Establishes strong consistency guarantees for Kernel Power k-Means.
Paper proves MDS NP-hard and provides a PTAS.
problem Theoretical limitations of MDS objective function.
method Proves NP-hardness and provides a PTAS approximation algorithm.
result Minimizing Kamada-Kawai objective is NP-hard.
DeepKriging uses DNNs to predict spatial data with improved accuracy and scalability.
problem Predicting spatial processes with non-linear and non-Gaussian data.
method Adds an embedding layer of spatial coordinates with basis functions to DNNs.
result DeepKriging provides non-linear predictions with smaller approximation errors and is scalable for large datasets.
We propose a new way of thinking about deep neural networks, in which the linear and non-linear components of the network are naturally derived and justified in terms of principles in probability theory. In particular, the models constructed in our framework assign probabilities to uncertain realizations, leading to Ku…
New activation networks improve model efficiency and performance.
problem Creating hardware-efficient deep learning models.
method Restructurable Activation Networks (RANs) with RAN-explicit and RAN-implicit methods.
result RANs achieve state-of-the-art results with improved hardware efficiency.
The role of feature space in atomistic learningphysics.comp-ph
A framework to compare atomistic descriptors and their transformations.
problem Comparing and understanding different atomistic descriptors and their transformations.
method Introducing a framework to compare different sets of descriptors and their transformations by metrics and kernels.
result Diagnostic tools to determine equivalent information and distorted common information between feature spaces.
Classifies non-linear Fredholm maps linking to stable homotopy groups of spheres.
problem Classifying non-linear proper Fredholm maps between Hilbert spaces.
method Using stable homotopy groups of spheres to classify maps up to proper homotopy.
result Determines the non-trivial kernel of the map from stable homotopy groups to non-linear proper Fredholm maps.
Discover equations of motion from distorted video frames.
problem Learning equations of motion from unlabeled, distorted video.
method Train an autoencoder to map frames into latent space, then use symbolic regression to find differential equations.
result The method can discover motion equations even when video is distorted.
New insights into tSNE for large datasets.
problem Limitations of tSNE in handling large datasets.
method Identified continuum limit of tSNE objective function, proposed rescaled model.
result Rescaled model has a consistent limit for large datasets.
Paper uses non-linear dimension reduction for better economic forecasting.
problem Analyzing economic effects of shocks in large datasets.
method Non-linear dimension reduction in factor-augmented vector autoregressions.
result Non-linear dimension reduction techniques improve forecasting, especially in volatile data.