A common practice in most of deep convolutional neural architectures is to employ fully-connected layers followed by Softmax activation to minimize cross-entropy loss for the sake of classification. Recent studies show that substitution or addition of the Softmax objective to the cost functions of support vector machin…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “Hybrid Objective Function”
A hybrid neural network improves robustness in estimating vehicle parameters from noisy data.
problem Estimating parameters of a mechanical vehicle model from noisy acceleration data.
method Introduced a convolutional neural network with two objective functions: naive and hybrid.
result The hybrid objective function outperforms the naive one in robustness on noisy input data.
We present a hybrid method for latent information discovery on the data sets containing both text content and connection structure based on constrained low rank approximation. The new method jointly optimizes the Nonnegative Matrix Factorization (NMF) objective function for text clustering and the Symmetric NMF (SymNMF…
A key drawback of the current generation of artificial decision-makers is that they do not adapt well to changes in unexpected situations. This paper addresses the situation in which an AI for aerial dog fighting, with tunable parameters that govern its behavior, will optimize behavior with respect to an objective func…
ConBO optimizes multiple objectives conditional on state variables.
problem Optimizing multiple objectives with conditional state variables.
method Conditional Bayesian Optimization (ConBO) framework.
result Significantly better performance on various problems.
Bayesian framework learns latent preference archetypes for many-objective optimization.
problem Expanding space of trade-offs and context-dependent human values.
method Dirichlet-process mixture model for latent preference archetypes, hybrid queries for efficient information.
result Mixture-aware Bayesian optimization outperforms standard methods on synthetic and real-world benchmarks.
Paper develops a framework to identify latent dynamics from high-dimensional data.
problem Identifying latent dynamics from high-dimensional time-series data.
method Combines physics inductive bias and learn-to-identify strategy.
result Meta-HyLaD framework effectively identifies hybrid latent dynamics.
New algorithm solves nonconvex-convex minimax problems efficiently.
problem Solving nonconvex-convex minimax problems with nonsmooth, nonconvex, and nonlinearity.
method Hybrid variance-reduced SGD algorithm combining smoothing and biased techniques.
result Achieves O(T^(-2/3)) convergence rate and best oracle complexity.
RP1 uses active learning to improve world model in fewest samples.
problem Improving sample efficiency in MBRL for continuous control tasks.
method RP1 views MBRL as active learning, using a hybrid objective function and principled termination.
result Statistically significant gains over existing approaches on continuous control tasks.
Existing imitation learning approaches often require that the complete demonstration data, including sequences of actions and states, are available. In this paper, we consider a more realistic and difficult scenario where a reinforcement learning agent only has access to the state sequences of an expert, while the expe…
Interpretable machine learning has become a strong competitor for traditional black-box models. However, the possible loss of the predictive performance for gaining interpretability is often inevitable, putting practitioners in a dilemma of choosing between high accuracy (black-box models) and interpretability (interpr…
Generative Adversarial Networks (GANs) can achieve state-of-the-art sample quality in generative modelling tasks but suffer from the mode collapse problem. Variational Autoencoders (VAE) on the other hand explicitly maximize a reconstruction-based data log-likelihood forcing it to cover all modes, but suffer from poore…
Novel method for efficient optimization of noisy, expensive hybrid models.
problem Efficient optimization of hybrid models with noisy observations and constraints.
method Constrained Upper Quantile Bound (CUQB) method exploiting composite structure.
result Significantly improved sampling efficiency and theoretical guarantees.
We propose a neural hybrid model consisting of a linear model defined on a set of features computed by a deep, invertible transformation (i.e. a normalizing flow). An attractive property of our model is that both p(features), the density of the features, and p(targets | features), the predictive distribution, can be co…
A new method for optimizing functions without gradients, improving efficiency and convergence.
problem Optimizing functions without gradient information in machine learning.
method Hybrid Gradient Descent (HGE) using random and coordinate-wise gradient estimates.
result The proposed method achieves optimal convergence rates in convex cases and generalizes to non-convex cases.
Paper introduces hybrid curves moduli space and canonical measures.
problem Asymptotic geometry of Riemann surfaces and their moduli spaces.
method Definition of hybrid curves and canonical measures.
result Continuous variation of canonical measures over hybrid curves moduli space.
The study examines MCMC methods for arbitrary objectives and finds likelihood sharpness impacts performance and regularization.
problem Limitations of MCMC methods for arbitrary objective functions.
method Two-block MCMC framework with Metropolis-Hastings and Gibbs sampling, exploring likelihood curvature and sharpness.
result Likelihood sharpness governs in-sample performance and regularization inferred by training data.
A key requirement for the current generation of artificial decision-makers is that they should adapt well to changes in unexpected situations. This paper addresses the situation in which an AI for aerial dog fighting, with tunable parameters that govern its behavior, must optimize behavior with respect to an objective …
Mathematical analysis of Riemann surfaces and their moduli spaces using hybrid Laplacians.
problem Analyzing the asymptotics of Arakelov Green functions on Riemann surfaces near boundary of moduli spaces.
method Introducing hybrid Laplacian, solving hybrid Poisson equation, and defining hybrid Green functions.
result Layered description of asymptotics of Arakelov Green functions on Riemann surfaces near boundary of their moduli spaces.
Where the Quantum Lives in D-Wave Hybrid Portfolio Optimization: An Operational Decomposition Auditquant-ph
D-Wave hybrid quantum-classical portfolio optimization shows classical decomposition is key, not quantum sampling.
problem Optimizing portfolios with constraints using hybrid quantum-classical methods.
method Operational decomposition audit of D-Wave's hybrid quantum-classical service on mean-variance-turnover instances.
result Classical decomposition and feasibility-aware reassembly are key to hybrid quantum-classical performance.
Paper proposes COM-QEL to avoid overoptimistic solutions in offline optimization.
problem Incorrect extrapolation of objective values in unexplored regions.
method Integrates quantum extremal learning with conservative objective models.
result COM-QEL finds higher true objective values compared to QEL.
Clustering algorithms have regained momentum with recent popularity of data mining and knowledge discovery approaches. To obtain good clustering in reasonable amount of time, various meta-heuristic approaches and their hybridization, sometimes with K-Means technique, have been employed. A Kalman Filtering based heurist…
Physics-informed GCRL tackles sparse feedback learning with hybrid dynamics.
problem Sparse feedback learning with high-dimensional, hybrid, or contact-dependent dynamics.
method Introduces physics-informed inductive biases into goal-conditioned value learning.
result Contact-rich manipulation tasks degrade existing Pi-GCRL methods.
Paper uses RL to optimize derivative hedging with reduced costs.
problem Optimizing hedging strategies for derivatives with transaction costs.
method Reinforcement learning with two Q-functions, continuous state/action space, hybrid valuation model.
result Optimal hedging reduces mean and variance of hedging costs.
Generally speaking, the goal of constructive learning could be seen as, given an example set of structured objects, to generate novel objects with similar properties. From a statistical-relational learning (SRL) viewpoint, the task can be interpreted as a constraint satisfaction problem, i.e. the generated objects must…
Improves normalizing flows by incorporating data dependencies.
problem Current normalizing flow learning assumes independent data, leading to errors.
method Proposes a likelihood objective with dependencies and efficient learning algorithm.
result Improves density estimation and data generation on real-world data.
A hybrid algorithm combines optimization and enumeration for symbolic regression.
problem Finding any function from a set of operators without prior specification.
method Mixed-integer nonlinear optimization with explicit enumeration and constraints.
result The hybrid algorithm is competitive with state-of-the-art methods.
A new hybrid fuzzy-crisp clustering algorithm addresses imbalanced cluster sizes.
problem Imbalanced influence in fuzzy c-means clustering for large vs. small clusters.
method Hybrid fuzzy-crisp algorithm combining linear and quadratic membership functions, setting exact zero membership for sufficiently distant points.
result The hybrid algorithm outperforms conventional fuzzy and crisp clustering methods on imbalanced datasets.
In this paper, we propose a stochastic Primal-Dual Hybrid Gradient (PDHG) approach for solving a wide spectrum of regularized stochastic minimization problems, where the regularization term is composite with a linear function. It has been recognized that solving this kind of problem is challenging since the closed-form…
We consider the problem of learning a measure of distance among vectors in a feature space and propose a hybrid method that simultaneously learns from similarity ratings assigned to pairs of vectors and class labels assigned to individual vectors. Our method is based on a generative model in which class labels can prov…
Hybrid Bayesian neural networks use function uncertainty for probabilistic inference.
problem Uncertainty in neural network weights is hard to specify and interpret.
method Integrates probabilistic layers with standard deterministic layers for function uncertainty.
result Improves probabilistic inference by encoding function uncertainty.
Proposes EDESH-SA for better inventory management under uncertainty.
problem Inventory management under uncertainty.
method Ensemble Differential Evolution with simulation-based hybridization and self-adaptation.
result Improves financial performance and optimizes search spaces.
Study proposes hybrid machine learning models for crop yield prediction.
problem Crop yield prediction for food security.
method Hybrid machine learning models (ANN-ICA and ANN-GWO).
result ANN-GWO model outperformed ANN-ICA in crop yield prediction.
Regularization is an important component of predictive model building. The hybrid bootstrap is a regularization technique that functions similarly to dropout except that features are resampled from other training points rather than replaced with zeros. We show that the hybrid bootstrap offers superior performance to dr…
We present Simitate --- a hybrid benchmarking suite targeting the evaluation of approaches for imitation learning. A dataset containing 1938 sequences where humans perform daily activities in a realistic environment is presented. The dataset is strongly coupled with an integration into a simulator. RGB and depth stream…
High levels of air pollution may seriously affect people's living environment and even endanger their lives. In order to reduce air pollution concentrations, and warn the public before the occurrence of hazardous air pollutants, it is urgent to design an accurate and reliable air pollutant forecasting model. However, m…
Hybrid model improves weather forecasting accuracy.
problem Combining physics and machine learning for better weather predictions.
method Offline and online training of a neural network to correct model errors in the IFS.
result The hybrid model reduces forecast errors and improves accuracy.
We consider the two problems of predicting links in a dynamic graph sequence and predicting functions defined at each node of the graph. In many applications, the solution of one problem is useful for solving the other. Indeed, if these functions reflect node features, then they are related through the graph structure.…
Paper proposes a hybrid loss function for graph self-supervised learning.
problem Improving self-supervised representation learning for graphs.
method Hybrid loss function combining VICReg and HSIC.
result Hybrid loss function outperformed other methods in 4 out of 7 cases.
Hybrid controller combines model-based and policy-based reinforcement learning.
problem Combining model-based and policy-based reinforcement learning for stability and robustness.
method Designs a hybrid controller that interpolates a model-based linear controller and a differentiable policy.
result Proven to maintain stability and universal approximation properties.
EnKO combines VI and EnKF for efficient latent dynamics inference.
problem Particle degeneracy and biased gradient estimators in SMC-based methods.
method EnKO: hybrid of VI and EnKF.
result EnKO outperforms SMC-based methods in predictive ability and particle efficiency.
f-GRPO and Beyond: Divergence-Based Reinforcement Learning Algorithms for General LLM Alignmentcs.LG
Extends reinforcement learning alignment to scalar rewards, improving math reasoning.
problem Designing reinforcement learning algorithms for general LLM alignment.
method Introduces f-GRPO and f-HAL, estimating f-divergences between reward-aligned and unaligned distributions.
result Improves math reasoning RLVR tasks and mitigates reward hacking.
We develop an end-to-end deep learning-based anomaly detection model for temporal data in transportation networks. The proposed EVT-LSTM model is derived from the popular LSTM (Long Short-Term Memory) network and adopts an objective function that is based on fundamental results from EVT (Extreme Value Theory). We compa…
In this work, we present a globalized stochastic semismooth Newton method for solving stochastic optimization problems involving smooth nonconvex and nonsmooth convex terms in the objective function. We assume that only noisy gradient and Hessian information of the smooth part of the objective function is available via…
We introduce a simulation scheme for Brownian semistationary processes, which is based on discretizing the stochastic integral representation of the process in the time domain. We assume that the kernel function of the process is regularly varying at zero. The novel feature of the scheme is to approximate the kernel fu…
HyperFair integrates fairness in recommender systems using probabilistic soft logic.
problem Ensuring fairness in recommender systems across diverse domains.
method Soft fairness constraints integrated as regularization in a joint inference objective function.
result HyperFair improves fairness of predictions from black-box models and hybrid systems.
HyBO optimizes hybrid structures using diffusion kernels.
problem Optimizing complex interactions between discrete and continuous variables.
method HyBO uses diffusion kernels over hybrid spaces with additive kernel formulation.
result HyBO significantly outperforms state-of-the-art methods on real-world benchmarks.
Recent years have witnessed the rapid development of block coordinate update (BCU) methods, which are particularly suitable for problems involving large-sized data and/or variables. In optimization, BCU first appears as the coordinate descent method that works well for smooth problems or those with separable nonsmooth …