Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

128256383511 · Jun 202019922001200920172026
48 results for undesirable effects

Previously, we proposed a physically-inspired method to construct data points into an effective in-tree (IT) structure, in which the underlying cluster structure in the dataset is well revealed. Although there are some edges in the IT structure requiring to be removed, such undesired edges are generally distinguishable…

2015-07-29abs ↗pdf ↗

NPO method improves LLM unlearning without catastrophic collapse.

problem Efficiently unlearning undesirable data from LLMs without losing model utility.
method Negative Preference Optimization (NPO) method based on alignment.
result NPO-based methods achieve better unlearning results and maintain model utility.

How can we design safe reinforcement learning agents that avoid unnecessary disruptions to their environment? We show that current approaches to penalizing side effects can introduce bad incentives, e.g. to prevent any irreversible changes in the environment, including the actions of other agents. To isolate the source…

2018-06-04abs ↗pdf ↗

Proposes a method for evaluating multiple dimensions of organizational effectiveness using DEA.

problem Evaluating multiple dimensions of organizational effectiveness in large data sets.
method Introduces two regularized DEA models (SBM and GP-SBM) to estimate both dimension-specific and aggregate efficiency scores.
result Demonstrates improved efficiency and validity compared to conventional methods.

RePULSe improves language model alignment by reducing undesired outputs without sacrificing overall performance.

problem Aligning language models with human preferences while minimizing undesired outputs.
method Integrates probabilistic inference into RL training to reduce undesired outputs.
result RePULSe achieves a better balance between expected reward and undesired output probability.

New algorithm mitigates misspecification amplification in regression models with covariate shift.

problem Distribution shift and model misspecification in regression models.
method Developed a new algorithm inspired by robust optimization to avoid misspecification amplification.
result No misspecification amplification while still achieving optimal statistical rates.

Recent reports have described that learning Bayesian networks are highly sensitive to the chosen equivalent sample size (ESS) in the Bayesian Dirichlet equivalence uniform (BDeu). This sensitivity often engenders some unstable or undesirable results. This paper describes some asymptotic analyses of BDeu to explain the …

2012-02-14abs ↗pdf ↗

This paper characterizes VAE training pathologies and their effects on tasks.

problem Characterizing VAE training pathologies and their impact on downstream tasks.
method Concretely characterizing conditions for VAE training pathologies and their connection to specific downstream tasks.
result Connects VAE training pathologies to specific downstream tasks like learning compressed and disentangled representations, adversarial robustness, and semi-supervised learning.

Given data with noisy labels, over-parameterized deep networks can gradually memorize the data, and fit everything in the end. Although equipped with corrections for noisy labels, many learning methods in this area still suffer overfitting due to undesired memorization. In this paper, to relieve this issue, we propose …

2018-09-28abs ↗pdf ↗

Causality violations are typically seen as unrealistic and undesirable features of a physical model. The following points out three reasons why causality violations, which Bonnor and Steadman identified even in solutions to the Einstein equation referring to ordinary laboratory situations, are not necessarily undesirab…

2006-09-15abs ↗pdf ↗

Investors can enhance their portfolios by strategically using LETFs, especially with dynamic strategies.

problem Unsuitability of passive or static approaches to LETFs leads to undesirable risk-return profiles.
method Demonstrated the effectiveness of simple dynamic strategies in exploiting favorable Omega ratio dynamics.
result Dynamic strategies can exploit the compounding effect of LETFs, improving risk-return profiles.

Ranking models are typically designed to provide rankings that optimize some measure of immediate utility to the users. As a result, they have been unable to anticipate an increasing number of undesirable long-term consequences of their proposed rankings, from fueling the spread of misinformation and increasing polariz…

2019-05-13abs ↗pdf ↗

Gradient-based optimization methods are the most popular choice for finding local optima for classical minimization and saddle point problems. Here, we highlight a systemic issue of gradient dynamics that arise for saddle point problems, namely the presence of undesired stable stationary points that are no local optima…

2018-05-15abs ↗pdf ↗

Study suggests using information flow measures to target interventions in neural networks.

problem Identifying neural network edges that can be pruned to reduce bias.
method Used MM-information flow framework to measure and compare information flows about true labels and protected attributes, and evaluated pruning effects on bias reduction.
result Pruning edges with larger information flows about protected attributes reduces bias at the output.

Multiplicative noise, including dropout, is widely used to regularize deep neural networks (DNNs), and is shown to be effective in a wide range of architectures and tasks. From an information perspective, we consider injecting multiplicative noise into a DNN as training the network to solve the task with noisy informat…

2018-09-19abs ↗pdf ↗

Deep learning methods have recently achieved great empirical success on machine translation, dialogue response generation, summarization, and other text generation tasks. At a high level, the technique has been to train end-to-end neural network models consisting of an encoder model to produce a hidden representation o…

2017-11-27abs ↗pdf ↗

The paper analyzes oversmoothing in GNNs and quantifies the effects of mixing and denoising.

problem Oversmoothing in Graph Neural Networks (GNNs).
method Non-asymptotic analysis of graph convolutions and effects of mixing and denoising.
result The number of layers required for oversmoothing to occur is O(logN/log(logN))O(\log N/\log (\log N)) for dense graphs.

Recent results show that important singularities in General Relativity can be naturally described in terms of finite and invariant canonical geometric objects. Consequently, one can write field equations which are equivalent to Einstein's at non-singular points, but in addition remain well-defined and smooth at singula…

2014-01-24abs ↗pdf ↗

The paper proposes a new policy for optimal treatment allocation based on quantile treatment effects.

problem Optimal treatment allocation policies that target distributional welfare, especially when individuals are heterogeneous.
method The approach involves allocating treatments based on the conditional quantile of individual treatment effects (QoTE), considering both prudent and negligent policymakers.
result The proposed minimax policies are robust to model uncertainty and can be generalized to various settings.

Reinforcement learning agents are prone to undesired behaviors due to reward mis-specification. Finding a set of reward functions to properly guide agent behaviors is particularly challenging in multi-agent scenarios. Inverse reinforcement learning provides a framework to automatically acquire suitable reward functions…

2019-07-30abs ↗pdf ↗

Graph Convolutional Networks (GCNs) have shown very powerful for graph data representation and learning tasks. Existing GCNs usually conduct feature aggregation on a fixed neighborhood graph in which each node computes its representation by aggregating the feature representations of all its neighbors which is biased by…

2019-09-04abs ↗pdf ↗

Financial contagion from liquidity shocks has being recently ascribed as a prominent driver of systemic risk in interbank lending markets. Building on standard compartment models used in epidemics, in this work we develop an EDB (Exposed-Distressed-Bankrupted) model for the dynamics of liquidity shocks reverberation be…

2016-10-11abs ↗pdf ↗

Probability distributions produced by the cross-entropy loss for ordinal classification problems can possess undesired properties. We propose a straightforward technique to constrain discrete ordinal probability distributions to be unimodal via the use of the Poisson and binomial probability distributions. We evaluate …

2017-05-15abs ↗pdf ↗

When predictions support decisions they may influence the outcome they aim to predict. We call such predictions performative; the prediction influences the target. Performativity is a well-studied phenomenon in policy-making that has so far been neglected in supervised learning. When ignored, performativity surfaces as…

2020-02-16abs ↗pdf ↗

Paper introduces a method to predict molecule properties from diverse data sources.

problem Limited ability to accommodate scarce or fragmented training data.
method Adaptive Invariance using invariant risk minimization to generalize beyond heterogeneous data.
result Predictor outperforms state-of-the-art transfer learning methods by significant margin.

RAFT fine-tunes models using high-quality samples to align them with human preferences.

problem Aligning generative models with human ethics and preferences.
method RAFT selects high-quality samples, discards undesired behavior, and fine-tunes the model on filtered samples.
result RAFT improves model performance in reward learning and automated metrics.

Unbalanced minibatch Optimal Transport improves domain adaptation performance.

problem Optimal transport distances are computationally expensive for large datasets.
method Use unbalanced minibatch Optimal Transport to estimate distances over subsets of data.
result Unbalanced Optimal Transport leads to better domain adaptation results.

Approximately, 50 million people in the world are affected by epilepsy. For patients, the anti-epileptic drugs are not always useful and these drugs may have undesired side effects on a patient's health. If the seizure is predicted the patients will have enough time to take preventive measures. The purpose of this work…

2019-12-13abs ↗pdf ↗

Authentication is a task aiming to confirm the truth between data instances and personal identities. Typical authentication applications include face recognition, person re-identification, authentication based on mobile devices and so on. The recently-emerging data-driven authentication process may encounter undesired …

2019-05-16abs ↗pdf ↗