Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

4759491,4241,898 · Jun 202019922001200920172026
48 results for binary generalized linear models

BELIEF framework interprets GLMs using binary linear models.

problem Understanding and interpreting generalized linear models (GLMs) with binary outcomes.
method Developed a framework called binary expansion linear effect (BELIEF) to interpret GLMs through transparent linear models.
result BELIEF framework reveals perfect predictors in complete separation scenarios.

BEGIN network models binary data without parametric assumptions.

problem Conditional independence in non-parametric families of binary data.
method BEGIN network models binary data using sparse linear representations and block factorizations.
result BEGIN network captures conditional independence for arbitrary binary and multinomial variables.

Sharp bounds on uniform generalization errors in binary linear classification.

problem Understanding the uniform generalization errors in binary linear classification.
method Isoperimetric arguments, Poincaré and log-Sobolev inequalities for joint distributions.
result Sharp concentration bounds on uniform generalization errors, almost sure convergence in broad settings.

The paper analyzes how overparameterized models can generalize well in multiclass classification.

problem Generalization in multiclass classification with overparameterized models.
method Survival/contamination analysis framework adapted for multiclass classification.
result Multiclass classification can generalize well even with many classes, unlike regression tasks.

Algorithm BGLM-OFU minimizes regret in combinatorial causal bandits with binary models.

problem Minimizing expected regret in combinatorial causal bandits with binary generalized linear models.
method BGLM-OFU algorithm based on maximum likelihood estimation for Markovian BGLMs, and causal inference techniques for linear models with hidden variables.
result Achieves O(TlogT)O(\sqrt{T}\log T) regret for binary generalized linear models.

Probit regression was first proposed by Bliss in 1934 to study mortality rates of insects. Since then, an extensive body of work has analyzed and used probit or related binary regression methods (such as logistic regression) in numerous applications and fields. This paper provides a fresh angle to such well-established…

2018-02-01abs ↗pdf ↗

Batch normalization biases linear models towards uniform margins, improving performance in binary classification.

problem Understanding the implicit bias of batch normalization in linear models and neural networks.
method Analyzing gradient descent convergence on linear models and two-layer CNNs with batch normalization.
result Gradient descent with batch normalization in linear models converges to a uniform margin classifier with an exponential convergence rate.

Regularized linear regression improves binary classification performance, especially with ridge and 1\ell_1 regularization.

problem Improving binary classification accuracy with noisy labels.
method Systematic study of regularization strengths on linear classifiers trained on noisy binary classification data.
result Ridge regression consistently improves classification error, while 1\ell_1 regularization can induce sparsity and \ell_\infty regularization can concentrate weights to two values.

Linear Mixed Models (LMMs) are important tools in statistical genetics. When used for feature selection, they allow to find a sparse set of genetic traits that best predict a continuous phenotype of interest, while simultaneously correcting for various confounding factors such as age, ethnicity and population structure…

2015-07-16abs ↗pdf ↗

New algorithm recovers sparse binary vectors from generalized linear measurements efficiently.

problem Recovering sparse binary vectors from generalized linear measurements.
method Linear estimation algorithm and information theoretic lower bounds.
result Optimal sample complexity of O((k+σ2)logn)O((k+σ^2)\log{n}) for noisy one bit quantized linear measurements.

New method simplifies Bayesian analysis for categorical data.

problem Difficulties in scaling GLMs for categorical data due to non-conjugacy or posterior dependencies.
method Defining CB models with binary approximations for tractable inference.
result Fast and scalable inference for thousands of categories, outperforming competitors.

Study shows fine-tuned linear models outperform pretrained ones in transfer learning.

problem Transfer learning and fine-tuning in linear models for regression and binary classification.
method Stochastic gradient descent on pretrained linear models with small target data sets.
result Fine-tuned models outperform pretrained ones under certain conditions.

ENTED efficiently decomposes binary and count tensors using nonparametric Gaussian processes.

problem Handling high-dimensional and sparse binary and count data with traditional tensor decompositions.
method ENTED uses nonparametric Gaussian processes and sparse orthogonal variational inference to handle binary and count tensors.
result ENTED outperforms traditional methods in binary and count tensor completion tasks.

Grokking occurs in simple binary logistic classification near linear separability and noise.

problem Delayed generalization in binary logistic classification.
method Analytical and empirical insights into gradient descent dynamics near critical points.
result Logistic regression exhibits grokking when training data is nearly linearly separable from the origin with strong noise.

The technological applications of hidden Markov models have been extremely diverse and successful, including natural language processing, gesture recognition, gene sequencing, and Kalman filtering of physical measurements. HMMs are highly non-linear statistical models, and just as linear models are amenable to linear a…

2012-06-03abs ↗pdf ↗

Our paper examines binary linear classification under Gaussian mixtures, revealing conditions for optimal performance.

problem Understanding the conditions for optimal performance of binary linear classifiers under Gaussian mixtures.
method We study max-margin SVM and min-norm interpolating classifiers, deriving bounds and conditions for optimal performance.
result Interpolating estimators achieve asymptotically optimal performance under certain conditions, emphasizing the role of SNR and covariance.

This paper optimizes binary linear classifiers by tuning their weight vectors.

problem Optimizing the weight vector of binary linear classifiers for better performance.
method Parameterization of the discriminant through a scalar to control trade-offs between informative and noisy terms.
result Weight vector tuning compensates for non-optimal native hyperparameters, improving classification performance.

Erbium-doped fiber amplifier (EDFA) is an optical amplifier/repeater device used to boost the intensity of optical signals being carried through a fiber optic communication system. A highly accurate EDFA model is important because of its crucial role in optical network management and optimization. The input channels of…

2019-02-05abs ↗pdf ↗

Optimizes binary regression models with gradient ascent-descent methods.

problem Regression problems with binary weights in quantized learning and digital communication.
method Maximin optimization using gradient ascent-descent methods.
result The approach is optimal in linear regression with low noise and robust regression with few outliers.

Sparse generalized additive models (GAMs) are an extension of sparse generalized linear models which allow a model's prediction to vary non-linearly with an input variable. This enables the data analyst build more accurate models, especially when the linearity assumption is known to be a poor approximation of reality. …

2019-12-04abs ↗pdf ↗

SMD outperforms SGD in over-parametrized linear models for certain data distributions.

problem Understanding the generalization performance of SMD in over-parametrized linear models.
method Analysis of SMD for over-parametrized linear models with binary classification.
result Empirical validation of SMD's generalization performance differing from SGD.

New method for estimating gradients in stochastic binary networks.

problem Challenges in training neural networks with binary activations and weights.
method Combines sampling and analytic approximation steps to estimate gradients accurately.
result Significantly reduced variance at the cost of small bias, leading to practical tradeoffs.

We introduce Supersparse Linear Integer Models (SLIM) as a tool to create scoring systems for binary classification. We derive theoretical bounds on the true risk of SLIM scoring systems, and present experimental results to show that SLIM scoring systems are accurate, sparse, and interpretable classification models.

2013-06-25abs ↗pdf ↗

Exact simulation of correlated binary outcomes using PMF constraints and linear programming.

problem Simulating dependent Bernoulli outcomes with specific means and correlations.
method Formulate the problem over the joint Bernoulli PMF, impose constraints, and solve as a linear program. Use convex-hull characterization and truncated-moment completion scheme for feasibility and simulation.
result Exact simulation framework for correlated binary outcomes, providing a convex-hull characterization and truncated-moment completion scheme.

New algorithm optimizes AUC in binary classification and changepoint detection.

problem Difficult to optimize AUC in binary classification and changepoint detection.
method Proposes efficient path-following algorithms for choosing optimal learning rate.
result Proposed line search algorithm computes complete AUM/AUC representation.

Proposes a differentiable structure learning framework for general binary data.

problem Limitations of existing methods in discrete data structure learning.
method Formulates a differentiable optimization task for arbitrary dependencies in general discrete models.
result Establishes identifiability of complete set of compatible parameters and structures under mild assumptions.

Defines diversification as a binary relationship between financial portfolios.

problem Defines diversification in a new binary relationship for financial portfolios.
method Proposes a new definition of diversification based on convex linear combinations and second order stochastic dominance.
result The proposed definition coincides with second order stochastic dominance.

A new method for binary ICA using non-stationary sources.

problem Independent component analysis of binary data.
method Linear mixing model in latent space, followed by binary observation model with non-stationary sources.
result Proves non-identifiability with few observed variables but identifies with more variables.

This paper optimizes retraining models using their own predictions and noisy labels.

problem Improving model performance through optimal retraining of noisy labels.
method Developed a principled framework based on approximate message passing (AMP) to analyze iterative retraining procedures.
result Derivation of the Bayes optimal aggregator function to minimize prediction error.

The paper analyzes binary option markets with exogenous information and price sensitivity.

problem Analyzing binary option markets with exogenous information and price sensitivity.
method Derive and analyze a continuous model of binary option markets with exogenous information, using Filippov surfaces and general assumptions on purchasing rules.
result Price always converges when exogenous information is constant, and price sensitivity affects price lag vs. information.

The paper optimizes hyperplanes for binary classification in high-dimensional data with latent Gaussian mixtures.

problem Binary classification in high-dimensional data with latent Gaussian mixtures.
method Generalized least squares estimator for estimating the direction of the optimal separating hyperplane. Simple correction for intercept estimation.
result The procedure is minimax optimal in many scenarios and can retain the interpolation property.

Unified framework for binary responses using AUC loss and low-rank constraint.

problem Statistical inefficiency and shared structure in fitting multiple binary responses.
method Pairwise AUC loss aggregation with low-rank constraint, scalable projected gradient descent.
result Unified framework outperforms likelihood-based approaches in challenging settings.

Gradient flow on ReLU networks converges to a simple model with few regions.

problem Understanding the dynamics of gradient flow in shallow ReLU networks.
method Analysis of gradient flow dynamics on univariate ReLU neural networks.
result Gradient flow converges to a network with at most O(r) linear regions.

We introduce several techniques for sampling and visualizing the latent spaces of generative models. Replacing linear interpolation with spherical linear interpolation prevents diverging from a model's prior distribution and produces sharper samples. J-Diagrams and MINE grids are introduced as visualizations of manifol…

2016-09-14abs ↗pdf ↗