Improved variational inference by enforcing consistency with linear response.
problem Inconsistent variational approximations in inference methods.
method Introducing constraints on covariance to ensure consistency with linear response.
result Improvement in marginal probability distribution inference.
The paper provides risk bounds for learning many response functions using linear regression.
problem Learning many response functions from a single dataset.
method Ordinary least squares regression in a high-dimensional feature space.
result Convergence guarantees on worst-case excess prediction risk for infinite response functions with finite VC dimension.
Efficient methods for linear/logistic regression with network-dependent responses.
problem Regression with dependent responses in networked data.
method Projected gradient descent on negative log-likelihood, proving strong convexity and consistency.
result Strong consistency results for vector of coefficients and dependency strength.
We simplify complex regression coefficients using linearization and feature comparison.
problem Interpreting high-dimensional regression coefficients from nonlinear responses.
method Developed a linearization method to derive feature coefficients and compare them with regression coefficients.
result Shows how regression coefficients relate to linearized feature coefficients and how they change under regularization.
New deep learning model improves impulse response estimation.
problem Impulse response estimation of stable linear systems.
method Data-driven deep learning model.
result New model captures more hidden patterns in data.
Study robust linear regression without distributional assumptions for heavy-tailed responses.
problem Linear regression with heavy-tailed responses and no distributional assumptions.
method Combining truncated least squares, median-of-means, and aggregation theory to construct a non-linear estimator.
result Achieves excess risk of order d/n with optimal sub-exponential tail. Predicts individual septic shock children's vasoactive response using RNN.
problem Personalized physiologic responses to vasoactive titrations in septic shock children.
method Retrospective analysis of EMR data using a Recurrent Neural Network (RNN).
result RNN model predicted physiologic responses more accurately than a linear model.
Extends RRR to capture nonlinear interactions in multi-response regression.
problem Complex relationships in real-world data cannot be adequately modeled by linear interactions.
method Introduces Higher Order Reduced Rank Regression (HORRR) using tensor representations and Tucker decomposition.
result HORRR can capture nonlinear interactions in multi-response regression.
Volume sampling technique improves linear regression predictions.
problem Predict hidden response values for a subset of input points in linear regression.
method Reverse iterative volume sampling for constructing linear predictions.
result Volume sampled subproblem yields an unbiased estimator of the optimal solution.
FPP creates interpretable 2D embeddings for high-dimensional data.
problem Discovering interpretable relationships in high-dimensional data.
method Function preserving projections (FPP) for scalable linear embeddings.
result FPP reveals non-linear patterns of user-selected response functions.
Enhances preference learning by incorporating response times into binary choices.
problem Limited information from binary choices about preference strength.
method Combines choices and response times using the EZ diffusion model.
result Response times improve utility estimation for strong preferences.
Paper investigates optimal interpolation methods in linear regression.
problem Understanding when interpolating methods generalize well in linear regression.
method Investigates optimal response-linear interpolators using functions linear in the response variable.
result Provides a closed-form expression for the optimal interpolator and shows it can be derived as the limit of gradient descent.
We bridge statistical and worst-case approaches to experimental design for linear regression.
problem Designing efficient experiments for linear regression models with arbitrary responses.
method Propose a new experimental design framework for arbitrary response distributions, combining statistical and worst-case approaches.
result Develop efficient randomized design procedures achieving strong variance bounds for unbiased estimators using few responses.
Study on recovering sparse linear classifiers from mixed binary responses.
problem Learning a mixture of sparse linear classifiers from binary responses.
method Query-based approach to identify all sparse vectors from a set.
result Upper bounds on the number of queries required for recovery.
The paper introduces tools for designing responsible scoring mechanisms using unbiased function sampling.
problem Ensuring fairness and responsibility in scoring mechanisms used by data-driven systems.
method Unbiased function sampling and perturbation in the function space for designing responsible scoring mechanisms.
result A novel algorithm for approximating the construction of hyperplane arrangements, which is linear in the number of samples and hyperplanes.
Interpretable text-response modelling for structured outcomes
problem Predicting structured responses alongside textual data
method Joint non-negative matrix factorisation and binomial regression
result Recovering stable response-relevant textual signals
Study learns linear utility functions from comparisons, showing learnability gaps between passive and active learning.
problem Learn linear utility functions from pairwise comparison queries.
method Analyzes passive and active learning settings, considering noise-free and noisy query responses.
result Efficient learnability of linear utilities in passive learning, but not for utility parameters without strong assumptions.
Mean field variational Bayes (MFVB) is a popular posterior approximation method due to its fast runtime on large-scale data sets. However, it is well known that a major failing of MFVB is that it underestimates the uncertainty of model variables (sometimes severely) and provides no information about model variable cova…
The paper tackles linear regression without knowing the correspondence between variables.
problem Linear regression without known correspondence between variables.
method The paper provides a fully polynomial-time approximation scheme and an efficient algorithm based on lattice basis reduction.
result The efficient algorithm can exactly recover the unknown linear function in arbitrary dimension.
New geometric theory explains nonuniform origami responses.
problem Understanding nonuniform responses in origami sheets.
method Purely geometric continuum theory capturing nonuniform, nonlinear response.
result Three modes govern nonuniform response, varying smoothly across the sheet.
New neural network models for complex functional data analysis.
problem Complex relations between functional predictors and responses.
method Function-on-Function regression models using neural networks with continuous hidden layers.
result Demonstrated power and flexibility in handling complex functional models.
Study price responsiveness in electricity demand using empirical data.
problem Limited effectiveness of classical economic theories in real-time retail pricing.
method Dynamic modeling of hybrid Hammerstein model with delay and linear ARX model.
result Electricity consumption has distinct responses to moderate and high prices with a time delay.
Unified framework for binary responses using AUC loss and low-rank constraint.
problem Statistical inefficiency and shared structure in fitting multiple binary responses.
method Pairwise AUC loss aggregation with low-rank constraint, scalable projected gradient descent.
result Unified framework outperforms likelihood-based approaches in challenging settings.
CNNs accurately model retinal responses to natural scenes.
problem Understanding neural computations in retinal responses to natural stimuli.
method Deep convolutional neural networks (CNNs) were used to model retinal responses to natural scenes.
result CNNs are more accurate than linear models in predicting retinal responses to natural scenes.
A new tree-based model for multivariate responses interprets piecewise linear regimes.
problem Recovering piecewise multivariate linear regimes in complex data.
method Twoblock clustering trees with coskewness-based dimension reduction.
result Recovery of piecewise linear regimes in data.
Objects are represented in sensory systems by continuous manifolds due to sensitivity of neuronal responses to changes in physical features such as location, orientation, and intensity. What makes certain sensory representations better suited for invariant decoding of objects by downstream networks? We present a theory…
Regularized least-squares approaches have been successfully applied to linear system identification. Recent approaches use quadratic penalty terms on the unknown impulse response defined by stable spline kernels, which control model space complexity by leveraging regularity and bounded-input bounded-output stability. T…
Statistical properties of order-driven double-auction markets with Bid-Ask spread are investigated through the dynamical quantities such as response function. We first attempt to utilize the so-called {\it Madhavan-Richardson-Roomans model} (MRR for short) to simulate the stochastic process of the price-change in empir…
Projected random forests improve circular data prediction with adaptive arc length and finite-sample coverage.
problem Regression with circular responses.
method Adapting linear-response models to circular data using projection and random forest out-of-bag mechanism.
result Projected random forest out-of-bag conformal prediction sets are more efficient and shorter than alternative methods.
In this paper, we consider a generalized multivariate regression problem where the responses are monotonic functions of linear transformations of predictors. We propose a semi-parametric algorithm based on the ordering of the responses which is invariant to the functional form of the transformation function. We prove t…
SLIMs hybridize sparse linear and isotonic models for high-dimensional data.
problem High-dimensional data with non-linear relationships.
method Hybridizing sparse linear models and isotonic models, proposing a two-step algorithm for estimation.
result The algorithm accurately estimates sparse parameters and monotone functions.
Study examines how body segments respond to random vibrations.
problem Understanding human body responses to random vibrations.
method 35 participants were tested with random noise signals. Multiple linear regression models were created to determine influential predictors of peak translational gains.
result Multiple predictors, including motion direction and body segment, significantly influence peak translational gains.
A new method improves SSVEP BCI to recognize responses in sub-second time with high accuracy.
problem Achieving high accuracy in SSVEP BCI with short response times.
method CSTA (Combining Spatial-Filtering and Temporal Alignment) method.
result CSTA achieves maximum mean accuracy of 97.43% in sub-second response time.
DynNet models dynamic responses of linear and nonlinear systems with fewer variables and higher accuracy.
problem Predicting dynamic responses of linear and nonlinear systems.
method Physics-based recurrent neural network with optimized architecture and training techniques.
result Higher accuracy and fewer trainable variables compared to existing models.
When approximating a black-box function, sampling with active learning focussing on regions with non-linear responses tends to improve accuracy. We present the FLOLA-Voronoi method introduced previously for deterministic responses, and theoretically derive the impact of output uncertainty. The algorithm automatically p…
Optimal treatment assignment reduces demand response signal variance.
problem Accurately estimating demand response impact with limited signals and covariates.
method Formulated as a multivariate linear model, used randomized assignment and a strategic algorithm.
result Strategic assignment achieves optimal variance reduction, independent of covariates.
Neural networks simplify uncertainty quantification of locally nonlinear systems.
problem Estimating statistics of responses in large-scale locally nonlinear dynamical systems.
method Decomposes response into nominal linear system and a neural network-estimated pseudoforce.
result Neural networks can efficiently estimate pseudoforce containing nonlinear and uncertain information.
The classical approach to linear system identification is given by parametric Prediction Error Methods (PEM). In this context, model complexity is often unknown so that a model order selection step is needed to suitably trade-off bias and variance. Recently, a different approach to linear system identification has been…
The paper develops exact and approximate conformal inference methods for multi-output regression.
problem Uncertainty quantification in multi-output regression predictions.
method Exact derivations and approximations of conformal inference p-values for linear multi-output predictors, and efficient methods for nonlinear predictors.
result Efficient methods for approximating conformal prediction regions for multi-output predictors, both linear and nonlinear.
Neural models improve GLMMs for complex data.
problem Nonlinear relationships in grouped data.
method Replaced linear function with neural networks.
result Improved performance on synthetic and real-world data.
New model corrects and predicts manifold-valued data with gross errors.
problem Regression on manifold-valued data with gross errors.
method Correction via geodesic curves followed by multivariate linear regression.
result Empirically, model outperforms others in identifying and correcting gross errors.
A family of parsimonious Gaussian cluster-weighted models is presented. This family concerns a multivariate extension to cluster-weighted modelling that can account for correlations between multivariate responses. Parsimony is attained by constraining parts of an eigen-decomposition imposed on the component covariance …
The paper enhances preference learning by incorporating response time data.
problem Lack of temporal information in user decision-making for reward model learning.
method Integrates response time alongside binary choice data using the EZ model and Neyman-orthogonal loss functions.
result Response time-augmented approach reduces error rates from exponential to polynomial scaling, improving sample efficiency.
POTD estimates SDR subspace using optimal transport for binary response.
problem Insufficient performance of existing SDR methods for categorical responses.
method Principal optimal transport direction (POTD) using optimal transport coupling.
result POTD exclusively estimates SDR subspace for error-free class labels.
New method reconstructs brain stimuli from responses.
problem Reconstructing perceived stimuli from brain responses.
method Combining probabilistic inference and adversarial training of neural networks.
result Generates state-of-the-art reconstructions of perceived faces.
Estimates personalized treatment response curves using covariates.
problem Flexible estimation of personalized treatment response curves.
method Sieve based nonparametric estimator of smoothed regimen-response curve function.
result Asymptotic linearity and undersmoothing criteria for efficient estimation.
Self-Tuning Networks optimize hyperparameters using bilevel optimization and gated best-response functions.
problem Optimizing hyperparameters for neural networks.
method Bilevel optimization with gated best-response functions to adapt regularization hyperparameters online.
result Self-Tuning Networks outperform fixed hyperparameter values on large-scale deep learning problems.
New mathematical foundations for stable RKHSs improve system identification.
problem Improving stability tests and modeling of impulse responses.
method Providing new structural properties and stability conditions for stable RKHSs.
result Any stable kernel admits feature maps induced by orthogonal eigenvectors in l2.