Bayesian neural networks approximate Student-t processes in the infinite-width limit.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Student- processes have recently been proposed as an appealing alternative non-parameteric function prior. They feature enhanced flexibility and predictive variance. In this work the use of Student- processes are explored for multi-objective Bayesian optimization. In particular, an analytical expression for the h…
Gaussian process priors are commonly used in aerospace design for performing Bayesian optimization. Nonetheless, Gaussian processes suffer two significant drawbacks: outliers are a priori assumed unlikely, and the posterior variance conditioned on observed data depends only on the locations of those data, not the assoc…
We investigate the Student-t process as an alternative to the Gaussian process as a nonparametric prior over functions. We derive closed form expressions for the marginal likelihood and predictive distribution of a Student-t process, by integrating away an inverse Wishart process prior over the covariance kernel of a G…
Proposes a new Bayesian mixture of student-t processes for modeling non-stationary data.
The aim of this article is to design a moment transformation for Student- t distributed random variables, which is able to account for the error in the numerically computed mean. We employ Student-t process quadrature, an instance of Bayesian quadrature, which allows us to treat the integral itself as a random variable…
TPLVM models portfolio construction for non-Gaussian financial data.
Elliptical processes generalize Gaussian and Student-t models with fat tails and computational efficiency.
Gaussian process model for vector-valued function has been shown to be useful for multi-output prediction. The existing method for this model is to re-formulate the matrix-variate Gaussian distribution as a multivariate normal distribution. Although it is effective in many cases, re-formulation is not always workable a…
This study models target trajectories using stochastic processes for efficient tracking.
Exponential family distributions are highly useful in machine learning since their calculation can be performed efficiently through natural parameters. The exponential family has recently been extended to the t-exponential family, which contains Student-t distributions as family members and thus allows us to handle noi…
We consider the problem of learning the level set for which a noisy black-box function exceeds a given threshold. To efficiently reconstruct the level set, we investigate Gaussian process (GP) metamodels. Our focus is on strongly stochastic samplers, in particular with heavy-tailed simulation noise and low signal-to-no…
Elliptical processes extend Gaussian models with heavier tails.
NK bandits improve performance on nonlinear tasks.
Proposes a new method to extend Gaussian processes for non-Gaussian data.
Proposes scale mixture of NNGPs for more flexible stochastic processes.
New method uses minimal assumptions for machine learning, improving performance and speed.
Framework for real-time win probability and player ability in sports.
The study uses Hidden Markov Models to analyze student enrollment patterns and academic performance.
New framework for identifying spatial data components using TP latent components.
Predicts student performance in interactive online question pools using GNNs.
Proposes RaT to mitigate bias in student-teacher estimation.
Enhances student diversity in collaborative learning.
Student performance modelling (SPM) is a critical step to assessing and improving students performances in their learning discourse. However, most existing SPM are based on statistical approaches, which on one hand are based on probability, depicting that results are based on estimation; and on the other hand, actual i…
This dissertation reports work where physics methods are applied to financial and economical problems. The first part studies stock market data (chapter 1 to 5). The second part is devoted to personal income in the USA (chapter 6). We first study the probability distribution of stock returns at mesoscopic time lags (re…
Each year, roughly 30% of first-year students at US baccalaureate institutions do not return for their second year and over $9 billion is spent educating these students. Yet, little quantitative research has analyzed the causes and possible remedies for student attrition. Here, we describe initial efforts to model stud…
Deep neural networks bring in impressive accuracy in various applications, but the success often relies on the heavy network architecture. Taking well-trained heavy networks as teachers, classical teacher-student learning paradigm aims to learn a student network that is lightweight yet accurate. In this way, a portable…
Student-teacher learning improves generalization with noisy inputs.
A new teacher-class network method compresses DNNs by distributing knowledge to multiple student networks.
Contributions: Prior studies on education have mostly followed the model of the cross sectional study, namely, examining the pretest and the posttest scores. This paper shows that students' knowledge throughout the intervention can be estimated by time series analysis using a hidden Markov model. Background: Analyzing …
In this paper we do the first large scale analysis of writing style development among Danish high school students. More than 10K students with more than 100K essays are analyzed. Writing style itself is often studied in the natural language processing community, but usually with the goal of verifying authorship, assess…
An important, yet largely unstudied, problem in student data analysis is to detect misconceptions from students' responses to open-response questions. Misconception detection enables instructors to deliver more targeted feedback on the misconceptions exhibited by many students in their class, thus improving the quality…
Bayesian model identifies skill difficulties and student subgroups in engineering education.
Improved ImageNet classification with semi-supervised learning.
Modeling student behaviors and multiple predictions for early intervention.
Estimates model performance from compute budget for distillation.
Distilled models often fail to match teacher models, despite improving generalization.
A new method for student-initiated action advice using novelty detection.
In recent years, distance education has enjoyed a major boom. Much work at The Open University (OU) has focused on improving retention rates in these modules by providing timely support to students who are at risk of failing the module. In this paper we explore methods for analysing student activity in online virtual l…
The increasingly fast development cycle for online course contents, along with the diverse student demographics in each online classroom, make real-time student outcomes prediction an interesting topic for both industrial research and practical needs. In this paper, we tackle the problem of real-time student performanc…
Increasingly fast development and update cycle of online course contents, and diverse demographics of students in each online classroom, make student performance prediction in real-time (before the course finishes) and/or on curriculum without specific historical performance data available interesting topics for both i…
Explains Cartan geometries for graduate students.
Improved image reconstruction using VAEs with Student's t-prior.
Performing knowledge transfer from a large teacher network to a smaller student is a popular task in modern deep learning applications. However, due to growing dataset sizes and stricter privacy regulations, it is increasingly common not to have access to the data that was used to train the teacher. We propose a novel …
Study predicts academic achievement using students' support networks.
Self-training with noisy student-teacher boosts keyword spotting accuracy.
Student performance prediction - where a machine forecasts the future performance of students as they interact with online coursework - is a challenging problem. Reliable early-stage predictions of a student's future performance could be critical to facilitate timely educational interventions during a course. However, …
Deep convolutional neural networks have been widely used in numerous applications, but their demanding storage and computational resource requirements prevent their applications on mobile devices. Knowledge distillation aims to optimize a portable student network by taking the knowledge from a well-trained heavy teache…