A new method for distilling predictions from a teacher model to a student model without original training data.
problem Training without original labeled data.
method Prediction-only distillation scheme for linear and logistic regression.
result Prediction mixing can outperform both the teacher and pure-distilled models.
We are concerned with modeling the strength of links in networks by taking into account how often those links are used. Link usage is a strong indicator of how closely two nodes are related, but existing network models in Bayesian Statistics and Machine Learning are able to predict only wether a link exists at all. As …
High throughput sequencing techniques have highly impactedon modern biology, widening the gap between sequenced andannotated data. Automatic annotation tools are thereforeof the foremost importance to guide biologists' experiments. However, most of the state-of-the-art methods rely on annotation transfer, offering reli…
Quantile TD learning outperforms classical TD learning for value estimation.
problem Temporal-difference learning in reinforcement learning.
method Quantile Temporal-Difference Learning (QTD) for policy evaluation.
result QTD offers superior performance to classical TD learning, even in tabular settings.
In safety-critical applications a probabilistic model is usually required to be calibrated, i.e., to capture the uncertainty of its predictions accurately. In multi-class classification, calibration of the most confident predictions only is often not sufficient. We propose and study calibration measures for multi-class…
MD-split+ creates locally valid prediction regions for complex data.
problem Localized prediction regions for complex data.
method Localized model performance-based partitioning of feature space X.
result MD-split+ creates valid prediction regions that scale to high dimensions.
Proofs show finite subgroups of homeomorphism groups are almost nilpotent.
problem Finite subgroups of homeomorphism groups of compact topological manifolds.
method Finite group theoretic results provide a general strategy for proving Jordan-type theorems.
result Proof of the revised Ghys conjecture about nilpotent normal subgroups.
We are now witnessing the increasing availability of event stream data, i.e., a sequence of events with each event typically being denoted by the time it occurs and its mark information (e.g., event type). A fundamental problem is to model and predict such kind of marked temporal dynamics, i.e., when the next event wil…
By design, discriminatively trained neural network classifiers produce reliable predictions only for in-distribution samples. For their real-world deployments, detecting out-of-distribution (OOD) samples is essential. Assuming OOD to be outside the closed boundary of in-distribution, typical neural classifiers do not c…
The paper improves polyphonic music models by extracting salient features.
problem Improving performance of polyphonic music models.
method Training a neural network to predict both chords and notes, including extra features.
result Training a neural network to predict extra features improves model performance.
Efficiently trains deep Gaussian processes with sparse approximations.
problem High computational complexity in training and inference for DGP models.
method Tensor Markov Gaussian Processes (TMGP) and hierarchical expansion to create DTMGP model.
result DTMGP model achieves superior computational efficiency compared to existing DGP models.
Paper proposes faster adaptation to distribution shifts in online settings.
problem Violation of exchangeability assumption in evolving data environments.
method Online conformal inference with retrospective adjustment.
result Faster adaptation to distributional shifts demonstrated through numerical studies.
Accurate time series prediction over long future horizons is challenging and of great interest to both practitioners and academics. As a well-known intelligent algorithm, the standard formulation of Support Vector Regression (SVR) could be taken for multi-step-ahead time series prediction, only relying either on iterat…
A framework to explain decoder-only sequence classification models using intermediate predictions.
problem Explaining predictions of decoder-only sequence classification models.
method Progressive Inference framework with Single Pass-Progressive Inference and Multi Pass-Progressive Inference methods.
result Significantly better attributions compared to prior work on text classification tasks.
BART is extended to handle various response variables.
problem Modeling nonlinear regression functions for diverse response types.
method Generalized Bayesian Additive Regression Trees (GBART) for exponential family distributions.
result The posterior concentrates at a minimax rate for certain response distributions.
Bayesian optimization of antibodies learns from immune system evolution.
problem Efficiently optimizing antibody sequences in a large space of possibilities.
method Bayesian optimization guided by a generative model of evolving antibody sequences.
result CloneBO optimizes antibodies more efficiently than previous methods.
This study tackles mutual fund portfolio prediction, focusing on novel items.
problem Predicting novel items in mutual fund portfolios is challenging and less explored.
method Created a comprehensive benchmark dataset and evaluated various recommender system models.
result Autoencoder-based approaches outperform state-of-the-art models in predicting novel items.
The paper aims to mathematically define and learn abstractions from data.
problem Defining and learning abstractions from data.
method Characterize abstractions as summaries for answering queries, define leakiness as a loss function, and generalize classical statistics.
result A mathematical theory of abstraction can be learned from data.
This work approximates full conformal prediction for neural networks without sample splitting.
problem Uncertainty quantification for neural network regression models.
method Approximating full conformal prediction using Gauss-Newton influence for post-hoc uncertainty estimation.
result Locally-adaptive and often tighter prediction intervals compared to split-CP.
The objective of this work is to study the applicability of various Machine Learning algorithms for prediction of some rock properties which geoscientists usually define due to special lab analysis. We demonstrate that these special properties can be predicted only basing on routine core analysis (RCA) data. To validat…
UCSL combines clustering with supervised learning to discover interpretable subtypes.
problem Discovering interpretable subtypes in datasets relevant to supervised tasks.
method UCSL (Unsupervised Clustering driven by Supervised Learning) framework integrating clustering and supervised learning.
result UCSL achieves +1.9 points in balanced accuracy for psychiatric diseases clustering.
COMA combines prediction sets from multiple models for online, adaptive prediction.
problem Combining multiple prediction models with uncertainty guarantees.
method Online model aggregation using weighted voting of conformal prediction sets.
result COMA retains coverage guarantees under negative correlation assumptions.
Active learning selects most informative unlabeled samples for labeling.
problem Efficiently label unlabeled data in applications with scarce labeled data.
method Formulated as open-set recognition, uses VNNs to identify uncertain samples.
result Achieved state-of-the-art results on MNIST, CIFAR-10, and CIFAR-100.
This paper tackles graph translation challenges by predicting both node and edge attributes simultaneously.
problem Challenges in predicting both node and edge attributes in graph translation, especially in interactive, iterative, and asynchronous processes.
method Developed a novel framework integrating both node and edge translations seamlessly, using spectral graph regularization to maintain consistency.
result Demonstrated the effectiveness of the proposed method on both synthetic and real-world application data.
We consider the problem of predicting the next observation given a sequence of past observations, and consider the extent to which accurate prediction requires complex algorithms that explicitly leverage long-range dependencies. Perhaps surprisingly, our positive results show that for a broad class of sequences, there …
This research improves financial market predictions using LSTM networks.
problem Accurate real-time forecasting of financial time series.
method Sequentially trained many-to-one LSTMs with adaptive training epochs.
result Our approach maintains superior accuracy as predictions are made further in the future.
Meta-learning framework for few-shot one-class classification using order-equivariant networks.
problem Few labeled examples for positive class in one-class classification tasks.
method Order-equivariant networks for meta-learning a binary classifier conditioned on positive examples.
result Meta-learning framework outperforms baselines on unseen synthetic streams.