MO-GP models fill gaps in biophysical data with across-domain info transfer.
problem Gap filling of biophysical parameters LAI and fAPAR over rice areas.
method Multi-output Gaussian Processes (MO-GP) based on Linear Model of Coregionalization (LMC).
result MO-GP models successfully predict biophysical variables even in high missing data regimes.
A new neural network model predicts inflation and output gap more accurately.
problem Traditional Phillips curves struggle with unobserved inflation expectations and output gaps.
method Hemisphere Neural Network (HNN) that estimates latent states for inflation and output gap.
result HNN accurately forecasts inflation and identifies a large positive output gap starting from late 2020.
Extracurricular learning closes the accuracy gap in knowledge distillation.
problem Accuracy gap between teacher and student models after knowledge distillation.
method Modeling student and teacher output distributions, sampling from an extended data distribution, and matching over this set.
result Extracurricular learning reduces the accuracy gap by 46% to 68%.
Optimal algorithms identify non-dominated arms in multi-output linear bandit models.
problem Identifying the Pareto Set in multi-output linear bandit models.
method Design-based algorithms for Pareto Set Identification (PSI) in a structured multi-output linear bandit model.
result Nearly optimal guarantees in both fixed-budget and fixed-confidence settings.
Proposes GPLFR for predicting high-dimensional outputs with few data.
problem Predicting high-dimensional outputs from limited data.
method GPLFR combines Gaussian process and linear-Gaussian decoding for high-dimensional prediction.
result GPLFR outperforms existing methods in predicting high-dimensional outputs.
New algorithm identifies good arms with fewer samples when thresholds are close.
problem Good arm identification in bandit problems with small threshold gaps.
method Proposes lil'HDoC algorithm to improve GAI under small threshold gaps.
result Sample complexity of first λ output arm is nearly identical to HDoC algorithm when thresholds are close.
Multi-output learning aims to simultaneously predict multiple outputs given an input. It is an important learning problem due to the pressing need for sophisticated decision making in real-world applications. Inspired by big data, the 4Vs characteristics of multi-output imposes a set of challenges to multi-output learn…
A computer code can simulate a system's propagation of variation from random inputs to output measures of quality. Our aim here is to estimate a critical output tail probability or quantile without a large Monte Carlo experiment. Instead, we build a statistical surrogate for the input-output relationship with a modest …
This paper bounds meta-generalization gap using information theory.
problem Improving sample efficiency for new tasks in meta-learning.
method Information-theoretic upper bounds on meta-generalization gap for two meta-learning classes.
result Novel ITMI bounds for noisy iterative algorithms.
Study shows exponential gap in sample complexity between noisy and non-noisy recurrent neural networks.
problem Understanding the impact of noise on the sample complexity of recurrent neural networks.
method Analyzing noisy multi-layered sigmoid recurrent neural networks with independent noise and proving lower bounds.
result Exponential gap in sample complexity between noisy and non-noisy networks, even for small noise values.
WR-CP reduces prediction set size and coverage gap under distribution shift.
problem Guaranteed coverage under distribution shift not achievable with i.i.d. assumption.
method Wasserstein distance, probability measure pushforwards, importance weighting, regularized representation learning.
result Reduces coverage gap to 3.2% across different confidence levels.
We propose two methods for exact Gaussian process (GP) inference and learning on massive image, video, spatial-temporal, or multi-output datasets with missing values (or "gaps") in the observed responses. The first method ignores the gaps using sparse selection matrices and a highly effective low-rank preconditioner is…
BestChanID identifies the channel with maximal capacity using training sequences.
problem Identifying the channel with maximal capacity among several discrete memoryless channels.
method Formulated as a multi-armed bandit problem, proposed a capacity estimator, and developed gap-elimination algorithms.
result Guaranteed to output the DMC with the largest capacity with a desired confidence.
A bidirectional loss function improves label distribution learning and enhancement.
problem Challenges in label distribution learning and label enhancement.
method Bidirectional loss function to address dimensional gap and label enhancement.
result The bidirectional loss function improves the accuracy of label distribution learning and enhancement.
Paper introduces conformal prediction for reliable uncertainty quantification in landmark localization.
problem Systematic underestimation of total predictive uncertainty in landmark localization.
method Conformal prediction framework for multi-output regression, generating flexible prediction regions.
result Methods outperform existing approaches in validity and efficiency across 2D and 3D datasets.
New bound limits generalization gap for large models, independent of model complexity.
problem Understanding generalization gap in large-scale machine learning models.
method Established a model-independent upper bound for generalization gap using Rényi entropy.
result Generalization gap can be maintained with arbitrarily large models if data entropy is sufficient.
Chaos in cerebellar cells enhances complexity of neural patterns.
problem Understanding how cerebellar granular layer represents complex information.
method Constructed a model of cerebellar granular layer with gap junctions, evaluated using reservoir computing.
result Chaotic dynamics in the cerebellar granular layer produce complex and diverse output patterns.
Principal components analysis (PCA) is a standard tool for identifying good low-dimensional approximations to data in high dimension. Many data sets of interest contain private or sensitive information about individuals. Algorithms which operate on such data should be sensitive to the privacy risks in publishing their …
PointPainting fuses lidar and image data for better 3D object detection.
problem Lidar-only methods outperform fusion methods on 3D object detection benchmarks.
method Sequential fusion by projecting lidar points into image segmentation output and appending class scores.
result Significant improvements on state-of-the-art 3D object detection methods on KITTI and nuScenes datasets.
FFBO optimizes functions as inputs and outputs, improving on existing BO methods.
problem Optimizing functions as both inputs and outputs in complex systems.
method Function-on-function Gaussian process (FFGP) model with a separable operator-valued kernel, scalar upper confidence bound (UCB) acquisition function, and scalable functional gradient ascent algorithm (FGA).
result FFBO outperforms existing methods in synthetic and real-world data.
We present the first treatment of the arc length of the Gaussian Process (GP) with more than a single output dimension. GPs are commonly used for tasks such as trajectory modelling, where path length is a crucial quantity of interest. Previously, only paths in one dimension have been considered, with no theoretical con…
New method identifies key genes affecting phenotypes in biological systems.
problem Identifying genes that drive specific phenotypes in complex biological systems.
method Data-driven observability decomposition using Koopman operators.
result Koopman operator representation identifies genes that drive phenotypes.
Extends neural net safety guarantees by proving structural properties.
problem Proving formal guarantees for complex DNN architectures.
method Proves structural properties related to neural net structure to infer safety properties.
result Identifies a larger region of input space for safety properties.
Proposes a method to use generators as EBM foundations without latent inference.
problem Training EBMs from generator outputs without latent variables.
method Formulates a Hat EBM using generator outputs and residual variables.
result Strong performance on various generator tasks.
DRE combines DNN with random feature regression for efficient neural network design.
problem Designing and training deep neural networks (DNN) efficiently and effectively.
method DRE architecture with two-layer neural networks, randomly drawn input and output weights trained with linear ridge regression.
result DRE outperforms state-of-the-art DNN in many data sets with lower computational cost.
Optimizes target value in stochastic black box functions.
problem Finding input to minimize expected squared error to target value.
method Derives acquisition functions for expected improvement, probability of improvement, and lower confidence bound, assuming Gaussian aleatoric effects.
result Acquisition functions can outperform classical Bayesian optimization under certain conditions.
New method ranks sectors and countries using local and aggregate I-O data.
problem Ranking sectors and countries in global value chains using incomplete I-O tables.
method Rank-1 approximation to I-O tables using local and aggregate information. result Consistently good performance in reconstructing rankings of upstreamness and downstreamness.
This paper analyzes speculative decoding, a method to speed up large language model inferences.
problem Theoretical understanding of speculative decoding is lacking.
method Conceptualizes speculative decoding as a markov chain problem and studies its key properties.
result Reveals fundamental connections between LLM components and their impact on decoding efficiency.
This paper introduces Non-Autonomous Input-Output Stable Network(NAIS-Net), a very deep architecture where each stacked processing block is derived from a time-invariant non-autonomous dynamical system. Non-autonomy is implemented by skip connections from the block input to each of the unrolled processing stages and al…
Unified framework to bridge human and LLM judgments.
problem Systematic discrepancies between human and LLM evaluations.
method Latent human preference score and linear transformations of covariates.
result Higher agreement with human ratings and exposure of systematic gaps.
Paper proposes a new flatness measure for neural networks to improve generalization.
problem Generalization in deep learning models, especially with overparameterization.
method Soft rank measure of the Hessian to assess flatness and generalization.
result Soft rank flatness measure accurately estimates generalization gaps for various models.
New method fuses optical and SAR data to fill LAI gaps during cloudy periods.
problem Cloudy periods mask key crop growth stages, leading to unreliable yield predictions.
method Multi-Output Gaussian Process (MOGP) regression for fusing Sentinel-1 RVI and Sentinel-2 LAI time series.
result MOGP provides improved LAI estimations even during cloudy periods, especially for long gaps.
ARBITER learns SPX-VIX term structures without arbitrage constraints.
problem Arbitrage-free modeling of SPX-VIX term structures.
method Risk-neutral neural operator mapping market states to operator outputs enforcing static arbitrage constraints.
result ARBITER outperforms other models in derivatives term structure evaluation metrics.
New bounds estimate learning algorithm performance using prediction information.
problem Estimating the performance of black-box learning algorithms.
method Information-theoretic bounds based on prediction information.
result Improved bounds applicable to deterministic algorithms and easier to estimate.
Generative models emulate climate model outputs for impact assessment.
problem Outdated climate model projections hinder adaptation and mitigation planning.
method Score-based diffusion on a spherical mesh, trained on monthly ESM fields.
result Generative models produce distributions closely matching ESM outputs.
VAIOM models financial returns using continuous input and categorical output.
problem Modeling continuous, noisy, and heterogeneous financial data.
method VAIOM is a decoder-only Transformer that separates input representation from output likelihood.
result VAIOM models outperform fixed single-bar LightGBM baseline in both Test halves.
Consider scene understanding problems such as predicting where a person is probably reaching, or inferring the pose of 3D objects from depth images, or inferring the probable street crossings of pedestrians at a busy intersection. This paper shows how to solve these problems using Approximate Bayesian Computation. The …
Study on neural networks' performance under different normalizations as N grows.
problem Characterizing neural networks' performance under various normalizations.
method Developed an asymptotic expansion to analyze statistical output of shallow neural networks.
result No bias-variance trade-off exists to leading order in N, and variance decreases as normalization approaches mean field.
New method combines model forecasts and real-time observations for hourly wind speed predictions.
problem Filling the six-hour gap between weather model runs for accurate hourly wind speed forecasts.
method Combines quasi-real-time observed wind speed and weather model predictions using a novel Ensemble Model Output Statistics (EMOS) strategy.
result Successfully improved wind speed predictions compared to observed data from SYNOP stations.
Gated attention improves model curvature, enhancing performance on nonlinear tasks.
problem Understanding the geometric implications of gating in attention mechanisms.
method Modeling attention outputs as Gaussian distributions and analyzing Fisher--Rao geometry.
result Gated attention enables non-flat geometries, including positively curved manifolds.
SPLICE generates accurate time-series imputations with reliable prediction intervals.
problem Lack of reliability guarantees in time-series imputation models.
method Modular framework combining latent generative imputation with distribution-free prediction intervals.
result SPLICE achieves lowest mean Load-only MSE and best CRPS on various datasets.
AdaDEM decouples EM into two parts to improve class overlap and uncertainty.
problem Improper EM limits its effectiveness in various machine learning tasks.
method Decouple EM into CADF and GMC, and AdaDEM normalizes CADF reward and uses MEC.
result AdaDEM outperforms classical EM and improves performance in noisy and dynamic environments.
We introduce a new sampling method for large language models that balances diversity and parallelism.
problem Balancing diversity and parallelism in decoding for large language models.
method Arithmetic sampling framework compatible with various sampling variations.
result Improves estimation of expected BLEU score reward and reduces the gap with beam search.
Summarizes financial news for better investment decisions.
problem Information overload from financial news hinders timely investment decisions.
method Personalized Chain-of-Thought summarization framework integrating user-specified keywords.
result Personalized summaries highlight relevant market signals, improving investment narratives.
New algorithm achieves near optimal sample complexity for 1-identification problem.
problem Determining if an arm's mean reward is at least a known threshold with high probability.
method Design of Sequential-Exploration-Exploitation (SEE) algorithm with non-asymptotic analysis.
result Achieves near optimality in sample complexity, matching upper and lower bounds up to a polynomial logarithmic factor.
This paper introduces a new learning-based approach for approximately solving the Travelling Salesman Problem on 2D Euclidean graphs. We use deep Graph Convolutional Networks to build efficient TSP graph representations and output tours in a non-autoregressive manner via highly parallelized beam search. Our approach ou…
ATLAS uses LLMs to adaptively trade by optimizing prompts and coordinating agents.
problem Adapting LLMs for real-time financial decision-making in noisy markets.
method ATLAS integrates structured market data, uses Adaptive-OPRO for prompt optimization, and employs multi-agent coordination.
result Adaptive-OPRO consistently outperforms fixed prompts in financial trading.
DeepMIDE forecasts wind speeds across space, time, and height for offshore wind energy.
problem Forecasting wind speeds across multiple heights for large offshore wind turbines.
method Statistical deep learning model that jointly models wind speeds at different heights using a multi-output integro-difference equation.
result DeepMIDE forecasts outperform traditional methods in real-world offshore wind energy data.