New optimizer MARS-M combines variance reduction with Muon for faster LLM training.
problem Training large-scale neural networks efficiently.
method Integrates MARS variance reduction with Muon optimizer.
result MARS-M converges to a first-order stationary point at a rate of ildeO(T−1/3). Improves MARS for nonparametric multivariate regression with dimension reduction.
problem High number of basis functions in MARS for high-order interactions.
method Linear combinations of covariates for dimension reduction, facilitating gradient calculation and eigen-analysis for estimation.
result Asymptotic theory and numerical studies show improved performance over MARS.
Proposes a lasso variant of MARS for nonparametric regression.
problem Nonparametric regression with MARS.
method Least squares estimation over convex function combinations with a complexity constraint.
result Achieves logarithmic convergence rate in dimensionality.
MarS simulates financial markets using generative models.
problem Simulating realistic financial market effects.
method Order-level generative foundation model (LMM) for realistic, interactive, and controllable order generation.
result Strong scalability and robust realism in MarS.
MARS optimizes large model training by reducing variance, outperforming AdamW.
problem Training large models efficiently and scalably.
method Unified optimization framework MARS combining preconditioned gradient updates and variance reduction.
result MARS outperforms AdamW in training GPT-2 models.
Novel estimation methods improve MAR model accuracy for high-dimensional time series.
problem Limited estimation techniques for Matrix Autoregressive (MAR) models.
method Adapted Yule-Walker equations and Burg's method.
result Proposed methods achieve comparable model fit to VAR models.
MARS model outperforms others in stock price prediction across sectors.
problem Developing accurate models for stock price prediction.
method Used time series, econometric, machine learning, and deep learning models on stock data.
result MARS model is the best performing model across IT, Banking, and Health sectors.
SMART combines decision trees and MARS for better regression modeling.
problem High variance in decision trees for continuous relationships, poor performance in MARS for discontinuities.
method SMART uses a decision tree to identify subsets with distinct continuous relationships, then applies MARS to fit these relationships independently.
result SMART improves regression performance over state-of-the-art methods in capturing discontinuities and continuous relationships.
MARS-Gym framework for marketplaces to train and evaluate recommender systems.
problem Challenges in designing, training, and evaluating recommender systems in marketplaces.
method Open-source framework for Reinforcement Learning agents in marketplaces.
result Empowers researchers and engineers to quickly build and evaluate agents for recommendations.
Latent Variable Models (LVMs) are a large family of machine learning models providing a principled and effective way to extract underlying patterns, structure and knowledge from observed data. Due to the dramatic growth of volume and complexity of data, several new challenges have emerged and cannot be effectively addr…
MARS automatically selects tensor decomposition ranks, improving performance in neural network tasks.
problem Determining optimal decomposition ranks in tensor decompositions.
method MARS uses binary masks to learn optimal tensor structure during training via relaxed MAP estimation.
result MARS achieves better results than previous methods in various tasks.
Optimizes variational autoencoder for detecting missing data in Mars rover transmissions.
problem Detecting missing data in Mars rover transmissions to prevent volume loss and corruption.
method Applies derivative-free optimization to tune variational autoencoder.
result Improves variational autoencoder's ability to detect missing data, aiding GDSA team.
A hierarchical Bayesian classifier is trained at pixel scale with spectral data from the CRISM (Compact Reconnaissance Imaging Spectrometer for Mars) imagery. Its utility in detecting rare phases is demonstrated with new geologic discoveries near the Mars-2020 rover landing site. Akaganeite is found in sediments on the…
FLOWGEM generates complete datasets from incomplete data with non-monotone MAR missingness.
problem Dealing with non-monotone Missing at Random (MAR) missingness in data.
method Iterative particle evolution of Wasserstein Gradient Flow, approximated by local linear estimators of density ratio.
result FLOWGEM achieves state-of-the-art performance across various settings, including non-monotone MAR mechanisms.
Paper proposes a new MAR model for global economic forecasting.
problem Joint modeling of economic and financial variables across countries.
method Sparse matrix autoregressive model with trade network integration.
result Sparse component differentiates systematic and idiosyncratic cross-predictability.
Improved flow-based models capture dependencies better with multi-scale autoregressive priors.
problem Limited expressiveness of flow-based models for long-range data dependencies.
method Introducing channel-wise dependencies through multi-scale autoregressive priors (mAR) in split coupling flow layers (mAR-SCF).
result Achieves state-of-the-art density estimation results on MNIST, CIFAR-10, and ImageNet.
A new unsupervised method removes CT metal artifacts using beta-CycleGAN and attention.
problem Metal artifact reduction in computed tomography (CT) images.
method Unsupervised learning using a beta-CycleGAN architecture with attention mechanism.
result Improved metal artifact removal that preserves image details.
The explosion of time series data in recent years has brought a flourish of new time series analysis methods, for forecasting, clustering, classification and other tasks. The evaluation of these new methods requires either collecting or simulating a diverse set of time series benchmarking data to enable reliable compar…
New approach optimizes expensive black-box systems with uncertain outputs.
problem Optimizing expensive black-box systems with limited data and uncertainty.
method Flexible non-interpolating surrogate model (TK-MARS) and Smart-Replication approach.
result TK-MARS outperforms original MARS and detects important variables.
A probabilistic query may not be estimable from observed data corrupted by missing values if the data are not missing at random (MAR). It is therefore of theoretical interest and practical importance to determine in principle whether a probabilistic query is estimable from missing data or not when the data are not MAR.…
Proves uniqueness of non-extremal Kerr-Newman black holes under small perturbations.
problem Uniqueness of non-extremal Kerr-Newman black holes under small perturbations.
method Perturbative analysis using Mars-Simon type tensors.
result Proves that a space-time close to the Kerr-Newman family must be one of the Kerr-Newman solutions.
New approach to meaningful and robust algorithmic recourse.
problem Ineffective and unmeaningful algorithmic recourse explanations.
method Meaningful Algorithmic Recourse (MAR) and Effective Algorithmic Recourse (EAR).
result Proposes new constraints for algorithmic recourse that improve both prediction and target.
Planetary exploration missions with Mars rovers are complicated, which generally require elaborated task planning by human experts, from the path to take to the images to capture. NASA has been using this process to acquire over 22 million images from the planet Mars. In order to improve the degree of automation and th…
Rating prediction is an important application, and a popular research topic in collaborative filtering. However, both the validity of learning algorithms, and the validity of standard testing procedures rest on the assumption that missing ratings are missing at random (MAR). In this paper we present the results of a us…
Finding an energy minimum in the Ising model is an exemplar objective, associated with many combinatorial optimization problems, that is computationally hard in general, but occurs in all areas of modern science. There are several numerical methods, providing solution for the medium size Ising spin systems. However, th…
Proposes a method to combine datasets with missing values using Gaussian process latent variables.
problem Combining datasets with missing values under non-Missing at Random (NMAR) missingness.
method Gaussian process latent variable model for non-MAR missing data.
result Valid estimates are obtained using the proposed method, while existing methods provide severely biased estimates.
Proposes a framework to handle missing data in traffic forecasting with sensor blackouts.
problem Missing data in traffic forecasting due to sensor blackouts, especially when correlated with traffic conditions.
method Latent state-space framework that models traffic dynamics and sensor dropout probabilities.
result Improves traffic forecasting by reducing blackout imputation RMSE from 7.02 to 4.23, with MNAR modeling providing additional gains.
The thermal subsystem of the Mars Express (MEX) spacecraft keeps the on-board equipment within its pre-defined operating temperatures range. To plan and optimize the scientific operations of MEX, its operators need to estimate in advance, as accurately as possible, the power consumption of the thermal subsystem. The re…
Kernel ridge regression for causal inference with missing data.
problem Estimating treatment effects with missing data in selected samples.
method Kernel ridge regression estimators for nonparametric dose response curves and semiparametric treatment effects.
result Uniform consistency and finite sample rates for continuous treatment, root-n consistency for discrete treatment.
Proposes a method to make statistical inferences robust in spatially dependent settings with missing at random labels.
problem Statistical inference challenges with missing at random labels and spatial dependence.
method Doubly robust estimator with cross-fit nuisances and jackknife spatial HAC variance correction.
result Asymptotically valid confidence intervals with improved finite-sample calibration.
Improves BN graph learning with splines for scalability.
problem Learning accurate BN graph structures from data.
method Score-and-search approach with MARS for CPD modeling.
result Improves BN graph accuracy and scalability.
On-line portfolio selection has attracted increasing interests in machine learning and AI communities recently. Empirical evidences show that stock's high and low prices are temporary and stock price relatives are likely to follow the mean reversion phenomenon. While the existing mean reversion strategies are shown to …
Deep neural networks (DNNs) generate much richer function spaces than shallow networks. Since the function spaces induced by shallow networks have several approximation theoretic drawbacks, this explains, however, not necessarily the success of deep networks. In this article we take another route by comparing the expre…
A new method for semi-supervised learning with missing data using GMM and margin confidence.
problem Handling missing data in semi-supervised learning with classification uncertainty.
method Explicitly models missingness mechanism, uses margin confidence and Aranda Ordaz function, develops ECM algorithm.
result Effective reduction of bias and robustness in semi-supervised learning with substantial missing labels.
New method tackles MNAR missingness in domain adaptation.
problem Handling missingness in both source and target data.
method Reduces MNAR missingness to imputation problem, leveraging recent MNAR imputation methods.
result Developed a novel domain adaptation procedure for MNAR missingness shift.
In this paper, using blow-up analysis, we prove a quantization result for an elliptic equation with critical exponential growth on compact Riemannian surface without boundary. Similar results for Euclidean space were obtained by Adimurthi-Struwe \cite{Adi-Stru}, Druet \cite{Druet}, Lamm-Robert-Struwe \cite{L-R-S}, Mart…
MARS meta-learns function scores for improved predictive accuracy and uncertainty.
problem Difficulty in specifying expressive priors for Bayesian meta-learning.
method Meta-learning the score function of data-generating process marginals in the function space.
result State-of-the-art predictive accuracy and improved uncertainty estimates.
Efficiently clusters incomplete data without imputation or full EM, faster and more accurate.
problem Clustering partially recorded data efficiently.
method Model-based approach using multivariate t-distributions, considering only observed values.
result Approach is more accurate and computationally efficient than alternatives.
We provide a model to understand how adverse weather conditions modify traffic flow dynamic. We first prove that the microscopic Free Flow Speed of the vehicles is changed and then provide a rule to model this change. For this, we consider a thresholded linear model, corresponding to an application of a MARS model to r…
Missing data are ubiquitous in many domains including healthcare. When these data entries are not missing completely at random, the (conditional) independence relations in the observed data may be different from those in the complete data generated by the underlying causal process. Consequently, simply applying existin…
New taxonomy for structured missingness in large-scale databases.
problem Handling missing values in structured data.
method Introducing a new taxonomy for Structured Missingness (SM) and embedding it within existing mechanisms.
result Demonstrated the impact of Structured Missingness on inference and prediction.
Study improves feature acquisition for static settings in AFAPE.
problem Evaluate AFAPE performance in static feature settings.
method Derive and adapt IPW, DM, and DRL estimators for MAR and MNAR missingness.
result Improved data efficiency in synthetic and real-world experiments.
Unified ML imputation framework for missing data.
problem Invalid inference with incomplete data and ML imputations.
method Stratified by missingness patterns, weights and aggregates complete case information.
result Valid statistical inference for general missingness patterns.
(ABRIDGED) In previous work, two platforms have been developed for testing computer-vision algorithms for robotic planetary exploration (McGuire et al. 2004b,2005; Bartolo et al. 2007). The wearable-computer platform has been tested at geological and astrobiological field sites in Spain (Rivas Vaciamadrid and Riba de S…
Study compares traditional and machine learning methods for handling missing data in longitudinal studies.
problem Handling missing Not at Random (MNAR) and nonnormal data in longitudinal research.
method Monte Carlo simulations to assess six missing data techniques.
result FIML is most effective for MNAR data, while TSRE excels for MAR data.
Classical methods to control heating systems are often marred by suboptimal performance, inability to adapt to dynamic conditions and unreasonable assumptions e.g. existence of building models. This paper presents a novel deep reinforcement learning algorithm which can control space heating in buildings in a computatio…
Fed-MIWAE improves federated learning by imputing missing data.
problem Handling missing data in federated learning models.
method Federated version of MIWAE, a deep latent variable model for missing data imputation.
result Fed-MIWAE achieves imputation accuracy comparable to centralized methods in federated scenarios.
Stochastic differential equations are an important modeling class in many disciplines. Consequently, there exist many methods relying on various discretization and numerical integration schemes. In this paper, we propose a novel, probabilistic model for estimating the drift and diffusion given noisy observations of the…