New method shows data-driven causal studies can be misleading.
problem Misattribution of causality in data-driven earth science studies.
method Subsample-based ensemble approach for robust causality analysis.
result Transfer entropy-based causal graphs can be spurious.
NESYM combines AI and Earth models for new climate insights.
problem Replacing traditional Earth models with AI.
method Neural Earth System Modelling (NESYM) integrating AI and climate models.
result Artificial intelligence may render traditional models obsolete.
The purpose of the New York Workshop on Computer, Earth and Space Sciences is to bring together the New York area's finest Astronomers, Statisticians, Computer Scientists, Space and Earth Scientists to explore potential synergies between their respective fields. The 2011 edition (CESS2011) was a great success, and we w…
Meta-learning improves few-shot land cover classification across diverse regions.
problem Capturing diversity in land cover classification across different geographic regions.
method Model-agnostic meta-learning (MAML) algorithm applied to classification and segmentation tasks.
result Few-shot model adaptation outperforms traditional methods in diverse land cover classification tasks.
Proposes a novel MTL approach based on bias-variance analysis.
problem Improving multi-task learning performance through shared knowledge.
method Two-phase iterative aggregation of targets and features using bias-variance analysis.
result Validation on synthetic and real-world datasets demonstrates the effectiveness of the proposed method.
A new method estimates time-varying parameters in earth system models using offline and online data assimilation.
problem Estimating time-varying parameters in complex earth system models.
method Hybrid Offline Online Parameter Estimation with Particle Filtering (HOOPE-PF)
result HOOPE-PF outperforms existing methods, especially with small ensemble sizes.
DecoR estimates causal effects in confounded time series data.
problem Estimating causal effects in time series with unobserved confounders.
method Robust regression in the frequency domain.
result Proves upper bounds for estimation error of DecoR, implying consistency.
Kernel methods' derivatives make complex models more interpretable.
problem Interpreting complex kernel models.
method Deriving kernel functions' derivatives and applying them to various kernel methods.
result Derivatives of kernel functions can be computed and applied to improve model interpretation.
New method for neural networks to predict histogram data.
problem Lack of principled approach for histogram regression.
method Pinball loss applied to cumulative histogram.
result Accuracy similar to EMD with less computational cost.
Bayesian deep learning predicts satellite collisions.
problem Space debris poses planetary risk.
method Bayesian deep learning with LSTM networks.
result Predicts conjunction event evolution with uncertainties.
The problem of unsupervised learning node embeddings in graphs is one of the important directions in modern network science. In this work we propose a novel framework, which is aimed to find embeddings by \textit{discriminating distributions of similarities (DDoS)} between nodes in the graph. The general idea is implem…
Study identifies new stable climate states in climate model.
problem Understanding multistability and transitions in climate models.
method Combination of quasipotential theory and manifold learning.
result Discovery of a third stable climate state not previously known.
Numerical models based on physics represent the state-of-the-art in earth system modeling and comprise our best tools for generating insights and predictions. Despite rapid growth in computational power, the perceived need for higher model resolutions overwhelms the latest-generation computers, reducing the ability of …
Challenge to separate Earth's magnetic field from vehicle's magnetic field for accurate navigation.
problem Separate Earth's magnetic field from vehicle's magnetic field for accurate magnetic navigation.
method Use machine learning (ML) and integrate physics of magnetic navigation (SciML) to remove aircraft magnetic field from total magnetic field.
result A model can be constructed to effectively remove aircraft magnetic field from the dataset.
Develops a method to estimate network difference in high-dimensional time series data.
problem Estimating network differences in high-dimensional data can be unreliable.
method Uses an L1 penalty on the difference of inverse spectral densities to estimate network differences.
result Establishes consistency of the method for sparse network differences.
The paper applies Gaussianization to analyze Earth data, simplifying complex multivariate distributions.
problem Challenges in accurately estimating information content in high-dimensional, heterogeneous Earth data.
method Multivariate Gaussianization for robust probability density estimation.
result Validates the method for estimating information-theoretic measures in Earth system data.
Study loxodromes and geodesics on rotational surfaces in pseudo-isotropic space.
problem No study on loxodromes in pseudo-isotropic space I_p^3.
method Define pseudo-isotropic angles, derive equations for space-like and time-like loxodromes and geodesics on rotational surfaces.
result Equations for space-like and time-like loxodromes and geodesics on rotational surfaces in pseudo-isotropic space.
One of the most pressing questions in climate science is that of the effect of anthropogenic aerosol on the Earth's energy balance. Aerosols provide the `seeds' on which cloud droplets form, and changes in the amount of aerosol available to a cloud can change its brightness and other physical properties such as optical…
In this study, we establish a basis for selecting similarity measures when applying machine learning techniques to solve materials science problems. This selection is considered with an emphasis on the distinctiveness between materials that reflect their nature well. We perform a case study with a dataset of rare-earth…
A new optimization method improves deep learning accuracy without hyper-parameter tuning.
problem Computational demands and convergence behavior in deep learning training.
method Stochastic quasi-Gauss-Newton (SQGN) optimization method combining stochastic quasi-Newton, Gauss-Newton, and variance reduction.
result SQGN provides excellent accuracy without hyper-parameter experimentation, improving convergence and computational performance.
Homeowners around the world elevate houses to manage flood risks. Deciding how high to elevate a house poses a nontrivial decision problem. The U.S. Federal Emergency Management Agency (FEMA) recommends elevating existing houses to the Base Flood Elevation (the elevation of the 100-yr flood) plus a freeboard. This reco…
RSGMs extend SGMs to Riemannian manifolds for better data modeling.
problem Current SGMs are limited to Euclidean spaces; RSGMs handle Riemannian manifolds.
method RSGMs use a noising stage with a diffusion process and a denoising model approximating the time-reversal of the diffusion on Riemannian manifolds.
result RSGMs improve generative modeling for data on Riemannian manifolds.
DA improves solar wind forecasts by updating model boundary conditions.
problem Improving solar wind forecasting accuracy.
method Variational Data Assimilation with solar wind model and in-situ observations.
result DA forecasts are more accurate than non-DA forecasts, especially when STEREO-B's latitude is offset from Earth.
Positive definite kernels are an important tool in machine learning that enable efficient solutions to otherwise difficult or intractable problems by implicitly linearizing the problem geometry. In this paper we develop a set-theoretic interpretation of the Earth Mover's Distance (EMD) and propose Earth Mover's Interse…
Hybrid models combine domain knowledge and data-driven learning for Earth observation.
problem Challenges in modelling Earth observation data with either purely mechanistic or data-driven methods.
method Gaussian process convolution models, specifically latent force models (LFMs), integrating physical knowledge into multioutput GP models.
result Model automatically estimates soil moisture persistence and discovers latent forces related to precipitation.
In this article, we describe the algorithms for causal structure learning from time series data that won the Causality 4 Climate competition at the Conference on Neural Information Processing Systems 2019 (NeurIPS). We examine how our combination of established ideas achieves competitive performance on semi-realistic a…
New method for scalable inference in large-scale regression models with complex error structures.
problem Challenges in statistical inference for large-scale regression models with dependent errors.
method Generalized Method of Wavelet Moments with Exogenous variables (GMWMX).
result Statistical validity and scalability of GMWMX for linear models with complex error structures.
Earth observation embeddings can convert discrete biome maps into continuous representations that better capture ecological variation.
problem Biome maps impose categorical boundaries that compress continuous variation in biotic communities.
method Fit a linear classifier on Earth observation embeddings to predict biome labels.
result Continuous biome representation outperforms discrete biome labels for predicting species occurrence.
Gaussian processes enhance EO with accurate and uncertain predictions.
problem Challenges in GP models for EO, including data-driven physics and causal inference.
method Data-driven physics-aware models respecting signal characteristics and physical laws.
result GP models need to evolve for better EO applications.
Quantum Earth Mover's distance improves stability and efficiency in quantum learning.
problem Quantum learning's loss landscapes often lead to poor local minima and gradients.
method Introduced the quantum Earth Mover's (EM) distance and proposed a quantum Wasserstein generative adversarial network (qWGAN).
result The quantum EM distance makes quantum learning more stable and efficient.
Improving predictive understanding of Earth system variability and change requires data-model integration. Efficient data-model integration for complex models requires surrogate modeling to reduce model evaluation time. However, building a surrogate of a large-scale Earth system model (ESM) with many output variables i…
The study classifies tilings of the sphere by congruent quadrilaterals.
problem Classifying edge-to-edge tilings of the sphere by congruent quadrilaterals.
method Classification of tilings into three classes based on geometric data and parameters.
result Three classes of tilings are identified: 2-layer earth map tilings, quadrilateral subdivisions of the octahedron, and 3-layer earth map tilings.
Proposes a new framework for uncertainty evaluation in ML classification models.
problem Uncertainty evaluation for ML classification models not addressed by existing metrological guidelines.
method Develops a metrological framework based on probability mass functions and summary statistics.
result Extends the GUM to uncertainty for nominal properties, applicable to ML classification models.
FedSpace optimizes ML training on satellites and ground stations.
problem Training machine learning models on satellites with limited bandwidth.
method Federated Learning framework that dynamically schedules model aggregation based on satellite orbits.
result Reduces training time by 1.7 days over state-of-the-art algorithms.
Method reveals dissimilarity in alloys' Curie temperatures.
problem Tackles the dissimilarity between rare-earth transition metal binary alloys.
method Ensemble learning with Kernel ridge regression.
result Reveals meaningful relations between alloys' structure and Curie temperature.
Scoping review of EO-ML methods for causal inference in poverty geography.
problem Lack of thorough documentation and best practices for EO-ML methods in causal analysis.
method Comprehensive scoping review cataloging five principal approaches.
result Detailed protocol for integrating EO data into causal analysis.
Feature extraction and dimensionality reduction are important tasks in many fields of science dealing with signal processing and analysis. The relevance of these techniques is increasing as current sensory devices are developed with ever higher resolution, and problems involving multimodal data sources become more comm…
A Global Navigation Satellite System (GNSS) uses a constellation of satellites around the earth for accurate navigation, timing, and positioning. Natural phenomena like space weather introduce irregularities in the Earth's ionosphere, disrupting the propagation of the radio signals that GNSS relies upon. Such disruptio…
Gaussian processes are improved to account for input noise in earth observation.
problem Accurate error assessment in earth observation models.
method Propose a GP model that propagates input noise through the pipeline.
result Improved error representation in temperature predictions from infrared data.
Consider a setting with N independent individuals, each with an unknown parameter, pi∈[0,1] drawn from some unknown distribution P⋆. After observing the outcomes of t independent Bernoulli trials, i.e., Xi∼Binomial(t,pi) per individual, our objective is to accurately estimate $P^\sta…
Euler and Delisle developed a map method for the Russian Empire, which is now outperformed by the Lambert conformal conical projection.
problem Mapping a country onto a flat map while minimizing distortion.
method Developed a heuristic method for mapping the Russian Empire, which was later named Delisle--Euler map.
result The Lambert conformal conical projection outperforms the Delisle--Euler map in several respects.
DCGANs generate drainage networks quickly from samples.
problem High computational costs in generating large numbers of drainage networks.
method DCGANs trained with connectivity-informed directional information.
result Connectivity-informed DCGANs outperform other methods in reproducing accurate drainage networks.
Climate projections continue to be marred by large uncertainties, which originate in processes that need to be parameterized, such as clouds, convection, and ecosystems. But rapid progress is now within reach. New computational tools and methods from data assimilation and machine learning make it possible to integrate …
Diffusion-weighted MR imaging (DWI) is the only method we currently have to measure connections between different parts of the human brain in vivo. To elucidate the structure of these connections, algorithms for tracking bundles of axonal fibers through the subcortical white matter rely on local estimates of the fiber …
Study analyzes seasonal hydroclimatic features across climates and continents.
problem Lack of seasonal hydroclimatic feature analysis for Koppen-Geiger climates and continents.
method Global-scale analysis of 13,000 time series using 7 features.
result Notable differences in feature magnitudes across Koppen-Geiger climate classes and continental regions.
Generative models emulate climate model outputs for impact assessment.
problem Outdated climate model projections hinder adaptation and mitigation planning.
method Score-based diffusion on a spherical mesh, trained on monthly ESM fields.
result Generative models produce distributions closely matching ESM outputs.
Moser Flow generates models for complex geometries on manifolds without ODE solvers.
problem Learning generative models for complex geometries like spheres and tori.
method Moser Flow is a new class of continuous normalizing flows that parameterizes the model density as the divergence of a neural network.
result Moser Flow achieves significant improvements in density estimation, sample quality, and training complexity over existing methods.
Clouds frequently cover the Earth's surface and pose an omnipresent challenge to optical Earth observation methods. The vast majority of remote sensing approaches either selectively choose single cloud-free observations or employ a pre-classification strategy to identify and mask cloudy pixels. We follow a different st…