Investment tool predicts higher returns for Madrid real estate units.
problem Determining which real estate units have higher returns to investment in Madrid.
method Data collection from Idealista.com, descriptive statistics, return index, machine learning algorithms.
result Introduction of machine learning algorithms for rental real estate price prediction.
Improved tabular models learn better from real-world data.
problem Tabular models perform poorly on real-world datasets when trained only on synthetic data.
method Continued pre-training on a curated set of real-world datasets.
result Real-TabPFN achieves superior predictive accuracy on 29 datasets.
C-PP-COAD detects anomalies with limited real data, reducing dependency on real calibration data.
problem Limited real calibration data for online anomaly detection.
method Context-aware prediction-powered conformal online anomaly detection (C-PP-COAD).
result Significantly reduces dependency on real calibration data without compromising FDR control.
The paper presents a framework to quantify the trade-off between synthetic and real data.
problem Improving generalization with synthetic data when real data is scarce.
method Learning-theoretic framework leveraging algorithmic stability to derive generalization error bounds.
result Optimal synthetic-to-real data ratio minimizing expected test error as a function of Wasserstein distance.
Machine learning detects type Ia supernovae from photometric data.
problem Detecting type Ia supernovae accurately from photometric data.
method Machine learning approach using only real observation data.
result Good results on real data from the Open Supernovae Catalog.
Study reveals how spectral bias affects learnability on real-world data.
problem Understanding how well complex datasets can be learned using kernel methods.
method Use eigenvalues and eigenfunctions from idealized data to reveal spectral bias on real-world data.
result Bound learnability on real-world data using symmetries of realistic kernels.
Particle physics or High Energy Physics (HEP) studies the elementary constituents of matter and their interactions with each other. Machine Learning (ML) has played an important role in HEP analysis and has proven extremely successful in this area. Usually, the ML algorithms are trained on numerical simulations of the …
New algorithms improve federated learning accuracy and stability with real-world data.
problem Real-world data diversity and imbalance challenge federated learning.
method Developed new algorithms (FedVC, FedIR) to resample and reweight data.
result Significant improvements in accuracy and stability of federated learning.
Improves synthetic-to-real generalization without real data.
problem Synthetic models struggle with real data generalization.
method Encourages similar ImageNet representations and automates learning rates.
result Significant improvement in synthetic-to-real generalization.
Deep reinforcement learning provides a promising approach for vision-based control of real-world robots. However, the generalization of such models depends critically on the quantity and variety of data available for training. This data can be difficult to obtain for some types of robotic systems, such as fragile, smal…
New method ensures generated data statistics match real data distributions.
problem Ensuring generated data statistics match real data distributions in GANs.
method Added a new loss term to the generator loss function using f-divergences and kernel density estimation.
result Improved performance on synthetic and real-world datasets.
Synthetic data mimics real-world demographics for fairness testing.
problem Lack of complete, representative datasets for fairness testing.
method Construct synthetic datasets using overlapping real and separate datasets.
result Synthetic data yields consistent fairness metrics with real data.
New model detects crying in real-world settings with improved accuracy.
problem Generalization of cry detection models to real-world environments.
method Evaluated machine learning approaches on a novel dataset of real-world infant crying.
result Improved F1 score of 0.613 for crying event recognition in real-world settings.
A framework schedules hyperparameters for model-based reinforcement learning, improving performance.
problem Inadequate scheduling of hyperparameters in model-based reinforcement learning.
method Theoretical analysis and AutoMBPO framework to automatically schedule real data ratio and other hyperparameters.
result Training with hyperparameters scheduled by AutoMBPO significantly improves performance.
Paper addresses challenges in benchmarking stream learning algorithms with real-world data.
problem Lack of publicly available non-stationary real-world datasets for evaluating stream algorithms.
method Proposes a new public data repository for benchmarking stream algorithms with real-world data.
result Mitigates problems related to dataset choice in experimental evaluation of stream classifiers and drift detectors.
Paper proposes a new framework to improve policy optimization by aligning real and simulated data distributions.
problem Inaccurate model estimation leads to performance degradation in model-based reinforcement learning.
method Introduces unsupervised model adaptation to minimize the IPM between real and simulated data distributions.
result Achieves state-of-the-art performance in sample efficiency on various continuous control tasks.
Ever growing volume and velocity of data coupled with decreasing attention span of end users underscore the critical need for real-time analytics. In this regard, anomaly detection plays a key role as an application as well as a means to verify data fidelity. Although the subject of anomaly detection has been researche…
Satellite images improve real-estate price predictions.
problem Improving accuracy of real-estate price predictions.
method Used convolutional neural networks (CNN) to incorporate satellite image data.
result CNN model trained on satellite images and structured data performs 7% better in MAE.
Model predicts real-time job applicant numbers for regional economic analysis.
problem Real-time economic analysis using alternative data.
method Mixed-Frequency Aggregate Learning (MF-AGL) model.
result Model accurately predicts regional labor market conditions and economic status changes.
TC-VAE generates robust financial time series data with causal constraints.
problem Generating realistic financial time series data with causal relationships.
method TC-VAE with causality constraint, RealNVP prior, and Wasserstein distance.
result TC-VAE loss controls discrepancy between market and generated distributions.
Predict real-time crash risks during hurricane evacuations using connected vehicle data.
problem Mitigate crash risks during hurricane evacuations by predicting high-risk locations.
method Used connected vehicle data to predict crash risks in real-time, considering weather and traffic features.
result Gaussian Process Boosting and Extreme Gradient Boosting models performed best, with recall of 0.91.
Paper tackles AI driving competition challenges with mixed simulation and real-world data.
problem AI algorithms perform poorly in real-world environments compared to simulated ones and vice versa.
method Employed imitation learning on a mixed dataset to train algorithms equally well in all environments.
result Trained algorithms performed well in both simulated and real-world environments.
The Heston model optimizes portfolio management based on real market data.
problem Choosing between active and passive investment strategies.
method Calibrated Heston model to real stock market data.
result Passive strategy can outperform active strategy depending on market parameters.
This paper uses alternative data to forecast Japanese real estate performance.
problem Accurate rent and price forecasting in Japanese real estate markets.
method Created a comprehensive house price index using over 5 million transactions and economic factors.
result Alternative data variables can forecast real estate performance effectively.
Detecting patterns in real time streaming data has been an interesting and challenging data analytics problem. With the proliferation of a variety of sensor devices, real-time analytics of data from the Internet of Things (IoT) to learn regular and irregular patterns has become an important machine learning problem to …
Study improves accuracy of weather data for real-time building simulations.
problem Anomalous and missing weather data affect real-time building energy simulations.
method Introduces a framework for quality control of measured weather data using anomaly detection and neural network infilling.
result Neural Networks enhance the accuracy of data imputation compared to traditional methods.
Dividing local Gaussian processes improve real-time prediction efficiency.
problem Efficient online prediction for large data sets.
method Iterative data-driven division of input space for sublinear computational complexity.
result Sublinear computational complexity in real-time prediction.
Develops an efficient method for real-time data analysis and visualization.
problem Challenges of analyzing high-dimensional data.
method Incremental non-linear manifold approximation using GMRA framework.
result Accurately represents non-linear manifolds with small initial samples.
FinBloom enhances LLMs for real-time financial queries.
problem Limited access to real-time financial data by LLMs.
method Developed a custom 7B parameter LLM, Financial Context Dataset, and a Financial Agent.
result Significantly improved LLMs' capability to handle dynamic financial tasks.
New RESK distributions improve robust clustering of skewed data.
problem Robustly clustering non-symmetric, heavy-tailed data clusters.
method Proposes RESK distributions and an EM algorithm with robust skew-Huber M-estimator.
result Numerical experiments confirm the effectiveness of the proposed methods.
Variational autoencoders (VAEs), as well as other generative models, have been shown to be efficient and accurate for capturing the latent structure of vast amounts of complex high-dimensional data. However, existing VAEs can still not directly handle data that are heterogenous (mixed continuous and discrete) or incomp…
Paper tackles model collapse in recursive generative models using a weighted training scheme.
problem Model collapse in recursive generative models trained on synthetic data.
method Iteratively trains models on real and synthetic data, evaluates weighted training schemes.
result Optimal weighting scheme for synthetic data follows a unified expression, revealing a trade-off with model performance.
RealUID distills matching models using real data without GANs.
problem Slow inference in matching models like diffusion and flow.
method RealUID is a universal distillation framework that incorporates real data into the distillation procedure without using GANs.
result RealUID offers a simple theoretical foundation that covers previous distillation methods for Flow Matching and Diffusion models.
Flow Matching models help generative models stay within the subspace of real data.
problem How do generative models stay within the subspace of real data?
method Flow Matching models using a learned velocity field to transform a simple prior into a complex target distribution.
result Generated samples memorize real data points and represent the sample data subspace exactly.
New method detects anomalies in time series data, especially useful for monitoring services.
problem Detecting anomalies in time series data, especially for monitoring services and cloud resources.
method Models time series of probability distributions over real values, scales to millions of time series.
result Outperforms state-of-the-art methods in detecting anomalies on various data sets.
Big data trend has enforced the data-centric systems to have continuous fast data streams. In recent years, real-time analytics on stream data has formed into a new research field, which aims to answer queries about what-is-happening-now with a negligible delay. The real challenge with real-time stream data processing …
A new method for real-time CCA on streaming data.
problem Finding correlated features in online data streams.
method Sliding Window Informative Canonical Correlation Analysis (SWICCA) using streaming PCA.
result SWICCA provides real-time CCA components in high dimensions with theoretical guarantees.
CVNN outperforms RVNN on non-circular data.
problem Classifying complex-valued data with statistical dependence.
method Comparison of CVNN and RVNN on non-circular data.
result CVNN outperforms RVNN in accuracy and generalization.
Framework uses physics knowledge to improve spatiotemporal prediction with limited data.
problem Challenges in modeling physical systems with limited real-world data.
method Physics-aware meta-learning with auxiliary tasks, incorporating PDE-independent spatial and temporal modules.
result Framework outperforms in spatiotemporal prediction tasks with limited data.
Real estate appraisal is a complex and important task, that can be made more precise and faster with the help of automated valuation tools. Usually the value of some property is determined by taking into account both structural and geographical characteristics. However, while geographical information is easily found, o…
In standard generative adversarial network (SGAN), the discriminator estimates the probability that the input data is real. The generator is trained to increase the probability that fake data is real. We argue that it should also simultaneously decrease the probability that real data is real because 1) this would accou…
CEDA improves understanding of data fit to models.
problem Real-world data often deviates from theoretical models.
method Categorical Exploratory Data Analysis (CEDA) to highlight deviations.
result CEDA reveals where and how data fits or deviates from models.
Physics-informed denoising improves sensor data accuracy without needing clean data.
problem Noise in real-life sensor data affects system performance and reliability.
method Physics-informed denoising model that uses algebraic relationships between sensor measurements governed by physical laws.
result Achieved state-of-the-art performance in various real-world applications.
Synthetic medical data which preserves privacy while maintaining utility can be used as an alternative to real medical data, which has privacy costs and resource constraints associated with it. At present, most models focus on generating cross-sectional health data which is not necessarily representative of real data. …
TabDPT combines ICL and self-supervised learning to train tabular models on real data.
problem Slow generalization of tabular foundation models to unseen datasets.
method In-Context Learning (ICL) combined with self-supervised learning, using real data for pre-training.
result TabDPT achieves strong performance on regression and classification benchmarks.
We present a generic framework for spatio-temporal (ST) data modeling, analysis, and forecasting, with a special focus on data that is sparse in both space and time. Our multi-scaled framework is a seamless coupling of two major components: a self-exciting point process that models the macroscale statistical behaviors …
R2D2-GANs generate high-resolution images at real-time speed.
problem Generating high-resolution images at real-time speed.
method Conditional recursive GANs architecture.
result Synthesized images are indistinguishable from real ones.
Paper proposes an online anomaly detection method for real-time systems.
problem Rare events endanger profitability, safety, and environmental aspects.
method Online inverse cumulative distribution-based approach with dynamic process limits.
result Eliminates common problems of offline anomaly detectors and provides low-latency detection.