Deep Reinforcement Learning (DRL) has become increasingly powerful in recent years, with notable achievements such as Deepmind's AlphaGo. It has been successfully deployed in commercial vehicles like Mobileye's path planning system. However, a vast majority of work on DRL is focused on toy examples in controlled synthe…
Robust CD method for real-world time series with power-law distributions.
problem Challenges in causal discovery due to noise sensitivity.
method Power-law spectral feature extraction for robust CD.
result Consistently outperforms state-of-the-art alternatives on real-world datasets.
Myriad offers a testbed for integrating machine learning and trajectory optimization.
problem Real-world trajectory optimization challenges.
method JAX-based testbed with machine learning and trajectory optimization integration.
result End-to-end learning and planning with neural ODEs.
L2O uses ML to optimize traditional optimization techniques.
problem Real-world optimization problems with shared structures.
method Exploiting shared structures to enhance optimization techniques.
result Better or faster solutions through machine learning integration.
The study evaluates GRL approaches and finds limitations in their applicability.
problem Challenges in applying GRL approaches to real-world graphs with varying structural differences.
method Empirical data-driven framework and theoretical analysis of GRL approaches.
result Existing GRL approaches are insufficient for real-world graphs with diverse structural patterns.
Survey of QML applications on near-term quantum devices.
problem Achieving quantum advantage on real-world applications.
method Analysis of supervised and unsupervised techniques, including encoding, ansatz structure, error mitigation, and gradient methods.
result Current QML implementations on quantum hardware face limitations but show potential for real-world applications.
Study compares Interval Regression models and their performance.
problem Regression models struggle with interval target values.
method Comprehensive review and comparative analysis of existing Interval Regression models.
result No single model is universally optimal for all scenarios.
Survey of challenges and future directions in applying RL to real-world settings.
problem Challenges in deploying RL in practical settings due to limited interaction and changing environments.
method Analysis of RL system design, implementation, and continual improvement.
result Need for theory and methodology to bridge research and application gap.
Research on deep learning generalization in real-world applications.
problem Understanding and improving deep learning generalization in non-i.i.d. real-world data.
method Analyzing deep net generalization, identifying and addressing assumptions and problem settings failures.
result Proposes methods to address failures in deep net generalization for real-world applications.
In many real-world applications of machine learning classifiers, it is essential to predict the probability of an example belonging to a particular class. This paper proposes a simple technique for predicting probabilities based on optimizing a ranking loss, followed by isotonic regression. This semi-parametric techniq…
This paper surveys fairness notions in ML and recommends the most suitable one for real-world scenarios.
problem Ensuring ML systems do not discriminate against specific individuals or sub-populations.
method Identifying fairness-related characteristics of real-world scenarios and analyzing the behavior of fairness notions.
result A decision diagram to recommend the most suitable fairness notion for specific setups.
Real-world machine learning applications often have complex test metrics, and may have training and test data that are not identically distributed. Motivated by known connections between complex test metrics and cost-weighted learning, we propose addressing these issues by using a weighted loss function with a standard…
In the 'Big Data' era, many real-world applications like search involve the ranking problem for a large number of items. It is important to obtain effective ranking results and at the same time obtain the results efficiently in a timely manner for providing good user experience and saving computational costs. Valuable …
Recent advances in contextual bandit optimization and reinforcement learning have garnered interest in applying these methods to real-world sequential decision making problems. Real-world applications frequently have constraints with respect to a currently deployed policy. Many of the existing constraint-aware algorith…
Reinforcement learning (RL) has proven its worth in a series of artificial domains, and is beginning to show some successes in real-world scenarios. However, much of the research advances in RL are often hard to leverage in real-world systems due to a series of assumptions that are rarely satisfied in practice. We pres…
Proposes online learning for Hawkes processes with network structure and event interaction.
problem Modeling complex interactions and latent structures in network events.
method Online learning approach for mixture of multivariate Hawkes processes.
result Efficacy demonstrated on synthetic and real-world data.
New method estimates treatment effects across different populations.
problem Estimating treatment effects across populations with changing distributions.
method SBRL-HAP framework combining balancing and independence regularizers with hierarchical attention.
result Significant improvement in HTE estimation across out-of-distribution populations.
Paper compares semi-supervised training for differentiable particle filters.
problem Lack of labelled data in real-world applications.
method Compares two semi-supervised training objectives.
result Improved performance in environments with scarce labelled data.
Study reveals how spectral bias affects learnability on real-world data.
problem Understanding how well complex datasets can be learned using kernel methods.
method Use eigenvalues and eigenfunctions from idealized data to reveal spectral bias on real-world data.
result Bound learnability on real-world data using symmetries of realistic kernels.
New model reduces sampling cost in diffusion models, making them faster and applicable to real-world applications.
problem Challenges in generating high-quality samples, mode coverage, and fast sampling in deep generative models.
method Proposes denoising diffusion GANs that model each denoising step using a multimodal conditional GAN to reduce sampling cost.
result Demonstrates 2000imes faster sampling on CIFAR-10 dataset while maintaining competitive sample quality and diversity. Safe Bayesian Optimization algorithms are improved to ensure safety in real-world applications.
problem Ensuring safety in Bayesian Optimization algorithms for real-world applications.
method Investigated and improved three safety-related issues of SafeOpt-type algorithms: frequentist uncertainty bounds, RKHS norm assumptions, and discrete search spaces.
result Introduced Real-{eta}-SafeOpt, Lipschitz-only Safe Bayesian Optimization (LoSBO), and Lipschitz-only GP-UCB (LoS-GP-UCB) algorithms that retain safety guarantees and superior performance.
Through many recent successes in simulation, model-free reinforcement learning has emerged as a promising approach to solving continuous control robotic tasks. The research community is now able to reproduce, analyze and build quickly on these results due to open source implementations of learning algorithms and simula…
One of the primary aspects of sustainable development involves accurate understanding and modeling of environmental phenomena. Many of these phenomena exhibit variations in both space and time and it is imperative to develop a deeper understanding of techniques that can model space-time dynamics accurately. In this pap…
Retail company uses Prophet algorithm for accurate sales forecasting.
problem Accurate sales forecasting in the retail industry.
method Facebook's Prophet algorithm and backtesting strategy.
result Framework demonstrates real-world use case capabilities.
Long Short-Term Memory networks trained with gradient descent and back-propagation have received great success in various applications. However, point estimation of the weights of the networks is prone to over-fitting problems and lacks important uncertainty information associated with the estimation. However, exact Ba…
New R package for NMF evaluated on real-world data.
problem Limited comprehensive evaluations of NMF packages under real-world conditions.
method Systematic performance comparison of three NMF packages using real-world data.
result New package outperforms existing ones in computational efficiency and reconstruction accuracy.
Validates economic scenarios using statistical tests on stochastic processes.
problem Ensuring the accuracy of real-world economic scenario models.
method Applies Chevyrev and Oberhauser's (2022) signature and maximum mean distance test to various stochastic processes.
result Demonstrates the test's effectiveness across different path properties relevant to financial modeling.
New method handles indirect mediators in CMA for complex scenarios.
problem Handling indirect and multi-dimensional mediators in causal mediation analysis.
method Identifiable Variational Autoencoder (iVAE) architecture for multi-dimensional, indirectly observed mediators.
result Accurate estimation of direct and mediated effects in synthetic and semi-synthetic experiments.
In this paper, we consider a problem of failure prediction in the context of predictive maintenance applications. We present a new approach for rare failures prediction, based on a general methodology, which takes into account peculiar properties of technical systems. We illustrate the applicability of the method on th…
This paper improves change-point detection for complex data streams using denoising score matching.
problem Timely identification of distributional shifts in high-dimensional, complex data streams.
method Score-based CUSUM change-point detection with denoising score matching.
result Denoising score matching enhances detection power by effectively controlling noise scale.
Complex networks are ubiquitous to several Computer Science domains. Centrality measures are an important analysis mechanism to uncover vital elements of complex networks. However, these metrics have high computational costs and requirements that hinder their applications in large real-world networks. In this tutorial,…
Framework for transitioning financial models from risk-neutral to real-world measure.
problem Transitioning financial models from risk-neutral to real-world measure to better reflect market dynamics and investor preferences.
method Leveraging probability theory, specifically Girsanov's theorem, to incorporate real-world dynamics into financial models.
result Validation of the robustness and practical relevance of the methodology through case studies involving financial forecasts and stress tests.
Recent work by Locatello et al. (2018) has shown that an inductive bias is required to disentangle factors of interest in Variational Autoencoder (VAE). Motivated by a real-world problem, we propose a setting where such bias is introduced by providing pairwise ordinal comparisons between instances, based on the desired…
Paper addresses challenges in benchmarking stream learning algorithms with real-world data.
problem Lack of publicly available non-stationary real-world datasets for evaluating stream algorithms.
method Proposes a new public data repository for benchmarking stream algorithms with real-world data.
result Mitigates problems related to dataset choice in experimental evaluation of stream classifiers and drift detectors.
Paper proposes a risk-aware decision-making framework for real-world sequential decisions.
problem Real-world sequential decision-making problems often have critical constraints that learning solutions often neglect.
method Actor multi-critic architecture with risk characterization.
result Our approach consistently satisfies system constraints with minimal performance toll.
This paper reviews methods to create compact neural networks for IoT applications.
problem Complex deep neural networks are costly and slow, hindering real-world deployment.
method Automatic synthesis of compact, accurate DNN/LSTM models.
result Compact neural networks reduce energy consumption, memory, and inference time.
We present the use of the fitted Q iteration in algorithmic trading. We show that the fitted Q iteration helps alleviate the dimension problem that the basic Q-learning algorithm faces in application to trading. Furthermore, we introduce a procedure including model fitting and data simulation to enrich training data as…
Develops an algorithm for bilevel optimization with coupled constraints.
problem Challenges in bilevel optimization with coupled constraints.
method Primal-dual-assisted penalty approach and a fully first-order algorithm (BLOCC).
result Established rigorous convergence theory and demonstrated effectiveness on real-world applications.
Survey on offline RL methods for real-world applications.
problem Inaccessible domains due to high cost and danger of interacting with the environment.
method Unifying taxonomy and review of offline RL algorithms.
result Wide range of applications for offline RL, including education, healthcare, and robotics.
Improved measure of predictive uncertainty for machine learning models.
problem Current measure of predictive uncertainty assumes BMA predictive distribution is equivalent to true model's distribution.
method Introduced a new measure based on information theory to correct the assumption.
result Our measure behaves more reasonably in synthetic tasks and is advantageous in real-world applications.
This paper introduces a novel framework for modeling temporal events with complex longitudinal dependency that are generated by dependent sources. This framework takes advantage of multidimensional point processes for modeling time of events. The intensity function of the proposed process is a mixture of intensities, a…
Anomaly detection is a fundamental problem in data mining field with many real-world applications. A vast majority of existing anomaly detection methods predominately focused on data collected from a single source. In real-world applications, instances often have multiple types of features, such as images (ID photos, f…
Paper proposes CCVAE for generalized zero-shot domain adaptation.
problem Adapting to unseen classes in target domain with limited labeled data.
method Coupled Conditional Variational Autoencoder (CCVAE).
result CCVAE generates synthetic target domain features for unseen classes.
Gaussian processes (GPs) are powerful non-parametric function estimators. However, their applications are largely limited by the expensive computational cost of the inference procedures. Existing stochastic or distributed synchronous variational inferences, although have alleviated this issue by scaling up GPs to milli…
Mitigates anomaly score imbalance in long-tailed distributions.
problem Class imbalance in normal data leads to skewed anomaly detection performance.
method Proposes an importance-weighted loss function to balance anomaly scores.
result Improves anomaly detection performance by 0.043 on real-world datasets.
Tree ensemble method tackles multi-objective constrained optimization in energy systems.
problem Complex, multi-objective, and constrained optimization problems in energy systems.
method Data-driven tree ensemble approach for black-box problems with heterogeneous variable spaces.
result Competitive performance and sampling efficiency compared to state-of-the-art tools.
Paper introduces EnCounteR for estimating causal effects using encouragement data.
problem Challenges in estimating causal effects due to incomplete randomization and limited encouragement data.
method Introduces a generalized IV estimator, EnCounteR, leveraging both observational and encouragement data.
result Demonstrates superior performance of EnCounteR over existing methods.
The standard greedy algorithm has been recently shown to enjoy approximation guarantees for constrained non-submodular nondecreasing set function maximization. While these recent results allow to better characterize the empirical success of the greedy algorithm, they are only applicable to simple cardinality constraint…