This paper introduces Probability Engineering to improve deep learning models.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Bayesian inference engines improve density estimation accuracy and scalability.
Dynamic Vocabulary Pruning stabilizes LLM training by removing low-probability tokens.
Paper introduces TS-GPT for engineering time series forecasting.
Survey and new results link hydrodynamics, molecular physics, and financial engineering.
Chess engines Stockfish and LCZero differ in their approach to solving endgame puzzles.
We study the fundamental problem of learning an unknown, smooth probability function via pointwise Bernoulli tests. We provide a scalable algorithm for efficiently solving this problem with rigorous guarantees. In particular, we prove the convergence rate of our posterior update rule to the true probability function in…
We extend Bayes' theorem for upper probabilities considering likelihood uncertainty.
Hybrid continuous-discrete models naturally represent many real-world applications in robotics, finance, and environmental engineering. Inference with large-scale models is challenging because relational structures deteriorate rapidly during inference with observations. The main contribution of this paper is an efficie…
Predicting the click-through rate of an advertisement is a critical component of online advertising platforms. In sponsored search, the click-through rate estimates the probability that a displayed advertisement is clicked by a user after she submits a query to the search engine. Commercial search engines typically rel…
Modified lognormal distribution with flexible tails for skewed data.
Algorithm learns diverse rankings for search engines.
Improves Bayesian optimisation for engineering design problems with many variables.
Extends Bayesian theory to handle complex interdependencies in multidimensional event spaces.
Bayesian Optimization tackles hidden constraints in architecture optimization.
Generative model synthesizes earthquake acceleration data.
Lognormal random variables appear naturally in many engineering disciplines, including wireless communications, reliability theory, and finance. So, too, does the sum of (correlated) lognormal random variables. Unfortunately, no closed form probability distribution exists for such a sum, and it requires approximation. …
The Lugannani-Rice formula is a saddlepoint approximation method for estimating the tail probability distribution function, which was originally studied for the sum of independent identically distributed random variables. Because of its tractability, the formula is now widely used in practical financial engineering as …
Simpler GNNs with low-rank non-parametric aggregators perform well on graph benchmarks.
New method models stopping times that can be equal with non-zero probability.
SBI helps scientists match model outputs to data.
Partial Differential Equations (PDE) are fundamental to model different phenomena in science and engineering mathematically. Solving them is a crucial step towards a precise knowledge of the behaviour of natural and engineered systems. In general, in order to solve PDEs that represent real systems to an acceptable degr…
Proposes isotonic regression for calibrating Deep Cox models' survival probabilities.
A new method estimates rare failure events in complex systems.
We propose a permutation-invariant loss function designed for the neural networks reconstructing a set of elements without considering the order within its vector representation. Unlike popular approaches for encoding and decoding a set, our work does not rely on a carefully engineered network topology nor by any addit…
In many instances, information on engineering systems can be obtained through measurements, monitoring or direct observations of system performances and can be used to update the system reliability estimate. In structural reliability analysis, such information is expressed either by inequalities (e.g. for the observati…
Paper examines stability of Bayesian posterior measures using integral probability metrics.
The semantic map calibrates uncertainty from language model probabilities.
This review discusses challenges and solutions for AI in chemical engineering.
Applied Data Scientists throughout various industries are commonly faced with the challenging task of encoding high-cardinality categorical features into digestible inputs for machine learning algorithms. This paper describes a Bayesian encoding technique developed for WeWork's lead scoring engine which outputs the pro…
Proposes novel wSVMs for sparse learning and accurate probability estimation.
We combine Bayesian networks (BNs) and structural reliability methods (SRMs) to create a new computational framework, termed enhanced Bayesian network (eBN), for reliability and risk analysis of engineering structures and infrastructure. BNs are efficient in representing and evaluating complex probabilistic dependence …
Optimal engine operation during a transient driving cycle is the key to achieving greater fuel economy, engine efficiency, and reduced emissions. In order to achieve continuously optimal engine operation, engine calibration methods use a combination of static correlations obtained from dynamometer tests for steady-stat…
Privacy subsidy found in market trading with noisy direction signals.
NP-HMC extends HMC for nonparametric models in probabilistic programming.
Paper uses deep reinforcement learning for better control of rocket engines during start-up phases.
We propose a Fourier-based learning algorithm for highly nonlinear multiclass classification. The algorithm is based on a smoothing technique to calculate the probability distribution of all classes. To obtain the probability distribution, the density distribution of each class is smoothed by a low-pass filter separate…
Predicts next actions in soccer possessions using path signatures.
Paper proposes verifier engineering for improving foundation models.
New metrics quantify implementation risk in portfolio backtesting, revealing systematic differences in engine implementations.
We study the problem of offline learning in automated decision systems under the contextual bandits model. We are given logged historical data consisting of contexts, (randomized) actions, and (nonnegative) rewards. A common goal is to evaluate what would happen if different actions were taken in the same contexts, so …
With the rapid growth in fashion e-commerce and customer-friendly product return policies, the cost to handle returned products has become a significant challenge. E-tailers incur huge losses in terms of reverse logistics costs, liquidation cost due to damaged returns or fraudulent behavior. Accurate prediction of prod…
New method calculates sensitivity of system failure probability.
Near real-time damage diagnosis of building structures after extreme events (e.g., earthquakes) is of great importance in structural health monitoring. Unlike conventional methods that are usually time-consuming and require human expertise, pattern recognition algorithms have the potential to interpret sensor recording…
This paper presents an engine able to predict jointly the real-time concentration of the main pollutants harming people's health: nitrogen dioxyde (NO2), ozone (O3) and particulate matter (PM2.5 and PM10, which are respectively the particles whose size are below 2.5 um and 10 um). The engine covers a large part of the …
Predicts coherence from quantum heat engine noise using machine learning.
This monograph aims at providing an introduction to key concepts, algorithms, and theoretical results in machine learning. The treatment concentrates on probabilistic models for supervised and unsupervised learning problems. It introduces fundamental concepts and algorithms by building on first principles, while also e…
A growing interest has been witnessed recently from both academia and industry in building nearest neighbor search (NNS) solutions on top of full-text search engines. Compared with other NNS systems, such solutions are capable of effectively reducing main memory consumption, coherently supporting multi-model search and…