A framework for analyzing regularizers to ensure trustworthy theory-driven model estimation.
problem Uncertain choice of regularizers can compromise the interpretability of deep grey-box models.
method Adapting neural net architecture and training objective to analyze regularizer behavior empirically.
result Empirical analysis of regularizers helps in making a justified choice for trustworthy theory-driven model estimation.
We introduce a theory-driven mechanism for learning a neural network model that performs generative topology design in one shot given a problem setting, circumventing the conventional iterative process that computational design tasks usually entail. The proposed mechanism can lead to machines that quickly response to n…
Natural language processing (NLP) can be done using either top-down (theory driven) and bottom-up (data driven) approaches, which we call mechanistic and phenomenological respectively. The approaches are frequently considered to stand in opposition to each other. Examining some recent approaches in deep learning we arg…
LeJEPA provides a scalable, theory-driven approach to self-supervised learning.
problem Lack of practical guidance and theory in JEPAs.
method Identified optimal Gaussian distribution and introduced SIGReg objective.
result LeJEPA achieves state-of-the-art performance with minimal hyperparameters and heuristics.
BacHMMachine harmonizes Baroque chorales using theory-driven principles and Hidden Markov Models.
problem Algorithmic harmonization of Baroque chorales.
method Theory-driven approach guided by music composition principles, combined with data-driven learning of key and chord transitions.
result BacHMMachine generates musically coherent harmonizations with reduced computational burden and greater interpretability.
Faster, context-aware topic modeling approach unveiled.
problem Slow and heavy preprocessing in topic modeling.
method Conceptualizes topics as independent axes, decomposes embeddings using ICA.
result 4.5x faster than BERTopic on average, with diverse and coherent topics.
Operationalizes engagement as human behavior, linking theory and data.
problem Fuzziness of engagement concept.
method Formal framework, Melchoir Model, model comparison, theory-driven hypothesis.
result Engagement can be shaped and interpreted using data-driven methods.
Algorithm ensures demographic parity in regression without sensitive attribute data.
problem Performing regression with demographic parity constraints.
method Post-processing algorithm using accurate estimates and sensitive attribute predictor.
result Generates predictions meeting demographic parity constraint.
This paper tackles noise in raw datasets to improve representation learning efficiency.
problem Noise in real-world datasets degrades representation learning quality.
method Proposes denoising Cosine-Similarity (dCS) loss to learn robust representations.
result Empirical results show the dCS loss outperforms baseline objective functions.
Hybrid model combines physics and data to handle incomplete systems.
problem Incomplete physics models with missing terms.
method Combines deep grey-box models with Optimal Transport.
result Enhances incomplete physics models with superior performance.
This paper improves model training by using a reference model to guide target model training.
problem Improving generalization and data efficiency in model training.
method DRRho risk minimization framework based on Distributionally Robust Optimization (DRO).
result DRRho risk minimization improves generalization and data efficiency compared to training without a reference model.
Develops a flexible batched experimentation framework for limited adaptivity.
problem Challenges of continual reallocation in bandit algorithms with delayed feedback.
method Computational framework leveraging Gaussian sequential experiment and dynamic programming.
result Improves statistical power over standard methods, even compared to Bayesian bandit algorithms.
Study uses SABR model to create implied volatilities from sparse quotes.
problem Creating accurate implied volatility surfaces from limited market data.
method Multitask Gaussian process with SABR model embeddings and hierarchical regularization.
result Model produces more accurate volatilities than single-task methods.
L2O uses machine learning to design optimization methods.
problem Designing efficient optimization methods for specific problem distributions.
method Data-driven approach to automate optimization method design.
result L2O methods are practical for specific problem distributions but fail on out-of-distribution problems.
LoRA-One uses one-step full gradient to align adapters for efficient large model fine-tuning.
problem Fine-tuning large language models efficiently and accurately.
method Properly initializing LoRA adapters using the one-step full gradient and incorporating preconditioners.
result LoRA-One achieves significant empirical improvements over existing methods.
We consider extensive data on Spanish international trades and population composition and, through statistical-mechanics and graph-theory driven analysis, we unveil that the social network made of native and foreign-born individuals plays a role in the evolution and in the diversification of trades. Indeed, migrants na…
New algorithm finds important synapses without training data.
problem Finding important synapses in neural networks without data.
method Iterative Synaptic Flow Pruning (SynFlow) based on conservation law.
result Algorithm consistently outperforms existing pruning methods.
Study combines SEM, OLS, and DML for robustness checks in survey-based research.
problem Stability of SEM findings under alternative estimation frameworks.
method Staged robustness analysis framework connecting SEM, OLS, and DML.
result Identifies stable and unstable relationships across SEM, OLS, and DML checks.
Geometric approach combines asset returns and investor views for better portfolio optimization.
problem Optimizing portfolios with investor-specific views.
method Generalized Wasserstein barycenter (GWB) to integrate statistical asset returns and investor views.
result The geometric approach offers more flexibility and rewards for correct investor views.
Paper proposes an alternative method to price American options using HJM approach.
problem Price American options efficiently and accurately.
method Utilizes HJM technique to model term structure of volatility for equity markets.
result Proposes a new value function, stopping criteria, and stopping time for American options.
We study inference and learning based on a sparse coding model with `spike-and-slab' prior. As in standard sparse coding, the model used assumes independent latent sources that linearly combine to generate data points. However, instead of using a standard sparse prior such as a Laplace distribution, we study the applic…
Quantum machine learning: Adiabatic quantum SVM outperforms classical methods.
problem Training support vector machines efficiently on large datasets.
method Adiabatic quantum computing for SVM training.
result Quantum approach outperforms classical methods in accuracy and scalability.
We develop a semi-analytic approach to the valuation of auto-callable structures with accrual features subject to barrier conditions. Our approach is based on recent studies of multi-assed binaries, present in the literature. We extend these studies to the case of time-dependent parameters. We compare numerically the s…
Two ML approaches learn local volatility surfaces from option prices, with GP being arbitrage-free.
problem Interpolating European vanilla option prices to create a local volatility surface.
method Gaussian process regression and neural net with arbitrage penalties.
result GP approach is arbitrage-free and yields best out-of-sample calibration error.
This paper critiques the Standardized Measurement Approach (SMA) for operational risk and recommends maintaining Advanced Measurement Approach (AMA).
problem Weaknesses and failures of the Standardized Measurement Approach (SMA) in operational risk.
method Critical review and analysis of SMA and AMA approaches.
result SMA is unstable, insensitive to risk, and implicitly related to systemic risk in the banking sector.
Distributed Acoustic Sensing (DAS) using fiber optic cables is a promising new technology for pipeline monitoring and protection. In this work, we applied and compared two approaches for event detection using DAS: Classic machine learning approach and the approach based on image processing and deep learning. Although w…
A new Euclidean approach reveals the pentagram map's beauty.
problem Exploring the pentagram map through classical geometry.
method Introducing an alternative Euclidean approach.
result Demonstrates the pentagram map's elegance through classical geometry.
Two approaches extend knowledge distillation to Gaussian Processes, showing relationships to existing methods.
problem Applying knowledge distillation to Gaussian Processes for regression and classification.
method Data-centric and distribution-centric approaches to extend distillation to GPR and GPC.
result Distribution-centric approach for GPC approximately corresponds to data duplication and scaling.
We discuss the relative merits of optimistic and randomized approaches to exploration in reinforcement learning. Optimistic approaches presented in the literature apply an optimistic boost to the value estimate at each state-action pair and select actions that are greedy with respect to the resulting optimistic value f…
Classical approaches for approximate inference depend on cleverly designed variational distributions and bounds. Modern approaches employ amortized variational inference, which uses a neural network to approximate any posterior without leveraging the structures of the generative models. In this paper, we propose Amorti…
Online boosting method improves weak to strong learner.
problem Online learning of weak to strong learner.
method Extends batch GentleAdaBoost to online approach with line search.
result Online boosting performs better than other methods.
Predicting potential credit default accounts in advance is challenging. Traditional statistical techniques typically cannot handle large amounts of data and the dynamic nature of fraud and humans. To tackle this problem, recent research has focused on artificial and computational intelligence based approaches. In this …
In this paper, we present a new wrapper feature selection approach based on Jensen-Shannon (JS) divergence, termed feature selection with maximum JS-divergence (FSMJ), for text categorization. Unlike most existing feature selection approaches, the proposed FSMJ approach is based on real-valued features which provide mo…
Two new methods for option pricing without or with a riskless asset.
problem Traditional option pricing methods require a riskless asset and may not be market-complete.
method Develops two approaches: one without a riskless asset and one with.
result Both methods produce the same option prices as classical approaches.
An integrated and extendable approach for stress-testing loan portfolios
problem Stress-testing loan portfolios
method Simulate completed portfolios, generate uncertain cash flow history, compute credit risk metrics
result Enhanced stress-testing practices within any bank
Bayesian symbolic regression automates model discovery from data.
problem Learning closed-form mathematical models from data using heuristic methods.
method Probabilistic approach to symbolic regression, connecting to information theory and statistical physics.
result Probabilistic approach provides model plausibility and performance guarantees.
New approach interprets Nyström for kernel machines with geometric insight.
problem No comparative study over Nyström-based kernel machine approaches.
method Developed a new approach with geometric interpretation, showing equivalence to existing methods.
result Proposed approach offers insights into approximation errors and accuracy.
Common Representation Learning (CRL), wherein different descriptions (or views) of the data are embedded in a common subspace, is receiving a lot of attention recently. Two popular paradigms here are Canonical Correlation Analysis (CCA) based approaches and Autoencoder (AE) based approaches. CCA based approaches learn …
Two approaches detect EV charging patterns at stations.
problem Identify charging patterns at electric vehicle charging stations.
method Two approaches: rule-based and hierarchical clustering.
result Hierarchical clustering revealed unexpected charging patterns.
The floating body approach to affine surface area is adapted to a holomorphic context providing an alternate approach to Fefferman's invariant hypersurface measure.
We review classical approaches to the problem of isometrically embedding a Riemannian surface into Euclidean 3-space, including coordinate-based approaches exposited by Darboux and Eisenhart, as well as the moving-frames based approaches advocated by Cartan. In particular, the first approach involves reducing the probl…
Paper evaluates CNN-based facial landmark detection methods.
problem Evaluate characteristics and performance of CNN-based facial landmark detection methods.
method Divided into regression and heatmap approaches, investigated using a hybrid loss function and discrimination network.
result Proposed model outperforms other models in all tested datasets.
This paper provides a comprehensive benchmark and taxonomy for certifiably robust DNN defenses.
problem Certifiably robust defenses against adversarial attacks for deep neural networks.
method Taxonomy and benchmark of certifiably robust approaches.
result First comprehensive benchmark of certifiably robust approaches on different datasets.
Saliency maps are often used in computer vision to provide intuitive interpretations of what input regions a model has used to produce a specific prediction. A number of approaches to saliency map generation are available, but most require access to model parameters. This work proposes an approach for saliency map gene…
VB approach for dynamic network models improves efficiency and accuracy.
problem Estimating dynamic network models in large-scale systems.
method Variational Bayesian inference for network autoregression.
result VB approach detects proper active structures and achieves similar or better accuracy.
New approach for prudent risk evaluation using model aggregation.
problem Risk evaluation and optimization under uncertainty.
method Model Aggregation (MA) approach based on stochastic dominance.
result Produces robust risk evaluation and distributional models.
Study proposes a new approach for deep hedging using artificial market simulations.
problem Challenges in selecting the best model for underlying asset simulations in deep hedging.
method Proposes artificial market simulations to replicate financial market stylized facts.
result Achieves similar performance to traditional approaches without mathematical finance models.
Some of recent developments, including recent results, ideas, techniques, and approaches, in the study of degenerate partial differential equations are surveyed and analyzed. Several examples of nonlinear degenerate, even mixed, partial differential equations, are presented, which arise naturally in some longstanding, …