Remove symmetries to improve model optimization and performance.
problem Symmetries in loss functions trap models in low-capacity states, hindering training and optimization.
method Proposes syre, a simple algorithm to remove symmetries in neural networks.
result Removing symmetries correlates well with improved optimization and performance.
Understanding black-box machine learning models is crucial for their widespread adoption. Learning globally interpretable models is one approach, but achieving high performance with them is challenging. An alternative approach is to explain individual predictions using locally interpretable models. For locally interpre…
High-capacity neural network ensembles often benefit more from high-capacity models than from increased diversity.
problem The performance of high-capacity neural network ensembles is often harmed by interventions that promote predictive diversity.
method A large-scale study of nearly 600 neural network classification ensembles, examining various interventions and architectures.
result Discouraging predictive diversity can be benign in large-network ensembles, and higher-capacity models often yield better performance than diverse architectures.
The paper examines how insurers manage risks and liquidity in a dynamic market.
problem Model uncertainty in insurance pricing and competitive equilibrium.
method Analyzes insurers' robustness preferences and optimization strategies for underwriting and liquidity management.
result Robust insurance pricing leads to higher premiums and equity valuations compared to a benchmark.
WGANs improve probability distribution approximation with depth and width trade-offs.
problem Approximating complex probability distributions accurately.
method Wasserstein GANs with GroupSort discriminators, quantified generalization bound.
result High-capacity discriminators are crucial for WGANs' performance.
Importance-weighted risk minimization is a key ingredient in many machine learning algorithms for causal inference, domain adaptation, class imbalance, and off-policy reinforcement learning. While the effect of importance weighting is well-characterized for low-capacity misspecified models, little is known about how it…
In this paper, we propose the nonlinearity generation method to speed up and stabilize the training of deep convolutional neural networks. The proposed method modifies a family of activation functions as nonlinearity generators (NGs). NGs make the activation functions linear symmetric for their inputs to lower model ca…
The performance of gradient-based optimization strategies depends heavily on the initial weights of the parametric model. Recent works show that there exist weight initializations from which optimization procedures can find the task-specific parameters faster than from uniformly random initializations and that such a w…
Deep imagination optimizes decision-making in large trees with limited resources.
problem Optimal planning in large decision trees with limited resources and time.
method Analytical solutions and numerical analysis of sampling capacity allocation.
result Optimal policy is to allocate few samples per level for deep exploration, favoring depth over breadth.
Generalizes conformal prediction to multiple learnable parameters for efficient prediction sets.
problem Learning valid and efficient prediction sets with low-capacity function classes.
method Constrained empirical risk minimization (ERM) with gradient-based optimization of differentiable surrogate losses and Lagrangians.
result Achieves approximate valid population coverage and near-optimal efficiency within class.
Improved breast cancer screening with a fast, memory-efficient model.
problem Classifying high-resolution breast cancer screening images.
method Extends globally-aware multiple instance classifier to handle image-level labels.
result Achieves AUC of 0.93 in classifying malignant findings, outperforming existing methods.
New tensor framework connects Fisher information, hypergraphs, and multi-observable correlations.
problem Missing structure in pairwise Fisher graphs for multi-observable radiation patterns.
method Higher-order Fisher tensors and natural exponential-family coordinates.
result Exact triality of Fisher tensors, cumulants, and hypergraphs.
Neural-Network Quantum States have been recently introduced as an Ansatz for describing the wave function of quantum many-body systems. We show that there are strong connections between Neural-Network Quantum States in the form of Restricted Boltzmann Machines and some classes of Tensor-Network states in arbitrary dime…
Paper finds coefficients of Catalan states using Θ_A-state expansion.
problem Finding coefficients of Catalan states of lattice crossings.
method Uses Θ_A-state expansion to express coefficients as a linear combination of other states.
result Shows that coefficients can be found using Θ_A-state expansion.
We propose the application of a high-speed maximum likelihood clustering algorithm to detect temporal financial market states, using correlation matrices estimated from intraday market microstructure features. We first determine the ex-ante intraday temporal cluster configurations to identify market states, and then st…
Associated to every state surface for a knot or link is a state graph, which embeds as a spine of the state surface. A state graph can be decomposed along cut-vertices into graphs with induced planar embeddings. Associated with each such planar graph is a checkerboard surface, and each state surface is a fiber if and o…
This paper tackles belief-state selection in simulators with latent states.
problem Selecting among approximate belief-state samplers for simulators with latent variables.
method Reduces belief-state selection to conditional distribution selection, develops algorithms and analyses.
result Different formulations of belief-state selection have varying guarantees under different roll-out methods.
New method for state inference in state-space models with unknown dynamics.
problem State inference in state-space models with computationally expensive and undefined dynamics.
method Estimate state transition dynamics using a multi-output Gaussian process and Bayesian Neural Network as a surrogate model.
result Significant improvement in accuracy for state inference and prediction in non-stationary user models.
New proof for knot state-sum formula using bijection between states.
problem Proving a knot state-sum formula for colored Jones polynomial.
method Established bijection between states on arc-graph and bichromatic digraph, used flow property of R-matrix.
result Two state models are essentially the same, extending formula to links.
New method uses entropy to improve policy gradient exploration.
problem Limited exploration in policy gradient methods.
method Entropy regularization with discounted future state distribution.
result Proves convergence to locally optimal policy.
A new method learns state and proposal dynamics in state-space models using neural networks.
problem Inference in non-linear state-space models.
method StateMixNN method using neural networks for proposal and transition distributions.
result Significantly improved recovery of hidden state, especially in highly non-linear scenarios.
In this letter we borrow from the inference techniques developed for unbounded state-cardinality (nonparametric) variants of the HMM and use them to develop a tuning-parameter free, black-box inference procedure for Explicit-state-duration hidden Markov models (EDHMM). EDHMMs are HMMs that have latent states consisting…
The paper develops a state-space approach to deep Gaussian processes for efficient state estimation.
problem Efficient regression and state estimation for deep Gaussian processes.
method Hierarchical transformed Gaussian process priors, state-space representation, linear stochastic differential equations, sequential methods.
result The state-space approach enables efficient state estimation and regression for deep Gaussian processes.
Method learns CTMC models from steady-state data, predicting unseen states.
problem Learning CTMC models from aggregate steady-state statistics without sequence examples.
method ∞-SGD, a stochastic gradient descent method that avoids infinite sums.
result Successfully learns CTMC models and predicts unseen states.
This work improves policy optimization by maximizing entropy of state distribution, leading to better exploration.
problem Lack of exploration in state space when maximizing policy entropy.
method Proposes maximizing the entropy of a lower bound approximation to the state weighting distribution, based on latent space representation.
result Entropy regularization based on marginal state distribution achieves superior state space coverage and better performance in various domains.
A new asset allocation model uses Markov states from clustered efficient frontier coefficients.
problem Characterizing market regimes using efficient frontiers for better asset allocation.
method Hierarchical clustering of monthly efficient frontier coefficients to define states, then a Markov process on these states for portfolio optimization.
result The model significantly outperforms benchmark portfolios empirically.
Bayesian model detects altered neural circuits in MCI patients.
problem Detecting altered neural circuits in Mild Cognitive Impairment patients.
method Hierarchical Bayesian recurrent state space model.
result Model discovers latent states predominantly observed in MCI patients.
Quantum states can be learned efficiently using gentle measurements.
problem Efficiently learning quantum states with minimal measurements.
method Introducing α-LGM measurements and proving strong quantum DPI.
result The number of states needed for accurate learning is of order 1/(ε^2 α^2).
Proposes a new model for time series that considers smooth transitions between states.
problem Models assume instantaneous transitions between discrete states, ignoring gradual changes.
method Dynamical Wasserstein Barycentric (DWB) model that estimates system state and pure state distributions over time.
result Accurately learns pure state distributions and improves state estimation for transition periods.
Quantum states associated with subsets of product manifolds are separable.
problem Characterizing quantum states associated with subsets of product manifolds.
method Using holomorphic sections of quantum line bundles and restriction maps.
result Quantum states associated with finite unions of products are separable.
Defines a universal state sum construction for various TQFTs.
problem No specific problem stated; universal construction for TQFTs.
method Defines a universal state sum construction using n-categories with specific conditions.
result Produces state sums from n-categories and handle decompositions of n+1-manifolds.
The accurate and interpretable prediction of future events in time-series data often requires the capturing of representative patterns (or referred to as states) underpinning the observed data. To this end, most existing studies focus on the representation and recognition of states, but ignore the changing transitional…
This paper simplifies OPE in large state spaces using state abstractions.
problem Accurately evaluating policies offline in large state spaces.
method Developed a backward-model-irrelevance condition and an iterative state abstraction procedure.
result Deeply-abstracted states substantially simplify OPE sample complexity.
New method finds unseen states for RL, improving performance.
problem Offline RL struggles with unseen states and actions.
method Value-informed state perturbations and filtering.
result Improved performance in offline RL tasks.
Characterizes optimal-speed quantum state evolution Hamiltonians.
problem Optimal-speed unitary time evolution of pure and quasi-pure quantum states.
method Construction of the manifold of pure states and isometry with flag manifold, characterization of equigeodesic vectors.
result Hamiltonians generating optimal-speed time evolution are fully characterized by equigeodesic vectors of the flag manifold.
SiBBlInGS discovers interpretable building blocks across states in multi-way data.
problem Identifying interpretable units (Building Blocks) in multi-state, multi-way data.
method Graph-based dictionary learning approach for sparse BBs and temporal traces.
result Captures per-trial variability and state-specific vs. state-invariant components.
DAC-SSM learns domain-agnostic states for better imitation learning.
problem Domain shifts hinder imitation learning in partially observable tasks.
method DAC-SSM uses adversarial training to remove domain-dependent information from states.
result DAC-SSM achieves comparable performance to experts in sparse reward tasks.
Studying general quantum many-body systems is one of the major challenges in modern physics because it requires an amount of computational resources that scales exponentially with the size of the system.Simulating the evolution of a state, or even storing its description, rapidly becomes intractable for exact classical…
Protocol learns pure quantum states with minimal disturbance.
problem Efficiently learn quantum states with minimal disturbance.
method Sequential measurements with minimal disturbance.
result Achieves maximal precision with polylogarithmic regret.
An incremental/online state dynamic learning method is proposed for identification of the nonlinear Gaussian state space models. The method embeds the stochastic variational sparse Gaussian process as the probabilistic state dynamic model inside a particle filter framework. Model updating is done at measurement sample …
Paper develops a new state estimation method for nonlinear systems.
problem State estimation for nonlinear state-space models is intractable.
method Developed a variational inference approach based on Gaussian approximations.
result The method outperforms alternative Gaussian approaches in various examples.
We introduce the notion of a "state function" for framed tangles in a disk. After choosing a finite set of states for each marked disk, a state function is a projection from the vector space spanned by all tangles to the vector space spanned by the states, that is local, and topologically invariant. Given the states fo…
Develops machine learning models for excited states of CH2NH2+.
problem Accurately predicting excited-state properties and couplings for CH2NH2+.
method Combines neural networks and kernel ridge regression, encoding electronic states in inputs.
result Improved accuracy in predicting excited-state properties and couplings.
This research improves dynamical systems understanding by identifying latent states and their nonlinear transitions.
problem Previous work on dynamical systems could not identify nonlinear transition dynamics, leading to unreliable predictions.
method Proposes a state-space modeling framework using variational auto-encoders to identify latent states and their nonlinear transition functions.
result Demonstrates high accuracy in recovering latent state dynamics and future prediction accuracy.
We study statistical aspects of state-dependent Hawkes processes, which are an extension of Hawkes processes where a self- and cross-exciting counting process and a state process are fully coupled, interacting with each other. The excitation kernel of the counting process depends on the state process that, reciprocally…
Machine learning aids excited-state molecular dynamics studies.
problem Challenges in studying electronically excited states of molecules.
method Employing machine learning techniques for excited-state molecular dynamics.
result Highlight successes and challenges in machine learning for excited-state processes.
We propose a novel methodology to define, analyze and forecast market states. In our approach market states are identified by a reference sparse precision matrix and a vector of expectation values. In our procedure, each multivariate observation is associated with a given market state accordingly to a minimization of a…
Recurrent neural networks (RNNs) are a vital modeling technique that rely on internal states learned indirectly by optimization of a supervised, unsupervised, or reinforcement training loss. RNNs are used to model dynamic processes that are characterized by underlying latent states whose form is often unknown, precludi…