The paper proposes a system for faster probabilistic program inference.
problem Intractable probabilistic program inference in PPLs.
method Amortized inference using guide programs with neural network components.
result Preliminary results show faster inference with guide programs.
Neural model guides PBE problem solving in programming.
problem Synthesizing programs from example inputs/outputs.
method Uses a neural model to guide miniKanren's constraint logic programming system.
result Synthesizes programs faster and generalizes to larger problems.
Enhances data programming with continuous labeling functions for better model performance.
problem Scarcity of labeled data hampers supervised learning models.
method Integrates continuous scoring functions and quality guides into a generative model to improve data programming reliability.
result Continuous labeling functions lead to improved recall and more stable model performance.
PG-IM uses neural-symbolic programs to manipulate images.
problem Creating holistic image representations and manipulations.
method PG-IM detects patterns, induces symbolic programs, and manipulates images using a neural network.
result PG-IM learns from a single image and achieves superior performance.
BUSTLE synthesizes programs by learning from intermediate values.
problem Challenges in synthesizing complex programs due to large search space.
method Bottom-up search guided by a neural network trained on input-output examples.
result Bottom-up search with execution of intermediate programs provides valuable semantic information.
Adapting neural networks to guide program optimization for better classifiers.
problem Learning differentiable programs with complex architectures.
method Formulating program optimization as a graph search problem, using neural networks as heuristic relaxations.
result Trained neural networks can guide combinatorial search for programmatic classifiers, improving accuracy and interpretability.
Neurally-Guided Structure Inference combines search and data-driven methods for efficient, robust structure inference.
problem Combining the advantages of exhaustive search and data-driven methods for structure inference.
method Neurally-Guided Structure Inference (NG-SI) uses a neural network to guide hierarchical search over structures.
result NG-SI outperforms search-based and data-driven methods on probabilistic matrix decomposition and symbolic program parsing.
Self-guided ALPs improve MDP policies without domain knowledge.
problem Improving MDP policies with minimal domain knowledge.
method Self-guided sequence of ALPs with random basis functions and state-relevance distribution.
result High probability error bounds and improved policy performance.
Researchers solved a problem about extreme mass distributions in quasi-copulas.
problem Solving the extreme mass distribution problem for quasi-copulas.
method Analytical approach using linear programming.
result Complete solution to the original problem, disproving a conjecture.
Gradient-guided nested sampling improves posterior inference efficiency.
problem Efficiently sampling from complex posterior distributions.
method Gradient-guided nested sampling combining differentiable programming, Hamiltonian slice sampling, clustering, mode separation, dynamic nested sampling, and parallelization.
result Significantly faster mode discovery and more accurate partition function estimates.
Framework uses neural networks to learn fitness functions for machine programming.
problem Automatic software generation and crafting effective fitness functions.
method Genetic algorithms augmented with neural networks and a search heuristic.
result Framework discovers more correct programs with fewer candidate generations.
DeepHGNN detects program identity changes using system behaviors.
problem Detecting program identity changes to prevent malware.
method Attentional heterogeneous graph neural network (DeepHGNN) for graph classification.
result DeepHGNN effectively identifies program identities across various metrics.
SPoC uses search to translate pseudocode into correct programs with error localization.
problem Mapping pseudocode to functionally correct long programs.
method Search-based approach guided by compilation errors for credit assignment.
result Search improves synthesis success rate from 25.6% to 44.7%.
Paper tackles partial label learning with self-guided retraining.
problem Dealing with partially labeled examples where each instance has a set of candidate labels.
method Unified formulation with constraints for joint training and pseudo-labeling; maximum infinity norm regularization for automatic differentiation; convex-concave optimization problem; upper-bound surrogate objective function.
result Significantly outperforms state-of-the-art partial label learning approaches.
CrossBeam learns to search more efficiently in program synthesis.
problem Efficiently searching through vast program spaces.
method Trains a neural model to guide program synthesis, combining previously explored programs.
result CrossBeam explores much smaller portions of the program space compared to state-of-the-art methods.
System uses machine learning and automated reasoning to speed up PBE synthesis.
problem Slow synthesis in PBE due to domain-specific knowledge and large training datasets.
method Preprocess SyGuS PBE problems with a neural network to reduce search space, then use automated reasoning for faster solution.
result System outperforms all competing tools in the 2019 SyGuS Competition for the PBE Strings track by 47.65%.
DP-Net uses dynamic programming for efficient deep neural network compression.
problem Efficiently compressing deep neural networks while maintaining accuracy.
method Dynamic Programming for optimal weight quantization and clustering-friendly training.
result Achieves up to 77X compression ratio on Wide ResNet with minimal accuracy loss.
BPI models 2D patterns on multiple planes and 3D scene from a single image.
problem Understanding and editing images with multiple 2D planes and 3D scene from a single image.
method Box Program Induction (BPI) with neural networks and search-based algorithm.
result Holistic, structured scene representation enables 3D-aware image editing.
EvoNUDGE uses graph neural networks to improve genetic programming performance.
problem Efficiency in evolutionary computation for problem solving.
method Graph neural network to elicit additional knowledge from symbolic regression problems.
result EvoNUDGE significantly outperforms conventional and neural genetic programming methods.
Framework learns to optimize tensor programs for various hardware.
problem Manual optimization of tensor operators for deep learning limits applicability and increases engineering costs.
method Learning-based statistical cost models guide tensor operator implementations over billions of variants.
result Framework delivers performance competitive with hand-tuned libraries across multiple hardware targets.
Adaptive learning method for stochastic programs with latent uncertainty.
problem Stochastic programming problems with implicitly decision-dependent uncertainty.
method Adaptive learning-based surrogate method integrating simulation and statistical estimates.
result Established non-asymptotic convergence rate analysis for enhanced stability and efficiency.
A new probabilistic LGP method improves symbolic regression performance.
problem Traditional LGP's random search limits its effectiveness.
method Integrates SCFG with LGP, updating grammar based on selected individuals.
result Statistically better results on symbolic regression benchmarks.
Nemo improves WS learning pipeline by 20%.
problem Creating effective labeling heuristics for weak supervision.
method Interactive procedure for designing heuristics, strategic data selection, contextualization of heuristics.
result Improves WS learning pipeline by 20%.
Mixed integer programming identifies critical neurons in neural networks.
problem Identifying neurons critical for network performance and generalization.
method Developed a mixed integer program (MIP) to assign importance scores to neurons, guiding pruning decisions.
result The method identifies multiple 'lucky' sub-networks resulting in optimized architectures that generalize across datasets.
Etalumis bridges scientific simulators and probabilistic programming.
problem Infeasibility of rewriting scientific simulators for Bayesian inference.
method Cross-platform probabilistic execution protocol, MCMC and IC engines, distributed training of 3DCNN-LSTM.
result Achieved largest-scale posterior inference in a Turing-complete PPL for LHC use-case.
Framework optimizes battery storage for markets by separating long-term degradation from short-term market dynamics.
problem Intractable computation due to timescale mismatch between battery degradation and market dynamics.
method Approximate dynamic programming with value function approximation and pseudo-time encoding.
result Policy outperforms benchmarks in real-time market scenarios.
Stan models are compiled to generative languages and extended with new features.
problem Lack of direct support for variational inference and deep models in Stan.
method Comprehensive compilation scheme to convert Stan models to generative languages, and extension of Stan with new features.
result NumPyro backend yields a 2.3x speedup compared to Stan in geometric mean over 26 benchmarks.
Machine learning improves searching for polynomial proofs.
problem Automatically searching for proofs of polynomial inequalities.
method Deep reinforcement learning guiding inference rules in semi-algebraic proof systems.
result Reduces the size of linear programs by several orders of magnitude.
DL/FBF improves GPSR solutions by selecting compact, generalising expressions.
problem Overfitting and structural bloat in symbolic regression with genetic programming.
method Description length (DL) and fractional Bayes factor (FBF) criteria for selecting compact, generalising expressions.
result DL/FBF post-selection improves test performance compared to AIC/BIC baseline.
Variational inference improves hierarchical imitation learning of control programs.
problem Learning structured control policies from demonstrations.
method Variational inference for discovering hierarchical structure in observation-action traces.
result Variational inference leads to more efficient and generalized control policies.
MIP-GNN uses graph neural networks to predict variable biases for MIP solvers.
problem Improving combinatorial optimization through data-driven insights.
method Encoding MILP interactions as graphs, training a graph neural network to predict variable biases, and guiding the MIP solver with these predictions.
result Significant improvements in solving binary MILPs compared to default settings of state-of-the-art solvers.
PGLMC tackles HDLSS problems with improved linear classifier.
problem Challenges in high-dimensional low-sample-size data sets.
method Population-guided large margin classifier (PGLMC) with comprehensive consideration of local structural information and training samples.
result PGLMC outperforms state-of-the-art methods in most cases.
New tool improves scalability of data-driven invariant inference.
problem Scaling data-driven invariant inference to programs with many variables.
method Developed oasis tool to improve scalability.
result Outperforms state-of-the-art systems on benchmarks.
New algorithm reduces online decision-making regret with efficient LP re-solving and parallel first-order method.
problem Worse regret guarantees and high computational cost of LP-based OLP algorithms.
method Combines LP-based and first-order OLP methods, re-solving LP subproblems periodically and using parallel first-order method.
result Achieves O ( log ( T / f ) + f ) \mathscr{O}(\log (T/f) + \sqrt{f}) O ( log ( T / f ) + f ) regret, balancing computational efficiency and superior regret guarantee. New heuristics improve genetic programming's parent selection for classification problems.
problem Improving genetic programming's parent selection for classification tasks.
method Proposed three heuristics inspired by specific classifiers' characteristics, using similarity measures.
result Combination of agreement-based selection and random selection outperforms classical and state-of-the-art schemes.
TPOT-MDR uses genetic programming to automatically design machine learning pipelines for bioinformatics studies.
problem Efficiently analyzing complex diseases in genome-wide association studies.
method Genetic programming combined with Multifactor Dimensionality Reduction (MDR) and expert knowledge-guided feature selector.
result TPOT-MDR significantly outperforms modern machine learning methods and produces high-accuracy, interpretable solutions.
This study optimizes cycle representatives in persistent homology using linear programming.
problem Non-uniqueness of cycle representatives in persistent homology creates ambiguity.
method Optimization of cycle representatives using linear programming methods.
result Optimization reduces the size of cycle representatives and is effective in most data sets.
LIBTwinSVM offers a free library for efficient Twin Support Vector Machines.
problem Large-scale classification problems.
method Efficient implementation of Twin Support Vector Machines.
result Effectiveness demonstrated through benchmarks.
New framework verifies reinforcement learning systems without altering neural networks.
problem Lack of assurance guarantees in reinforcement learning applications.
method Repurposes formal verification techniques for reinforcement learning, synthesizing simpler programs that preserve safety.
result Synthesized programs ensure safety of reinforcement learning systems without modifying neural networks.
Paper characterizes optimal learning trajectories for high-dimensional nonlinear models.
problem Characterizing optimal learning trajectories in high-dimensional nonlinear models.
method Exploits maximum principle and dynamic programming for an optimal control problem of a gradient system.
result Constructs optimal learning trajectories leading to optimal model parameters.
Paper tackles efficient exploration of unseen graph-structured environments.
problem Efficient exploration of unseen graph-structured environments.
method Learning to explore framework using reinforcement learning and graph-structured memory.
result Approach outperforms hand-engineered methods in software testing and real-world applications.
New method allows sheets to morph into multiple shapes via spatially varying stimuli.
problem Limitation of current shape-programmed sheets to achieve only one target geometry.
method Patterning the stimulus itself for spatiotemporal control over local deformation magnitudes.
result A single physical sample can be induced to traverse a continuous family of target geometries.
Efficiently projects points onto polytopes, especially useful in web-scale applications.
problem Efficiently projecting points onto polytopes in large-scale applications.
method Developed a vertex-oriented incremental algorithm for polytope projection, tailored for simplex and unit-box cut polytopes.
result Majority of projections lie on vertices of polytopes, leading to significant performance improvements.
Nucleosome positioning is an important process required for proper genome packing and its accessibility to execute the genetic program in a cell-specific, timely manner. In the recent years hundreds of papers have been devoted to the bioinformatics, physics and biology of nucleosome positioning. The purpose of this rev…
Exact simulation of correlated binary outcomes using PMF constraints and linear programming.
problem Simulating dependent Bernoulli outcomes with specific means and correlations.
method Formulate the problem over the joint Bernoulli PMF, impose constraints, and solve as a linear program. Use convex-hull characterization and truncated-moment completion scheme for feasibility and simulation.
result Exact simulation framework for correlated binary outcomes, providing a convex-hull characterization and truncated-moment completion scheme.
The paper proposes a test for trading intelligence similar to the Turing Test.
problem Determining if trading programs exhibit intelligent behavior.
method Develops a test based on the Turing Test for financial trading programs.
result Introduces a method to assess trading intelligence in financial markets.
Paper introduces a new IS scheme for estimating distribution tails of complex models.
problem Scalability and feasibility issues in traditional IS schemes for rich models.
method Develops a self-structuring IS approach guided by large deviations principles.
result First to achieve asymptotically optimal variance reduction across various multivariate distributions.
New framework optimizes complex systems decisions via simulation.
problem Optimizing strategic, tactical, and operational decisions in complex systems.
method Global-local metamodel assisted two-stage optimization via simulation.
result Framework efficiently searches for optimal decisions with unknown objective.