Paper introduces a new model for polyphonic music composition.
problem Creating music with multiple interwoven voices.
method Developed a coupled recurrent model using probabilistic factorization and neural network ideas.
result Trained models for single-voice and multi-voice composition on a large dataset.
New dataset shows state-of-the-art embeddings fail on compositional tasks.
problem Evaluating compositional semantics in sentence embeddings.
method Developed a new dataset for natural language inference (NLI) that requires compositional understanding.
result State-of-the-art sentence embeddings perform poorly on new compositional dataset.
New method to measure compositional generalization on realistic data.
problem Limited compositional generalization in machine learning.
method Maximizing compound divergence while ensuring small atom divergence.
result Machine learning architectures fail to generalize compositionally.
We present new computations of tight shapes obtained using the constrained gradient descent code RIDGERUNNER for 544 composite knots with 12 and fewer crossings, expanding our dataset to 943 knots and links. We use the new data set to analyze two outstanding conjectures about tight knots, namely that the ropelengths of…
New scalable methods for robust model learning from large datasets.
problem Training robust models resistant to data distribution shifts.
method Composite optimization for distributionally robust optimization (DRO).
result Scalable methods for learning robust models from large datasets.
New kernels from neural networks show better performance than traditional methods.
problem Improving neural network performance on small datasets.
method Developed algebraic operations to create compositional kernels from neural network architectures.
result Compositional kernels achieve higher accuracy than neural tangent kernels and neural networks on small datasets.
SCL discovers compositional structures in analogical reasoning tasks.
problem Discovering compositional structures in analogical reasoning tasks like Raven's Progressive Matrices.
method Proposes Scattering Compositional Learner (SCL) that composes neural networks in sequence.
result Achieves state-of-the-art performance on RPM datasets with significant improvements.
Develops methods for causal inference in compositional data using instrumental variables.
problem Interpreting summary statistics like diversity indices as causal effects in compositional data.
method Statistical data transformations and regression techniques tailored for compositional data.
result Advantages and limitations of the proposed methods demonstrated on synthetic and real microbiome data.
Adapts Altman's model to compositional data for bankruptcy prediction.
problem Predicting business default using standard financial ratios has issues.
method Uses compositional data methodology with log-ratios and machine learning.
result Compositional methods improve predictive performance, especially random forests.
Learning embeddings of entities and relations is an efficient and versatile method to perform machine learning on relational data such as knowledge graphs. In this work, we propose holographic embeddings (HolE) to learn compositional vector space representations of entire knowledge graphs. The proposed method is relate…
New composite indicators reveal hidden relationships between indicators.
problem Subjective aggregation of indicators leads to missed information.
method Used dimensionality reduction techniques (PCA, filtering, clustering) to reveal hidden relationships.
result Cluster-driven composite indicators outperform traditional ones in data reconstruction.
Sharp privacy bounds for sequential analysis of sensitive data.
problem Privacy degradation under sequential analysis of sensitive data.
method Edgeworth expansion in f-differential privacy framework.
result Improved privacy bounds under composition with refined approximation accuracy.
Generative model synthesizes complex data structures with composite and nested types.
problem Synthesizing complex data structures with composite and nested types.
method Generic framework using causal transformers for struct and list generation.
result Consistently outperforms state-of-the-art models on standard and complex hierarchical datasets.
Diffusion models learn hierarchical composition rules from data.
problem How many samples do generative models need to learn hierarchical composition rules?
method Theoretical and empirical investigation of diffusion models on probabilistic context-free grammars.
result Diffusion models learn hierarchical composition rules with sample complexity scaling polynomially with context size.
A new offline RL framework unifies imitation learning and vanilla offline RL.
problem Learning from expert datasets without active data collection.
method A new offline RL framework that interpolates between imitation learning and vanilla offline RL, using a weak concentrability coefficient and a lower confidence bound algorithm.
result LCB algorithm achieves a faster rate of 1/N for nearly-expert datasets, and is adaptively optimal for the entire data composition range. New framework interprets deep neural networks through input structure.
problem Limited understanding of how input structure, network parameters, and optimization algorithms work together.
method Introducing a novel theoretical framework based on the compositional structure of piecewise linear activation functions.
result Shows that input instances can be grouped based on their similarity in the internal representation of the neural network.
New method for identifying phase shifts in XRD data.
problem Automating phase extraction from large XRD datasets.
method Nonnegative Matrix Factorization integrated with custom clustering.
result Robust determination of phase shifts and accurate phase diagrams.
A new geometry-preserving method for interpreting compositional data.
problem Statistical challenges in high-dimensional compositional data.
method Geometry-preserving framework for dimension reduction of compositional data.
result Identification of a central compositional subspace for compositional predictors.
Improved GP models for scalable large data sets.
problem Computational infeasibility of Gaussian process models for large datasets.
method Composite likelihood approach with recursive computation and hyper-parameter learning.
result The derived composite GP model provides accurate predictions and hyper-parameter learning.
StackedGP framework integrates and enhances predictions of environmental variables.
problem Improving predictions of environmental variables with quantified uncertainties.
method A network of independently trained Gaussian processes (StackedGP) that integrates different datasets, enhances predictions through intermediate predictions, and propagates uncertainties.
result Validation and application in real data show the effectiveness of the StackedGP model in model composition and cascading predictions.
Efficient logistic regression for aggregated data reduces computation time.
problem Inference for logistic regression models is computationally expensive for large datasets.
method Adapted symbolic data analysis to summarise predictor variables into histograms and use composite likelihoods.
result The method achieves comparable classification rates to full data analysis but at lower computational cost.
Deep learning model separates syntax and semantics for better language generalization.
problem Standard deep learning methods struggle with systematic generalization in natural language.
method Implemented a Syntactic Attention model that separates syntactic and semantic processing.
result The Syntactic Attention model outperforms standard methods on a compositional generalization task.
This paper improves neural network explanations by quantifying and visualizing semantic compositions.
problem Improving neural network explanations for natural language processing tasks.
method Proposes a formal way to quantify word and phrase importance, introduces SCD and SOC algorithms.
result Our algorithms outperform prior methods in explaining neural network predictions.
Proposes a novel method to identify complex effects in multi-view datasets.
problem Challenges in analyzing multi-view biomedical datasets with complex interactions.
method Generalized kernel machine approach considering marginal and joint effects of features from different views.
result Effective identification of higher-order composite effects in multi-view datasets.
We propose a framework for training GANs on composed data, improving model modularity and interpretability.
problem Training GANs on complex, composed data.
method Composition/decomposition framework for adversarially training GANs on composed data.
result Improves modularity, extensibility, and interpretability of GANs.
Unified tensor model disentangles object appearance factors.
problem Representing hierarchical intrinsic and extrinsic causal factors of object appearance.
method Compositional hierarchical tensor factorization.
result Interpretable object representation robust to occlusion and reduced training data requirements.
CFA improves model's ability to generalize across unseen domain-class combinations.
problem Challenges in real-world machine learning applications due to data distribution shifts and limited training data.
method Developed Compositional Feature Alignment (CFA) technique to improve CG ability of pretrained models.
result CFA outperforms common finetuning techniques in compositional generalization.
Three supervised learning methods for selecting logratios in compositional data analysis.
problem Selecting logratios for predicting a dependent variable in compositional data.
method Three supervised learning methods: unrestricted search, parts restriction, and additive logratios.
result The first method excels in predictive power, while the other two are more interpretable.
Energy-based models can generate complex images by combining simpler concepts.
problem Generating natural images that satisfy complex logical combinations of concepts.
method Energy-based models combine probability distributions of simpler concepts to generate compositions.
result Energy-based models can generate images that satisfy conjunctions, disjunctions, and negations of concepts.
New framework infers multiple classes per image for one-shot learning.
problem Inferring multiple classes per image in one-shot learning.
method Compositional embedding framework with joint training of embedding and composition/query functions.
result Compositional embedding models outperform existing methods on various datasets.
CB-GLNs learn video data's complex dependencies via graph representation.
problem Capturing complex dependency structures in sequential data like videos.
method Represent video data as a graph, find compositional dependencies via graph-cut and message passing.
result CB-GLNs efficiently learn video data's semantic compositional structure.
New insights into privacy guarantees for subsampled mechanisms under composition.
problem Tight privacy guarantees for the composition of subsampled differentially private mechanisms.
method Addressed confusion points in privacy accounting for subsampled mechanisms, providing examples and counterexamples.
result Privacy guarantees for subsampled mechanisms differ significantly between Poisson subsampling and sampling without replacement.
PICLE uses probabilistic models to efficiently evaluate and compose modules for continual learning.
problem Challenging search space of module compositions in continual learning.
method Probabilistic framework to cheaply compute module compositions' fitness.
result First modular CL algorithm to achieve perceptual, few-shot, and latent transfer.
A new neural network for text classification reduces parameters with improved accuracy.
problem Reducing the number of parameters in text classification models.
method Compositional coding, capsule network, k-means routing algorithm.
result The proposed method achieves competitive accuracy with significantly fewer parameters.
Paper introduces variance reduction for infinite datasets with finite-sum structure.
problem Optimizing composite and strongly convex objectives with stochastic perturbations.
method Variance reduction approach for stochastic optimization with composite and strongly convex objectives.
result Convergence rate outperforms SGD with a smaller constant factor.
A new clustering method using transportation distance for multilevel data.
problem Multilevel clustering problems, especially with large datasets.
method Probabilistic approach based on composite transportation distance, solving a joint optimization problem over probability measures.
result Efficient and scalable solution for multilevel datasets, demonstrated on synthetic and real data.
Simple model outperforms neural networks on language understanding tasks.
problem Neural networks struggle with creating novel expressions from familiar ones.
method Attention-inspired modification of a baseline model, focusing on sequential thinking and acting.
result Simple model achieves good performance on gSCAN tasks, validating the benchmark.
Describes explaining neurons in deep representations using compositional logical concepts.
problem Interpreting neuron behavior in deep neural networks.
method Identifying compositional logical concepts that closely approximate neuron behavior.
result Compositional explanations provide insights into model performance and allow for adversarial example creation.
Generative model improves scene graph prediction for rare compositions.
problem Challenges in inferring unseen or rare scene graph compositions.
method Synthesizing rare scene graphs by perturbing real ones, using conditional GANs.
result Marginal but consistent improvements in zero- and few-shot metrics.
Developed neural network for predicting mechanical properties of composite materials.
problem Predicting and optimizing mechanical properties of composite materials.
method Convolutional neural network model integrated with a genetic algorithm optimizer.
result Highly accurate predictions and optimal microstructural designs identified.
Sublinearly structured DNNs achieve feature learning consistency for compositional functions.
problem Achieving feature-learning and prediction consistency in deep neural networks.
method Sublinearly structured DNNs
result Sublinearly structured DNNs match or surpass wide DNNs in prediction.
New methods for predicting compositional data using conformal prediction.
problem No well-established methods for constructing valid prediction sets in compositional data.
method Investigated three conformal prediction-based approaches for Dirichlet regression models.
result HDR approximation approach is robust in terms of coverage, while grid discretization reduces overcoverage.
Paper improves gas species identification in complex mixtures using neural networks.
problem Identifying gas species in multi-gas mixtures with high accuracy.
method Multi-label neural networks with optimal thresholding for IR spectroscopy.
result Optimal thresholding improves classification performance over conventional methods.
3D RadViz improves 3D data visualization of multidimensional datasets.
problem Tackles the challenge of visualizing multidimensional datasets in 3D.
method Develops RadViz3D, a 3D radial visualization tool with uniform anchor points.
result Improves the display of multidimensional datasets, especially for uncorrelated variables.
New algorithm framework solves stochastic composite nonconvex optimization problems efficiently.
problem Solving stochastic composite nonconvex optimization problems.
method ProxSARAH framework using SARAH estimator with proximal gradient and averaging steps.
result Achieves best-known complexity bounds with constant and adaptive step-sizes.
The paper proposes a method to efficiently predict using labeled binary trees and analyzes the number of samples needed.
problem Efficiently predicting using compositional nonparametric models.
method A compositional nonparametric method expressed as a labeled binary tree, with a greedy algorithm for regression validation.
result The sufficient number of samples is O(klog(pq)+log(k!)), and the necessary number of samples is Ω(klog(pq)−log(k!)). Adaptive MAB algorithms handle composite, anonymous feedback without reward interval knowledge.
problem Multi-armed bandit with composite and anonymous feedback, especially without reward interval size knowledge.
method Proposed adaptive algorithms for stochastic and adversarial cases, without reward interval knowledge.
result First algorithm for adversarial case handling non-oblivious adversary and unknown reward interval size.
Improved atomistic model predicts molecular properties using weighted skip-connections.
problem Understanding the relative importance of interactions in molecular property prediction.
method Extended SchNet architecture with weighted skip-connections to analyze molecule properties.
result Relative weighting of interaction blocks depends on molecule's chemical composition and configurational degrees of freedom.