Algorithm finds minimal colorings of tree structures.
problem Finding minimal unbounded factor complexity colorings of trees.
method Induction algorithm using colored balls.
result Characterization of Sturmian colorings.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,291 papers · 148 categories
Trend · papers per month
48 results for “induction algorithm”
Novel framework for Bayesian reinforcement learning infers value function distributions.
problem Bayesian reinforcement learning's challenges in inferring value function distributions.
method Inferential Induction framework for Bayesian reinforcement learning, developing Bayesian Backwards Induction algorithm.
result Proposed algorithm is competitive with state-of-the-art methods.
OTI extends OTP for inductive semi-supervised learning.
problem Inductive semi-supervised learning for out-of-sample data.
method Optimal transport-based approach extended to inductive tasks.
result OTI outperforms state-of-the-art methods in experiments.
Interpolated-MLPs control inductive bias for better performance in low-compute tasks.
problem Low-compute performance gap between MLPs and CNNs.
method Introduced Interpolated MLP (I-MLP) approach to control inductive bias incrementally.
result Continuous logarithmic relationship between inductive bias and performance in low-compute tasks.
I-BERT extends Transformer's self-attention to arbitrary input lengths.
problem Transformer models struggle with inductive generalization to unseen input lengths.
method Replaces positional encodings with a recurrent layer.
result I-BERT achieves state-of-the-art results on algorithmic tasks.
Algorithmic Task Capture, Computational Complexity, and Inductive Bias of Infinite Transformerscs.LG
Transformers capture combinatorial tasks with bounded error and logarithmic sample dependence.
problem Capturing complex combinatorial tasks with bounded error and sample efficiency.
method Formal definition of algorithmic capture, empirical analysis of infinite-width transformers, upper bounds on computational complexity.
result Transformers exhibit an inductive bias favoring simpler algorithmic procedures over higher complexity ones.
This paper examines inductive biases in deep reinforcement learning and their impact on performance.
problem The trade-off between inductive biases and performance in deep reinforcement learning.
method Investigated domain-specific components and adaptive solutions in deep reinforcement learning agents.
result Adaptive components can sometimes outperform domain-specific components, but not always.
Unsupervised MT struggles with morphologically rich languages.
problem Limitations of unsupervised machine translation on morphologically rich languages.
method Adversarial unsupervised alignment of word embedding spaces for bilingual dictionary induction.
result A simple trick exploiting weak supervision from identical words improves unsupervised bilingual dictionary induction performance.
Transformers learn to use induction heads or shortcuts based on data diversity.
problem How data diversity influences the behavior of transformers.
method Gradient-based training of a single-layer transformer on a minimal task.
result Data diversity steers transformers toward induction heads or shortcuts.
Probabilistic models use quantum circuits for sequence tasks.
problem Sequence modeling with classical datasets.
method Gradient-free algorithm based on matrix product states.
result Circuit-based models provide a useful inductive bias for classical datasets.
Discriminative model improves bilingual lexicon induction.
problem Inducing accurate bilingual lexicons between languages.
method Combines bipartite matching and representation-based approaches with an efficient Viterbi EM algorithm.
result The prior improves the induced bilingual lexicons.
This research formalizes inductive generalization and proposes a new learning paradigm called Inductive Learning.
problem Generalization from easy to hard tasks, especially out-of-domain generalization.
method Formalizes inductive generalization, introduces Inductive Learning, and outlines steps to adapt techniques for learning model successors.
result A new learning paradigm (Inductive Learning) that emphasizes induction and universal properties of learning and computation.
R2N learns interpretable rules and literals from numerical features.
problem Lack of expressive vocabulary in rule-based decision models.
method Relational Rule Network (R2N) learns literals and rules end-to-end.
result Learned literals improve prediction accuracy and rule conciseness.
Ensemble method detects time series anomalies without preselecting parameter values.
problem Anomaly detection requires known anomaly length, limiting practicality.
method Ensemble grammar induction for variable-length anomalies.
result Ensemble approach outperforms existing methods with different parameter selections.
Study links neural network inductive bias, feature learning, and generalization on Boolean functions.
problem Understanding how neural networks learn and generalize on Boolean data.
method End-to-end analysis of depth-2 discrete fully connected networks and DNF formulas, using Monte Carlo learning.
result Predictable training dynamics and interpretable features emerge, linking inductive bias and generalization.
Study reveals biases and generalization patterns in deep image models.
problem Understanding the inductive bias of deep generative models in high dimensions.
method Proposed a framework to empirically investigate bias and generalization using designed training datasets.
result Identified similarities to human psychology in model behavior and patterns.
Develops fair decision trees for improved accuracy and fairness.
problem Lack of fairness in machine learning algorithms.
method Regularized tree induction to build fair decision trees.
result Fair Forest retains benefits of tree-based approach and improves accuracy and fairness.
GuideR learns rules guided by user preferences for classification, regression, and survival analysis.
problem Lack of user preferences in rule learning algorithms.
method Guided sequential covering approach.
result User preferences improve rule quality in classification, regression, and survival analysis.
New algorithm reduces sample and computational complexities for matrix completion.
problem Recovering a rank- matrix from features.
method Gradient-based non-convex optimization algorithm with linear convergence rate.
result Linear sample complexity and logarithmic computational complexity.
Induction of Non-Monotonic Rules From Statistical Learning Models Using High-Utility Itemset Miningcs.LG
Algorithm extracts non-monotonic rules from statistical models using HUIM.
problem Extracting non-monotonic rules from statistical learning models.
method Reduces problem to HUIM, uses TreeExplainer for feature importance.
result Significant improvement in classification metrics and training time.
RuleKit aids in creating interpretable models for various data types.
problem Creating interpretable models for different data types.
method Sequential covering induction algorithm for classification, regression, and survival problems.
result Facilitates verification of hypotheses about data dependencies.
GraphSAGE generates node embeddings for unseen data in large graphs.
problem Inductive learning of node embeddings for unseen nodes in large graphs.
method Generative function that aggregates sampled node features from local neighborhoods.
result Outperforms baselines on inductive node classification tasks.
New -capsule networks improve adversarial robustness and explainability of capsule networks.
problem Improving the robustness and explainability of capsule networks.
method Introducing -capsule networks with a new routing algorithm and training method.
result Experimental results show -capsule networks are more robust and transparent.
Study explores efficient data division for ICPs.
problem Efficiently dividing limited development data for ICPs.
method Experiments with training, calibration, and test data divisions.
result Allows overlap between training and calibration sets improves efficiency.
We provide a proof of backpropagation algorithm in matrix notation.
problem The lack of a full induction proof of backpropagation algorithm in matrix notation.
method We provide a full induction proof of the BP algorithm in matrix notation, situating it in the framework of matrix differential calculus.
result We prove the validity of the backpropagation algorithm in inductive form.
Local nonparametric meta-learning improves meta-generalization across tasks.
problem Meta-learning struggles with global inductive biases and out-of-distribution tasks.
method Proposes a local, nonparametric meta-learning algorithm using meta-trained local learning rules.
result Improved meta-generalization and state-of-the-art results in robotics benchmarks.
In this paper, we examine previous work on the naive Bayesian classifier and review its limitations, which include a sensitivity to correlated features. We respond to this problem by embedding the naive Bayesian induction scheme within an algorithm that c arries out a greedy search through the space of features. We hyp…
Neural model learns efficient, general algorithms for various problems.
problem Learning efficient algorithms that generalize well.
method Carefully designed neural model with imitation and reinforcement learning.
result Neural model outperforms custom solutions on sorting and knapsack problems.
Paper compares AutoML methods for recommending classification algorithms.
problem Finding the best classification algorithm for a dataset.
method Four AutoML methods using Evolutionary Algorithms and CASH approach.
result EA-based methods, especially decision-tree induction, produce interpretable models.
New methods to define self-inductance by regularizing divergent integrals.
problem Defining self-inductance for identical loops.
method Regularization of divergent integrals using Neumann/Weber formula.
result Established new methods to calculate self-inductance.
This study examines hyperparameter tuning for CART and C4.5 DT algorithms.
problem Finding optimal hyperparameters for DT algorithms to improve predictive performance.
method Comprehensive empirical study with 94 datasets, using IRACE for tuning.
result Different HP profiles provide significant improvements for CART, but less for C4.5.
Study reveals biases in gradient descent for GLNs, improving neural network performance.
problem Understanding and improving the inductive biases of deep neural networks.
method Derive infinite-time training limit of gated linear networks and generalize to other networks.
result Theoretical framework captures key inductive biases of ReLU networks.
Paper explores how knowledge distillation transfers inductive biases between models.
problem Transferring inductive biases between models for tasks with limited data.
method Knowledge distillation applied to models with different inductive biases (LSTMs vs. Transformers, CNNs vs. MLPs).
result Effect of inductive biases is transferred through knowledge distillation, impacting both performance and solution characteristics.
New method quantifies inductive bias for machine learning tasks.
problem Quantifying the amount of inductive bias in machine learning models.
method Estimates inductive bias by modeling loss distribution of random hypotheses.
result Higher dimensional tasks require greater inductive bias.
Evolutionary algorithms improve decision tree ensembles.
problem Improving predictive performance of decision trees.
method Real-valued vector representation of decision trees, evolutionary algorithms (Differential evolution, Evolution strategies).
result Proposed methods outperform classical decision tree induction algorithms.
AOI algorithm improved predictive maintenance accuracy.
problem Improving predictive maintenance accuracy in industrial assets.
method Extended AOI algorithm with LSTM for anomaly detection and RUL calculation.
result Methodology accurately detected anomalies and calculated RUL with high precision.
Improves transferability of representations from source to target domains with weights and invariant representations.
problem Label shift between source and target domains in unsupervised domain adaptation.
method Integrates weights and invariant representations to bound the target risk, highlighting the role of inductive bias.
result Empirical evidence shows that weak inductive bias makes adaptation more robust.
GENESIM creates interpretable models with improved predictive performance.
problem Overfitting in decision trees leads to poor predictive performance and lack of interpretability.
method GENESIM uses a genetic algorithm to transform an ensemble of decision trees into a single interpretable model.
result GENESIM achieves better predictive performance than decision tree induction and ensemble techniques, while maintaining interpretability.
Sparse group matrix completion reduces complexity and improves performance.
problem Matrix completion with non-informative side features.
method Group-Lasso regularization for feature selection in matrix factorization.
result Theoretical sample complexity is significantly lower than competitors.
Improved stability and generalization for blackbox learned optimizers.
problem Stability and generalization issues in blackbox learned optimizers.
method Investigation using dynamical systems, modifications to optimizer architecture and meta-training procedure.
result Improved stability and generalization of learned optimizers.
No free lunch theorems show all algorithms perform equally under uniform distribution.
problem Analyzing scenarios involving non-uniform distributions and comparing algorithms.
method No Free Lunch theorems applied to analyze and compare algorithms without distribution assumptions.
result Anti-cross-validation performs as well as cross-validation under non-uniform distributions.
A new geometric method for clustering SPD data improves upon Euclidean and Riemannian approaches.
problem Skewed interpretations of SPD data in Euclidean analysis and computational inefficiency of Riemannian methods.
method Proposes a geometric method based on the Thompson metric for unsupervised clustering of SPD data.
result Demonstrates improved clustering results using inductive midrange centroid computation.
A new method for document network embedding interprets and generalizes well.
problem Lack of interpretability and generalization to new documents in existing methods.
method Introduces Topic-Word Attention (TWA) and Inductive Document Network Embedding (IDNE) to generate document representations.
result Achieves state-of-the-art performance on various networks and produces meaningful representations.
One-layer transformers can't solve induction heads task efficiently.
problem Solving the induction heads task efficiently with one-layer transformers.
method Communication complexity argument showing exponential size requirement.
result No one-layer transformer can solve the induction heads task efficiently.
Study the inductive bias of neural networks using neural tangent kernels.
problem Understanding the generalization properties of over-parameterized neural networks.
method Analysis of the neural tangent kernel and its corresponding function space (RKHS).
result Stability properties of functions with finite norm, including stability to image deformations in convolutional networks.
Improved neural networks for relational reasoning by projecting high-dimensional data to low-dimensional manifolds.
problem Out-of-distribution generalization in complex relational reasoning tasks.
method Neuroscience-inspired inductive-biased module projecting high-dimensional object representations to low-dimensional manifolds.
result Significantly better out-of-distribution generalization performance on relational reasoning tasks.
In supervised learning, an inductive learning algorithm extracts general rules from observed training instances, then the rules are applied to test instances. We show that this splitting of training and application arises naturally, in the classical setting, from a simple independence requirement with a physical interp…
This work automates decision tree construction from neural networks.
problem Creating optimal decision tree architectures from neural networks.
method Automatic induction of non-greedy decision trees using weights transfer from neural networks.
result Improved model performance over fixed hyperparameters.