Massively parallel architectures such as the GPU are becoming increasingly important due to the recent proliferation of data. In this paper, we propose a key class of hybrid parallel graphlet algorithms that leverages multiple CPUs and GPUs simultaneously for computing k-vertex induced subgraph statistics (called graph…
GraphVite efficiently trains node embeddings for large networks.
problem Scaling node embedding algorithms to handle large networks (tens of millions of nodes).
method CPU-GPU hybrid system with parallel edge sampling and negative sampling.
result GraphVite achieves high performance (50x faster) for large networks.
We present Caffe con Troll (CcT), a fully compatible end-to-end version of the popular framework Caffe with rebuilt internals. We built CcT to examine the performance characteristics of training and deploying general-purpose convolutional neural networks across different hardware architectures. We find that, by employi…
New hybrid model reduces MILP solver time by up to 26%.
problem Improving CPU-based MILP solver efficiency.
method Combines GNN and MLP for efficient CPU-based branching.
result Up to 26% reduction in solver running time compared to state-of-the-art methods.
The graphics processing unit (GPU) has emerged as a powerful and cost effective processor for general performance computing. GPUs are capable of an order of magnitude more floating-point operations per second as compared to modern central processing units (CPUs), and thus provide a great deal of promise for computation…
Clustering samples according to an effective metric and/or vector space representation is a challenging unsupervised learning task with a wide spectrum of applications. Among several clustering algorithms, k-means and its kernelized version have still a wide audience because of their conceptual simplicity and efficacy.…
Asymmetry PRISM outperforms CPU and GPU solvers for institutional rebalancing.
problem Institutional rebalancing with deadline constraints
method Asymmetry PRISM
result Asymmetry PRISM-CPU is 4.5x to 24.1x faster than the fastest completed reference row in the same lane.
aweSOM accelerates SOM clustering for large datasets.
problem Scalability issues in existing SOM implementations for large, multidimensional data.
method CPU/GPU-accelerated Self-organizing Maps (SOM) with ensemble stacking.
result 10-100x speed up and improved memory efficiency for large datasets.
AdaNet automates ensemble learning with TensorFlow.
problem Automatic ensemble learning for high-quality models.
method Inspired by AdaNet algorithm, integrates TensorFlow ecosystem, offers flexible API.
result Efficiently accelerates training on various hardware.
Defines non-parabolic curves in spatial hybrid space with applications.
problem Defining and analyzing non-parabolic spatial hybrid framed curves.
method Definition and proof of existence and uniqueness theorem for non-parabolic spatial hybrid framed curves.
result Existence and uniqueness theorem for non-parabolic spatial hybrid framed curves.
Hybrid subgroups found in non-arithmetic PU(2,1) lattices.
problem Exploring hybrid subgroups in non-arithmetic PU(2,1) lattices.
method Exploring hybrid subgroups of certain non-arithmetic lattices in PU(2,1). Showing that Mostow's lattices are virtually hybrids and some are hybrids of two non-commensurable arithmetic lattices in PU(1,1).
result Mostow's lattices are virtually hybrids and some are hybrids of two non-commensurable arithmetic lattices in PU(1,1).
Discussing hybrid models in Bayesian networks.
problem Improving accuracy in network modeling.
method Hybrid semiparametric Bayesian approach.
result Enhanced model performance in complex networks.
Convolutional Neural Networks (CNNs) are extremely computationally demanding, presenting a large barrier to their deployment on resource-constrained devices. Since such systems are where some of their most useful applications lie (e.g. obstacle detection for mobile robots, vision-based medical assistive technology), si…
Framework optimizes cloud container sizing for ML tasks.
problem Challenges in cloud container configuration for ML services.
method Autonomous scaling using nested-loop Monte Carlo simulation.
result Reduces compute cost and accelerates ML algorithms.
Expert augmentation improves hybrid model generalization.
problem Limited generalization of hybrid models outside training distribution.
method Introducing expert augmentation to improve hybrid model performance.
result Expert augmentation improves generalization of hybrid models.
In this work we present a new approach on studying dynamical systems. Combining the two ways of expressing the uncertainty, using probabilistic theory and credibility theory, we have research the generalized fractional hybrid equations. We have introduced the concepts of generalized fractional Wiener process, generaliz…
BlackJAX simplifies Bayesian inference with modular, fast implementations.
problem Efficient and modular Bayesian inference methods for complex models.
method Functional approach to implementing sampling and variational inference algorithms in JAX.
result Ease of use, speed, and modularity in implementing Bayesian inference.
The paper introduces new tests for global controllability in hybrid systems.
problem Global controllability in hybrid systems with discrete events.
method Geometric formulation of hybrid systems and analysis of jump points.
result Hybrid systems can be globally controllable even if continuous systems are not.
Defines hybrid systems on principal bundles and studies impact effects.
problem Understanding impact effects in hybrid mechanical systems.
method Defines hybrid systems on principal bundles, studies underlying geometry, and finds conditions for impact preservation.
result Conditions for preservation of both exterior and interior impacts by mechanical connections.
Hybrid models forecast EPEC energy spot prices.
problem Forecasting energy spot prices in EPEC markets.
method Combining Naive, Fourier, ARMA/GARCH, mean-reversion, jump-diffusion, and RNN models.
result Improved accuracy in forecasting compared to individual models.
New method sparsifies hybrid neural ODEs for better performance and stability.
problem Excessive latent states and interactions from mechanistic models lead to training inefficiency and over-fitting.
method Automatic state selection and structure optimization combining domain-informed graph modifications with data-driven regularization.
result Improved predictive performance and robustness with desired sparsity.
Hybrid models combine interpretable and complex models for better performance and control.
problem Improving model performance and user transparency in machine learning.
method Investigates hybrid models from theory, taxonomy, and methodological perspectives.
result Hybrid models can outperform standalone black boxes and provide precise control over transparency.
Deep learning classifies corn hybrids' tolerance to drought and heat.
problem Classifying corn hybrids' tolerance to drought and heat stress.
method Unsupervised deep convolutional neural networks approach.
result 121 hybrids labeled drought tolerant, 193 heat tolerant, 29 both.
A hybrid ASR system using conformer architecture improves word-error-rate and training speed.
problem Improving word-error-rate and training efficiency for hybrid ASR systems.
method Used conformer architecture, applied time downsampling, and transposed convolutions.
result Conformer-based hybrid model achieves competitive results and significantly outperforms BLSTM-based hybrid model.
A new framework handles hybrid action spaces in reinforcement learning.
problem Handling reinforcement learning with both discrete and continuous actions.
method Parametrized Deep Q-Networks (P-DQN) framework integrating DQN and DDPG.
result Empirical validation of efficiency and effectiveness in simulated RoboCup soccer and game King of Glory.
PL-NMF improves parallel NMF by optimizing data locality.
problem Data movement costs dominate in parallel NMF applications.
method Developed a parallel NMF algorithm based on HALS with data locality optimizations.
result Significant performance improvement over existing parallel NMF algorithms.
Hybrid actor-critic learns in complex action spaces.
problem Learning in complex, structured action spaces.
method Parallel sub-actor networks and a critic network.
result Hybrid PPO outperforms previous methods in parameterized action spaces.
CuLE accelerates reinforcement learning on GPUs.
problem Limited CPU-GPU communication bandwidth in Atari Learning Environment.
method CUDA port of ALE, leveraging GPU parallelization and direct frame rendering.
result Up to 155M frames per hour on a single GPU, accelerating reinforcement learning.
The paper introduces FMCI and hybrid decoding for hidden Markov models.
problem Computing distributions and decoding hidden state sequences in HMMs.
method Finite Markov chain imbedding (FMCI) and hybrid decoding.
result Hybrid decoding improves performance over traditional methods.
TF-Replicator simplifies distributed ML for researchers.
problem Complex distributed ML code for researchers.
method Abstraction over TensorFlow, data-parallel and model-parallel.
result Strong scalability without distributed systems expertise.
In the present paper, a fuzzy logic based method is combined with wavelet decomposition to develop a step-by-step dynamic hybrid model for the estimation of financial time series. Empirical tests on fuzzy regression, wavelet decomposition as well as the new hybrid model are conducted on the well known SP500 index fin…
Hybrid model improves music source separation by 1.4 dB.
problem Improving music source separation accuracy.
method End-to-end hybrid spectrogram and waveform model, using model decision for domain choice.
result 1.4 dB improvement in Signal-to-Distortion (SDR) on MusDB HQ dataset.
Hybrid model combines deep features with invertible transformations for accurate predictions and feature modeling.
problem Accurate prediction and feature modeling using deep and invertible transformations.
method Neural hybrid model with a linear model on features from a deep invertible transformation.
result Hybrid model achieves similar accuracy to purely predictive models while maintaining generative capabilities.
This paper is devoted to pricing American options using Monte Carlo and the Malliavin calculus. Unlike the majority of articles related to this topic, in this work we will not use localization fonctions to reduce the variance. Our method is based on expressing the conditional expectation E[f(St)/Ss] using the Malliavin…
Develops numerical methods for PDEs on hypergraphs and networks.
problem Solving PDEs on complex geometric structures like hypergraphs and networks.
method Hybrid finite element methods, focusing on hybrid discontinuous Galerkin methods.
result Derives numerical approximations for PDEs on hypergraphs and networks.
Paper proposes a method to estimate scientific parameters in hybrid models without relying on model architecture.
problem Estimating unknown parameters in hybrid models combining machine learning and scientific models.
method Sharpness-aware minimization adapted for hybrid modeling, focusing on model simplicity.
result Demonstrates effectiveness of SAM-based hybrid model learning for scientific parameter estimation.
HyBO optimizes hybrid structures using diffusion kernels.
problem Optimizing complex interactions between discrete and continuous variables.
method HyBO uses diffusion kernels over hybrid spaces with additive kernel formulation.
result HyBO significantly outperforms state-of-the-art methods on real-world benchmarks.
Mathematical analysis of Riemann surfaces and their moduli spaces using hybrid Laplacians.
problem Analyzing the asymptotics of Arakelov Green functions on Riemann surfaces near boundary of moduli spaces.
method Introducing hybrid Laplacian, solving hybrid Poisson equation, and defining hybrid Green functions.
result Layered description of asymptotics of Arakelov Green functions on Riemann surfaces near boundary of their moduli spaces.
New hybrid method combines ARIMA and ANN for better time series forecasting.
problem Improving forecasting accuracy of time series data.
method ARIMA-ANN hybrid method with empirical mode decomposition strategies.
result Our hybrid method outperforms traditional methods in forecasting accuracy.
Neural Tangents simplifies infinite-width neural networks for research.
problem Training and studying infinite-width neural networks.
method High-level API for specifying complex architectures, analytical or gradient-based training, and automatic distribution.
result Analytical training of infinite-width networks and automatic parallelization.
Novel hybrid method for Bayesian network structure learning reduces computational time without sacrificing accuracy.
problem Bayesian network structure learning efficiency and accuracy trade-off.
method Partitioned PC (pPC), p-value adjacency thresholding (PATH), hybrid greedy initialization (HGI). result pHGS achieves significant computational reductions compared to the PC algorithm without sacrificing structure learning accuracy.
Bayesian hybrid models correct for missing physics in machine learning.
problem Systematic bias in machine learning models.
method Fusing physics-based insights with machine learning constructs, using Bayesian calibration and stochastic programming.
result Bayesian hybrid models outperform pure machine learning approaches with less data.
Hybrid models are reinterpreted as Neuro-Symbolic AI designs to quantify uncertainty and variability.
problem Limited semantic interface for comparing hybrid models across domains.
method Reinterpret hybrid models as Neuro-Symbolic AI, translating them into explicit inference function and logic-belief decomposition.
result Metrics SVR and BD quantify uncertainty and variability in hybrid models.
A hybrid model for Bayesian optimization handles mixed variables using MCTS for categorical and GP for continuous.
problem Optimizing functions with mixed variable types (continuous, integer, categorical).
method Merges MCTS for categorical and GP for continuous variables, integrates UCTS search strategy, and dynamically selects kernels.
result Hybrid models outperform traditional methods in Bayesian optimization.
Paper proposes efficient inner product approximation for hybrid sparse and dense vectors.
problem Efficient search in hybrid spaces with both sparse and dense components is challenging.
method Proposes a technique to approximate inner product computation in hybrid vectors.
result Achieves over 10x speedup and higher accuracy in search compared to baselines.
Relay simplifies deep learning compilation across diverse hardware.
problem Challenges in extending DL frameworks to diverse models and hardware.
method Relay introduces a unified, expressive intermediate representation and extension mechanisms for hardware portability.
result Relay achieves competitive performance across various hardware platforms.
This paper explores data science applications in economics using a taxonomy of models and hybrid models showing higher accuracy.
problem Investigating data science applications in economics.
method Systematic literature review using Prisma method.
result Hybrid models showed higher prediction accuracy than other algorithms.
Regularization is an important component of predictive model building. The hybrid bootstrap is a regularization technique that functions similarly to dropout except that features are resampled from other training points rather than replaced with zeros. We show that the hybrid bootstrap offers superior performance to dr…