A common method of generalizing binary to multi-class classification is the error correcting code (ECC). ECCs may be optimized in a number of ways, for instance by making them orthogonal. Here we test two types of orthogonal ECCs on seven different datasets using three types of binary classifier and compare them with t…
Flexible deep learning models for dynamic accuracy and speed trade-offs.
problem Dynamic accuracy and speed trade-offs in real-world applications.
method Training deep neural networks with a new method allowing flexible numerical precision during inference.
result Achieved comparable accuracy to dedicated models trained at the same precision with dynamic precision settings.
Visual Human Activity Recognition (HAR) and data fusion with other sensors can help us at tracking the behavior and activity of underground miners with little obstruction. Existing models, such as Single Shot Detector (SSD), trained on the Common Objects in Context (COCO) dataset is used in this paper to detect the cur…
The paper compares clustering methods for improving time series forecasting accuracy.
problem Improving time series forecasting accuracy using neural networks.
method Investigates feature-based and distance-based clustering methods for time series forecasting.
result Feature-based clustering outperforms distance-based clustering in terms of speed and efficiency.
New algorithms optimize time series classification speed and accuracy.
problem Efficiently classify time series data quickly without sacrificing accuracy.
method Optimization criterion balancing misclassification and delay costs, derived non-myopic algorithms.
result Supervised-based algorithms outperform unsupervised-based ones in real data sets.
Scientific Computing relies on executing computer algorithms coded in some programming languages. Given a particular available hardware, algorithms speed is a crucial factor. There are many scientific computing environments used to code such algorithms. Matlab is one of the most tremendously successful and widespread s…
FastForest boosts Random Forest speed by 24%.
problem Efficiency in processing speed for Random Forest.
method Subsample Aggregating, Logarithmic Split-Point Sampling, Dynamic Restricted Subspacing.
result Average 24% increase in processing speed with accuracy maintained.
Value selection reduces model size while maintaining accuracy.
problem Space efficiency in model size reduction.
method Two probabilistic methods based on information theory's metric: PVS and P + VS.
result Value selection achieves balance between accuracy and model size reduction.
Neural network quantization procedure is the necessary step for porting of neural networks to mobile devices. Quantization allows accelerating the inference, reducing memory consumption and model size. It can be performed without fine-tuning using calibration procedure (calculation of parameters necessary for quantizat…
This work improves surrogate models for balancing accuracy and cost in multi-fidelity methods.
problem Balancing accuracy and computational cost in multi-fidelity methods.
method Develops context-aware surrogate models for multi-fidelity importance sampling and Bayesian inverse problems.
result Context-aware surrogate models can lead to runtime speedups of up to one order of magnitude.
Training of one-vs.-rest SVMs can be parallelized over the number of classes in a straight forward way. Given enough computational resources, one-vs.-rest SVMs can thus be trained on data involving a large number of classes. The same cannot be stated, however, for the so-called all-in-one SVMs, which require solving a …
Wireless traffic prediction is a fundamental enabler to proactive network optimisation in beyond 5G. Forecasting extreme demand spikes and troughs due to traffic mobility is essential to avoiding outages and improving energy efficiency. Current state-of-the-art deep learning forecasting methods predominantly focus on o…
SRSGD improves DNN training speed and accuracy.
problem Training deep neural networks is computationally expensive and slow.
method Scheduled Restart SGD (SRSGD) combines NAG momentum with momentum reset.
result SRSGD achieves better error rates with fewer training epochs.
Diffusion models' speed-accuracy relations derived from thermodynamics.
problem Understanding the trade-off between model speed and accuracy.
method Connecting diffusion models to thermodynamics and optimal transport.
result Speed-accuracy relations derived, providing insights into optimal learning protocols.
Our work focuses on the problem of predicting the transfer of pediatric patients from the general ward of a hospital to the pediatric intensive care unit. Using data collected over 5.5 years from the electronic health records of two medical facilities, we develop classifiers based on adaptive boosting and gradient tree…
Gradient-based methods improve understanding of deep learning survival models.
problem Limited interpretability of deep learning survival models hinders their adoption.
method Gradient-based explanation methods tailored to survival neural networks.
result Gradient-based methods capture feature effects and temporal dynamics.
A new L2D system produces calibrated probabilities of expert correctness without sacrificing accuracy.
problem Calibration of learning to defer systems for safety.
method One-vs-all classifiers with a consistent surrogate loss function.
result Proposes a calibrated L2D system that outperforms existing methods in accuracy and calibration.
CoroNet detects COVID-19 from chest X-rays with high accuracy.
problem Detecting COVID-19 from chest X-rays using limited testing kits.
method Proposes CoroNet, a deep neural network based on Xception architecture trained on a combined dataset of COVID-19 and pneumonia X-rays.
result CoroNet achieved an overall accuracy of 89.6% and precision/recall rates of 93%/98.2% for 4-class cases (COVID vs Pneumonia bacterial vs pneumonia viral vs normal).
This paper studies the trade-off between model accuracy and coverage for diagnosis models used by patients.
problem Balancing accuracy and coverage in diagnosis models for patient use.
method Learned diagnosis models with varying coverage from EHR data.
result A 1% drop in top-3 accuracy for every 10 diseases added to the coverage.
The study reduces a personality measurement instrument to 10 features with minimal loss of accuracy.
problem Accurately predicting personality types with minimal predictors.
method Reduced a 94-item personality survey to 10 features, using class imbalance correction methods.
result Achieved 73.81% accuracy on unseen data with only 1% loss.
Adaptive Misinformation defends against model stealing attacks by sending incorrect predictions for OOD queries.
problem Model stealing attacks clone target models using black-box query access and a surrogate dataset.
method Selective sending of incorrect predictions for Out-Of-Distribution (OOD) queries to degrade attacker's clone model accuracy.
result Our defense reduces attacker's clone model accuracy by up to 40% while maintaining benign user accuracy under 0.5%.
RCS-YOLO improves brain tumor detection speed and accuracy.
problem Efficiently detecting brain tumors with high accuracy and speed.
method Proposes RCS-YOLO, a fast and accurate brain tumor detector using YOLO with Reparameterized Convolution and channel Shuffle.
result RCS-YOLO outperforms other YOLO versions in speed and accuracy on brain tumor detection.
Robust cancer screening model using pre-trained ensembles for biomarkers.
problem Detecting early-stage cancer, especially in hard-to-diagnose cases like pancreatic cancer.
method Meta-trained Hyperfast model for robust classification, combined with ensembling of XGBoost and LightGBM.
result Achieved highest AUC of 0.9929 and robust performance on imbalanced datasets.
Approximate multipliers boost CNN training speed, power, and area at slight accuracy cost.
problem Improving CNN training performance in terms of speed, power, and area.
method Simulation of approximate multipliers' impact on CNN training, hybrid training method combining approximate and exact multipliers.
result Using approximate multipliers for most of training enhances speed, power, and area with minimal accuracy loss.
Background-Foreground classification is a well-studied problem in computer vision. Due to the pixel-wise nature of modeling and processing in the algorithm, it is usually difficult to satisfy real-time constraints. There is a trade-off between the speed (because of model complexity) and accuracy. Inspired by the reject…
LaRT models LLMs' response accuracy and CoT length to evaluate reasoning ability and speed.
problem Valid evaluation of Large Language Models (LLMs) via response accuracy and chain-of-thought length.
method Introduces Latency-Response Theory (LaRT) to jointly model response accuracy and CoT length using latent ability and latent speed.
result LaRT yields higher estimation accuracy and shorter confidence intervals for latent traits compared to IRT.
RS-NN predicts belief functions for classification, improving accuracy and uncertainty estimation.
problem Improving confidence in machine learning predictions for safety-critical applications.
method Random-Set Neural Network (RS-NN) using random set mathematics.
result RS-NN outperforms state-of-the-art methods in accuracy, uncertainty estimation, and OoD detection.
Hybrid model improves wind speed prediction accuracy using MLP and WOA.
problem Improving wind speed prediction accuracy for renewable energy control.
method Combining MLP with Whale Optimization Algorithm (WOA) for data preprocessing and model optimization.
result The hybrid MLP-WOA model outperformed standalone MLP model in wind speed prediction accuracy.
Paper designs optimal ECOCs using IP for robust multiclass classification.
problem Designing robust ECOCs for multiclass classification.
method Integer Programming formulation to minimize codebooks with desirable error-correcting properties, leveraging graph-theoretic structure and edge clique covers.
result IP-generated codebooks achieve high nominal and robust adversarial accuracy.
New linear algorithms improve wSVMs for multiclass probability estimation.
problem Estimating conditional probabilities for multiclass problems.
method Proposed baseline learning and OVA learning schemes to improve wSVMs.
result Linear algorithms achieve optimal computational efficiency and good estimation accuracy.
Bayesian method improves few-shot classification accuracy.
problem Few-shot classification with small labeled datasets.
method Gaussian process classifier with Pólya-Gamma augmentation and one-vs-each softmax.
result Improved accuracy and uncertainty quantification.
Any given classification problem can be modeled using multi-class or One-vs-All (OVA) architecture. An OVA system consists of as many OVA models as the number of classes, providing the advantage of asynchrony, where each OVA model can be re-trained independent of other models. This is particularly advantageous in setti…
Kaleidoscope matrices improve model quality and inference speed.
problem Choosing structured linear transformations for efficiency and accuracy.
method Introduce kaleidoscope matrices that can capture any structured matrix with near-optimal space and time complexity. Learn these matrices automatically within end-to-end pipelines.
result Kaleidoscope matrices can improve model quality and inference speed.
Hybrid quantum-classical model boosts S&P 500 prediction accuracy to 60.14%.
problem Challenges in financial market prediction, especially high noise and non-stationarity.
method Combines quantum sentiment analysis, Decision Transformer, and model selection strategies.
result Achieved 60.14% directional accuracy on S&P 500, a 3.10% improvement.
The well-known Ising model used in statistical physics was adapted to a social dynamics context to simulate the adoption of a technological innovation. The model explicitly combines (a) an individual's perception of the advantages of an innovation and (b) social influence from members of the decision-maker's social net…
SingleProp speeds up robust neural network training with minimal certification.
problem Efficiently defending neural networks against adversarial attacks with certified guarantees.
method SingleProp regularizer that requires only one forward pass per training iteration.
result Comparable certified accuracy to state-of-the-art defenses, but significantly faster training.
Deep learning classifies autism vs controls with high accuracy using large fMRI dataset.
problem Classification difficulty of autism vs typically developing controls with fMRI data.
method Ensemble CNN model trained on 43,858 fMRI datapoints, employing class-balancing and visualization methods.
result Deep learning models achieve AUROCs of 0.6774, 0.7680, and 0.9222 for ASD vs TD, gender, and task vs rest classifications.
In recent years, the number of papers on Alzheimer's disease classification has increased dramatically, generating interesting methodological ideas on the use machine learning and feature extraction methods. However, practical impact is much more limited and, eventually, one could not tell which of these approaches are…
Researchers use Gaussian Process Regression to improve accuracy of a low-cost hot-wire anemometer.
problem Improving accuracy of low-cost hot-wire anemometers in varying temperatures.
method Probabilistic calibration using Gaussian Process Regression.
result The method provides good performance in estimating actual wind speeds, including uncertainty.
Study reveals how initialization scale affects training accuracy in linear networks.
problem Understanding implicit bias in linear classification models.
method Asymptotic analysis of gradient flow trajectories and training loss minimization.
result Implicit bias is more complex at reasonable initialization scales and training accuracies.
This work proposes a method to learn sparse representations that are more efficient for large-scale data retrieval.
problem Efficient retrieval of high-dimensional representations from large databases is computationally challenging.
method The approach minimizes the number of floating-point operations (FLOPs) by learning sparse embeddings with uniform non-zero entries.
result The proposed method achieves a similar or better speed-vs-accuracy tradeoff compared to existing baselines.
Donor-aware scRNA-seq benchmarks improve classification accuracy in inflammatory bowel disease.
problem Influenza disease classification from scRNA-seq data is prone to donor-level confounding.
method Developed and evaluated three feature representations across two IBD cohorts.
result Compartment-stratified CLR composition and GatedStructuralCFN embeddings outperform linear models in classification accuracy.
Bayesian deep learning ensemble improves pneumonia diagnosis accuracy.
problem Manual, time-consuming pneumonia diagnosis with high inter-observer variability.
method Multi-level ensemble classification system using Bayesian Deep Learning.
result Accuracy of 98.06% in differentiating four pathologies.
GOAT improves graph matching speed and accuracy using optimal transport.
problem Efficiently matching large graphs in various applications.
method Replaces linear assignment with optimal transport methods.
result GOAT provides improvements in speed and accuracy.
GBM outperforms DL in credit scoring tasks, but performance depends on dataset.
problem Benchmarking deep learning vs. gradient boosting for credit scoring.
method Used three datasets with different features to compare DL and GBM.
result GBM is more powerful and faster than DL for credit scoring.
Machine learning improves earnings forecasting accuracy and speed.
problem Improving earnings forecasting accuracy and speed.
method Adopting machine learning models for earnings forecasting.
result Machine learning model outperforms traditional models in accuracy and speed.
Co-designing efficient machine learning based systems across the whole hardware/software stack to trade off speed, accuracy, energy and costs is becoming extremely complex and time consuming. Researchers often struggle to evaluate and compare different published works across rapidly evolving software frameworks, hetero…
Proposes a new adversarial model to avoid accuracy vs. adversarial accuracy tradeoff.
problem Inherent tradeoff between accuracy and adversarial accuracy in existing adversarial robustness definitions.
method Introduces Voronoi-epsilon adversary that balances perturbation constraints.
result Voronoi-epsilon adversary avoids accuracy vs. adversarial accuracy tradeoff even with large ε.