This paper explores how optimizing data access and reducing redundancy can improve machine learning algorithm performance.
problem Performance issues in machine learning algorithms due to data locality and redundancy.
method Analysis of data access patterns and computational redundancy in machine learning algorithms, identifying opportunities for reuse and experimentation.
result Initial indicative results show potential for improving performance through data access optimization and reuse of computation results.
This work benchmarks counterfactual methods in time series classification.
problem Lack of benchmarking studies for counterfactual methods in time series classification.
method Redesign metrics for sparsity, plausibility, and consistency; systematically benchmark 6 CF methods on 30 datasets.
result Performance of CF methods varies across metrics and models.
New framework makes ML methods compliant with regulations.
problem Ensuring ML methods meet regulatory standards.
method InfoGram and Admissible Machine Learning framework.
result Redesigns ML methods for regulatory compliance.
CFS (Correlation-Based Feature Selection) is an FS algorithm that has been successfully applied to classification problems in many domains. We describe Distributed CFS (DiCFS) as a completely redesigned, scalable, parallel and distributed version of the CFS algorithm, capable of dealing with the large volumes of data t…
Gradient descent can always optimize certain neural networks.
problem Designing neural networks for successful optimization.
method Discussion and demonstration of universality of gradient descent optimization.
result Existence of a neural network extension that can be trained by gradient descent.
In applications like computer aided design, geometric models are often represented numerically as polynomial splines or NURBS, even when they originate from primitive geometry. For purposes such as redesign and isogeometric analysis, it is of interest to extract information about the underlying geometry through reverse…
Combines Lyapunov functions with controller synthesis for safe control policies.
problem Ensuring safety in controller design for nonlinear systems.
method Iterative algorithm combining Lyapunov function estimation and controller synthesis.
result Effective control policies with large safe regions are derived.
Feature selection (FS) is a key research area in the machine learning and data mining fields, removing irrelevant and redundant features usually helps to reduce the effort required to process a dataset while maintaining or even improving the processing algorithm's accuracy. However, traditional algorithms designed for …
Strategic feature selection in high-stakes domains like healthcare.
problem Strategic manipulation of input features in algorithmic predictors.
method Formal study of strategic classification through feature selection and ridge regularization.
result Excluding individual features based on manipulability is generally suboptimal.
Graph Convolutional Networks improve performance on complex data.
problem Processing high-dimensional, graph-based data for automation.
method Enhanced existing Graph Convolutional Network models with four improvements.
result Significant performance improvements on four benchmark datasets.
New formula identifies and quantifies costs for automated market makers.
problem Adverse selection costs faced by liquidity providers in automated market makers.
method Derives a Black-Scholes-like formula for AMMs and identifies loss-versus-rebalancing cost.
result Closed-form expressions for LVR applicable to all automated market makers.
Many engineers wish to deploy modern neural networks in memory-limited settings; but the development of flexible methods for reducing memory use is in its infancy, and there is little knowledge of the resulting cost-benefit. We propose structural model distillation for memory reduction using a strategy that produces a …
This paper improves K-SVD for image denoising using deep learning.
problem Improving the performance of the K-SVD denoising algorithm.
method Designing a deep architecture inspired by K-SVD, trained end-to-end for denoising.
result The proposed deep architecture outperforms classical K-SVD significantly.
Bayesian neural networks improve reliability in multimedia forensics.
problem Challenges with out-of-distribution data in multimedia authentication.
method Proposes Bayesian neural networks (BNN) for forensic tasks.
result BNNs provide distributions for better reliability and out-of-distribution detection.
GradSkip reduces local training steps for better communication efficiency.
problem High communication costs in distributed optimization.
method GradSkip redesigns ProxSkip to allow clients with less important data to take fewer local training steps.
result GradSkip converges linearly with reduced local training steps and same accelerated communication complexity.
Paper augments neural nets with logic for improved performance.
problem Training neural networks with declarative knowledge without extra parameters.
method Systematically compiles logical statements into computation graphs that augment neural networks.
result Knowledge-augmented networks significantly improve performance, especially in low-data scenarios.
In this paper we present two new approaches to efficiently solve large-scale compressed sensing problems. These two ideas are independent of each other and can therefore be used either separately or together. We consider all possibilities. For the first approach, we note that the zero vector can be taken as the initial…
Extends gradient-based optimization to spline functions.
problem Limitations of standard differentiable programming methods.
method Derives Jacobian of spline functions and uses it in predictive models.
result Improved performance in various applications.
DEEPLY improves cloud service partitioning across multiple datasets and goals.
problem Finding a generally useful method to partition monolithic enterprise applications into cloud-based microservices.
method DEEPLY extends CO-GCN with a novel loss function and hyper-parameter optimization.
result DEEPLY outperforms prior work across multiple datasets and goals.
Generative Adversarial Networks (GANs) have achieved great success in generating realistic images. Most of these are conditional models, although acquisition of class labels is expensive and time-consuming in practice. To reduce the dependence on labeled data, we propose an un-conditional generative adversarial model, …
Enhances traffic forecasting with dynamic regression incorporating error modeling.
problem Improving accuracy of traffic forecasts using deep spatiotemporal models.
method Integrates matrix-variate autoregressive (AR) model into loss function for error series of base model.
result Improved traffic forecasting performance on SOTA models with interpretable AR coefficients.
SIVAE integrates sentences and their syntactic trees for improved text generation.
problem Improving the grammar of generated text.
method SIVAE uses two separate latent spaces for sentences and syntactic trees, optimizing a joint distribution with two encoders and two decoders.
result SIVAE generates sentences with better grammar compared to existing models.
Improved StyleGAN model enhances image quality and invertibility.
problem Characteristics artifacts in StyleGAN's image quality.
method Redesigned generator normalization, revisited progressive growing, and introduced a capacity problem.
result Improved image quality and easier inversion of generated images.
This study develops an online predictive optimization framework for dynamically operating a transit service in an area of crowd movements. The proposed framework integrates demand prediction and supply optimization to periodically redesign the service routes based on recently observed demand. To predict demand for the …
In recent years, reinforcement learning (RL) methods have been applied to model gameplay with great success, achieving super-human performance in various environments, such as Atari, Go, and Poker. However, those studies mostly focus on winning the game and have largely ignored the rich and complex human motivations, w…
Improved model for non-smooth signals with complex spectra.
problem Current models struggle with non-smooth signals and complex spectral structures.
method CGPCM and RGPCM models with causality and Bayesian nonparametric interpretations, improved variational inference.
result Proposed models show better performance on synthetic and real-world data.
Deep convolutional neural networks have achieved great success in various applications. However, training an effective DNN model for a specific task is rather challenging because it requires a prior knowledge or experience to design the network architecture, repeated trial-and-error process to tune the parameters, and …
Neural networks designed for the task of classification have become a commodity in recent years. Many works target the development of more effective networks, which results in a complexification of their architectures with more layers, multiple sub-networks, or even the combination of multiple classifiers, but this oft…
VerifAI toolkit improves neural network-based aircraft taxiing system safety.
problem Improving safety of autonomous aircraft taxiing systems using neural networks.
method Unified approach to formal analysis and retraining of AI systems, including falsification, debugging, and retraining.
result Improved neural network performance and reduced failure cases in aircraft taxiing system.
New method improves solving NP-hard problems on graphs.
problem Solving combinatorial optimization problems on graphs.
method A novel reinforcement learning strategy based on AlphaGo Zero for graph embeddings.
result Our method generalizes better to various graphs than S2V-DQN.
Improved diffusion models for image synthesis with better training dynamics.
problem Uneven and ineffective training in diffusion models.
method Redesigned network layers to preserve activation, weight, and update magnitudes.
result Significantly better networks at equal computational complexity, improving FID to 1.81.
Enhanced ECCD speeds up elastic net model training.
problem Efficiently solving generalized linear models with elastic net constraints.
method Redesigned cyclic coordinate descent with Taylor expansion and batched computations.
result Empirically shows consistent 3imes performance improvement over state-of-the-art solvers. We present an approach to adaptively utilize deep neural networks in order to reduce the evaluation time on new examples without loss of accuracy. Rather than attempting to redesign or approximate existing networks, we propose two schemes that adaptively utilize networks. We first pose an adaptive network evaluation sc…
Flexible nonstationary Gaussian process with neural network parameters.
problem Limited expressiveness of stationary Gaussian processes.
method Nonstationary kernels with neural network parameters trained jointly.
result Better accuracy and log-score compared to stationary and hierarchical models.
Class-conditional extensions of generative adversarial networks (GANs), such as auxiliary classifier GAN (AC-GAN) and conditional GAN (cGAN), have garnered attention owing to their ability to decompose representations into class labels and other factors and to boost the training stability. However, a limitation is that…
PoPCoin aims to create a more equitable cryptocurrency.
problem Inequality in traditional money systems.
method Develops two rules for PoPCoin: equal distribution and demurrage.
result PoPCoin can limit monetary inequality and incentivize rapid growth.
Efficient surrogate modeling for complex PDEs with physical laws.
problem High computational cost of repeated PDE simulations.
method LC-prior Gaussian process with POD and RBF-FD.
result Significantly reduced computational cost and improved accuracy.
Revises logistic-softmax likelihood for Bayesian meta-learning in few-shot classification.
problem Inherent uncertainty in logistic-softmax leads to suboptimal performance in meta-learning.
method Redesigns logistic-softmax likelihood with a temperature parameter for better control of prior confidence.
result Achieves well-calibrated uncertainty estimates and comparable/superior performance on benchmark datasets.
Self-reflective VAE improves inference and generative modeling without complex components.
problem Limitations of typical VAEs in inference and generative modeling.
method Introduces self-reflective inference, a new hierarchical structure that matches variational posterior to exact posterior.
result Self-reflective inference achieves state-of-the-art performance on binarized MNIST without autoregressive layers.
Survey of challenges and future directions in applying RL to real-world settings.
problem Challenges in deploying RL in practical settings due to limited interaction and changing environments.
method Analysis of RL system design, implementation, and continual improvement.
result Need for theory and methodology to bridge research and application gap.
RGCF improves collaborative filtering by refining graph convolution embeddings.
problem GCN-based recommendation models introduce noise and redundancy, limiting high-order connectivity capture.
method Developed RGCF, a new GCN-based Collaborative Filtering model with redesigned embeddings.
result RGCF significantly outperforms state-of-the-art models on public datasets.
This paper uses ODE to improve RNN models for time series data.
problem Improving RNN models for irregularly sampled time series data.
method Extending RNNs with Neural Ordinary Differential Equations (ODEs).
result New ODE-based RNN models reduce training and evaluation time.
Enhances molecular design models by fine-tuning uncertainty-guided VAEs.
problem Fine-tuning pre-trained generative models for specific molecular property optimization.
method Uncertainty-guided fine-tuning of variational autoencoders in an active learning setting.
result Uncertainty-guided fine-tuning improves model performance across multiple molecular properties.
Solar improves variable selection in high-dimensional data with complicated dependence structures.
problem Variable selection in ultrahigh dimensional data with severe multicollinearity and grouping effect issues.
method Subsample-ordered least angle regression (Solar) for ultrahigh dimensional data.
result Solar yields substantial improvements in sparsity, stability, and accuracy of variable selection compared to traditional methods.
Proposes a Carbon Equivalence Principle for financial products to align incentives and drive sustainability.
problem Align financial market incentives with carbon emissions to limit global warming.
method Introduces a Carbon Equivalence Principle requiring financial products to describe equivalent carbon flows alongside cash flows.
result Transparency of carbon flows in financial products can align incentives and reduce future costs, necessitating project re-structuring and financial net-zero designs.
Improved MACD trading strategies with other indicators for better performance.
problem Evaluating the effectiveness of MACD-based trading strategies in the US stock market.
method Backtested various MACD-based trading strategies on US stock indices using Python.
result Win-rate of MACD strategies improved with other momentum indicators, leading to a new VPVMA indicator.
FROB model improves robustness and reliable confidence for few-shot OoD detection.
problem Challenges in few-shot classification and OoD detection due to limited samples and adversarial attacks.
method FROB model combines support boundary generation and few-shot Outlier Exposure (OE) for improved robustness and reliable confidence.
result FROB achieves generalization to unseen OoD and maintains robustness independent of few-shot number.
Examines algorithmic modeling across three cultures.
problem Tackles algorithmic modeling in different cultural contexts.
method Uses parametric regressions, interpretable algorithms, and complex algorithms.
result Extension of Leo Breiman's thesis to include cultural differences.