Selective reinitialization improves adaptability of neural bandits in dynamic environments.
problem Loss of plasticity in neural bandits, leading to rigid neural network parameters.
method Selective Reinitialization (SeRe) framework that dynamically resets underutilized units.
result SeRe enhances adaptability of CNB algorithms, reducing cumulative regret in dynamic environments.
Partial reinitialization improves heuristic optimizers by retaining previous information.
problem Local optima in heuristic optimizers.
method Partial reinitialization of sub-sets of variables.
result Significant improvements in solution quality.
Gradients help find global optima in complex functions.
problem Finding global optima in functions with many local minima.
method A principle for generating search directions from non-local quadratic approximants based on gradients.
result The proposed algorithm and CMA-ES perform better than random reinitialized BFGS.
Study examines effects of pruning techniques on deep learning models.
problem Understanding the impact of pruning methods on deep learning model structure and dynamics.
method Investigated differences in connectivity and learning dynamics of pruned models using various iterative pruning techniques.
result Emergence of structure in pruned models through magnitude-based unstructured pruning and weight rewinding.
Enhanced quantum synchronization achieved using quantum machine learning.
problem Quantum synchronization between two systems with different loss/decoherence mechanisms.
method Digital-analog decomposition of the master equation, quantum machine learning protocol with projective measurements and reinitialization.
result Quantum machine learning protocol enhances synchronization even with different loss/decoherence mechanisms.
New insights into why sparse networks perform well, including Supermasks.
problem Understanding why sparse networks trained from scratch perform better than non-sparse models.
method Analyzed three critical components of the Lottery Ticket algorithm: zeroing weights, signs, and masking.
result Discovered Supermasks that can improve performance of untrained networks.
Early neural network training reveals important sub-networks and weight distributions.
problem Understanding the early phases of neural network training.
method Extensive measurements and quantitative probing of weight distribution and dataset reliance.
result Deep networks are not robust to reinitializing with random weights while maintaining signs, and weight distributions are highly non-independent.
Model for cross-border markets with limited transmission capacities.
problem Limited transmission capacities between two countries' markets.
method Developed a regime-switching process model with high-frequency approximation.
result Analytic tractability allows computation of key market quantities.
Extends a model for limit order markets to more flexible distributions.
problem Modeling the dynamics of limit order markets with flexible distributions.
method Uses Markov renewal processes to model bid and ask queues, keeping analytical tractability.
result Calibrated model accurately represents market data for five stocks.
A real-time federated neural architecture search approach reduces costs and improves performance.
problem High communication and computational demands in federated learning for large models.
method Evolutionary approach with double-sampling technique to optimize model performance and reduce costs.
result Effective real-time federated neural architecture search for deep models on edge devices.
RIFLE improves deep transfer learning by reinitializing fully-connected layers.
problem Limited improvement in transfer learning accuracy with pre-trained models on small datasets.
method Re-Initializing fully-connected layers with random scratch during fine-tuning.
result Significant improvement in deep transfer learning accuracy across various datasets.
Deep learning predicts curvature of 2D interfaces in level-set method.
problem Estimating curvature in level-set method for complex interfaces.
method Deep learning using feed-forward neural networks trained on synthetic data.
result Deep learning models approximate curvature with comparable precision to traditional methods.
Paper introduces a simulator-free approach to reinforcement learning policy distillation.
problem Learning multiplicity of cases corresponding to a given action in reinforcement learning.
method Generative adversarial approach to find multiple exemplars for each output class.
result Improves over state-of-the-art on data-free learning of student networks.