DL2 uses deep learning to optimize resource allocation in DL clusters.
problem Efficient resource scheduling for deep learning clusters is challenging.
method DL2 combines supervised learning and reinforcement learning to dynamically allocate resources.
result DL2 reduces average training completion time by 44.1% compared to fairness scheduler.
NeuRewriter learns to choose and rewrite heuristics in combinatorial problems.
problem Time-consuming tuning of heuristics in combinatorial optimization.
method NeuRewriter uses reinforcement learning to learn a policy for picking heuristics and rewriting solutions.
result NeuRewriter outperforms existing methods in various combinatorial tasks.
The paper proposes calibration to improve algorithm performance using machine learning predictions.
problem Improving real-world performance of online algorithms with machine learning predictions.
method Calibration as a tool to bridge the gap between prediction uncertainty and algorithm design.
result Calibrated advice leads to more effective guidance in high-variance settings and significant performance improvements in real-world data.
Study schedules jobs with unknown holding costs to minimize expected cumulative cost.
problem Minimizing expected cumulative holding costs of jobs with unknown parameters.
method Learning-based cμ rule scheduling with a preemption phase. result Achieves near-optimal performance guarantees with nearly matching regret bounds.
Study on scheduling jobs with unknown types, achieving sublinear excess cost.
problem Optimizing job scheduling with unknown job types and varying durations.
method Design of algorithms for non-preemptive and preemptive scenarios, proving lower bounds.
result Preemptive algorithms can significantly outperform non-preemptive ones when job types have distinct durations.
Sequence-to-sequence models predict resource usage for co-scheduled jobs in data centers.
problem Challenges in co-scheduling jobs due to resource interference and inefficiencies.
method Sequence-to-sequence models based on recurrent neural networks for workload interference prediction.
result Models accurately forecast resource usage trends from job profiles, improving scheduling decisions.
Decima uses machine learning to automatically generate efficient scheduling policies.
problem Scheduling data processing jobs on distributed clusters is complex and requires tuning for each workload.
method Decima employs reinforcement learning and neural networks to learn workload-specific scheduling policies without human intervention.
result Decima improves average job completion time by at least 21% compared to hand-tuned heuristics.
The paper optimizes dynamic scheduling for ring architectures in deep learning training.
problem Optimizing deep learning training times with ring architectures.
method Formulated a non-convex, non-linear, NP-hard integer programming problem and developed a doubling heuristic.
result Dynamic scheduling can significantly reduce job completion times in ring architectures.
A heuristic minimizes tardy jobs' total weight on single-machine scheduling.
problem Minimizing tardy jobs' total weight on single-machine scheduling.
method Data-driven heuristic combining machine learning and problem-specific characteristics.
result Significantly outperforms state-of-the-art in optimality gap and adaptability.
GraSP-RL uses graph neural networks to improve job shop scheduling.
problem Capturing machine-unit-job sequence relationships and managing state space growth.
method Graph neural networks for feature extraction, reinforcement learning for decision-making, decentralized optimization.
result GraSP-RL outperforms existing methods in minimizing makespan for complex production environments.
This paper tackles JSSP with uncertain task durations using DRL.
problem Job Shop Scheduling Problem with uncertain task durations.
method Integrates Graph Neural Networks (GNNs) and Deep Reinforcement Learning (DRL) to generate robust schedules.
result Advances DRL applications to JSSPs, enhancing generalization and scalability.
Deep RL learns effective job shop scheduling rules from raw features.
problem Designing effective priority dispatching rules for job shop scheduling is challenging.
method End-to-end deep reinforcement learning using Graph Neural Networks.
result Agent learns high-quality dispatching rules from raw features and generalizes well to unseen instances.
Predicts and classifies computational jobs for efficient resource allocation in cloud centers.
problem Efficiently scheduling and assigning resources to computational jobs in cloud centers.
method Applied LSTM neural network for job arrival prediction and BIRCH clustering for job classification.
result Improved accuracy in predicting and classifying computational jobs compared to existing methods.
DeepPlace learns to place applications in clusters using RL.
problem Manual placement rules for scheduling are non-trivial and suboptimal.
method Uses Deep Reinforcement Learning to learn optimal placement rules.
result Reduces resource competition and optimizes cluster utilization.
Separating the short jobs from the long is a known technique to improve scheduling performance. In this paper we describe a method we developed for accurately predicting the runtimes classes of the jobs to enable this separation. Our method uses the fact that the runtimes can be represented as a mixture of overlapping …
The paper proposes an online algorithm for network resource allocation with reduced costs.
problem Optimizing resource allocation and job transfers in a network of servers.
method Randomized online algorithm based on the exponentially weighted method.
result The algorithm achieves sub-linear regret, indicating improved efficiency over time.
Bayesian method optimizes rescheduling for multipurpose batch processes with incomplete look-ahead information.
problem Optimizing rescheduling for multipurpose batch processes under incomplete look-ahead information.
method Proposes a Bayesian dynamic scheduling method that learns from disturbances and updates schedules online.
result Achieves statistically better long-term costs and system nervousness compared to existing periodic rescheduling strategies.
Proposes a framework for energy-efficient AIGC workload scheduling in cloud data centers.
problem Challenges of scheduling AIGC workloads for energy efficiency and quality control.
method Joint energy management and coordinated AIGC workload scheduling framework with diffusion model-aided reward shaping.
result Effective learning of scheduling policies under sparse environmental feedback.
New approach for algorithms that learn predictors to improve performance.
problem Improving algorithm performance by learning better predictions.
method Identify functional dependence and apply online learning techniques.
result Improved results in various online settings with simpler analysis.
Optimizes resource allocation in a network with random job requests.
problem Minimizing costs while satisfying job requests within a budget.
method Formalizes as a repeated game, proposes an online saddle-point algorithm.
result Upper bounds for regret and constraint violations are derived.
Paper develops multilingual job classification for ISCO and KZiS.
problem Classifying job advertisements for accurate occupation coding.
method Transformer architecture for hierarchical multi-class classification.
result Hierarchical structure improves prediction accuracy by 1-2 percentage points.
Study on optimizing task allocation for agents receiving proposals sequentially.
problem Optimizing task allocation for agents receiving proposals sequentially.
method An agent receives task proposals sequentially and can either accept or reject a proposal. The study considers two scenarios: known reward function but unknown task duration distribution, and unknown reward function.
result Regret incurred by the agent in both scenarios.
The paper analyzes team formation on online platforms, tackling the exploration vs. exploitation dilemma.
problem Matching workers with tasks on online platforms, especially complex ones.
method Analyzed two settings: strongest member vs. weakest member, using regret bounds and optimal algorithms.
result Established fundamental regret bounds and designed near-optimal algorithms for team matchings.
New RL algorithms learn Gittins indices for unknown Markovian states.
problem Learning Gittins indices for unknown Markovian state transitions.
method Tabular (QGI) and Deep RL (DGN) algorithms based on retirement formulation.
result Lower run time, less storage space, better convergence to Gittins index.
Algorithm stabilizes queues in asymmetric systems with unknown service rates.
problem Stabilizing queues in multi-class multi-server systems with unknown service rates.
method Proposes UCB and Thompson Sampling algorithms to stabilize queues while learning service rates.
result Achieves system stability with an average queue length bound of \(O(\min\{N,K\}/ε)\) for large time horizon \(T\).
Schedule-free SGD is optimal for nonconvex optimization problems.
problem Nonconvex optimization in neural networks.
method Developed a general framework for online-to-nonconvex conversion, which converts schedule-free SGD into an effective nonconvex optimization algorithm.
result Schedule-free SGD achieves optimal iteration complexity for nonsmooth, nonconvex optimization problems.
Paper proposes OPF policy for fair resource allocation with sublinear regret.
problem Fair resource allocation in an online setting against an unrestricted adversary.
method Online Proportional Fair (OPF) policy achieving approximate sublinear regret.
result OPF policy achieves cα-approximate sublinear regret with cα≤1.445. MARTHE optimizes learning rates online using hypergradient approximations.
problem Optimizing task-specific learning rates for better generalization.
method Online algorithm guided by hypergradient approximations, interpolating between RTHO and HD.
result Produces more stable learning rate schedules leading to better model generalization.
Optimal learning rate schedules for SGD in changing data distributions.
problem Minimizing regret in online learning with changing data distributions.
method Characterized optimal schedules for linear regression, proposed schedules for general convex and non-convex losses, and defined a notion of regret for non-convex losses.
result Upper and lower bounds for regret with constants for convex losses, and an upper bound on total expected regret for non-convex losses.
Algorithm learns from human demonstrations to schedule tasks efficiently.
problem Efficient resource scheduling in dynamic environments.
method Personalized apprenticeship learning framework infers decision-making criteria from heterogeneous human demonstrations.
result Achieves high accuracy in synthetic and real-world domains, outperforming baselines.
NESA learns user preferences and calendar contexts for efficient event scheduling.
problem Challenges in understanding user preferences and complex calendar contexts for automated event scheduling.
method Leverages deep neural networks to learn user preferences and calendar context from raw online calendars.
result Significantly outperforms previous models in personal and multi-attendee event scheduling tasks.
New job recommendation system improves job seekers' welfare through field experiments.
problem Current job recommendation systems focus on clicks and applications, not job seekers' welfare.
method Developed a job-search model with two dimensions: utility and success probability. Conducted field experiments to validate model predictions.
result Welfare-optimal job recommendation algorithms outperform existing approaches and perform close to the benchmark.
Paper presents algorithm for optimal job selection with dynamic scoring.
problem Optimal job assignment in a sequential selection process with dynamic scores.
method Developed using dynamic programming, with extensions for partial and no-information cases.
result Algorithm allows for optimal job assignment with limited information.
FairJob dataset for job recommendations in advertising, preserving fairness and utility.
problem Fairness in online job recommendations for advertising.
method Anonymized dataset with proxy for sensitive attributes, fairness metric computation.
result Demonstrated potential improvements in fairness with trade-offs in utility.
Machine learning biases in job recommendations can lead to unfair outcomes.
problem Biased recommendations from recommender systems in job matching.
method Addressing biases at various stages of recommender systems training and deployment.
result Techniques can reduce bias in job recommendations, ensuring fair outcomes.
Graph neural networks improve online planner selection for AI tasks.
problem Selecting the best planner for AI tasks.
method Graph Neural Network (GNN) for planner selection and adaptive scheduling.
result Improved planner selection and scheduling for cost-optimal planning.
Paper analyzes AI's impact on job tasks, predicting future demands.
problem AI's impact on job tasks and potential technological unemployment.
method Dynamic task shares analysis using ARIMA model on large job postings dataset.
result AI has risen in high wage occupations, predicting future task demands.
Optimal transport strategy reduces gender bias in job recommendation systems.
problem Mitigating gender biases in AI-driven job recommendation systems.
method Model agnostic optimal transport strategy applied to multi-class neural networks.
result Reduced undesirable algorithmic biases in job recommendation tasks.
Study online learning with delays and capacity constraints, achieving optimal regret bounds.
problem Online learning with delays and capacity constraints.
method Novel scheduling and preemptive techniques, matching upper and lower bounds.
result Achieves optimal regret bounds across all capacity levels.
A novel bandit problem with delayed arms, showing optimal strategies and lower bounds.
problem Optimizing reward in a stochastic multi-armed bandit setting with delayed arms.
method Mapping to PINWHEEL scheduling problem, simple greedy algorithm, UCB based algorithm, lower bounds.
result Simple greedy algorithm is asymptotically (1−1/e) optimal and UCB based algorithm has clogT+o(logT) cumulative regret. SOOTT framework optimizes target tracking with robust and learning-augmented algorithms.
problem Optimizing target tracking in dynamic environments with adversarial perturbations.
method Integrates robust and learning-augmented algorithms for online decision-making.
result CoRT learning-augmented algorithm strictly improves over robust BEST when predictions are accurate.
AIHT improves online high-dimensional quantile regression by separating support discovery and refinement.
problem Online high-dimensional quantile regression with structural sparsity.
method Adaptive Iterative Hard Thresholding (AIHT) alternates stochastic updates with adaptive hard-thresholding steps.
result AIHT achieves logarithmic regret for the sliding-window objective in high-dimensional settings.
JPLink uses machine learning to match jobs with RIASEC labels.
problem Matching jobs with RIASEC labels requires significant manual effort.
method JPLink uses text content and O*NET knowledge to assign RIASEC labels to jobs.
result JPLink outperforms conventional baselines in matching jobs with RIASEC labels.
New algorithm optimizes online network resource allocation with long-term constraints.
problem Optimal resource reservation in communication networks with job transfers and budget limits.
method Randomized exponentially weighted method for long-term constraints.
result Upper bound for regret and cumulative constraint violations established.
Paper introduces a new job recommendation method using candidate job selection progression.
problem Traditional job recommendation methods are either filter-based or feature-based, limiting serendipitous and cold-start recommendations.
method Uses machine learning to analyze candidate job selection progression and derive latent competencies.
result Achieved best click-through rate in a real-world job recommender system.
This paper optimizes diffusion schedules for better sampling from data distributions.
problem Choosing an optimal discretization schedule for denoising diffusion models.
method Adaptive algorithm that selects an optimal schedule based on a work cost measure.
result The learned schedule recovers and outperforms manually tuned schedules.
GALA adapts learning rates online by aligning gradients, improving deep learning model performance.
problem Fine-tuning learning rates for deep learning models requires extensive grid search.
method GALA dynamically adjusts learning rates by tracking gradient alignment and local curvature.
result GALA produces a flexible, adaptive learning rate schedule that increases when gradients align.
Deep learning approach for efficient IoT task scheduling in MEC networks.
problem Minimizing task latency in IoT users with large-scale MEC systems.
method Stacked auto-encoder for data compression, adaptive simulated annealing, experience replay.
result Near-optimal performance with significantly reduced computational time.