A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Proposes a framework for energy-efficient AIGC workload scheduling in cloud data centers.
Efficiently scheduling data processing jobs on distributed compute clusters requires complex algorithms. Current systems, however, use simple generalized heuristics and ignore workload characteristics, since developing and tuning a scheduling policy for each workload is infeasible. In this paper, we show that modern ma…
We improve private training accuracy with learning rate schedules and matrix factorizations.
Sequence-to-sequence models predict resource usage for co-scheduled jobs in data centers.
Training large machine learning (ML) models with many variables or parameters can take a long time if one employs sequential procedures even with stochastic updates. A natural solution is to turn to distributed computing on a cluster; however, naive, unstructured parallelization of ML algorithms does not usually lead t…
More and more companies have deployed machine learning (ML) clusters, where deep learning (DL) models are trained for providing various AI-driven services. Efficient resource scheduling is essential for maximal utilization of expensive DL clusters. Existing cluster schedulers either are agnostic to ML workload characte…
SOOTT framework optimizes target tracking with robust and learning-augmented algorithms.
AlgoPerf competition evaluates neural network training speed-ups.
This work introduces a new benchmark to compare neural network training algorithms.
There is a general trend towards solving problems suited to deep learning with more complex deep learning architectures trained on larger training sets. This requires longer compute times and greater data parallelization or model parallelization. Both data and model parallelism have been historically faster in paramete…
FLAME auto-labels mobile data efficiently on diverse processors.
New method SF-AdamW trains large models without decay phases or memory overhead.
Resource scheduling and coordination is an NP-hard optimization requiring an efficient allocation of agents to a set of tasks with upper- and lower bound temporal and resource constraints. Due to the large-scale and dynamic nature of resource coordination in hospitals and factories, human domain experts manually plan a…
The paper optimizes LLM inference systems through queueing theory.
Service-induced congestion in memory-constrained LLM serving
The ability to accurately forecast and control inpatient census, and thereby workloads, is a critical and longstanding problem in hospital management. Majority of current literature focuses on optimal scheduling of inpatients, but largely ignores the process of accurate estimation of the trajectory of patients througho…
Linear algebra algorithms are used widely in a variety of domains, e.g machine learning, numerical physics and video games graphics. For all these applications, loop-level parallelism is required to achieve high performance. However, finding the optimal way to schedule the workload between threads is a non-trivial prob…
This paper tackles computational bottlenecks in federated learning on mobile devices.
GPA improves LLM training speed by 8.71% for Llama-160M models.
The paper predicts workload using process mining and neural networks.
A crucial and time-sensitive task when any disaster occurs is to rescue victims and distribute resources to the right groups and locations. This task is challenging in populated urban areas, due to the huge burst of help requests generated in a very short period. To improve the efficiency of the emergency response in t…
Developing reliable workload predictive models can affect many aspects of clinical decision making procedure. The primary challenge in healthcare systems is handling the demand uncertainty over the time. This issue becomes more critical for the healthcare facilities that provide service for chronic disease treatment be…
Accurate estimation of the run time of computational codes has a number of significant advantages for scientific computing. It is required information for optimal resource allocation, improving turnaround times and utilization of science gateways. Furthermore, it allows users to better plan and schedule their research,…
AI agents on social networks rarely engage in extended conversations.
Smart grid uses deep learning to optimize household energy use.
Critical task and cognition-based environments, such as in military and defense operations, aviation user-technology interaction evaluation on UI, understanding intuitiveness of a hardware model or software toolkit, etc. require an assessment of how much a particular task is generating mental workload on a user. This i…
Paper proposes a human-algorithm approach to reduce medical device recall risk and workload.
Risk management in dynamic decision problems is a primary concern in many fields, including financial investment, autonomous driving, and healthcare. The mean-variance function is one of the most widely used objective functions in risk management due to its simplicity and interpretability. Existing algorithms for mean-…
New method schedules learning rate without stopping time, outperforming existing methods.
This paper proposes a method to select project schedules with the lowest risk.
Systems that can automatically analyze EEG signals can aid neurologists by reducing heavy workload and delays. However, such systems need to be first trained using a labeled dataset. While large corpuses of EEG data exist, a fraction of them are labeled. Hand-labeling data increases workload for the very neurologists w…
Optimizes financial auditor schedules to reduce time and costs.
ScheduleFree+ improves large language model training without schedules or learning rates.
Cosine schedule is optimal for discrete diffusion models.
Assessment of mental workload in real-world conditions is key to ensure the performance of workers executing tasks that demand sustained attention. Previous literature has employed electroencephalography (EEG) to this end despite having observed that EEG correlates of mental workload vary across subjects and physical s…
Optimal learning rate schedules derived for various tasks.
The paper optimizes interpolation schedules in generative models to improve sampling accuracy.
New method converts and optimizes sampling schedules for generative models.
AIHT improves online high-dimensional quantile regression by separating support discovery and refinement.
JAMPI improves matrix multiplication in Spark, boosting performance by up to 24%.
This paper proposes a system-agnostic policy for dynamic scheduling.
The paper presents a multi-power law for predicting loss curves across different learning rate schedules.
To date, pavement management software products and studies on optimizing the prioritization of pavement maintenance and rehabilitation (M&R) have been mainly focused on three parameters; the pre-treatment pavement condition, the rehabilitation cost, and the available budget. Yet, the role of the candidate projects' spa…
Current clinical practice to monitor patients' health follows either regular or heuristic-based lab test (e.g. blood test) scheduling. Such practice not only gives rise to redundant measurements accruing cost, but may even lead to unnecessary patient discomfort. From the computational perspective, heuristic-based test …
Preserving the privacy of individuals by protecting their sensitive attributes is an important consideration during microdata release. However, it is equally important to preserve the quality or utility of the data for at least some targeted workloads. We propose a novel framework for privacy preservation based on the …
Optimal learning rate schedules for SGD in changing data distributions.
Simple policy outperforms complex ones in cloud auto-scaling.
The virtualization of compute and network resources enables an unseen flexibility for deploying network services. A wide spectrum of emerging technologies allows an ever-growing range of orchestration possibilities in cloud-based environments. But in this context it remains challenging to rhyme dynamic cloud configurat…