Abstract:

In order to solve the unreasonable wait existed in delay algorithm, this paper presents a method based on resource forecast delay scheduling algorithm, by which one reasonably dispatches operation  on the basis of resource availability prediction method. The experimental results show that in the Hadoop cluster general application scenario, the scheduling algorithm, compared with related work, makes the average operating efficiency increased by a factor of 288%  in the assurance of localization computing map task to be similar. This work will greatly improve the working efficiency of Mapreduce.

Key words: Hadoop platform, Mapreduce model, resource scheduling, resource forecast, delay scheduling