专利名称:Load balancing using progressive sampling
based on load balancing quality targets
发明人:Garret Swart,Smriti R. Ramakrishnan申请号:US13561383申请日:20120730公开号:US09032416B2公开日:20150512
专利附图:
摘要:A method, system, and computer program product for of load balancing in aparallel map/reduce paradigm. The method commences by sampling a first set of inputrecords, and forming a prospective load balancing assignment by assigning the first set
of input records to the plurality of worker tasks based on a workload estimate for eachof the worker tasks. To measure the prospective load balancing assignment, the methodcompares the workload variance over the plurality of worker tasks to a workloadvariance target, and also calculates a confidence level based on the sampled first set ofinput records. If the measured quality of the prospective load balancing assignment isnot yet achieved, then the method samples additional input records; for example whenthe calculated workload variance is greater than the maximum workload variance targetor when the calculated confidence level is lower than a confidence level threshold.
申请人:Garret Swart,Smriti R. Ramakrishnan
地址:Palo Alto CA US,Palo Alto CA US
国籍:US,US
代理机构:Vista IP Law Group, LLP
更多信息请下载全文后查看
因篇幅问题不能全部显示,请点此查看更多更全内容