Abstract: In order to making full use of the resource of each node of the GPU cluster, and improving the computing performance of the GPU cluster.In this article, Taking the mass video quality analysis in 3G network as research background, made a Load balancing strategy based on CPU-GPU cluster, and built a GPU heterogeneous cluster system.Through a large number of experiments show that the load balancing policy can full advantage of the GPU and CPU computing resources and improve the efficiency of cluster computing.