Abstract: This paper proposes a new way that selects initial cluster center in order to solve the partially most superior phenomenon.By using the fuzzy weighting on the samples, this improved method decreases the influence that the k-means algorithm is very sensitive to the isolated point.Lastly, we have a test about text clustering and the result shows that this method obtains good clustering effect.