Abstract: Control algorithm of media player was proposed by dynamic hand gesture, using thinking in finite state automation.Firstly, sequences image was converted from RGB color space to YCrCb, in which gesture target region and it's center were obtained by means of otsu.Secondly, center of target region and frame delay time were input signal of finite state automation, different functions of media player were it's state, different gesture commands were decided by input signal and current state.Finally, functions of media player such as pause/continue、next/previous and volume adjustment were realized by windows system function keybd_event () .Experimental results show that media player can be controlled real-timely and effectively using the algorithm, Midas Touch program is perfectly solvable.