Abstract: We present a background image building method to deal with the problem of color images motion object detection in real-time.The distance between color images is defined to compare the frame image and the background image according to the frame sequences.The motion state matrix is extracted to update background image in pixels level.The method need not background models and fit variety changes.Actual color images were used to test the method.The experimental results show that our method is effective and accurate.