The accuracy of the current interest points detection algorithms are usually influenced by the unstable interest points in the non-interest regions. To overcome this disadvantage, an image retrieval algorithm combining interest point detection and region division is proposed. First, the interest points detection algorithm, combining the feature of Scale-Invariant Feature Transform (SIFT) and Harris (IPDSH), detects the stable interest points. Second, using the spatial positions of the stable interest points, the algorithm divides the image into annular region and convex hull, and calculates the color histogram of pixels in the convex hull and the pseudo-Zernike in the local field of stable interest points in the annular region. Finally, the algorithm retrieves the image with the weighted feature vector. Experimental results show that the proposed method possesses high retrieval speed, simple realization, robustness in rotation and translation, and can reduce the impact of unstable interest points. The image retrieval precision can by improve by 7.0%-15.1%.