Sedimentary rocks are widely distributed on the surface and contain abundant solid minerals and hydrocarbon resources.The accurate identification of sedimentary rocks is of great significance for basic geological research and the exploration of solid minerals and hydrocarbon resources. At present, lithology identification of sedimentary rocks mainly relies on visual identification, optical identification and X-ray powder diffraction analysis. These methods have many problems such as great influence of subjective factors, long experiment period and high cost which can not meet the needs of real-time lithology results acquisition in the field. In this paper, four typical sedimentary rocks of terrigenous clastic rocks (sandstone and mudstone) and carbonate rock (limestone and dolomite) are identified rapidly by the quartz abundance index (8625D), carbonate abundance index (6500D), carbonate composition index (2340W), illite-smectite mixed layer abundance index (2200D), kaolinite abundance index (2160D2190) and rock brightness index (Albedo-SWIR), which is combined infrared reflectance spectroscopy with binary intersection graphic method. The overall recognition rate is more than 90%. This study provides a rapid, non-destructive and objective identification method for sedimentary rock lithology and has a good application prospect, which plays an important significance for the subsequent research on detailed cataloging of cores, stratigraphic division, sedimentary facies division, and physical property evaluation of carbonate reservoir.