In this paper, how to measure the softening zone of high strength and wear-resistant rail joint conveniently and accurately in construction site is discussed, in order to meet the requirements of the TB/T1632 "Rail Welding" standard, the test method of using the Leeb hardness tester to refine the measuring point spacing is studied. And the hardness of 60N U76CrRE rail gas pressure welding joint is tested. The results show that the average hardness of the softening zone on the top surface of the joint rail is 15 HB（5%） lower than that of the standard testing method; The average hardness of the joint decreases by 18 HB（5%）, and the width of the softening zone widens 0.5～1.2 mm（4% ～ 9%）; The average hardness of the joint softening area on vertical section decreases by 1.1 HRC（3%）, the average hardness of the joint decreases by 1.3 HRC（3%）, and the softening zone broadens 1～1.5 mm（7%～10%）.The measuring point spacing method is more accurate and convenient than the standard method.