Intergeneric crop plant hybrid lines with small-segment chromosome translocations are very useful in plant genetic research and breeding. In this study, to create small-segment chromosome translocations with beneficial agronomic characters, the progeny of wheat-rye substitution lines 5R/5A and 6R/6A were selected from generations F2 to F5 for rye-specific characteristics. A PCR primer and specific simple sequence repeat marker for rye were used in F5 populations to detect rye chromatin and to amplify a specific chromosome band in six translocation lines (06-6-5, 06-6-6, 06-6-9, 6-26-1, 7-23, and 7-33). Fragment pSc119.1 cloned from 7-33 had 99% homology with the big ear gene sequence (GenBank AF512607.1) in wheat. The six lines were further characterized via pollen mother cell meiosis analysis for genetic stability, and chromosome C-banding and genomic in situ hybridization for rye chromatin. The results show that line 7-33 was still within the 5R/5A substitution lines and possessed the big ear gene. The other lines all contained small-segment rye chromosome translocations. The results indicated that substitution line hybridization is an effective method for creating small-segment chromosome translocations with useful agronomic traits. Trials for these six wheat-rye translocation lines are justified because they possess many important stably-inherited agronomic characters, including disease resistance and improved yield.