In the paper, the micro deformation of oxide scale in hot strip rolling has been investigated with considering the friction effect. The finite element simulation of the micro deformation of oxide scale has been successfully conducted, and the calculated surface roughness is compared with the measured value, which shows a good agreement. A crystal plasticity finite element method (CPFEM) model was also successfully developed to analyse the surface roughness transfer during metal manufacturing. The simulation results show a good agreement with the experimental results in the flattening of surface asperity, and the surface roughness decreases significantly with an increase of reduction. This study also indicates that the lubrication can delay surface asperity flattening.