We consider the pricing of credit default swaps (CDSs) with the reference asset assumed to follow a geometric Brownian motion with a fast mean-reverting stochastic volatility, which is often observed in the financial market. To establish the pricing mechanics of the CDS, we set up a default model, under which the fair price of the CDS containing the unknown "no default" probability is derived first. It is shown that the "no default" probability is equivalent to the price of a down-and-out binary option written on the same reference asset. Based on the perturbation approach, we obtain an approximated but closed-form pricing formula for the spread of the CDS. It is also shown that the accuracy of our solution is in the order of O(ε).