It does, but like I said most people just automatically buy new bonds, instead of actually removing the money from the Government.

As far as I know, only the interest is considered as an expense. The principal is not accounted but I might be corrected.