The Post Office will sell you US currency, but AFAIK not US stamps.