Yes instantly! As soon as the guest completes the payment they will receive the receipt to their registered email address. Guests also have the option to resend the email to another email address they prefer.
The following image is an illustration of how this appears to guests: