Before we treat this as a bug we likely need more information.
Guest posts do require CAPTCHA but there's no expectation for this to fail.
So which CAPTCHA are you using exactly? CAPTCHA would usually need to be required on registration too, so does this also affect registrations? Are there any errors logged in the "Server error log" in Admin > Logs?