Yeah, looks like Youtube just fixed it on their end. I was briefly using the provided template edit workaround, but now was able to safely remove it.
EDIT:
My mistake, I removed the template edit and refreshed an affected page on my site, and the Youtube embeds still loaded fine, so I assumed it was fixed on Youtube's end. I guess something was cached which allowed those embeds to load successfully again or something.