I think I'm experiencing something similar but the image linked on my install is:
data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7
I've rebuilt thumbnail caches again and again. I'm using the R2 storage plugin, dunno if that matters.