A year after giving up on Fedify, I split it into its own service and got a working follower, with replies landing as comments on the blog.