Credit where due, it is just my best guess. I have no evidence.

I simply think if you have custom code on a machine to ingest data, creating a federation interface may be more suitable and stable in the long run than a scraper. The extra server load may draw attention or run amuck with security policies designed to obscure scrapers.

But that is certainly an option.