Harvester Fetching Revised

132 words.

Fyi, I got a complaint about the UvHarvester fetch frequency last week so I’ve revised it (UvHarvester is the program that collects feed data for the aggregator). Previously it visited each feed once an hour, but now it derives how often to check a feed from the frequency of posts on the feed. So, for example, a feed that gets updated on average once a day will now get 4 visits a day. (This has the unfortunate side-effect that new posts will not show up very quickly on feeds that don’t update often, but that’s not a design goal anyway.) I’ve also revised the comment crawling a little to cut out some unnecessary fetches. I will also be trying some other things to cut down on unnecessary fetching in the coming days/weeks.

Related

This page is a static archival copy of what was originally a WordPress post. It was converted from HTML to Markdown format before being built by Hugo. There may be formatting problems that I haven't addressed yet. There may be problems with missing or mangled images that I haven't fixed yet. There may have been comments on the original post, which I have archived, but I haven't quite worked out how to show them on the new site.

Sorry, new comments are disabled on older posts. This helps reduce spam. Active commenting almost always occurs within a day or two of new posts.