[feed.py] Updating: not all feeds publish etags or modified headers #2

Open
opened 2022-01-01 07:34:09 +00:00 by aadil · 0 comments
aadil commented 2022-01-01 07:34:09 +00:00 (Migrated from git.autonomic.zone)

copied over from lumbung-feed-aggregator repo

Currently the main way to check for updates is to check for date modified or etag headers returned from the feed source. Some systems such as tumblr and SPIP do not use this at all and therefore the feed is downloaded over and over again.

16cbeaedb0/rss_aggregator.py (L150)

Perhaps it is possible to derive another signature from the feed or have another way of checking whether an update is in order.

copied over from [`lumbung-feed-aggregator` repo](https://git.vvvvvvaria.org/rra/lumbung-feed-aggregator/issues/6) > Currently the main way to check for updates is to check for date modified or etag headers returned from the feed source. Some systems such as tumblr and SPIP do not use this at all and therefore the feed is downloaded over and over again. > > [16cbeaedb0/rss_aggregator.py (L150)](https://git.vvvvvvaria.org/rra/lumbung-feed-aggregator/src/commit/16cbeaedb017e80fe162b4206325b296fd3ab4d8/rss_aggregator.py#L150) > > Perhaps it is possible to derive another signature from the feed or have another way of checking whether an update is in order.
Sign in to join this conversation.
No Label
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: lumbung.space/konfluks#2
No description provided.