Check feeds from same provider for duplicate items

[hardy24]

When you subscribe to more than one feed from a provider (usually a news website such as BBC or Reuters) there is often some 'overlapping' of content, hence you get items appearing in more than one feed.

It would be nice, to combat this if you could tell gregarius that certain feeds may be liable to have some duplicates, so that it could check during every update, and delete all but one copy of the duplicated item.

For added functionality, being able to set a 'priority' would be nice, what I mean by that is, say an item is found in the Main News feed, Sport News feed and say Football Feed, to keep the copy found in the Football feed and delete the duplicates in the Sport feed and Main News feed.

[sdcosta]

If the feeds have guid's or atom ID's for the items then it should be easier to do this via a plugin. I don't think this should be a core feature for gregarius.