make the echo plugin more manifest when debugging
especially useful to figure out if catchup works, from a user perspective
View Articlefix planet test failure on older html2text
The test suite was failing on my laptop for some mysterious reason. After investigation, it turns out I still had an older version of html2text there which triggered a change in the output. We had...
View Articleadd failing test for issue #5
We do not need to see the output of that feed, actually: we just want to parse it. Therefore, make sure we can test any .xml file provided even if it does not have a matching .mbx. It is a little...
View Articlefix parsing of empty links
For some obscure reason, with the test feed provided in #5, the resulting link is no available in the feed at all, which crashes the normalize routine. That is because urlparse.urlsplit returns a...
View Articlewayback machine API change: HEAD not supported anymore
This unfortunately makes the API slower, but there's nothing else I can do. I tried to report this upstream, went unanswered.
View Articlefix strange crash in wayback plugin
Not sure what `extra` was for but it was crashing now.
View Articleinclude post timestamp in ikiwiki GUIDs
The recent changes page can include multiple posts with the same GUID, as the GUID is simply the URL of the page. In blog posts, that's usually fine because we don't want to act every time a blog post...
View Articlecomply with new feedparser deprecation warning
Somewhere after 5.1.3, feedparser started warning about updated_parsed usage, without any possibility of compliance: https://github.com/kurtmckee/feedparser/issues/151 We properly added defaults but...
View Articledisable cov which crashes on sqlite3.IntegrityError
see https://github.com/pytest-dev/pytest-cov/issues/215
View Articlere-enable coverage tests
We somehow need to tell coveragepy that we're running in parallel even though it's unclear to me that we do: https://github.com/nedbat/coveragepy/issues/702#issuecomment-432016361 Just doing what I'm...
View ArticleMerge branch 'master' into 'master'
According to RFC5064, change header 'Archive-At' to 'Archived-At' See merge request anarcat/feed2exec!4
View Articlewarn instead of crashing on invalid dates
We used to completely crash when a feed had invalid or missing dates. After reviewing the standards, it turns out this is not quite valid behavior: RSS 0.90 and 0.91, for example, do not have dates at...
View Articleexpand and cleanup date validation routines
We used to have a long list of fields. Now we just iterate over the item, then the feed, and look for the fields we want. It's cleaner visually and might even make some feeds validate, as we now look...
View Articleuse dateparser module if available
This behaves better than the feedparser date parser in most scenarios. Still needs unit tests and dependency checks. Closes: #6
View Articlehandle broken pipe correctly from plugins
Before this, doing "feed2exec parse foo | head" would yield an error message for *every* feed item. This silences the warnings completely.
View Articleadd JSON output plugin
This plugin is very simple, if not trivial: it simply dumps all the feed items in a JSON stream. This can be parsed by `jq` on the commandline to diagnose feed problems, do scripting or whatever. This...
View Articleswitch to dateparser for PyPI and tests as well
Because the Debian package recommends dateparser, I had different results running tests natively on Debian and within tox. This harmonizes things and makes use of dateparser everywhere, warts and...
View Articlereduce noise level of 'missing time' problems
It seems like previous versions of feedparser would never trigger that problem, and would fill in the date instead. Now I have feeds that have this on *every* item and it generates a lot of noise in...
View Articleinstall python3-dev, required for compiling regex
Not sure why all that junk is necessary, but I want to fix the build.
View Articleavoid newer feedparser versions
feedparser 6.0+ removed the FeedParserDict which we depend on: https://github.com/kurtmckee/feedparser/issues/197 Until we refactor the Feed class, stick with older versions of feedparser.
View Article