Tools for managing the data behind the FCP site
Go to file
Dave Morriss 4f744f37c4 Updates for FOSDEM 2023
Changes to the main 'feedWatcher' script: new -check=mode and
    -rejects=file options to automate copyright checks and save rejected
    URLs. Made subroutines parseFeed, and execSQL more resilient.
    Experimented with using XML::FeedPP but haven't done so yet.
    Enhanced checkCopyright to do auto, manual and no checking. Some POD
    additions.

The database is currently being sent to the repo, but this may be unwise.

The script 'make_reports' is for making the various reports uploaded
    here: html, JSON, OPML, Markdown and PDF. The PDF is built from the
    Markdown with Pandoc. The HTML is generated from the template
    'feedWatcher.tpl', which is the default.

The TT² template 'feedWatcher_5.tpl' is for dumping the URLs from the
    database into a file so that they can be reloaded. Daily dumps of
    the database are made on my workstation, and kept for 6 months.
2023-01-09 18:20:17 +00:00
.gitignore Regenerated PDF 2022-11-20 22:49:57 +00:00
README.md Updates to README.md 2022-11-19 22:11:39 +00:00
db_regen first commit 2022-11-19 21:27:51 +00:00
feedWatcher Updates for FOSDEM 2023 2023-01-09 18:20:17 +00:00
feedWatcher.cfg first commit 2022-11-19 21:27:51 +00:00
feedWatcher.db Updates for FOSDEM 2023 2023-01-09 18:20:17 +00:00
feedWatcher.html Updates for FOSDEM 2023 2023-01-09 18:20:17 +00:00
feedWatcher.json Updates for FOSDEM 2023 2023-01-09 18:20:17 +00:00
feedWatcher.mkd Updates for FOSDEM 2023 2023-01-09 18:20:17 +00:00
feedWatcher.opml Updates for FOSDEM 2023 2023-01-09 18:20:17 +00:00
feedWatcher.pdf Updates for FOSDEM 2023 2023-01-09 18:20:17 +00:00
feedWatcher.tpl first commit 2022-11-19 21:27:51 +00:00
feedWatcher_1.tpl first commit 2022-11-19 21:27:51 +00:00
feedWatcher_2.tpl Regenerated PDF 2022-11-20 22:49:57 +00:00
feedWatcher_3.tpl first commit 2022-11-19 21:27:51 +00:00
feedWatcher_4.tpl first commit 2022-11-19 21:27:51 +00:00
feedWatcher_5.tpl Updates for FOSDEM 2023 2023-01-09 18:20:17 +00:00
feedWatcher_schema.sql first commit 2022-11-19 21:27:51 +00:00
make_reports Updates for FOSDEM 2023 2023-01-09 18:20:17 +00:00

README.md

Free Culture Podcasts

History

The project dates back to 2013 when the idea of keeping a list of Linux, Making, Hacking and other technical podcasts was suggested. Various attempts to build such a system were made, culminating in a Perl script called feedWatcher which maintained a SQLite database of podcast feeds.

For the FOSDEM meeting of 2020 a table was obtained to represent as many of the Free Culture podcasts whose details could be collected. The name Free Culture Podcasts was used, a website created (https://freeculturepodcasts.org) and feedWatcher enhanced to generate the HTML to populate it.

Other reports were generated for handouts, etc. The FOSDEM table was deemed a success as it created a fair bit of interest.

Post COVID

Another table was requested at FOSDEM for the 2023 meeting, which unlike the previous years, was in-person.

The feedWatcher script and the database

No significant development has been carried out since 2020. The script is still capable of generating HTML reports and other listings using TT² (Template Toolkit) templates.

More podcast URLs have been added to the database. Several were provided by the HPR host 'norrist'. A process of scanning the #podcast hashtag on Mastodon has also turned up some potential additions.

The original design of the script was to be able to scan feeds already in the database to determine their status. This was planned to enable deleted and fading feeds to be spotted. As feeds are loaded into the database details of their enclosures are also stored, so it is possible to give statistics about feed activity.

Unfortunately, the scan function was not implemented in 2020 and has not been added since, so this feature is not available yet.