Additions to the database and feedWatcher

feedWatcher: added the parsing of HTML feeds to get the title tag in the
    <head> area; new database fields relating to the copyright check
    done, and why the feed was allowed in if done so manually; added dry
    run mode; changed the way -load and -delete work so each can be
    given URLs on the command line; starting to report settings at start
    time (needs work); -load and -delete not allowed together; more
    logging; addition of a _debug function; enhancement of reportFeed to
    show one feed and a summary of relevant details (more useful than
    dumping the entire database this way); added getHTMLTitle for
    parsing out the HTML title; enhanced checkCopyright to get a reason
    if in manual mode and a feed is allowed in; needs a lot of
    clean-up!

feedWatcher.{html,json,mkd,opml,pdf}: various reports.

feedWatcher_3.tpl: For making Markdown which is turned into PDF.
    'Licence' becomes 'Copyright'

feedWatcher_5.tpl: for dumping all the URLs in the database
    & regenerating everything

feedWatcher_schema.sql: new fields added
This commit is contained in:
Dave Morriss
2023-01-14 23:13:49 +00:00
parent 01ec2cf92f
commit db39655199
10 changed files with 1047 additions and 393 deletions

View File

@@ -198,6 +198,14 @@
<dl>
<dt><a href="https://2.5admins.com">2.5 Admins</a> (<a href="https://2.5admins.com/feed/podcast">feed</a>)</dt>
<dd>2.5 Admins is a podcast featuring two sysadmins called Allan Jude and Jim Salter, and a producer/editor who can just about configure a Samba share called Joe Ressington. Every two weeks we get together, talk about recent tech news, and answer some of your admin-related questions.</dd>
<dt><a href="https://www.adminadminpodcast.co.uk">Admin Admin Podcast</a> (<a href="http://feeds.feedburner.com/TheAdminAdminPodcast">feed</a>)</dt>
@@ -558,6 +566,14 @@
<dt><a href="https://www.linuxuserspace.show">Linux User Space</a> (<a href="https://www.linuxuserspace.show/rss">feed</a>)</dt>
<dd>How did your favorite Linux distribution get its start? Join us and find out! Linux User Space is hosted by Leo and Dan, and every two weeks we deep dive into the history of Linux distributions and the things that matter to us. Episodes drop every other Monday.</dd>
<dt><a href="https://www.linuxatwork.org">Linux at Work</a> (<a href="http://feeds.podtrac.com/mBdfP0QTX0iY">feed</a>)</dt>
@@ -702,6 +718,14 @@
<dt><a href="http://www.scienceforthepeople.ca/">Science for the People</a> (<a href="http://feeds.feedburner.com/SkepticallySpeaking">feed</a>)</dt>
<dd>Science for the People is a long-format interview podcast that explores the connections between science, popular culture, history, and public policy, to help listeners understand the evidence and arguments behind what&#39;s in the news and on the shelves. Our hosts sit down with science researchers, writers, authors, journalists, and experts to discuss science from the past, the science that affects our lives today, and how science might change our future.</dd>
<dt><a href="https://twit.tv/shows/security-now">Security Now (Audio)</a> (<a href="http://feeds.twit.tv/sn.xml">feed</a>)</dt>