I250 -Clarify SQLite / MySQL Instructions for local generation #251

Open
paulj wants to merge 3 commits from paulj/hpr_generator:recommend_sqlite into main
2 changed files with 42 additions and 44 deletions

View File

@ -81,7 +81,8 @@ or
`wget --directory-prefix=./ https://www.hackerpublicradio.org/hpr.sql` `wget --directory-prefix=./ https://www.hackerpublicradio.org/hpr.sql`
## Creating an SQLite database file You can process the file using SQLite, or MySQL as you prefer. SQLite is the recommended option for local processing, but instructions are given for both options:
## Option 1: Creating an SQLite database file
The SQL of the hpr.sql file must be converted from MySQL specific statements to The SQL of the hpr.sql file must be converted from MySQL specific statements to
SQLite specific statements. The mysql2sqlite script found in the utils directory SQLite specific statements. The mysql2sqlite script found in the utils directory
@ -101,6 +102,17 @@ From the root of the local hpr_generator repository run:
`./utils/update-sqlite-db.sh` `./utils/update-sqlite-db.sh`
## Option 2: Creating a MySQL database file
The SQL code in the hpr.sql file needs to be loaded into a local database:
* Create database hpr_hpr in the MySQL server from HPR dump file.
- ``sudo mysql --host=localhost < hpr.sql``
* Create a user that will be used by the site-generator.
- Suggested username: hpr-generator
- ``CREATE USER 'hpr-generator'@'localhost' IDENTIFIED BY '<password>';``
* Limit the user's privileges to EXECUTE and SELECT
- ``GRANT SELECT ON hpr_hpr.* TO 'hpr-generator'@'localhost';``
- ``GRANT EXECUTE ON `hpr_hpr`.* TO 'hpr-generator'@'localhost';``
# Configure the site-generator # Configure the site-generator
In your favorite text editor, open the site.cfg file found in the root of the In your favorite text editor, open the site.cfg file found in the root of the

View File

@ -1,65 +1,47 @@
# hpr_generator # hpr_generator
Static web page generator for the Hacker Public Radio website. Static web page generator for the Hacker Public Radio website.
## Installation ## Installation
Steps necessary to install this generator locally:
* Clone or download this repository * Clone or download this repository
* With SQLite * Install the needed Perl modules using your preferred method (distribution
* Create the sqlite3 database from the hpr.sql MySQL dump file available on packages, CPAN, etc.)
hackerpublicradio.org. The default name for the database file is "hpr.db"
and should be located in the root of the project directory. The name and
location can be set in the site.cfg file.
* An "update-hpr.sh" helper script is available in the utils directory. This
script will download the hpr.sql file, convert it to the SQLite hpr.db file,
and regenerate the website using the site-generator.
1. `cd` into the root of the project directory
2. Run `./utils/update-hpr.sh`
* SQLite v3.8.3 or greater is recommended. CTE WITH clauses are used in some template queries. Must convert WITH
clauses to sub-queries when using earlier versions of SQLite.
* With MySQL
* Create database hpr_hpr in the MySQL server from HPR dump file.
- ``sudo mysql --host=localhost < hpr.sql``
* Create a user that will be used by the site-generator.
- Suggested username: hpr-generator
- ``CREATE USER 'hpr-generator'@'localhost' IDENTIFIED BY '<password>';``
* Limit the user's privileges to EXECUTE and SELECT
- ``GRANT SELECT ON hpr_hpr.* TO 'hpr-generator'@'localhost';``
- ``GRANT EXECUTE ON `hpr_hpr`.* TO 'hpr-generator'@'localhost';``
* Install the needed Perl modules using preferred method (distribution packages, CPAN, etc.)
* Getopt::Long
* Pod::Usage
* Config::Std
* Template
* Template::Plugin::File
* Template::Plugin::DBI
* Template::Plugin::Date
* Template::Plugin::HTML::Strip
* DBI
* Tie::DBI
* DBD::SQLite or DBD::mysql
* Date::Calc
* Text::CSV_XS
* HTML::Entities
* See the [Getting Started](GETTING_STARTED.md) tutorial for more details on
installing the HPR generator.
## Usage ## Usage
Generate two specific pages: The following utilities are provided to support the process of
`site-generator index about` generating the website:
* `utils/update-hpr-db.sh` - Download the database and transform it
into the hpr.db SQLite database.
* `utils/update-hpr.sh` - Download HPR.sql and create the SQLite database
using `update-hpr-db.sh`, then run `site-generator` to create the
website.
* `./site-generator` - Using the information in the templates
directory and the show information in the database, generate the
website. Without parameters, the whole site will be generated.
Generate the whole site: If you need to generate specific pages (in this example, index and about):
`site-generator --all` `site-generator index about`
Having downloaded the database, you can also regenerate the whole site:
`site-generator --all`
Generate pages based on the same template: Generate pages based on the same template:
`site-generator correspondent=1,3,5..10` `site-generator correspondent=1,3,5..10`
## More Information
* See the [Getting Started](GETTING_STARTED.md) tutorial for more details on
installing and using the HPR generator.
## Support ## Support
Please [submit an Issue](https://repo.anhonesthost.net/HPR/hpr_generator/issues), Please [submit an Issue](https://repo.anhonesthost.net/HPR/hpr_generator/issues),
and add the label "**Help Request**" for help running or installing the site-generator. and add the label "**Help Request**" for help running or installing the site-generator.
For discussing HPR site generation in general, please [submit an Issue](https://repo.anhonesthost.net/HPR/hpr_generator/issues) and add the label "**General Discussion**". For discussing HPR site generation in general, please [submit an Issue](https://repo.anhonesthost.net/HPR/hpr_generator/issues) and add the label "**General Discussion**".
## Contributing ## Contributing
Happy to take any contributions or suggestions. Happy to take any contributions or suggestions.
To contribute code or documentation, please create a fork of the project and [submit a pull request](https://repo.anhonesthost.net/HPR/hpr_generator/pulls) or send a patch. If an issue exists that is related to your patch, please assign the issue to yourself, or if it is already assigned to someone else, please coordinate with them to minimize duplicated efforts. To contribute code or documentation, please create a fork of the project and [submit a pull request](https://repo.anhonesthost.net/HPR/hpr_generator/pulls) or send a patch. If an issue exists that is related to your patch, please assign the issue to yourself, or if it is already assigned to someone else, please coordinate with them to minimize duplicated efforts.
@ -71,9 +53,13 @@ To make a suggestion, please [submit an Issue](https://repo.anhonesthost.net/HPR
and add the label "**Feature Request**". and add the label "**Feature Request**".
## Authors and acknowledgment ## Authors and acknowledgment
* Roan "Rho`n" Horning * Roan "Rho`n" Horning
* Dave Morriss * Dave Morriss
* gordons * gordons
* Ken Fallon * Ken Fallon
* norrist * norrist
* Paul Jewell (paulj)