IA upload issue #18

Closed
opened 2025-12-15 14:18:40 +00:00 by ken_fallon · 1 comment
Owner

ia upload hpr4571 "hpr4571.txt" --metadata=mediatype:audio --metadata="contributor:HackerPublicRadio" --metadata="creator:Lee" --metadata="date:2026-02-09" --metadata="description:This is Hacker Public Radio episode 4571 for Monday the 9th of February 2026. Todays show is entitled. Data processing retrospective. It is part of the series "How I got into tech". It is hosted by Lee, and is about 43 minutes long. It carries a clean flag. The summary is. Lee talks to his Mum about her history with computers." --metadata="language:eng" --metadata="licenseurl:http://creativecommons.org/licenses/by-sa/4.0" --metadata="title:Data processing retrospective." --metadata=reviews-allowed:none --header x-archive-keep-old-version:0 --retries=5 --no-derive --no-backup
Gives "Publication date 2026-02-09" which is perfect.
Great thanks - please close the ticket.

Regards,
Ken Fallon
On 2025-12-14 09:34, Ken Fallon wrote:
I see now that I can change "date: " in the editor https://archive.org/editxml/hpr4551 and it renders as "Publication date" in the future 2026-01-12 

I'll double check if I can add it using the ia tool.
Regards,
Ken Fallon

On 2025-12-13 21:11, Jason Scott wrote:
Ken, can you give me the identifier of the show that you are testing this on? I can then take it and see what I can do.

On Sat, Dec 13, 2025, 2:59 PM Ken Fallon <ken@fallon.ie\wrote:
Well I set the "publishing dates" to todays date and that allowed me to upload.
Now if I set the publishing date to the future, then it get's set to todays date anyway.
So no it's not fixed. In my view is that this is incorrect as upload date and publishing date are not the same.
Regards,
Ken Fallon
On 2025-12-09 20:47, Jason Scott wrote:
Did things start working?

On Thu, Nov 20, 2025 at 9:43 AM Ken Fallon <ken@fallon.ie\wrote:
Thanks Jason and Team,

More than happy to work with you on solutions.

FYI I have tried to update one of the shows and I'm getting this error from the cli ia app and also uploading via the web page.

The files are in fact uploaded and the error only appears after the transfer.

https://archive.org/edit.php?edit-files=1&identifier=hpr4600
503 Slow Down(details)

<?xml version='1.0' encoding='UTF-8'?> SlowDown Please reduce your request rate.total\_tasks\_queued exceeds global\_limit 9d7e6ce5-843d-44a2-9576-f1a16d43866b Regards, Ken Fallon

On 2025-11-18 10:51, Jason Scott wrote:
Ken, I'll escalate to see the situation. Be prepared to find alternate solutions with me i f it comes to that.

On Tue, Nov 18, 2025, 5:26 PM Ken Fallon <ken@fallon.ie\wrote:
Hi Internet Archive Team,
I believe that this is a recent policy change, as the system has been allowing the upload of future publishing dates for years.
To give an example of https://archive.org/details/hpr4532 which has a "Addeddate: of 2025-09-13 10:17:29", but is not scheduled to be published until Publication date: 2025-12-16. 
We post the media for shows to the IA prior to them going into our RSS feed where they will be considered "published". This is in line with the documentation of https://archive.org/developers/metadata-schema/index.html#date. "Use the most specific verifiable date you have access to", which is the date that it will be published. 
This change requires us to use "Addeddate" as the "Publication date" which will put all our works out of order as many are scheduled for publishing a year in advance.
I understand that people may be abusing Published Date, but from the IA point of view I would ask to not limit the publishing date to a future, as there are many use cases where you should get a copy of the work prior to the official publication date.
Regards,
Ken Fallon

On 2025-11-18 06:46, Patron Services Gray (Internet Archive) wrote:
##- Please type your reply above this line -##
Your request (1421585) has been updated. To add additional comments, reply to this email.
Patron Services Gray (Internet Archive) Nov 17, 2025, 23:46 CST Hi Ken, Thanks for contacting us. Sorry, the system doees not allow an invalid future date on upload. Thanks for using archive.org Best, Internet Archive Team |   | Patron Services Gray (Internet Archive) Nov 17, 2025, 23:46 CST Hi Ken, Thanks for contacting us. Sorry, the system doees not allow an invalid future date on upload. Thanks for using archive.org Best, Internet Archive Team | |   | Patron Services Gray (Internet Archive) Nov 17, 2025, 23:46 CST Hi Ken, Thanks for contacting us. Sorry, the system doees not allow an invalid future date on upload. Thanks for using archive.org Best, Internet Archive Team
This email is a service from Internet Archive. Delivered by Zendesk
[V1G6ZL-MRDJZ]

ia upload hpr4571 "hpr4571.txt" --metadata=mediatype:audio --metadata="contributor:HackerPublicRadio" --metadata="creator:Lee" --metadata="**date:2026-02-09"** --metadata="description:This is Hacker Public Radio episode 4571 for Monday the 9th of February 2026. Todays show is entitled. Data processing retrospective. It is part of the series "How I got into tech". It is hosted by Lee, and is about 43 minutes long. It carries a clean flag. The summary is. Lee talks to his Mum about her history with computers." --metadata="language:eng" --metadata="licenseurl:[http://creativecommons.org/licenses/by-sa/4.0](http://creativecommons.org/licenses/by-sa/4.0)" --metadata="title:Data processing retrospective." --metadata=reviews-allowed:none --header x-archive-keep-old-version:0 --retries=5 --no-derive --no-backup Gives "Publication date [2026-02-09](https://archive.org/search.php?query=date:2026-02-09)" which is perfect. Great thanks - please close the ticket. Regards, Ken Fallon On 2025-12-14 09:34, Ken Fallon wrote: I see now that I can change "date: " in the editor [https://archive.org/editxml/hpr4551](https://archive.org/editxml/hpr4551) and it renders as "Publication date" in the future 2026-01-12  I'll double check if I can add it using the ia tool. Regards, Ken Fallon On 2025-12-13 21:11, Jason Scott wrote: Ken, can you give me the identifier of the show that you are testing this on? I can then take it and see what I can do. On Sat, Dec 13, 2025, 2:59 PM Ken Fallon <[ken@fallon.ie](mailto:ken@fallon.ie)\wrote: Well I set the "publishing dates" to todays date and that allowed me to upload. Now if I set the publishing date to the future, then it get's set to todays date anyway. So no it's not fixed. In my view is that this is incorrect as upload date and publishing date are not the same. Regards, Ken Fallon On 2025-12-09 20:47, Jason Scott wrote: Did things start working? On Thu, Nov 20, 2025 at 9:43 AM Ken Fallon <[ken@fallon.ie](mailto:ken@fallon.ie)\wrote: Thanks Jason and Team, More than happy to work with you on solutions. FYI I have tried to update one of the shows and I'm getting this error from the cli ia app and also uploading via the web page. The files are in fact uploaded and the error only appears after the transfer. [https://archive.org/edit.php?edit-files=1&identifier=hpr4600](https://archive.org/edit.php?edit-files=1&identifier=hpr4600) 503 Slow Down(details) <?xml version='1.0' encoding='UTF-8'?> <Error> <Code>SlowDown</Code> <Message>Please reduce your request rate.</Message><Resource>total\_tasks\_queued exceeds global\_limit</Resource> <RequestId>9d7e6ce5-843d-44a2-9576-f1a16d43866b</RequestId> </Error> Regards, Ken Fallon On 2025-11-18 10:51, Jason Scott wrote: Ken, I'll escalate to see the situation. Be prepared to find alternate solutions with me i f it comes to that. On Tue, Nov 18, 2025, 5:26 PM Ken Fallon <[ken@fallon.ie](mailto:ken@fallon.ie)\wrote: Hi Internet Archive Team, I believe that this is a recent policy change, as the system has been allowing the upload of future publishing dates for years. To give an example of [https://archive.org/details/hpr4532](https://archive.org/details/hpr4532) which has a "Addeddate: of 2025-09-13 10:17:29", but is not scheduled to be published until Publication date: 2025-12-16.  We post the media for shows to the IA prior to them going into our RSS feed where they will be considered "published". This is in line with the documentation of [https://archive.org/developers/metadata-schema/index.html#date](http://Publication%20date,%20%20%20%202025-12-16). "Use the most specific verifiable date you have access to", which is the date that it will be published.  This change requires us to use "Addeddate" as the "Publication date" which will put all our works out of order as many are scheduled for publishing a year in advance. I understand that people may be abusing Published Date, but from the IA point of view I would ask to not limit the publishing date to a future, as there are many use cases where you should get a copy of the work prior to the official publication date. Regards, Ken Fallon On 2025-11-18 06:46, Patron Services Gray (Internet Archive) wrote: ##- Please type your reply above this line -## Your request (1421585) has been updated. To add additional comments, reply to this email. Patron Services Gray (Internet Archive) Nov 17, 2025, 23:46 CST Hi Ken, Thanks for contacting us. Sorry, the system doees not allow an invalid future date on upload. Thanks for using archive.org Best, Internet Archive Team |   | Patron Services Gray (Internet Archive) Nov 17, 2025, 23:46 CST Hi Ken, Thanks for contacting us. Sorry, the system doees not allow an invalid future date on upload. Thanks for using archive.org Best, Internet Archive Team | |   | Patron Services Gray (Internet Archive) Nov 17, 2025, 23:46 CST Hi Ken, Thanks for contacting us. Sorry, the system doees not allow an invalid future date on upload. Thanks for using archive.org Best, Internet Archive Team This email is a service from Internet Archive. Delivered by [Zendesk](https://www.zendesk.com/support/?utm_campaign=text&utm_content=Internet+Archive&utm_medium=poweredbyzendesk&utm_source=email-notification) \[V1G6ZL-MRDJZ\] >
Author
Owner

Issue fixed and manually fixed 40 episodes.

Issue fixed and manually fixed 40 episodes.
ken_fallon referenced this issue from a commit 2025-12-15 14:19:32 +00:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: HPR/hpr-tools#18