CyberCoveLLC/threshold-plugin-aws
1
0 Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

0 Releases 25 Tags

RSS Feed
  • v0.6.3 e8a0b0bf10
    Compare

    feat(storage): support multipart uploads (#72)

    jknapp released this 2026-06-26 14:34:32 +00:00 | 15 commits to main since this release

    This changeset implements multipart uploads. AWS caps PutObject calls at 5
    GiB, effectively causing the plugin to error on any upload larger than that.
    Multipart limit is 8 TiB, which should be plenty for most use cases.

    Multipart implementation is size-gated: we only switch to multipart uploads once
    the file size is greater than multipartThreshold, which is currently set to 8
    MiB, and we set the part size to 8 MiB as well (this follows AWS CLI and boto3).
    That gives us ~78 GiB max object before we auto-scale, due to 10,000 part cap on
    AWS.

    Co-authored-by: Hugo 10965479+hugoghx@users.noreply.github.com

    Downloads