Commit Graph

1546 Commits

Author SHA1 Message Date
Shaka Bot c819deaa23
chore(main): release 3.4.2 (#1473) 2025-01-17 14:19:28 -08:00
Joey Parrish 89d59a3601
ci: Update comments for the settings workflow (#1476)
Since the introduction of `vars` to GitHub Actions, I started using that
instead of the "environments" trick I used in Packager. However, it has
become clear now that the `vars` strategy has major drawbacks, such as
requiring the use of `pull_request_target`, which should only be used
for actions that do not execute PR-author-controlled code.

This updates the comments to clarify why this is used. This reusable
settings workflow will also be deployed now in other repos to
standardize on this "environments" mechanism, which is safer than
`vars`.
2025-01-17 14:18:54 -08:00
Joey Parrish 565fec5262
ci: Stop using self-hosted Linux/arm64 runners (#1474)
These are no longer required since GitHub launched their own Linux/arm64
runners.

See
https://github.blog/changelog/2025-01-16-linux-arm64-hosted-runners-now-available-for-free-in-public-repositories-public-preview/
2025-01-16 18:37:01 -08:00
Joey Parrish b882572b54
fix(ci): Fix incomplete 3.4.1 release (#1471)
google-github-actions/release-please-action has been deprecated and
replaced with googleapis/release-please-action.
2025-01-16 15:44:10 -08:00
Joey Parrish ea48ee46bf
ci: Upgrade pylint to support Python 3.12 (#1472)
Also fixes issues raised by the newer, stricter pylint
2025-01-10 08:11:04 -08:00
Shaka Bot 8b52868269
chore(main): release 3.4.1 (#1463) 2024-12-20 13:55:22 -08:00
Shaka Bot f8460a6794
chore: Sync policy documents (#1467)
This is an automated sync of policy documents for this organization.
The upstream source is:

de0823bbe4

Co-authored-by: Shaka Bot <shaka-bot@users.noreply.github.com>
2024-12-20 13:54:49 -08:00
Joey Parrish 038b8571a3
ci: Update nodejs to a maintained version (#1466) 2024-12-19 17:53:50 -08:00
Shaka Bot 091f0f3e03
chore: Sync common workflows (#1465)
This is an automated sync of common workflows for this organization.
The upstream source is:

be928d3061

Co-authored-by: Shaka Bot <shaka-bot@users.noreply.github.com>
2024-12-18 08:35:37 -08:00
Joey Parrish 57330eda4a
ci: Do not persist credentials after checkout (#1464)
See actions/checkout#485 and
https://johnstawinski.com/2024/01/11/playing-with-fire-how-we-executed-a-critical-supply-chain-attack-on-pytorch/

In short, it is a terrible idea to persist even our default credentials
after checkout. There's no call for that, so we will now set
`persist-credentials: false` on all checkout actions.
2024-12-18 08:25:39 -08:00
Joey Parrish 4e6a79f5d7
ci: Update workflow permissions (#1462)
Now that default permissions are read-only, we must enable specific
permissions for certain workflow jobs.
2024-12-17 09:30:05 -08:00
Joey Parrish 774cd3f1bc
ci: Read build matrix JSON explicitly (#1461)
Because we used require() to read build-matrix.json, the file could be
replaced with build-matrix.json.js, allowing code injection into our CI
pipelines. This fixes this vulnerability by reading the JSON text with
the fs module, then explicitly parsing it, rather than relying on
require().

This also changes the location of the file, to match its location in
other projects.

Note that this workflow is not currently giving any elevated permissions
to users, so it is not currently possible to damage the repo through a
PR. But this might have been possible in the past, due to
organization-wide defaults for token permissions (recently fixed). No
evidence has been found of past exploit.

See also https://github.com/shaka-project/shaka-streamer/issues/216 and
https://github.com/shaka-project/static-ffmpeg-binaries/issues/57
2024-12-16 15:02:21 -08:00
Joey Parrish df745bdf1a
fix: Add "iw" variant of Hebrew language code (#1458)
We already mapped Hebrew's "heb" to "he", but not to the alternative 2-letter code "iw".

Closes #1457
2024-12-12 11:22:06 -08:00
Joey Parrish 154c1b3a18
ci: Ignore cert error for apt.kitware.com (#1459)
This should fix the retrieval of the GPG key and allow an updated cmake to be installed.
2024-12-12 10:22:30 -08:00
Shaka Bot a26e6623d6
chore: Sync common workflows (#1456)
This is an automated sync of common workflows for this organization.
The upstream source is:

11128e0985

Co-authored-by: Shaka Bot <shaka-bot@users.noreply.github.com>
2024-12-10 09:56:59 -08:00
Shaka Bot 1f0a4d1959
chore(main): release 3.4.0 (#1450) 2024-11-11 11:05:51 -08:00
Joey Parrish 3fdc807ed3
feat: Add option to ignore HTTP output failures (#1449)
When uploading a live stream, if a single segment upload fails, we shouldn't give up.

This adds an option to ignore HTTP output failures so that a single failed upload does not result in a hung stream.  See https://github.com/shaka-project/shaka-streamer/issues/195 for details.
2024-11-11 10:00:09 -08:00
Joey Parrish 0857653338
ci: Fix workflow events (#1446)
This was found by auditing workflows based on research published here:

https://github.com/joeyparrish/workflow-cheat-sheet

The research was prompted by a workflow bug in Shaka Streamer
2024-11-05 14:34:47 -08:00
Shaka Bot cca6cc096f
chore(main): release 3.3.0 (#1444)
🤖 I have created a release *beep* *boop*
---


##
[3.3.0](https://github.com/shaka-project/shaka-packager/compare/v3.2.1...v3.3.0)
(2024-10-25)


### Features

* Add IAMF support
([#1416](https://github.com/shaka-project/shaka-packager/issues/1416))
([dc6196d](dc6196d3d1)),
closes
[#1415](https://github.com/shaka-project/shaka-packager/issues/1415)
* EXT-X-SESSION-KEY support
([#1427](https://github.com/shaka-project/shaka-packager/issues/1427))
([d88ed27](d88ed2798c)),
closes [#36](https://github.com/shaka-project/shaka-packager/issues/36)
* **http:** Add DELETE method support
([#1442](https://github.com/shaka-project/shaka-packager/issues/1442))
([ddeacb2](ddeacb2525))


### Bug Fixes

* **http:** Fix "Failed sending data to the peer" errors
([#1443](https://github.com/shaka-project/shaka-packager/issues/1443))
([2c9d100](2c9d100d44))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-10-28 10:55:24 -07:00
Joey Parrish 0957309dc2
chore: Fix "potentially uninitialized variable" errors in IAMF (#1445)
These errors were specifically coming up in Windows builds and in Linux release builds.  This initializes those variables.

This also fixes errors in IAMF tests like "offset 2 out of bounds", which some compilers raise when you try to statically initialize a vector, then add to it later.
2024-10-25 16:36:16 -07:00
Felicia Lim dc6196d3d1
feat: Add IAMF support (#1415) (#1416) 2024-10-25 09:56:28 -07:00
SteveR-PMP d88ed2798c
feat: EXT-X-SESSION-KEY support (#36) (#1427) 2024-10-25 09:55:27 -07:00
Joey Parrish ddeacb2525
feat(http): Add DELETE method support (#1442)
When we try to remove an old segment from a live stream we uploaded via HTTP, we need to send DELETE requests.
2024-10-24 20:13:04 -07:00
Joey Parrish 2c9d100d44
fix(http): Fix "Failed sending data to the peer" errors (#1443)
Upgrading curl fixes errors like "Failed sending data to the peer" flooding the log.  This is described upstream in https://github.com/curl/curl/issues/10591 and fixed in curl 8.2.0.  Here we upgrade to curl 8.9.1 (latest as of today).

This required updating the way we attach c-ares to libcurl and updating CURLOPT_PUT (deprecated) to CURLOPT_UPLOAD (compatible equivalent AFAICT).
2024-10-24 13:53:39 -07:00
Shaka Bot ed68e69584
chore(main): release 3.2.1 (#1408)
🤖 I have created a release *beep* *boop*
---


##
[3.2.1](https://github.com/shaka-project/shaka-packager/compare/v3.2.0...v3.2.1)
(2024-10-02)


### Bug Fixes

* Add Missing Dash Roles to RoleFromString function
([#1418](https://github.com/shaka-project/shaka-packager/issues/1418))
([#1419](https://github.com/shaka-project/shaka-packager/issues/1419))
([9cb00e9](9cb00e91ab))
* Break header installation for the shared library
([#1407](https://github.com/shaka-project/shaka-packager/issues/1407))
([b5c2cb8](b5c2cb8b73)),
closes
[#1406](https://github.com/shaka-project/shaka-packager/issues/1406)
* Embed full python protobuf library
([#1438](https://github.com/shaka-project/shaka-packager/issues/1438))
([f07fd0d](f07fd0d997)),
closes
[#1436](https://github.com/shaka-project/shaka-packager/issues/1436)

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-10-23 21:49:45 -07:00
Joey Parrish f07fd0d997
fix: Embed full python protobuf library (#1438)
This embeds the full python protobuf library into the output in pssh-box-protos, which is used by installation targets and Docker images.  Without this, the installed pssh-box.py tool would depend on a separate installation of the python protobuf library.

Closes #1436
2024-10-02 08:31:04 -07:00
Wojciech Tyczyński 4bf8b5ef5e
chore: Update README.md (#1435) 2024-09-30 08:37:17 -07:00
John Laurin 9cb00e91ab
fix: Add Missing Dash Roles to RoleFromString function (#1418) (#1419)
As per issue #1418, several Dash roles are missing from the
RoleFromString function, making them unusable in practice. This update
should enable them for use.

---------

Co-authored-by: John Laurin <john.laurin@svt.se>
2024-08-28 18:59:57 -07:00
zaki699 b5c2cb8b73
fix: Break header installation for the shared library (#1407)
include/file.h is breaking header installation for the shared library build.  macros/classes.h must be included to the public headers.

Closes #1406

Co-authored-by: Zaki Ahmed <zaki.ahmed.perso@gmail.com>
Co-authored-by: Joey Parrish <joeyparrish@users.noreply.github.com>
2024-05-30 21:16:05 -07:00
Shaka Bot 53b866886f
chore(main): release 3.2.0 (#1400)
🤖 I have created a release *beep* *boop*
---


##
[3.2.0](https://github.com/shaka-project/shaka-packager/compare/v3.1.0...v3.2.0)
(2024-05-11)


### Features

* support Dolby Vision profile 8.x (HEVC) and 10.x (AV1) in HLS and DASH
([#1396](https://github.com/shaka-project/shaka-packager/issues/1396))
([a99cfe0](a99cfe036f))


### Bug Fixes

* adaptation set IDs were referenced by lowest representation ID
([#1394](https://github.com/shaka-project/shaka-packager/issues/1394))
([94db9c9](94db9c9db3)),
closes
[#1393](https://github.com/shaka-project/shaka-packager/issues/1393)
* escape media URLs in MPD
([#1395](https://github.com/shaka-project/shaka-packager/issues/1395))
([98b44d0](98b44d01df))
* set yuv full range flag to 1 for VP9 with sRGB
([#1398](https://github.com/shaka-project/shaka-packager/issues/1398))
([f6f60e5](f6f60e5fff))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-05-11 23:18:05 -07:00
Cosmin Stejerean a99cfe036f
feat: support Dolby Vision profile 8.x (HEVC) and 10.x (AV1) in HLS and DASH (#1396)
Support Dolby Vision profile 8.1, 8.2, 8.4, 10.1, 10.4 signaling in HLS
and DASH.

Adds new option `--use_dovi_supplemental_codecs` (off by default) to use
SUPPLEMENTAL-CODECS in HLS and `scte214:supplementalCodecs` and
`scte214:supplementalProfiles` for DASH.

To maintain compatibility with existing players the current behavior of
using two entries in the manifest remains the default. This will be
changed in a future version where `use_dovi_supplemental_codecs` will
become on by default.

Adds Dolby Vision compatible brands, 'db1p', 'db2g', 'db4g', 'db4h',
'dby1' based on https://mp4ra.org/#/brands

---------

Co-authored-by: Xingzhao Yun <xyun@dolby.com>
2024-05-10 17:42:34 -07:00
Cosmin Stejerean f6f60e5fff
fix: set yuv full range flag to 1 for VP9 with sRGB (#1398)
If color_space is VPX_COLOR_SPACE_SRGB, the specs says that color_range
should be 1 i.e. yuv_full_range = true. 

However, yuv_full_range was initialized as false and wasn't set in the branch for color_space
is VPX_COLOR_SPACE_SRGB.

Fixes #990

---------

Co-authored-by: Joey Parrish <joeyparrish@users.noreply.github.com>
2024-05-10 17:41:30 -07:00
Cosmin Stejerean 98b44d01df
fix: escape media URLs in MPD (#1395)
Currently `media_info.media_file_url()` is not escaped when placed into
MPD for things like BaseURL. This for example breaks when trying to us a
file name that contains special characters like &. Since these are
supposed to be URLs let's URL encode them.

Fixes #1107

---------

Co-authored-by: Joey Parrish <joeyparrish@users.noreply.github.com>
2024-05-10 17:27:13 -07:00
Cosmin Stejerean b7e96f7d93
docs: document --enable_entitlement_license option for Widevine (#1399)
The option was never covered to the widevine docs when it was added,
requiring someone to read the source code or the --help to discover this
option.

Fixes #983
2024-05-10 17:25:00 -07:00
Cosmin Stejerean 94db9c9db3
fix: adaptation set IDs were referenced by lowest representation ID (#1394)
After change to add forced command line ordering adaptation set IDs in
places were referenced by their sort index (the minimum representation
index they contained).

Instead always refer to adaptation sets by their own ID, and use the
index only as an optional sort key.

Fixes #1393
2024-05-10 17:24:04 -07:00
Shaka Bot 52647b900c
chore(main): release 3.1.0 (#1391)
🤖 I have created a release *beep* *boop*
---


##
[3.1.0](https://github.com/shaka-project/shaka-packager/compare/v3.0.4...v3.1.0)
(2024-05-03)


### Features

* add missing DASH roles from ISO/IEC 23009-1 section 5.8.5.5
([#1390](https://github.com/shaka-project/shaka-packager/issues/1390))
([fe885b3](fe885b3ade))
* get start number from muxer and specify initial sequence number
([#879](https://github.com/shaka-project/shaka-packager/issues/879))
([bb104fe](bb104fef5d))
* teletext formatting
([#1384](https://github.com/shaka-project/shaka-packager/issues/1384))
([4b5e80d](4b5e80d02c))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-05-03 17:32:27 -07:00
sr90 a54e745cf8
refactor: merge Period::ProtectedAdaptationSetMap into AdaptationSet (#844)
---------

Co-authored-by: Cosmin Stejerean <cstejerean@meta.com>
2024-05-02 19:11:04 -07:00
sr90 bb104fef5d
feat: get start number from muxer and specify initial sequence number (#879)
Set the start number in representation to the segment index that is sent by muxer.

With this enhancement, you can now specify the initial sequence number
to be used on the generated segments when calling the packager.
With the old implementation, it was always starting with "1".

---------

Co-authored-by: Cosmin Stejerean <cstejerean@meta.com>
2024-05-02 13:25:49 -07:00
Cosmin Stejerean 62f861c9c2
docs: Fix missing graphviz outputs in generated docs (#1392)
Fixes #1388
2024-05-01 14:20:35 -07:00
Cosmin Stejerean fe885b3ade
feat: add missing DASH roles from ISO/IEC 23009-1 section 5.8.5.5 (#1390)
Fixes #1149

---------

Co-authored-by: Joey Parrish <joeyparrish@users.noreply.github.com>
2024-04-30 14:10:23 -07:00
Torbjörn Einarson 4b5e80d02c
feat: teletext formatting (#1384)
This PR adds parsing of teletext styling, and rendering of the styling
in output TTML and WebVTT subtitle tracks.

Beyond unit tests, I've used the sample
https://drive.google.com/file/d/19ZYsoeUfH85gEilQkaAdLbPhC4CxhDEh/view?usp=sharing
which has rather advanced subtitling with two separate rows at the same
time, where one is left aligned and another is right aligned. This
necessitates two parallel cues to be rendered. It also has some colored
text.

Solve #1335.

## parse teletext styling and formatting

Extend the teletext parser to parse the teletext styling and formatting.
This includes translating rows into regions, calculating alignment
from start and stop position of the text, and extracting text and
background colors.

The colors are limited to full lines.
Both lines and regions are propagated in the TextSample structures.
This is because the number of lines may differ from different sources.
For teletext, there are 24 rows, but they are essentially always
used with double height, so the number of output lines is 12
from 0 to 11.
There are also corresponding regions are denoted "ttx_R",
where R is an integer row number. A renderer can use either
the line number or the region ID to render the text.

## ttml generation for teletext to EBU-TT-D

Add support to render teletext input in EBU-TT-D (IMSC-1) format.
This includes appropriate regions ttx_0 to ttx_11 signalled
in the TextSamples, alignment and text and background colors.

The general TTML output has been changed to always include
metadata, layout, and styling nodes, even if they are empty.

EBU-TT-D is detected by the presence of "ttx_?" regions in the
samples. If detected, extra TTML elements will be added and
the EBU-TT-D linePadding used as well.

Appropriate styles for background and text colors are generated
depending on the color and backgroundColor attributes in the
text fragments.

## adapt WebVTT output to teletext TextSample.

Teletext input generates both a region with prefix ttx_
and a floating point line number (e.g. 9.5) in the
range 0 to 11.5 (due to input 0-23 as double lines).

The output is adopted to drop such regions
and convert the line number to an integer
since the standard only used floats for percent
values but not for plain line numbers.
2024-04-29 10:33:03 -07:00
Cosmin Stejerean 84009d82ef
build: turn on integration tests in ctest by default (#1381)
They can still be skipped by passing `-DSKIP_INTEGRATION_TESTS=ON` for
the build configuration. Fix integration tests so they run correctly when building out of tree.

Use FindPython3 in CMake to fix build and integration tests on Windows.
2024-04-19 07:56:49 -07:00
Shaka Bot ceeb378a85
chore(main): release 3.0.4 (#1377)
🤖 I have created a release *beep* *boop*
---


## [3.0.4](https://github.com/shaka-project/shaka-packager/compare/v3.0.3...v3.0.4) (2024-03-27)


### Bug Fixes

* BaseURL missing when MPD base path is empty ([#1380](https://github.com/shaka-project/shaka-packager/issues/1380)) ([90c3c3f](90c3c3f9b3)), closes [#1378](https://github.com/shaka-project/shaka-packager/issues/1378)
* Fix NPM binary selection on ARM Macs ([#1376](https://github.com/shaka-project/shaka-packager/issues/1376)) ([733af91](733af9128d)), closes [#1375](https://github.com/shaka-project/shaka-packager/issues/1375)

---
This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
2024-03-27 13:39:26 -07:00
Cosmin Stejerean 90c3c3f9b3
fix: BaseURL missing when MPD base path is empty (#1380)
The check for `!mpd_dir.empty()` is not needed because MakePathRelative
handles the case where the parent path is empty. As a result of this
check the base url, segment url, or segment template URLs were all
missing in cases where the mpd output was in the current working
directory.

Fixes #1378
2024-03-27 12:03:10 -07:00
Cosmin Stejerean b7dd8562cf
test: fix TTML integration test where ordering was changed by #1364 (#1379) 2024-03-25 12:31:21 -07:00
Vitaly Gashkov 733af9128d
fix: Fix NPM binary selection on ARM Macs (#1376)
Fixes #1375
2024-03-20 20:22:29 -07:00
Shaka Bot a87a0e0559
chore(main): release 3.0.3 (#1372) 2024-03-12 13:14:38 -07:00
Joey Parrish 4cb6536060
fix: Fix NPM binary publication (#1371)
The default .npmignore would disallow bin/, which contains binaries for
our NPM release. Every release before v3.0.3 was missing .npmignore, and
therefore had no binaries. These were unusable in NPM, and have been
marked as deprecated because of it.

Closes #1369
2024-03-12 13:09:56 -07:00
Joey Parrish d83c7b1d45
fix: Fix tags in official Docker images and binaries (#1370)
The release workflows did not run checkout with `fetch-tags: true`, so
the builds were unable to compute the correct release version number. I
audited all instances of `actions/checkout` to add `fetch-tags` where
needed and clean up unneeded options.

I also had to fix options to `docker/build-push-action`, which by
default ignores `actions/checkout` and tries to pull from git itself.
This led to the Docker build running in a context without the new tag.

Finally, to make verification easier and provide version info in the
build logs, this adds debugging info to the version-generation script
via stderr.

Closes #1366
2024-03-12 13:09:38 -07:00
Shaka Bot 5ee2b7f0de
chore(main): release 3.0.2 (#1365)
🤖 I have created a release *beep* *boop*
---


##
[3.0.2](https://github.com/shaka-project/shaka-packager/compare/v3.0.1...v3.0.2)
(2024-03-07)


### Bug Fixes

* duplicate representation id for TTML when forced ordering is on
([#1364](https://github.com/shaka-project/shaka-packager/issues/1364))
([0fd815a](0fd815a160)),
closes
[#1362](https://github.com/shaka-project/shaka-packager/issues/1362)

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
2024-03-11 10:59:23 -04:00