211 Commits

Author SHA1 Message Date
Christoph Reiter
d028d3acbd fetch-assets: add --delete option to clear targetdir of unwanted files
This removes all files we no longer need from the target, while keeping
files where the mtime and size match and wont re-download them.

This is useful for keeping a directory in sync via a cron job for example.
2021-08-11 21:06:08 +02:00
Christoph Reiter
51666786b6 allow src.tar.zst again 2021-07-25 09:03:16 +02:00
Christoph Reiter
be1f0f71e0 thinko 2021-07-17 21:31:02 +02:00
Christoph Reiter
7f481fdb1a Simplify build order selection
It was selecting the middle one first and then filtered the list
to find the right build type. In many cases this results on not the
middle being built in the end.
2021-07-17 21:16:59 +02:00
Christoph Reiter
71e061429e Add back the third job 2021-07-17 19:55:27 +02:00
Christoph Reiter
e2279e671a fetch-assets: warn in case the mtime of the existing file is different 2021-07-17 19:50:12 +02:00
Christoph Reiter
41f566d371 When downloading an asset preserve the mtime
We take the update_date of the release asset as the mtime.
2021-07-17 19:46:19 +02:00
Christoph Reiter
082e6ba927 Move a function to its only user 2021-07-17 19:06:40 +02:00
Christoph Reiter
8618aa349c Create the referenced releases automatically 2021-07-17 19:04:33 +02:00
Christoph Reiter
ae604e8cac Add some more type annotations 2021-07-17 18:45:56 +02:00
Christoph Reiter
e45ceae224 Move some global state into a function 2021-07-17 18:30:50 +02:00
Christoph Reiter
788340e1bb Add libgda to broken packages
I tried to fix it but gave up. It segfaults at some point during the build.
2021-07-14 20:28:28 +02:00
Christoph Reiter
235648ed1b Remove third job again
We are hitting the api rate limit, so this doesn't add much
2021-07-13 19:04:41 +02:00
Christoph Reiter
44337498b1 use a separate limit for read only limits
it's the main bottle neck now, and there are not many write requests,
so keep them separate.
2021-07-13 06:07:17 +02:00
Christoph Reiter
5eb08f94cd
bump the min remaining requests a bit
with that many jobs we are hitting the rate limit too often
2021-07-13 05:32:28 +02:00
Christoph Reiter
37d15cdc42 Print the build config 2021-07-12 20:57:34 +02:00
Christoph Reiter
d3fa21febc Try to add a third build job 2021-07-12 20:51:48 +02:00
Christoph Reiter
246029f842
Add jeremyd2019 to uploaders 2021-07-11 08:29:41 +02:00
Jeremy Drake
f54ad41f4e Add -R/--repo parameter for which repo to use.
Inspired by Github CLI's -R/--repo option.
2021-07-07 08:01:23 +02:00
Jeremy Drake
de1083d03e Windows ARM64 self-hosted runner support.
Workflow improvements to support a self-hosted runner on Windows ARM64.
The biggest issue is that the currently released versions of Windows on
ARM64 do not support x64 emulation, only x86.

Add a comment to setup-msys2 action that it would need to install a
32-bit msys for current released Windows ARM64.
2021-07-05 20:08:45 +02:00
Christoph Reiter
78b3da8727 fix 2021-07-02 23:40:02 +02:00
Christoph Reiter
a55b4f0bfd Try to filter out built types not in MINGW_ARCH_LIST 2021-07-02 22:12:37 +02:00
Christoph Reiter
58b4e7747c Make it possible to change MINGW_SRC_ARCH
The job schedule needs to take this into account
2021-07-02 22:01:05 +02:00
Christoph Reiter
7a1e258101 Clean up IGNORE_RDEP_PACKAGES
We now ignore rdeps for packages that aren't in the repo already
so these are no longer needed.
2021-07-02 21:55:52 +02:00
Christoph Reiter
219634574f Move everything config related to one place 2021-07-02 21:54:13 +02:00
Christoph Reiter
7ca0610513 Rework the upload-assets command
Instead of requiring a package name just pass a directory and match all
packages.

Also make the package patterns more strict so .sig files don't match.

This makes uploading a directory full of packages easier.
2021-06-30 00:30:04 +02:00
Christoph Reiter
d8c110587c
typo 2021-06-25 16:35:45 +02:00
Christoph Reiter
9e3bd5306d Don't pass CI related env vars to build scripts
Fixes #30
2021-06-25 10:36:02 +02:00
Christoph Reiter
3c86ba12f9 Revert "mark clang32 as wip for now"
This reverts commit 4a2b2ad7b0919b26b488235d956a314dc357395f.
2021-06-24 08:38:41 +02:00
Christoph Reiter
a7489361f5 If a package is marked incomplete it also needs to block rdeps
This just moves the check into the loop that checks deps until there are no more changes.
2021-06-24 08:14:52 +02:00
Christoph Reiter
4a2b2ad7b0 mark clang32 as wip for now 2021-06-24 06:42:50 +02:00
Christoph Reiter
676af4c2d7
Add mingw-w64-kirigami2-qt5 to IGNORE_RDEP_PACKAGES 2021-06-16 15:12:07 +02:00
Christoph Reiter
16f20bf2ec Don't block on clangarm64 if it's a reverse dep for msys packages 2021-05-23 14:12:49 +02:00
Christoph Reiter
cf48da40ba Trigger a website update after updating the build status file
And use the same request timeout everywhere
2021-05-16 20:10:44 +02:00
Christoph Reiter
d4e9a3a4b1 don't replace the status of blocked packages if the src is the only uploadable 2021-05-16 05:48:39 +02:00
Christoph Reiter
b7465338f6 fetch-assets: also include incomplete builds with --fetch-all
We want them to end up in staging still so they get some testing.
2021-05-15 11:46:20 +02:00
Christoph Reiter
f6d048f250 Explicitely block lone source packages
Otherwise we try to upload them every time because we have no way to track them.
2021-05-14 17:48:07 +02:00
Christoph Reiter
a3fb4f818f Keep ignoring clangarm64
for example sphinx is blocking other packages, but we can't easily build it and unblock things
2021-05-14 17:11:41 +02:00
Christoph Reiter
d50c183681 Take into account if the packge to build is new or not
instead of being more lax with newer repos in general use that fact that a package is new
instead to decide when to block uploads.
2021-05-14 13:20:17 +02:00
Christoph Reiter
ea7ae5138e Remove GITHUB_USER/PASS support
afaik this got deprecated
2021-05-14 08:54:24 +02:00
Christoph Reiter
c0cea6bff9 Mark clangarm64 as WIP 2021-05-14 08:52:31 +02:00
Christoph Reiter
e13dda0bb9 Never let source packages get blocked by other things 2021-05-14 08:51:55 +02:00
Christoph Reiter
4d99bee231 Add clangarm64 2021-05-13 16:47:26 +02:00
Christoph Reiter
4ba4930f7e Store multiple URLs per failed run
So we can link to multiple pages
2021-05-01 15:54:38 +02:00
Christoph Reiter
99330be9d6 GHA doesn't give us the real run name, so set it manually 2021-05-01 15:19:59 +02:00
Christoph Reiter
fba4a9e16e Add a command for clearing the failed state of one build type
This is useful for mass rebuilds of one build type
2021-05-01 14:22:39 +02:00
Christoph Reiter
478184ad37 Try to improve the error log url
github makes it hard to get the url of the currently running job.
I think this should work, at least in our setup
2021-05-01 14:11:37 +02:00
Christoph Reiter
cbff3ed167 update_status: handle requests exceptions as well
like in other places. they leak through..
2021-04-26 19:47:21 +02:00
Christoph Reiter
41e990ace1 Install mingw-w64-clang-i686-toolchain after adding the repo 2021-04-25 16:52:57 +02:00
Christoph Reiter
dad24d4aef Add clang32 2021-04-25 14:50:25 +02:00