33 Commits

Author SHA1 Message Date
Christoph Reiter
99a86f1ca4 run: add CLI option to skip external sources
makes testing faster in some cases
2024-06-30 15:55:53 +02:00
Christoph Reiter
c1a941bd9b Use the new Arch geo mirror by default
Less likely to be offline
2024-05-25 18:20:02 +02:00
Christoph Reiter
9bdd3d22b1 Expose matched CVEs on the outofdate and the package pages 2024-03-24 11:34:00 +01:00
Christoph Reiter
915771dd65 Add a very basic gentoo package mapper
I couldn't find a proper API, so while this matches lots of packages
it also includes testing/unstable versions which makes for a lot
of false positives would we use it to detect new versions, so it's
marked as a fallback provider for now.
2024-01-12 11:21:22 +01:00
Christoph Reiter
76d4b4d39b Run pyupgrade
upgrade everything to 3.10+
2023-11-01 19:28:08 +01:00
Christoph Reiter
cdd119e863 Parse the pkgmeta data from the srcinfo json file
See https://github.com/msys2/MSYS2-packages/issues/4019
2023-09-17 18:59:12 +02:00
Christoph Reiter
3f0c1ae9cf fetch: reduce update interval
now that we send cache request headers we can ask more often
2023-08-15 22:08:20 +02:00
Christoph Reiter
515198449c Add proper pypi integration
We now fetch the cached pypi API responses and extract the version
and the oldest date of any version artifact
2023-07-03 19:55:50 +02:00
Christoph Reiter
081835a3ee update_arch_versions: move to new arch repo layout
testing, community* are gone; core-testing, extra-testing are new
also remove multilib, likely doesn't include anything that helps us.

and switch to a different mirror which apparently updates more often.
2023-05-21 21:05:16 +02:00
Christoph Reiter
689e8447b4 config: default to ucrt64 where a default is needed 2022-12-30 12:19:20 +01:00
Christoph Reiter
7be7b56370 queue: also read the msys2-arm build status
Both builders will upload the complete build status when they run,
but up until now we only read the one from the main autobuild repo.
This meant that if the arm runner was building something without
the main autobuild running the website wouldn't notice and always
show the out of date state until the next scheduled run.

This now loads both and takes the newest according to the last-modified header
send by github. To keep local caching working during development we
store the last-modified as the cache file mtime.
2022-12-30 10:28:07 +01:00
Christoph Reiter
9c6be6c7e3 Switch to new mapping format
This adds the following things:

* the mapping data is now sourced from the package repositories
* cygwin mapping works too (for example see "msys2-runtime")
* packages can be marked internal so they are never linked
  to arch or cygwin (for example see "base")
2022-12-29 13:53:29 +01:00
Christoph Reiter
4d16111fb4 arch mapping: add provided packages as a fallback
This gives us a few more matches
2022-12-29 06:32:22 +01:00
Christoph Reiter
e0b0ae48da Add a base group collection
This is conceptionally similar to a pkgbase, but for groups.
Something like this doesn't really exist on the PKGBUILD level,
but end users can't really work with pkgbase with pacman either,
so for them that doesn't matter.

It still gives the end user the same structure as with packages,
there is a base thing that has multiple instances for each environment,
and searching might be a bit easier.

The UX could be improved, but the basics are there at least.

Fixes #47
2022-12-26 12:00:45 +01:00
Christoph Reiter
69372e5c2b Switch default branch to main 2022-09-05 08:22:43 +02:00
Christoph Reiter
b595541183 Allow two updates per 5 minutes
Now that we only update what is needed, we can allow more of them
2022-08-01 08:14:55 +02:00
Christoph Reiter
f4f1d592d6 Clean up the app config 2022-08-01 07:35:06 +02:00
Christoph Reiter
1ec7244b13 Rename arch_mapping to external_mapping
we might extend it with cygwin mappings in the future
2022-08-01 07:16:43 +02:00
Christoph Reiter
988e1b41dc cygwin: switch to a better mirror and use the compressed index 2022-07-31 08:21:07 +02:00
Christoph Reiter
6eff4ff779 Download all of the AUR metadata instead of searching via rpc
Turns out they provide it as a json file which gets updated every 15 minutes,
which is good enough for us.
2022-07-31 08:20:39 +02:00
Christoph Reiter
5d324dad8f srcinfo files are now compressed 2022-07-22 17:57:17 +02:00
Christoph Reiter
bb4b996726 package index: remove the "all" option and default to some repo
The page is getting very large and showing all packages for all
repos shouldn't be a common use case.

Let's filter always and default to mingw64
2022-04-01 17:45:16 +02:00
Christoph Reiter
bd6fd47cc9 Use mirror.msys2.org for direct download URLs 2021-07-02 11:16:23 +02:00
Christoph Reiter
dca64c5797 api: add an endpoint for triggering an update
Rate limited to once every 5 minutes.
Can be called from GHA for example.
2021-05-16 15:40:45 +02:00
Christoph Reiter
7f7bb0aee4 Move the cache dir to the top level directory 2021-05-14 07:45:15 +02:00
Christoph Reiter
feae8f571c Add clangarm64 repo 2021-05-13 14:34:40 +02:00
Christoph Reiter
1c5c64e50f Add clang32 2021-04-25 15:09:16 +02:00
Christoph Reiter
e734bafe5b
copy paste bug 2021-03-19 12:23:34 +01:00
Christoph Reiter
e4f4f6fc64 Add new repos 2021-03-19 09:33:51 +01:00
Christoph Reiter
00ec82e7a2 queue: add a build status column 2021-01-22 19:52:15 +01:00
Christoph Reiter
8d9b696783 Switch to the new srcinfo source and format
We now generate them directly in the repo.

Other changes to the format:
* Use ISO dates
* Include the target repo
2020-08-17 20:50:19 +02:00
Christoph Reiter
ee9596a656 Switch repo URLs to https 2020-07-22 07:42:33 +02:00
Christoph Reiter
0bb4b0e659 Split app up into multiple modules
It's time..
2020-05-24 10:16:38 +02:00