CI fails regularly due to bogus network problems
As pointed out multiple times already, contribs has express supported for separating download and build. There are no reasons to fail CI due to network error on an already known source.
Of course, CI will fail if a new package or a new version of an existing package, needs to be downloaded as a direct consequence of the MR. But that's about 1% of tarballs.