Vagrant fails to download boxes from new Hashicorp Cloud Platform

[anoopcs9]

Since the migration of vagrant boxes from Vagrant cloud to HCP(Hashicorp Cloud Patform) we started observing the following failure in our CI runs:

Bringing machine 'setup0' up with 'libvirt' provider...
==> setup0: Box 'generic/centos9s' could not be found. Attempting to find and install...
    setup0: Box Provider: libvirt
    setup0: Box Version: >= 0
==> setup0: Box file was not detected as metadata. Adding it directly...
==> setup0: Adding box 'generic/centos9s' (v0) for provider: libvirt
    setup0: Downloading: https://vagrantcloud.com/generic/centos9s
The box failed to unpackage properly. Please verify that the box
file you're trying to add is not corrupted and that enough disk space
is available and then try again.
The output from attempting to unpackage (if any):

bsdtar: Error opening archive: Unrecognized archive format

ref: hashicorp/vagrant#13571
ref: https://bugzilla.redhat.com/show_bug.cgi?id=2337302