Push process of Kafka Connect fails

[lordofthejars]

Hello I am using Strimzi to deploy MongoDB Sink Kafka Connect to my Kafka instance, and I got an error. I am probably doing something wrong, but the error message is unclear.

The YAML file looks like this:

apiVersion: kafka.strimzi.io/v1beta2
kind: KafkaConnect
metadata:
  name: mongodb-sink-connect-cluster
  annotations:
    strimzi.io/use-connector-resources: "true"
spec:
  version: 3.2.3
  replicas: 1
  bootstrapServers: my-cluster-kafka-bootstrap:9092 
  build:
    output:
      type: docker
      image: quay.io/lordofthejars/mongodb-sink-connect-cluster:latest
      pushSecret: quayio 
    plugins:
      - name: my-plugin
        artifacts:
          - type: maven
            repository: https://repo1.maven.org/maven2 
            group: org.mongodb.kafka
            artifact: mongo-kafka-connect
            version: 1.8.1
  config:
    group.id: connect-cluster
    key.converter: org.apache.kafka.connect.json.JsonConverter
    value.converter: org.apache.kafka.connect.json.JsonConverter
    key.converter.schemas.enable: false
    value.converter.schemas.enable: false
    offset.storage.topic: connect-offsets
    offset.storage.replication.factor: 1
    config.storage.topic: connect-configs
    config.storage.replication.factor: 1
    status.storage.topic: connect-status
    status.storage.replication.factor: 1

The secret I created with the credentials to push:

k create secret docker-registry quayio --docker-server=quay.io --docker-username=$QUAY_USERNAME --docker-password=$QUAY_PASSWORD

And when I apply the resource, I got the following log lines:

Pushing image quay.io/lordofthejars/mongodb-sink-connect-cluster:latest ...
Getting image source signatures
Warning: Push failed, retrying in 5s ...
Getting image source signatures
Warning: Push failed, retrying in 5s ...
Getting image source signatures
Warning: Push failed, retrying in 5s ...
Registry server Address:
Registry server User Name: lordofthejars
Registry server Email:
Registry server Password: <<non-empty>>
error: build error: Failed to push image: error copying layers and metadata from "containers-storage:[overlay@/var/lib/containers/storage+/var/run/containers/storage:mountopt=metacopy=on]quay.io/lordofthejars/mongodb-sink-connect-cluster:latest" to "docker://quay.io/lordofthejars/mongodb-sink-connect-cluster:latest": Error trying to reuse blob sha256:762908e901a628d2f6f7967c6f0ea9c3723c0c53318592508c518772afaa417d at destination: too many requests to registry

I guess this last error is because of all the retries that Quay blocks the storage, but the real problem is hidden. So first, of course, I'd love to know what I am doing wrong, but also I think that it would be great to provide the information every time there is a failure, exactly the reason, as it might help to know exactly what's going on every time.

I am using OpenShift 4.9, with Red Hat AMQ Streams project.

[scholzj]

On OpenShift, the OpenShift Build is used. You can find the build details in the OpenShift Console. TBH, I have no idea if the log verbosity can be somehow increased there.