Feature data source kafka topic list + Fix acceptance test

[dttung2905]

Merry Christmas and Happy New Year everyone,

• I hope this MR would solve the request in feature request - data source - a list of all topics #204
• I also fix the issue with make testacc step. Example is here

Error: /20 17:24:21 [ERROR] Error connecting to kafka kafka: client has run out of available brokers to talk to (Is your cluster reachable?)

We use tag latest for our docker image (confluentinc/cp-kafka and confluentinc/cp-zookeeper). In the later version kafka.security.auth.SimpleAclAuthorizer was replaced by kafka.security.authorizer.AclAuthorizer which will make kafka throw error and ultimately make all 3 kafka broker goes down

[dttung2905]

Hi @Mongey,
Happy new year! Could you help me take a look at this MR ?

[Mongey]

Thanks for starting on this @dttung2905
I think we should call the data source kafka_topics rather than kafka_topic_list and we should change it to return a more complex structure, instead of just a list of strings, e.g. it should return a list of structs similar to the kafka_topic datasource (if possible)

			"name": {
				Type:        schema.TypeString,
				Required:    true,
				Description: "The name of the topic.",
			},
			"partitions": {
				Type:        schema.TypeInt,
				Computed:    true,
				Description: "Number of partitions.",
			},
			"replication_factor": {
				Type:        schema.TypeInt,
				Computed:    true,
				Description: "Number of replicas.",
			},
			"config": {
				Type:        schema.TypeMap,
				Computed:    true,
				Description: "A map of string k/v attributes.",
				Elem:        schema.TypeString,
			},

[dttung2905]

Thanks @Mongey for the suggestion. Let me make relevant changes to the MR and update you here

[dttung2905]

Hi @Mongey, I have change the returned attributes like you suggested above. Do you mind reviewing it again ?

[dttung2905]

Hi @Mongey , just want to revisit this issue whether there is anything I can improve on?

[dttung2905]

@Mongey Just to to circle back on this issue for your feedback

[gintek]

Hi folks, is there any chance to merge this change in near future ?

[dttung2905]

Hi @gintek I would love to. Do you know who else could review and merge the MR ?

[dttung2905]

Hi @Mongey,
I have rebased my PR . There is a CI failure that is due to invalid your invalid SSH key (link). Could you help to take a look at it ?
Also there is an unrelated CI test failure. I'm not sure whether we need to do something about it as it has been there for a while iinw