New Connector List #446

odbozhou · 2023-03-29T07:56:17Z

注意：有不少数据库方面的存储系统是支持 JDBC 的，RocketMQ Connect 也已经提供通用的 JDBC Connector 实现，所以如果是通过 JDBC 实现的 Connector ，不需要再实现单独的新的 Connector， JDBC Connector 已经支持了。

序号	Connector	优先级	项目难度	Source/Sink	github id
1	Iceberg	high	high	Sink	开源之夏
2	HBase	high	high	Sink	开源之夏
3	TiDB	middle	middle	Source	joeCarf
4	Druid	middle	middle	Source
5	Druid	high	middle	Sink	daimingbao
6	ClickHouse	high	low	Sink	joeCarf
7	Splunk	high	middle	Source
8	Splunk	low	middle	Sink
9	Kudu	high	high	Source
10	Kudu	high	high	Sink
11	HDFS	high	high	Sink	Chovyyyyyy
12	HDFS	high	high	Source	TyrantLucifer
13	OSS	high	middle	Source	yiduwangkai
14	OSS	high	middle	Sink	yiduwangkai
15	Solr	middle	middle	Sink
16	Email	middle	low	Sink	liuxiaocs7
17	Redis	high	middle	Sink	totalo
18	MongoDB	high	middle	Sink	totalo
19	Neo4j	middle	middle	Sink	liuzongliang0202
20	Phoenix	middle	middle	Sink
21	Hive	low	middle	Sink	TyrantLucifer
23	ADB PostgreSQL	high	low	Sink	Hello-gzk-World
24	ADB PostgreSQL	high	low	Source	Hello-gzk-World
25	ADB MySQL	high	low	Sink	mgljava
26	ADB MySQL	high	low	Source	mgljava
27	Aliyun Tablestore	high	middle	Source	liuxiaocs7
28	Aliyun Tablestore	high	middle	Sink	liuxiaocs7
29	Hologres	middle	middle	Source	ferrirW
30	Hologres	middle	middle	Sink	ferrirW
31	DataHub	middle	middle	Source
32	SLS	high	middle	Source
33	EBS	middle	middle	Source
34	NAS	middle	middle	Source
35	Snowflake	middle	high	Sink	joeCarf
36	Snowflake	middle	high	Source	joeCarf
37	Salesforce (Bulk API) Connector	middle	middle	Source
38	Salesforce (Bulk API) Connector	middle	middle	Sink
39	Google BigQuery	middle	middle	Source
40	Google BigQuery	high	middle	Sink
41	Google Cloud Pub/Sub	middle	middle	Source
42	Datadog Metrics Sink Connector	high	middle	Sink
43	Amazon S3 Connector	high	low	Sink	DuansgXD
44	Amazon S3 Connector	high	low	Source	DuansgXD
45	Amazon Redshift Connector	high	middle	Source
46	Amazon Redshift Connector	middle	middle	Sink
47	Google Firebase Realtime Database	high	low	Source	lianzhanbiao
48	Google Firebase Realtime Database	middle	low	Sink	lianzhanbiao
49	Amazon Kinesis	middle	middle	Sink
50	Azure Event Hubs Source	middle	middle	Source
51	Greenplum	high	high	Source	ShockleysxX
52	Greenplum	high	high	Sink	ShockleysxX
53	SQData CDC	high	high	Source
54	Github	low	low	Source	my-vegetable-has-exploded
55	Enterprise WeChat	low	low	Sink	makersy
56	Databricks Lakehouse	high	high	Sink
58	Teradata	middle	middle	Source
59	Teradata	middle	middle	Sink
60	Vertica	middle	middle	Sink
61	Couchbase	middle	middle	Sink
62	Couchbase	middle	middle	Source
63	IBM MQ	middle	middle	Source
64	Aws lambda	middle	middle	Sink
65	Apache Paimon	high	middle	Sink	ShockleysxX
66	Apache Paimon	high	middle	Source	yiduwangkai
67	Object Storage Connector（hdfs, oss, s3, obs, gcs）	high	high	Source
68	Object Storage Connector（hdfs, oss, s3, obs, gcs）	high	high	Sink

joeCarf · 2023-04-04T09:26:45Z

I'd like to do Tidb & clickhouse

liuxiaocs7 · 2023-04-25T11:32:01Z

Hi, @odbozhou, I am a newcomer, could you assign the email sink to me first, i want to try it!

odbozhou · 2023-04-25T11:37:06Z

Hi, @odbozhou, I am a newcomer, could you assign the email sink to me first, i want to try it!

okay, welcome

totalo · 2023-04-27T09:06:46Z

@odbozhou hi , I'd like to do redis & mongodb

yiduwangkai · 2023-04-27T09:42:18Z

I'd like to do oss and Paimon

ShockleysxX · 2023-04-27T10:03:14Z

Hi, @odbozhou, i am also interested in Apache Paimon, could assign Paimon Source and Sink to me.

makersy · 2023-04-27T10:28:00Z

@odbozhou Hi, I'd like to do Enterprise WeChat. Thank you.

Duansg · 2023-04-27T10:56:40Z

@odbozhou Hi，i am also interested in Amazon S3 Connector, could assign S3 Source and Sink to me.

odbozhou · 2023-04-27T11:42:29Z

@odbozhou hi , I'd like to do redis & mongodb

assigned @totalo

Chovyyyyyy · 2023-04-27T11:46:49Z

@odbozhou hi , I'd like to do Iceberg

odbozhou · 2023-04-27T11:52:31Z

@odbozhou hi , I'd like to do Iceberg

Iceberg has been selected as the topic of Open Source Summer, are you a student? Sign up to participate through Open Source Summer. If you can't participate in Open Source Summer, can you see if there are other interested? terribly sorry.

odbozhou · 2023-04-27T11:54:17Z

@odbozhou Hi，i am also interested in Amazon S3 Connector, could assign S3 Source and Sink to me.

assigned @DuansgXD

odbozhou · 2023-04-27T11:56:08Z

@odbozhou Hi, I'd like to do Enterprise WeChat. Thank you.

assigned @makersy

odbozhou · 2023-04-27T12:02:29Z

I'd like to do oss and Paimon
@yiduwangkai
oss is assigned to you. Paimon, you and ShockleysxX have signed up, you can discuss who will complete the source/sink?

odbozhou · 2023-04-27T12:03:58Z

@ShockleysxX
Paimon, you and yiduwangkai have signed up, you can discuss who will complete the source/sink?

Chovyyyyyy · 2023-04-27T12:05:09Z

@odbozhou how about HDFS sink? I'd like to do this

@Chovyyyyyy Your participation is very welcome，assigned to you，thank you for your understanding

liuzongliang0202 · 2023-04-27T12:45:46Z

@odbozhou I'd like to do Neo4j, Thank you.

TyrantLucifer · 2023-04-27T12:51:09Z

@odbozhou I'd like to do hive & hdfs source, Thank you!

my-vegetable-has-exploded · 2023-04-27T13:11:41Z

I'd like to do Cassandra, Thank you.

ShockleysxX · 2023-04-27T13:26:23Z

I'd like to do oss and Paimon
@yiduwangkai
oss is assigned to you. Paimon, you and ShockleysxX have signed up, you can discuss who will complete the source/sink?

Hi, @yiduwangkai, Can i take Paimon sink? Thanks!

@odbozhou, I'd like to do Greenplum at the same time, Thanks!

yiduwangkai · 2023-04-27T15:53:55Z

I'd like to do oss and Paimon
@yiduwangkai
oss is assigned to you. Paimon, you and ShockleysxX have signed up, you can discuss who will complete the source/sink?

Hi, @yiduwangkai, Can i take Paimon sink? Thanks!

@odbozhou, I'd like to do Greenplum at the same time, Thanks!

ok

liuxiaocs7 · 2023-04-27T18:41:51Z

Hi, @odbozhou, i also want to try Aliyun Tablestore Source and Sink, thanks!

odbozhou · 2023-04-28T01:40:14Z

@odbozhou I'd like to do Neo4j, Thank you.

assigned @liuzongliang0202

odbozhou · 2023-04-28T02:00:50Z

@odbozhou I'd like to do hive & hdfs source, Thank you!

assigned @TyrantLucifer

odbozhou · 2023-04-28T02:01:18Z

my-vegetable-has-exploded

assigned @my-vegetable-has-exploded

odbozhou · 2023-04-28T02:03:43Z

@ShockleysxX
Greenplum is assigned to you, looking forward to your contribution

odbozhou · 2023-04-28T02:04:19Z

Hi, @odbozhou, i also want to try Aliyun Tablestore Source and Sink, thanks!

assigned @liuxiaocs7

mgljava · 2023-04-28T02:20:10Z

Hi,@odbozhou,i also wang to try ADB MySQL Source and Sink. But this is my first time developing Connector, I hope to give a chance. thanks!

odbozhou · 2023-04-28T02:27:48Z

Hi,@odbozhou,i also wang to try ADB MySQL Source and Sink. But this is my first time developing Connector, I hope to give a chance. thanks!

@mgljava
assigned, the open source community welcomes the participation of every developer and looks forward to your contribution

daimingbao · 2023-04-28T04:48:56Z

I want to Druid Sink and sink ，thinks

odbozhou · 2023-04-28T05:48:38Z

I want to Druid Sink and sink ，thinks

assigned @daimingbao

sunxiaojian · 2023-04-28T18:24:55Z

HI @odbozhou Object storage (hdfs, oss, s3, obs, gcs) can be abstracted uniformly like jdbc connectors

TyrantLucifer · 2023-04-29T14:00:52Z

I can do this work. Could you please assign it to me?

sunxiaojian · 2023-04-30T14:52:25Z

ok, you can provide a general API for file processing, and the file source needs to provide an incremental API

my-vegetable-has-exploded · 2023-05-01T08:00:38Z

my-vegetable-has-exploded

assigned @my-vegetable-has-exploded

I found cassandra sourceConnector already adapt to openmessaging-connector api 0.1.4 issue 317 . So can you tell me what I need to do in this task? @odbozhou

Hello-gzk-World · 2023-05-05T03:38:06Z

@odbozhou, Hi！ I'm interested in ADB PostgreSQL, could assign ADB PostgreSQL Source and Sink to me.

makersy · 2023-05-05T15:03:55Z

@odbozhou Hi, I'd like to do Enterprise WeChat. Thank you.

assigned @makersy

@odbozhou I have some questions about the way that messages are consumed in Enterprise WeChat sink task. Is that sending to a specific Enterprice Wechat group?

odbozhou · 2023-05-08T02:22:11Z

I can do this work. Could you please assign it to me?

@TyrantLucifer
Are you willing to complete a unified connector for Object storage (hdfs, oss, s3, obs, gcs) ？

odbozhou · 2023-05-08T02:25:38Z

@my-vegetable-has-exploded
I'm very sorry, I made a mistake in my work, I put a completed connector in the list, can you choose another one?

odbozhou · 2023-05-08T02:29:44Z

@makersy
Yes, this can achieve some event notifications, such as common alarm notifications

Hello-gzk-World · 2023-05-08T02:52:04Z

@odbozhou, Hi！ I'm interested in ADB PostgreSQL, could assign ADB PostgreSQL Source and Sink to me.

@odbozhou By the way, I am going to participate in OSPP2023, and I have sent an email to your apache mailbox, looking forward to your reply

joeCarf · 2023-05-08T03:52:35Z

Hi, @odbozhou .I have finished clickhouse source & sink. And I'd like to do snowflake source&sink as well :) please assign snowflake to me.

my-vegetable-has-exploded · 2023-05-08T05:16:41Z

@my-vegetable-has-exploded I'm very sorry, I made a mistake in my work, I put a completed connector in the list, can you choose another one?

@odbozhou I'd like to try github connector firstly.

odbozhou · 2023-05-09T01:42:18Z

@my-vegetable-has-exploded
assigned

odbozhou · 2023-05-09T01:42:33Z

Hi, @odbozhou .I have finished clickhouse source & sink. And I'd like to do snowflake source&sink as well :) please assign snowflake to me.
@joeCarf
assigned

lianzhanbiao · 2023-05-10T03:24:19Z

Hi, @odbozhou . I'd like to try Google Firebase Realtime Database. Could you please assign it to me?

odbozhou · 2023-05-10T05:49:25Z

Hi, @odbozhou . I'd like to try Google Firebase Realtime Database. Could you please assign it to me?
@lianzhanbiao
assigned

ferrirW · 2023-05-11T09:44:39Z

hi @odbozhou. I'd like to try Hologres. Could you please assign it to me?

BTW, Hologres has two source in the table.

odbozhou · 2023-05-12T03:37:26Z

@ferrirW

Fixed and assigned

Ziy1-Tan · 2023-06-18T15:00:32Z

Hey , @odbozhou! I want to try Druid. Assign me plz:)

odbozhou pinned this issue Mar 29, 2023

odbozhou mentioned this issue Apr 11, 2023

Open source contribution｜RocketMQ Connector construction is waiting for your participation #474

Open

totalo mentioned this issue May 8, 2023

[ISSUE #446]support redis sink #498

Closed

6 tasks

Ziy1-Tan mentioned this issue Jun 27, 2023

[ISSUE #446] Support oss sink connector #519

Closed

6 tasks

New Connector List #446

New Connector List #446

Comments

odbozhou commented Mar 29, 2023 • edited Loading

joeCarf commented Apr 4, 2023

liuxiaocs7 commented Apr 25, 2023

odbozhou commented Apr 25, 2023

totalo commented Apr 27, 2023

yiduwangkai commented Apr 27, 2023

ShockleysxX commented Apr 27, 2023

makersy commented Apr 27, 2023

Duansg commented Apr 27, 2023

odbozhou commented Apr 27, 2023 • edited Loading

Chovyyyyyy commented Apr 27, 2023

odbozhou commented Apr 27, 2023

odbozhou commented Apr 27, 2023

odbozhou commented Apr 27, 2023

odbozhou commented Apr 27, 2023 • edited Loading

odbozhou commented Apr 27, 2023 • edited Loading

Chovyyyyyy commented Apr 27, 2023 • edited by odbozhou Loading

liuzongliang0202 commented Apr 27, 2023

TyrantLucifer commented Apr 27, 2023

my-vegetable-has-exploded commented Apr 27, 2023

ShockleysxX commented Apr 27, 2023 • edited Loading

yiduwangkai commented Apr 27, 2023

liuxiaocs7 commented Apr 27, 2023

odbozhou commented Apr 28, 2023

odbozhou commented Apr 28, 2023

odbozhou commented Apr 28, 2023

odbozhou commented Apr 28, 2023

odbozhou commented Apr 28, 2023

mgljava commented Apr 28, 2023

odbozhou commented Apr 28, 2023

daimingbao commented Apr 28, 2023

odbozhou commented Apr 28, 2023

sunxiaojian commented Apr 28, 2023

TyrantLucifer commented Apr 29, 2023

sunxiaojian commented Apr 30, 2023

my-vegetable-has-exploded commented May 1, 2023 • edited Loading

Hello-gzk-World commented May 5, 2023

makersy commented May 5, 2023

odbozhou commented May 8, 2023

odbozhou commented May 8, 2023

odbozhou commented May 8, 2023

Hello-gzk-World commented May 8, 2023

joeCarf commented May 8, 2023

my-vegetable-has-exploded commented May 8, 2023

odbozhou commented May 9, 2023

odbozhou commented May 9, 2023 • edited Loading

lianzhanbiao commented May 10, 2023

odbozhou commented May 10, 2023

ferrirW commented May 11, 2023

odbozhou commented May 12, 2023

Ziy1-Tan commented Jun 18, 2023

odbozhou commented Mar 29, 2023 •

edited

Loading

odbozhou commented Apr 27, 2023 •

edited

Loading

odbozhou commented Apr 27, 2023 •

edited

Loading

odbozhou commented Apr 27, 2023 •

edited

Loading

Chovyyyyyy commented Apr 27, 2023 •

edited by odbozhou

Loading

ShockleysxX commented Apr 27, 2023 •

edited

Loading

my-vegetable-has-exploded commented May 1, 2023 •

edited

Loading

odbozhou commented May 9, 2023 •

edited

Loading