forked from apache/seatunnel
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[Doc][Improve]Add Support Chinese for start-v2/locally/quick-start-se…
…atunnel-engine.md and start-v2/locally/deployment.md
- Loading branch information
dzy
committed
Feb 28, 2024
1 parent
3e9e2b8
commit 65a971f
Showing
2 changed files
with
178 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,82 @@ | ||
--- | ||
|
||
sidebar_position: 1 | ||
------------------- | ||
|
||
import Tabs from '@theme/Tabs'; | ||
import TabItem from '@theme/TabItem'; | ||
|
||
# 本地部署 | ||
|
||
## 步骤 1: 准备工作 | ||
|
||
在开始本地运行前,您需要确保您已经安装了SeaTunnel所需要的以下软件: | ||
|
||
* 安装[Java](https://www.java.com/en/download/) (Java 8 或 11, 其他高于Java 8的版本理论上也可以工作) 以及设置 `JAVA_HOME`。 | ||
|
||
## 步骤 2: 下载 SeaTunnel | ||
|
||
进入[seatunnel下载页面](https://seatunnel.apache.org/download)下载最新版本的发布版安装包`seatunnel-<version>-bin.tar.gz` | ||
|
||
或者您也可以通过终端下载 | ||
|
||
```shell | ||
export version="2.3.5" | ||
wget "https://archive.apache.org/dist/seatunnel/${version}/apache-seatunnel-${version}-bin.tar.gz" | ||
tar -xzvf "apache-seatunnel-${version}-bin.tar.gz" | ||
``` | ||
|
||
|
||
## 步骤 3: 安装连接器插件 | ||
|
||
从2.2.0-beta版本开始,二进制包不再默认提供连接器依赖,因此在第一次使用它时,您需要执行以下命令来安装连接器:(当然,您也可以从 [Apache Maven Repository](https://repo.maven.apache.org/maven2/org/apache/seatunnel/) 手动下载连接器,然后将其移动至`connectors/seatunnel`目录下)。 | ||
|
||
```bash | ||
sh bin/install-plugin.sh 2.3.5 | ||
``` | ||
|
||
如果您需要指定的连接器版本,以2.3.5为例,您需要执行如下命令 | ||
|
||
```bash | ||
sh bin/install-plugin.sh 2.3.5 | ||
``` | ||
|
||
通常您并不需要所有的连接器插件,所以您可以通过配置`config/plugin_config`来指定您所需要的插件,例如,您只需要`connector-console`插件,那么您可以修改plugin.properties配置文件如下 | ||
|
||
```plugin_config | ||
--seatunnel-connectors-- | ||
connector-console | ||
--end-- | ||
``` | ||
|
||
如果您希望示例应用程序能正常工作,那么您需要添加以下插件 | ||
|
||
```plugin_config | ||
--seatunnel-connectors-- | ||
connector-fake | ||
connector-console | ||
--end-- | ||
``` | ||
|
||
您可以在`${SEATUNNEL_HOME}/connectors/plugins-mapping.properties`下找到所有支持的连接器和相应的plugin_config配置名称。 | ||
|
||
:::提示 | ||
|
||
如果您想通过手动下载连接器的方式来安装连接器插件,则需要特别注意以下事项 | ||
|
||
连接器目录包含以下子目录,如果他们不存在,则需要手动创建它们 | ||
|
||
``` | ||
flink | ||
flink-sql | ||
seatunnel | ||
spark | ||
``` | ||
|
||
如果您想手动安装V2连接器插件,您只需要下载您所需要的连接器插件即可,并将它们放在seatunnel目录下 | ||
|
||
::: | ||
|
||
## 此外 | ||
|
||
现在,您已经完成了SeaTunnel部署。您可以按照[快速开始](quick-start-seatunnel-engine.md)来配置并运行数据同步作业了。 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,96 @@ | ||
--- | ||
|
||
sidebar_position: 2 | ||
------------------- | ||
|
||
# SeaTunnel Engine快速开始 | ||
|
||
## 步骤 1: 部署SeaTunnel及连接器 | ||
|
||
在开始前,请确保您已经按照[本地部署](deployment.md)中的描述下载并部署了SeaTunnel | ||
|
||
## 步骤 2: 添加作业配置文件来定义作业 | ||
|
||
编辑`config/v2.batch.config.template`,它决定了当seatunnel启动后数据输入、处理和输出的方式及逻辑。 | ||
下面是配置文件的示例,它与上面提到的示例应用程序相同。 | ||
|
||
```hocon | ||
env { | ||
parallelism = 1 | ||
job.mode = "BATCH" | ||
} | ||
source { | ||
FakeSource { | ||
result_table_name = "fake" | ||
row.num = 16 | ||
schema = { | ||
fields { | ||
name = "string" | ||
age = "int" | ||
} | ||
} | ||
} | ||
} | ||
transform { | ||
FieldMapper { | ||
source_table_name = "fake" | ||
result_table_name = "fake1" | ||
field_mapper = { | ||
age = age | ||
name = new_name | ||
} | ||
} | ||
} | ||
sink { | ||
Console { | ||
source_table_name = "fake1" | ||
} | ||
} | ||
``` | ||
|
||
关于配置的更多信息请查看[配置概念](../../concept/config.md) | ||
|
||
## 步骤 3: 运行SeaTunnel应用程序 | ||
|
||
您可以通过以下命令启动应用程序 | ||
|
||
```shell | ||
cd "apache-seatunnel-${version}" | ||
./bin/seatunnel.sh --config ./config/v2.batch.config.template -e local | ||
``` | ||
|
||
**查看输出**: 当您运行该命令时,您可以在控制台中看到它的输出。您可以认为这是命令运行成功或失败的标志。 | ||
|
||
SeaTunnel控制台将会打印一些如下日志信息: | ||
|
||
```shell | ||
2022-12-19 11:01:45,417 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - output rowType: name<STRING>, age<INT> | ||
2022-12-19 11:01:46,489 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - subtaskIndex=0 rowIndex=1: SeaTunnelRow#tableId=-1 SeaTunnelRow#kind=INSERT: CpiOd, 8520946 | ||
2022-12-19 11:01:46,490 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - subtaskIndex=0 rowIndex=2: SeaTunnelRow#tableId=-1 SeaTunnelRow#kind=INSERT: eQqTs, 1256802974 | ||
2022-12-19 11:01:46,490 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - subtaskIndex=0 rowIndex=3: SeaTunnelRow#tableId=-1 SeaTunnelRow#kind=INSERT: UsRgO, 2053193072 | ||
2022-12-19 11:01:46,490 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - subtaskIndex=0 rowIndex=4: SeaTunnelRow#tableId=-1 SeaTunnelRow#kind=INSERT: jDQJj, 1993016602 | ||
2022-12-19 11:01:46,490 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - subtaskIndex=0 rowIndex=5: SeaTunnelRow#tableId=-1 SeaTunnelRow#kind=INSERT: rqdKp, 1392682764 | ||
2022-12-19 11:01:46,490 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - subtaskIndex=0 rowIndex=6: SeaTunnelRow#tableId=-1 SeaTunnelRow#kind=INSERT: wCoWN, 986999925 | ||
2022-12-19 11:01:46,490 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - subtaskIndex=0 rowIndex=7: SeaTunnelRow#tableId=-1 SeaTunnelRow#kind=INSERT: qomTU, 72775247 | ||
2022-12-19 11:01:46,490 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - subtaskIndex=0 rowIndex=8: SeaTunnelRow#tableId=-1 SeaTunnelRow#kind=INSERT: jcqXR, 1074529204 | ||
2022-12-19 11:01:46,490 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - subtaskIndex=0 rowIndex=9: SeaTunnelRow#tableId=-1 SeaTunnelRow#kind=INSERT: AkWIO, 1961723427 | ||
2022-12-19 11:01:46,490 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - subtaskIndex=0 rowIndex=10: SeaTunnelRow#tableId=-1 SeaTunnelRow#kind=INSERT: hBoib, 929089763 | ||
2022-12-19 11:01:46,490 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - subtaskIndex=0 rowIndex=11: SeaTunnelRow#tableId=-1 SeaTunnelRow#kind=INSERT: GSvzm, 827085798 | ||
2022-12-19 11:01:46,491 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - subtaskIndex=0 rowIndex=12: SeaTunnelRow#tableId=-1 SeaTunnelRow#kind=INSERT: NNAYI, 94307133 | ||
2022-12-19 11:01:46,491 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - subtaskIndex=0 rowIndex=13: SeaTunnelRow#tableId=-1 SeaTunnelRow#kind=INSERT: EexFl, 1823689599 | ||
2022-12-19 11:01:46,491 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - subtaskIndex=0 rowIndex=14: SeaTunnelRow#tableId=-1 SeaTunnelRow#kind=INSERT: CBXUb, 869582787 | ||
2022-12-19 11:01:46,491 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - subtaskIndex=0 rowIndex=15: SeaTunnelRow#tableId=-1 SeaTunnelRow#kind=INSERT: Wbxtm, 1469371353 | ||
2022-12-19 11:01:46,491 INFO org.apache.seatunnel.connectors.seatunnel.console.sink.ConsoleSinkWriter - subtaskIndex=0 rowIndex=16: SeaTunnelRow#tableId=-1 SeaTunnelRow#kind=INSERT: mIJDt, 995616438 | ||
``` | ||
|
||
## 此外 | ||
|
||
现在,您已经快速浏览了SeaTunnel,你可以通过[连接器](../../connector-v2/source/FakeSource.md)来找到SeaTunnel所支持的所有source和sink。 | ||
如果您想要了解更多关于信息,请参阅[SeaTunnel Engine](../../seatunnel-engine/about.md). | ||
|
||
SeaTunnel还支持在Spark/Flink中运行作业。您可以查看[Spark快速开始](quick-start-spark.md)或[Flink快速开始](quick-start-flink.md)。 |