添加新的FE节点时报错：catch an exception when setup bdb environment.

[WesZhang100]

1. 已经清空doris-meta文件夹。
2. 加了--helper参数。

[hf200012]

Please give details：

1. Doris version
2. Your operation steps can reproduce the case
3. Your FE exception information

[WesZhang100]

1. Doris version 0.15
2. Your operation steps can reproduce the case -- 3节点 FE --> 单节点FE --> 再次添加相同节点FE进Cluster时报错。
3. Your FE exception information
   fe.log
   2022-01-21 12:08:21,151 INFO (main|1) [PaloFe.start():111] Palo FE starting...
   2022-01-21 12:08:21,163 INFO (main|1) [FrontendOptions.init():88] local address: /10.19.250.161.
   2022-01-21 12:08:21,309 INFO (main|1) [ConsistencyChecker.initWorkTime():107] consistency checker will work from 23:00 to 4:00
   2022-01-21 12:08:21,595 INFO (main|1) [PrivTable.addEntry():63] add priv entry: global priv. host: %, user: root, priv: , set by resolver: false, domain user ident: null
   2022-01-21 12:08:21,596 INFO (main|1) [PaloAuth.setPasswordInternal():1024] finished to set password for 'root'@'%'. is replay: true
   2022-01-21 12:08:21,597 INFO (main|1) [PaloAuth.grantInternal():736] finished to grant privilege. is replay: true
   2022-01-21 12:08:21,597 INFO (main|1) [PaloAuth.grantInternal():766] finished to grant resource privilege. is replay: true
   2022-01-21 12:08:21,597 INFO (main|1) [PaloAuth.grantInternal():736] finished to grant privilege. is replay: true
   2022-01-21 12:08:21,597 INFO (main|1) [PaloAuth.grantInternal():766] finished to grant resource privilege. is replay: true
   2022-01-21 12:08:21,607 INFO (main|1) [PaloAuth.createUserInternal():610] finished to create user: 'root'@'%', is replay: true
   2022-01-21 12:08:21,607 INFO (main|1) [PrivTable.addEntry():63] add priv entry: global priv. host: %, user: admin, priv: , set by resolver: false, domain user ident: null
   2022-01-21 12:08:21,607 INFO (main|1) [PaloAuth.setPasswordInternal():1024] finished to set password for 'admin'@'%'. is replay: true
   2022-01-21 12:08:21,608 INFO (main|1) [PaloAuth.grantInternal():736] finished to grant privilege. is replay: true
   2022-01-21 12:08:21,608 INFO (main|1) [PaloAuth.grantInternal():766] finished to grant resource privilege. is replay: true
   2022-01-21 12:08:21,608 INFO (main|1) [PaloAuth.createUserInternal():610] finished to create user: 'admin'@'%', is replay: true
   2022-01-21 12:08:21,858 INFO (main|1) [Catalog.getHelperNodes():1163] get helper nodes: [10.16.50.46:9010]
   2022-01-21 12:08:21,895 INFO (main|1) [Catalog.getClusterIdAndRole():850] find ROLE and VERSION file in local, ignore helper nodes: [10.16.50.46:9010]
   2022-01-21 12:08:21,858 INFO (main|1) [Catalog.getHelperNodes():1163] get helper nodes: [10.16.50.46:9010]
   2022-01-21 12:08:21,895 INFO (main|1) [Catalog.getClusterIdAndRole():850] find ROLE and VERSION file in local, ignore helper nodes: [10.16.50.46:9010]
   2022-01-21 12:08:21,898 INFO (main|1) [Catalog.getClusterIdAndRole():1036] finished to get cluster id: 552469523, role: FOLLOWER and node name: 10.19.250.161_9010_1642735457199
   2022-01-21 12:08:21,919 INFO (main|1) [MetaReader.read():70] start load image from /Data/fe/doris-meta/image/image.22069763. is ckpt: false
   2022-01-21 12:08:22,188 INFO (main|1) [MetaHeader.read():72] Image header length: 21, format: COR1.
   2022-01-21 12:08:22,195 INFO (main|1) [Catalog.loadHeaderCOR1():1648] finished replay header from image
   2022-01-21 12:08:22,195 INFO (main|1) [Catalog.loadMasterInfo():1659] finished replay masterInfo from image
   2022-01-21 12:08:22,580 INFO (main|1) [Catalog.loadDb():1702] finished replay databases from image
   2022-01-21 12:08:22,652 INFO (main|1) [Catalog.loadLoadJob():1753] finished replay loadJob from image
   2022-01-21 12:08:22,653 INFO (main|1) [Catalog.loadAlterJob():1795] finished replay alterJob from image
   2022-01-21 12:08:22,663 INFO (main|1) [Catalog.loadRecycleBin():1927] finished replay recycleBin from image
   2022-01-21 12:08:22,653 INFO (main|1) [Catalog.loadAlterJob():1795] finished replay alterJob from image
   2022-01-21 12:08:22,663 INFO (main|1) [Catalog.loadRecycleBin():1927] finished replay recycleBin from image
   2022-01-21 12:08:22,688 INFO (main|1) [Catalog.loadGlobalVariable():1936] finished replay globalVariable from image
   2022-01-21 12:08:22,693 INFO (main|1) [Catalog.loadCluster():6472] finished replay cluster from image
   2022-01-21 12:08:22,694 INFO (main|1) [Catalog.loadBrokers():6569] finished replay brokerMgr from image
   2022-01-21 12:08:22,697 INFO (main|1) [Catalog.loadResources():1968] finished replay resources from image
   2022-01-21 12:08:22,697 INFO (main|1) [Catalog.loadExportJob():1772] finished replay exportJob from image
   2022-01-21 12:08:22,697 INFO (main|1) [Catalog.loadSyncJobs():1780] finished replay syncJobMgr from image
   2022-01-21 12:08:22,697 INFO (main|1) [Catalog.loadBackupHandler():1882] finished replay backupHandler from image
   2022-01-21 12:08:22,701 INFO (main|1) [Catalog.loadPaloAuth():1899] finished replay paloAuth from image
   2022-01-21 12:08:22,745 INFO (main|1) [Catalog.loadTransactionState():1908] finished replay transactionState from image
   2022-01-21 12:08:22,701 INFO (main|1) [Catalog.loadPaloAuth():1899] finished replay paloAuth from image
   2022-01-21 12:08:22,745 INFO (main|1) [Catalog.loadTransactionState():1908] finished replay transactionState from image
   2022-01-21 12:08:22,750 INFO (main|1) [Catalog.loadColocateTableIndex():1944] finished replay colocateTableIndex from image
   2022-01-21 12:08:22,750 INFO (main|1) [Catalog.loadRoutineLoadJobs():1952] finished replay routineLoadJobs from image
   2022-01-21 12:08:23,167 INFO (main|1) [Catalog.loadLoadJobsV2():1960] finished replay loadJobsV2 from image
   2022-01-21 12:08:23,167 INFO (main|1) [Catalog.loadSmallFiles():1976] finished replay smallFiles from image
   2022-01-21 12:08:23,191 INFO (main|1) [Catalog.loadPlugins():7017] finished replay plugins from image
   2022-01-21 12:08:23,452 INFO (main|1) [Catalog.loadDeleteHandler():1890] finished replay deleteHandler from image
   2022-01-21 12:08:23,458 INFO (main|1) [Catalog.loadSqlBlockRule():1984] finished replay sqlBlockRule from image
   2022-01-21 12:08:23,460 INFO (main|1) [MetaFooter.read():84] Image footer length: 533, indices: [header:29, masterInfo:50, frontends:74, backends:698, db:2884, loadJob:4698259, alterJob:4698284, recycleBin:4698320, globalVariable:4935548, cluster:4937715, broker:4937905, resources:4937909, exportJob:4938340, syncJob:4938344, backupHandler:4938348, paloAuth:4938356, transactionState:4939215, colocateTableIndex:5195498, routineLoadJobs:5196133, loadJobV2:5196137, smallFiles:13708360, plugins:13708364, deleteHandler:13708821, sqlBlockRule:13708852]
   2022-01-21 12:08:23,461 INFO (main|1) [MetaReader.read():113] finished to load image in 1542 ms
   2022-01-21 12:08:24,173 ERROR (MASTER 172.19.250.161_9010_1642735457199(-1)|1) [BDBJEJournal.open():305] catch an exception when setup bdb environment. will exit.
   com.sleepycat.je.DatabaseNotFoundException: (JE 7.3.7) _jeRepGroupDB
   at com.sleepycat.je.rep.impl.RepImpl.openGroupDb(RepImpl.java:1933) ~[je-7.3.7.jar:7.3.7]
   at com.sleepycat.je.rep.impl.RepImpl.getGroupDb(RepImpl.java:1871) ~[je-7.3.7.jar:7.3.7]
   at com.sleepycat.je.rep.impl.RepGroupDB.reinitFirstNode(RepGroupDB.java:1433) ~[je-7.3.7.jar:7.3.7]
   at com.sleepycat.je.rep.impl.node.RepNode.reinitSelfElect(RepNode.java:1734) ~[je-7.3.7.jar:7.3.7]
   at com.sleepycat.je.rep.impl.node.RepNode.startup(RepNode.java:895) ~[je-7.3.7.jar:7.3.7]
   at com.sleepycat.je.rep.impl.node.RepNode.joinGroup(RepNode.java:2157) ~[je-7.3.7.jar:7.3.7]
   at com.sleepycat.je.rep.impl.RepImpl.joinGroup(RepImpl.java:610) ~[je-7.3.7.jar:7.3.7]
   at com.sleepycat.je.rep.ReplicatedEnvironment.joinGroup(ReplicatedEnvironment.java:560) ~[je-7.3.7.jar:7.3.7]
   at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:621) ~[je-7.3.7.jar:7.3.7]
   at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:466) ~[je-7.3.7.jar:7.3.7]
   at com.sleepycat.je.rep.ReplicatedEnvironment.(ReplicatedEnvironment.java:540) ~[je-7.3.7.jar:7.3.7]
   at com.sleepycat.je.rep.util.DbResetRepGroup.reset(DbResetRepGroup.java:262) ~[je-7.3.7.jar:7.3.7]
   at org.apache.doris.journal.bdbje.BDBEnvironment.setup(BDBEnvironment.java:98) ~[palo-fe.jar:3.4.0]
   at org.apache.doris.journal.bdbje.BDBJEJournal.open(BDBJEJournal.java:302) [palo-fe.jar:3.4.0]
   at org.apache.doris.persist.EditLog.open(EditLog.java:909) [palo-fe.jar:3.4.0]
   at org.apache.doris.catalog.Catalog.initialize(Catalog.java:809) [palo-fe.jar:3.4.0]
   at org.apache.doris.PaloFe.start(PaloFe.java:125) [palo-fe.jar:3.4.0]
   at org.apache.doris.PaloFe.main(PaloFe.java:63) [palo-fe.jar:3.4.0]

fe.out

%d{yyyy-MM-dd HH:mm:ss,SSS} %p (%t|%tid) [%C{1}.%M():%L] %m%n %d{yyyy-MM-dd HH:mm:ss,SSS} %p (%t|%tid) [%C{1}.%M():%L] %m%n %d{yyyy-MM-dd HH:mm:ss,SSS} [%c{1}] %m%n ===== ============================== SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/doris/palo/fe/lib/slf4j-log4j12-1.7.28.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/doris/palo/fe/lib/log4j-slf4j-impl-2.14.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Found binding in [jar:file:/doris/palo/fe/lib/log4j-slf4j-impl-2.14.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] ~

[hf200012]

你的master是不是metadata_failure_recovery=true是打开的