Questions about Kyuubi Spark AuthZ Plugin #4063

zhichaoleo · 2023-01-03T08:07:21Z

zhichaoleo
Jan 3, 2023

Hi Team,

Thanks for your great work! ☺️
We want to use Kyuubi Spark AuthZ Plugin in our spark cluster(version: 3.3.1).
We build this plugin with Spark version: 3.3.1, Ranger version: 2.2.0
The spark config listed below:
spark.master=local[*, 4]; spark.databricks.cluster.profile=singleNode; spark.sql.extensions=org.apache.kyuubi.plugin.spark.authz.ranger.RangerSparkExtension

And it works fine with select SQL, but when we test other sql types we got errors as below:

SHOW DATABASES; SQL error as below:

com.databricks.backend.common.rpc.SparkDriverExceptions$SQLExecutionException: java.lang.UnsupportedOperationException
	at org.apache.spark.sql.catalyst.plans.logical.LeafNode.computeStats(LogicalPlan.scala:183)
	at org.apache.spark.sql.catalyst.plans.logical.LeafNode.computeStats$(LogicalPlan.scala:183)
	at org.apache.kyuubi.plugin.spark.authz.util.ObjectFilterPlaceHolder.computeStats(ObjectFilterPlaceHolder.scala:23)
	at org.apache.spark.sql.catalyst.plans.QueryPlanStats.$anonfun$stats$1(QueryPlanStats.scala:39)
	at scala.Option.getOrElse(Option.scala:189)
	at org.apache.spark.sql.catalyst.plans.QueryPlanStats.stats(QueryPlanStats.scala:38)
	at org.apache.spark.sql.catalyst.plans.QueryPlanStats.stats$(QueryPlanStats.scala:38)
	at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.stats(LogicalPlan.scala:31)

UPDATE SQL error as below:

com.databricks.backend.common.rpc.SparkDriverExceptions$SQLExecutionException: com.databricks.sql.transaction.tahoe.DeltaAnalysisException: UPDATE destination only supports Delta sources.
Some(Project [o_orderkey#1700L, o_custkey#1701L, o_orderstatus#1702, o_totalprice#1703, o_orderdate#1704, o_orderpriority#1705, o_clerk#1706, o_shippriority#1707, o_comment#1708]
+- RowFilterAndDataMaskingMarker
   +- Relation spark_catalog.tpch.orders[o_orderkey#1700L,o_custkey#1701L,o_orderstatus#1702,o_totalprice#1703,o_orderdate#1704,o_orderpriority#1705,o_clerk#1706,o_shippriority#1707,o_comment#1708] parquet
)
	at com.databricks.sql.transaction.tahoe.DeltaErrorsBase.notADeltaSourceException(DeltaErrors.scala:543)
	at com.databricks.sql.transaction.tahoe.DeltaErrorsBase.notADeltaSourceException$(DeltaErrors.scala:541)
	at com.databricks.sql.transaction.tahoe.DeltaErrors$.notADeltaSourceException(DeltaErrors.scala:2532)
	at com.databricks.sql.transaction.tahoe.PreprocessTableUpdate.toCommand(PreprocessTableUpdate.scala:59)
	at com.databricks.sql.transaction.tahoe.PreprocessTableUpdateEdge$$anonfun$apply0$1.applyOrElse(PreprocessTableUpdateEdge.scala:70)
	at com.databricks.sql.transaction.tahoe.PreprocessTableUpdateEdge$$anonfun$apply0$1.applyOrElse(PreprocessTableUpdateEdge.scala:46)
	at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.$anonfun$resolveOperatorsDownWithPruning$2(AnalysisHelper.scala:171)

DELETE SQL error as below:

com.databricks.backend.common.rpc.SparkDriverExceptions$SQLExecutionException: org.apache.spark.sql.AnalysisException: [UNSUPPORTED_FEATURE.TABLE_OPERATION] The feature is not supported: Table `spark_catalog`.`tpch`.`orders` does not support DELETE. Please check the current catalog and namespace to make sure the qualified table name is expected, and also check the catalog implementation which is configured by "spark.sql.catalog".
	at org.apache.spark.sql.errors.QueryCompilationErrors$.operationOnlySupportedWithV2TableError(QueryCompilationErrors.scala:742)
	at org.apache.spark.sql.execution.datasources.v2.DataSourceV2Strategy.apply(DataSourceV2Strategy.scala:328)
	at org.apache.spark.sql.catalyst.planning.QueryPlanner.$anonfun$plan$2(QueryPlanner.scala:69)
	at com.databricks.spark.util.FrameProfiler$.record(FrameProfiler.scala:80)
	at org.apache.spark.sql.catalyst.planning.QueryPlanner.$anonfun$plan$1(QueryPlanner.scala:69)

Could you help me with this problem? And I also want to check if Kyuubi Spark AuthZ Plugin can work with SQL types above?

Thanks,
Alex

pan3793 · 2023-01-03T17:15:43Z

pan3793
Jan 3, 2023
Collaborator

The first error caused by "SHOW DATABASES;" seems because the ObjectFilterPlaceHolder does not implement def computeStats(): Statistics, I tried w/ open-sourced spark 3.3(enable/disable cbo), but can not reproduce it, could you please provide more stack trace?

The second one seems tightly coupled w/ the Databricks(not the open-sourced one) Delta lake.

0 replies

zhichaoleo · 2023-01-04T01:58:22Z

zhichaoleo
Jan 4, 2023
Author

Hi @pan3793 ,
Thanks for your help.
For the SHOW DATABASES; error log, please refer to the logs below:

com.databricks.backend.common.rpc.SparkDriverExceptions$SQLExecutionException: java.lang.UnsupportedOperationException
	at org.apache.spark.sql.catalyst.plans.logical.LeafNode.computeStats(LogicalPlan.scala:183)
	at org.apache.spark.sql.catalyst.plans.logical.LeafNode.computeStats$(LogicalPlan.scala:183)
	at org.apache.kyuubi.plugin.spark.authz.util.ObjectFilterPlaceHolder.computeStats(ObjectFilterPlaceHolder.scala:23)
	at org.apache.spark.sql.catalyst.plans.QueryPlanStats.$anonfun$stats$1(QueryPlanStats.scala:39)
	at scala.Option.getOrElse(Option.scala:189)
	at org.apache.spark.sql.catalyst.plans.QueryPlanStats.stats(QueryPlanStats.scala:38)
	at org.apache.spark.sql.catalyst.plans.QueryPlanStats.stats$(QueryPlanStats.scala:38)
	at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.stats(LogicalPlan.scala:31)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksSizeInBytesOnlyStatsPlanVisitor$.visitLocalLimit(DatabricksSizeInBytesOnlyStatsPlanVisitor.scala:120)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksSizeInBytesOnlyStatsPlanVisitor$.visitLocalLimit(DatabricksSizeInBytesOnlyStatsPlanVisitor.scala:30)
	at org.apache.spark.sql.catalyst.plans.logical.LogicalPlanVisitor.visit(LogicalPlanVisitor.scala:44)
	at org.apache.spark.sql.catalyst.plans.logical.LogicalPlanVisitor.visit$(LogicalPlanVisitor.scala:32)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksSizeInBytesOnlyStatsPlanVisitor$.visit(DatabricksSizeInBytesOnlyStatsPlanVisitor.scala:30)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksBasicStatsPlanVisitor$.fallback(DatabricksBasicStatsPlanVisitor.scala:38)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksBasicStatsPlanVisitor$.visitLocalLimit(DatabricksBasicStatsPlanVisitor.scala:82)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksBasicStatsPlanVisitor$.visitLocalLimit(DatabricksBasicStatsPlanVisitor.scala:28)
	at org.apache.spark.sql.catalyst.plans.logical.LogicalPlanVisitor.visit(LogicalPlanVisitor.scala:44)
	at org.apache.spark.sql.catalyst.plans.logical.LogicalPlanVisitor.visit$(LogicalPlanVisitor.scala:32)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksBasicStatsPlanVisitor$.super$visit(DatabricksBasicStatsPlanVisitor.scala:32)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksBasicStatsPlanVisitor$.$anonfun$visit$1(DatabricksBasicStatsPlanVisitor.scala:32)
	at scala.Option.getOrElse(Option.scala:189)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksBasicStatsPlanVisitor$.visit(DatabricksBasicStatsPlanVisitor.scala:32)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksLogicalPlanStatsVisitor$.visit(DatabricksLogicalPlanStatsVisitor.scala:27)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksLogicalPlanStatsVisitor$.visit(DatabricksLogicalPlanStatsVisitor.scala:24)
	at org.apache.spark.sql.catalyst.plans.logical.statsEstimation.LogicalPlanStats$.visit(LogicalPlanStats.scala:50)
	at org.apache.spark.sql.catalyst.plans.logical.statsEstimation.LogicalPlanStats.computeStats(LogicalPlanStats.scala:28)
	at org.apache.spark.sql.catalyst.plans.logical.statsEstimation.LogicalPlanStats.computeStats$(LogicalPlanStats.scala:28)
	at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.computeStats(LogicalPlan.scala:31)
	at org.apache.spark.sql.catalyst.plans.QueryPlanStats.$anonfun$stats$1(QueryPlanStats.scala:39)
	at scala.Option.getOrElse(Option.scala:189)
	at org.apache.spark.sql.catalyst.plans.QueryPlanStats.stats(QueryPlanStats.scala:38)
	at org.apache.spark.sql.catalyst.plans.QueryPlanStats.stats$(QueryPlanStats.scala:38)
	at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.stats(LogicalPlan.scala:31)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksSizeInBytesOnlyStatsPlanVisitor$.visitGlobalLimit(DatabricksSizeInBytesOnlyStatsPlanVisitor.scala:80)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksSizeInBytesOnlyStatsPlanVisitor$.visitGlobalLimit(DatabricksSizeInBytesOnlyStatsPlanVisitor.scala:30)
	at org.apache.spark.sql.catalyst.plans.logical.LogicalPlanVisitor.visit(LogicalPlanVisitor.scala:40)
	at org.apache.spark.sql.catalyst.plans.logical.LogicalPlanVisitor.visit$(LogicalPlanVisitor.scala:32)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksSizeInBytesOnlyStatsPlanVisitor$.visit(DatabricksSizeInBytesOnlyStatsPlanVisitor.scala:30)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksBasicStatsPlanVisitor$.fallback(DatabricksBasicStatsPlanVisitor.scala:38)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksBasicStatsPlanVisitor$.visitGlobalLimit(DatabricksBasicStatsPlanVisitor.scala:62)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksBasicStatsPlanVisitor$.visitGlobalLimit(DatabricksBasicStatsPlanVisitor.scala:28)
	at org.apache.spark.sql.catalyst.plans.logical.LogicalPlanVisitor.visit(LogicalPlanVisitor.scala:40)
	at org.apache.spark.sql.catalyst.plans.logical.LogicalPlanVisitor.visit$(LogicalPlanVisitor.scala:32)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksBasicStatsPlanVisitor$.super$visit(DatabricksBasicStatsPlanVisitor.scala:32)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksBasicStatsPlanVisitor$.$anonfun$visit$1(DatabricksBasicStatsPlanVisitor.scala:32)
	at scala.Option.getOrElse(Option.scala:189)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksBasicStatsPlanVisitor$.visit(DatabricksBasicStatsPlanVisitor.scala:32)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksLogicalPlanStatsVisitor$.visit(DatabricksLogicalPlanStatsVisitor.scala:27)
	at com.databricks.sql.optimizer.statsEstimation.DatabricksLogicalPlanStatsVisitor$.visit(DatabricksLogicalPlanStatsVisitor.scala:24)
	at org.apache.spark.sql.catalyst.plans.logical.statsEstimation.LogicalPlanStats$.visit(LogicalPlanStats.scala:50)
	at org.apache.spark.sql.catalyst.plans.logical.statsEstimation.LogicalPlanStats.computeStats(LogicalPlanStats.scala:28)
	at org.apache.spark.sql.catalyst.plans.logical.statsEstimation.LogicalPlanStats.computeStats$(LogicalPlanStats.scala:28)
	at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.computeStats(LogicalPlan.scala:31)
	at org.apache.spark.sql.catalyst.plans.QueryPlanStats.$anonfun$stats$1(QueryPlanStats.scala:39)
	at scala.Option.getOrElse(Option.scala:189)
	at org.apache.spark.sql.catalyst.plans.QueryPlanStats.stats(QueryPlanStats.scala:38)
	at org.apache.spark.sql.catalyst.plans.QueryPlanStats.stats$(QueryPlanStats.scala:38)
	at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.stats(LogicalPlan.scala:31)
	at org.apache.spark.sql.execution.SparkPlanInfo$.$anonfun$fromSparkPlan$5(SparkPlanInfo.scala:128)
	at scala.Option.flatMap(Option.scala:271)
	at org.apache.spark.sql.execution.SparkPlanInfo$.fromSparkPlan(SparkPlanInfo.scala:125)
	at org.apache.spark.sql.execution.SparkPlanInfo$.fromSparkPlanCallback$1(SparkPlanInfo.scala:93)
	at org.apache.spark.sql.execution.SparkPlanInfo$.$anonfun$fromSparkPlan$2(SparkPlanInfo.scala:97)
	at org.apache.spark.sql.execution.ExplainUtils$.processPlan(ExplainUtils.scala:111)
	at org.apache.spark.sql.execution.SparkPlanInfo$.fromSparkPlan(SparkPlanInfo.scala:97)
	at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withCustomExecutionEnv$8(SQLExecution.scala:210)
	at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:414)
	at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withCustomExecutionEnv$1(SQLExecution.scala:190)
	at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:1003)
	at org.apache.spark.sql.execution.SQLExecution$.withCustomExecutionEnv(SQLExecution.scala:144)
	at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:364)
	at org.apache.spark.sql.Dataset.withAction(Dataset.scala:4342)
	at org.apache.spark.sql.Dataset.collectResult(Dataset.scala:3461)
	at com.databricks.backend.daemon.driver.OutputAggregator$.withOutputAggregation0(OutputAggregator.scala:267)
	at com.databricks.backend.daemon.driver.OutputAggregator$.withOutputAggregation(OutputAggregator.scala:101)
	at com.databricks.backend.daemon.driver.SQLDriverLocal.executeSql(SQLDriverLocal.scala:115)
	at com.databricks.backend.daemon.driver.SQLDriverLocal.repl(SQLDriverLocal.scala:145)
	at com.databricks.backend.daemon.driver.DriverLocal.$anonfun$execute$23(DriverLocal.scala:731)
	at com.databricks.unity.EmptyHandle$.runWith(UCSHandle.scala:103)
	at com.databricks.backend.daemon.driver.DriverLocal.$anonfun$execute$20(DriverLocal.scala:714)
	at com.databricks.logging.UsageLogging.$anonfun$withAttributionContext$1(UsageLogging.scala:401)
	at scala.util.DynamicVariable.withValue(DynamicVariable.scala:62)
	at com.databricks.logging.AttributionContext$.withValue(AttributionContext.scala:158)
	at com.databricks.logging.UsageLogging.withAttributionContext(UsageLogging.scala:399)
	at com.databricks.logging.UsageLogging.withAttributionContext$(UsageLogging.scala:396)
	at com.databricks.backend.daemon.driver.DriverLocal.withAttributionContext(DriverLocal.scala:64)
	at com.databricks.logging.UsageLogging.withAttributionTags(UsageLogging.scala:444)
	at com.databricks.logging.UsageLogging.withAttributionTags$(UsageLogging.scala:429)
	at com.databricks.backend.daemon.driver.DriverLocal.withAttributionTags(DriverLocal.scala:64)
	at com.databricks.backend.daemon.driver.DriverLocal.execute(DriverLocal.scala:691)
	at com.databricks.backend.daemon.driver.DriverWrapper.$anonfun$tryExecutingCommand$1(DriverWrapper.scala:622)
	at scala.util.Try$.apply(Try.scala:213)
	at com.databricks.backend.daemon.driver.DriverWrapper.tryExecutingCommand(DriverWrapper.scala:614)
	at com.databricks.backend.daemon.driver.DriverWrapper.executeCommandAndGetError(DriverWrapper.scala:533)
	at com.databricks.backend.daemon.driver.DriverWrapper.executeCommand(DriverWrapper.scala:568)
	at com.databricks.backend.daemon.driver.DriverWrapper.runInnerLoop(DriverWrapper.scala:438)
	at com.databricks.backend.daemon.driver.DriverWrapper.runInner(DriverWrapper.scala:381)
	at com.databricks.backend.daemon.driver.DriverWrapper.run(DriverWrapper.scala:232)
	at java.lang.Thread.run(Thread.java:750)

	at com.databricks.backend.daemon.driver.SQLDriverLocal.executeSql(SQLDriverLocal.scala:130)
	at com.databricks.backend.daemon.driver.SQLDriverLocal.repl(SQLDriverLocal.scala:145)
	at com.databricks.backend.daemon.driver.DriverLocal.$anonfun$execute$23(DriverLocal.scala:731)
	at com.databricks.unity.EmptyHandle$.runWith(UCSHandle.scala:103)
	at com.databricks.backend.daemon.driver.DriverLocal.$anonfun$execute$20(DriverLocal.scala:714)
	at com.databricks.logging.UsageLogging.$anonfun$withAttributionContext$1(UsageLogging.scala:401)
	at scala.util.DynamicVariable.withValue(DynamicVariable.scala:62)
	at com.databricks.logging.AttributionContext$.withValue(AttributionContext.scala:158)
	at com.databricks.logging.UsageLogging.withAttributionContext(UsageLogging.scala:399)
	at com.databricks.logging.UsageLogging.withAttributionContext$(UsageLogging.scala:396)
	at com.databricks.backend.daemon.driver.DriverLocal.withAttributionContext(DriverLocal.scala:64)
	at com.databricks.logging.UsageLogging.withAttributionTags(UsageLogging.scala:444)
	at com.databricks.logging.UsageLogging.withAttributionTags$(UsageLogging.scala:429)
	at com.databricks.backend.daemon.driver.DriverLocal.withAttributionTags(DriverLocal.scala:64)
	at com.databricks.backend.daemon.driver.DriverLocal.execute(DriverLocal.scala:691)
	at com.databricks.backend.daemon.driver.DriverWrapper.$anonfun$tryExecutingCommand$1(DriverWrapper.scala:622)
	at scala.util.Try$.apply(Try.scala:213)
	at com.databricks.backend.daemon.driver.DriverWrapper.tryExecutingCommand(DriverWrapper.scala:614)
	at com.databricks.backend.daemon.driver.DriverWrapper.executeCommandAndGetError(DriverWrapper.scala:533)
	at com.databricks.backend.daemon.driver.DriverWrapper.executeCommand(DriverWrapper.scala:568)
	at com.databricks.backend.daemon.driver.DriverWrapper.runInnerLoop(DriverWrapper.scala:438)
	at com.databricks.backend.daemon.driver.DriverWrapper.runInner(DriverWrapper.scala:381)
	at com.databricks.backend.daemon.driver.DriverWrapper.run(DriverWrapper.scala:232)
	at java.lang.Thread.run(Thread.java:750)

For the UPDATE SQL error log, please refer to the logs below:

com.databricks.backend.common.rpc.SparkDriverExceptions$SQLExecutionException: com.databricks.sql.transaction.tahoe.DeltaAnalysisException: UPDATE destination only supports Delta sources.
Some(Project [o_orderkey#50L, o_custkey#51L, o_orderstatus#52, o_totalprice#53, o_orderdate#54, o_orderpriority#55, o_clerk#56, o_shippriority#57, o_comment#58]
+- RowFilterAndDataMaskingMarker
   +- Relation spark_catalog.tpch.orders[o_orderkey#50L,o_custkey#51L,o_orderstatus#52,o_totalprice#53,o_orderdate#54,o_orderpriority#55,o_clerk#56,o_shippriority#57,o_comment#58] parquet
)
	at com.databricks.sql.transaction.tahoe.DeltaErrorsBase.notADeltaSourceException(DeltaErrors.scala:543)
	at com.databricks.sql.transaction.tahoe.DeltaErrorsBase.notADeltaSourceException$(DeltaErrors.scala:541)
	at com.databricks.sql.transaction.tahoe.DeltaErrors$.notADeltaSourceException(DeltaErrors.scala:2532)
	at com.databricks.sql.transaction.tahoe.PreprocessTableUpdate.toCommand(PreprocessTableUpdate.scala:59)
	at com.databricks.sql.transaction.tahoe.PreprocessTableUpdateEdge$$anonfun$apply0$1.applyOrElse(PreprocessTableUpdateEdge.scala:70)
	at com.databricks.sql.transaction.tahoe.PreprocessTableUpdateEdge$$anonfun$apply0$1.applyOrElse(PreprocessTableUpdateEdge.scala:46)
	at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.$anonfun$resolveOperatorsDownWithPruning$2(AnalysisHelper.scala:171)
	at org.apache.spark.sql.catalyst.trees.CurrentOrigin$.withOrigin(TreeNode.scala:106)
	at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.$anonfun$resolveOperatorsDownWithPruning$1(AnalysisHelper.scala:171)
	at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$.allowInvokingTransformsInAnalyzer(AnalysisHelper.scala:324)
	at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperatorsDownWithPruning(AnalysisHelper.scala:169)
	at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperatorsDownWithPruning$(AnalysisHelper.scala:165)
	at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.resolveOperatorsDownWithPruning(LogicalPlan.scala:31)
	at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperatorsWithPruning(AnalysisHelper.scala:99)
	at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperatorsWithPruning$(AnalysisHelper.scala:96)
	at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.resolveOperatorsWithPruning(LogicalPlan.scala:31)
	at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperators(AnalysisHelper.scala:76)
	at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperators$(AnalysisHelper.scala:75)
	at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.resolveOperators(LogicalPlan.scala:31)
	at com.databricks.sql.transaction.tahoe.PreprocessTableUpdateEdge$.apply0(PreprocessTableUpdateEdge.scala:46)
	at com.databricks.sql.transaction.tahoe.PreprocessTableUpdateEdge$.apply(PreprocessTableUpdateEdge.scala:42)
	at com.databricks.sql.transaction.tahoe.PreprocessTableUpdateEdge$.apply(PreprocessTableUpdateEdge.scala:36)
	at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$4(RuleExecutor.scala:218)
	at com.databricks.spark.util.FrameProfiler$.record(FrameProfiler.scala:80)
	at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$3(RuleExecutor.scala:218)
	at scala.collection.LinearSeqOptimized.foldLeft(LinearSeqOptimized.scala:126)
	at scala.collection.LinearSeqOptimized.foldLeft$(LinearSeqOptimized.scala:122)
	at scala.collection.immutable.List.foldLeft(List.scala:91)
	at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$2(RuleExecutor.scala:215)
	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
	at com.databricks.spark.util.FrameProfiler$.record(FrameProfiler.scala:80)
	at org.apache.spark.sql.catalyst.rules.RuleExecutor.executeBatch$1(RuleExecutor.scala:207)
	at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$8(RuleExecutor.scala:277)
	at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$8$adapted(RuleExecutor.scala:277)
	at scala.collection.immutable.List.foreach(List.scala:431)
	at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$1(RuleExecutor.scala:277)
	at com.databricks.spark.util.FrameProfiler$.record(FrameProfiler.scala:80)
	at org.apache.spark.sql.catalyst.rules.RuleExecutor.execute(RuleExecutor.scala:194)
	at org.apache.spark.sql.catalyst.analysis.Analyzer.executeSameContext(Analyzer.scala:353)
	at org.apache.spark.sql.catalyst.analysis.Analyzer.$anonfun$execute$1(Analyzer.scala:346)
	at org.apache.spark.sql.catalyst.analysis.AnalysisContext$.withNewAnalysisContext(Analyzer.scala:253)
	at org.apache.spark.sql.catalyst.analysis.Analyzer.execute(Analyzer.scala:346)
	at org.apache.spark.sql.catalyst.analysis.Analyzer.execute(Analyzer.scala:274)
	at org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$executeAndTrack$1(RuleExecutor.scala:186)
	at org.apache.spark.sql.catalyst.QueryPlanningTracker$.withTracker(QueryPlanningTracker.scala:153)
	at org.apache.spark.sql.catalyst.rules.RuleExecutor.executeAndTrack(RuleExecutor.scala:186)
	at org.apache.spark.sql.catalyst.analysis.Analyzer.$anonfun$executeAndCheck$1(Analyzer.scala:326)
	at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$.markInAnalyzer(AnalysisHelper.scala:331)
	at org.apache.spark.sql.catalyst.analysis.Analyzer.executeAndCheck(Analyzer.scala:325)
	at org.apache.spark.sql.execution.QueryExecution.$anonfun$analyzed$1(QueryExecution.scala:163)
	at com.databricks.spark.util.FrameProfiler$.record(FrameProfiler.scala:80)
	at org.apache.spark.sql.catalyst.QueryPlanningTracker.measurePhase(QueryPlanningTracker.scala:319)
	at org.apache.spark.sql.execution.QueryExecution.$anonfun$executePhase$3(QueryExecution.scala:353)
	at org.apache.spark.sql.execution.QueryExecution$.withInternalError(QueryExecution.scala:789)
	at org.apache.spark.sql.execution.QueryExecution.$anonfun$executePhase$1(QueryExecution.scala:353)
	at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:1003)
	at org.apache.spark.sql.execution.QueryExecution.executePhase(QueryExecution.scala:350)
	at org.apache.spark.sql.execution.QueryExecution.analyzed$lzycompute(QueryExecution.scala:144)
	at org.apache.spark.sql.execution.QueryExecution.analyzed(QueryExecution.scala:144)
	at org.apache.spark.sql.execution.QueryExecution.assertAnalyzed(QueryExecution.scala:136)
	at org.apache.spark.sql.Dataset$.$anonfun$ofRows$2(Dataset.scala:110)
	at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:1003)
	at org.apache.spark.sql.SparkSession.$anonfun$withActiveAndFrameProfiler$1(SparkSession.scala:1010)
	at com.databricks.spark.util.FrameProfiler$.record(FrameProfiler.scala:80)
	at org.apache.spark.sql.SparkSession.withActiveAndFrameProfiler(SparkSession.scala:1010)
	at org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:108)
	at org.apache.spark.sql.SparkSession.$anonfun$sql$1(SparkSession.scala:838)
	at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:1003)
	at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:817)
	at org.apache.spark.sql.SQLContext.sql(SQLContext.scala:695)
	at com.databricks.backend.daemon.driver.SQLDriverLocal.$anonfun$executeSql$1(SQLDriverLocal.scala:91)
	at scala.collection.immutable.List.map(List.scala:293)
	at com.databricks.backend.daemon.driver.SQLDriverLocal.executeSql(SQLDriverLocal.scala:37)
	at com.databricks.backend.daemon.driver.SQLDriverLocal.repl(SQLDriverLocal.scala:145)
	at com.databricks.backend.daemon.driver.DriverLocal.$anonfun$execute$23(DriverLocal.scala:731)
	at com.databricks.unity.EmptyHandle$.runWith(UCSHandle.scala:103)
	at com.databricks.backend.daemon.driver.DriverLocal.$anonfun$execute$20(DriverLocal.scala:714)
	at com.databricks.logging.UsageLogging.$anonfun$withAttributionContext$1(UsageLogging.scala:401)
	at scala.util.DynamicVariable.withValue(DynamicVariable.scala:62)
	at com.databricks.logging.AttributionContext$.withValue(AttributionContext.scala:158)
	at com.databricks.logging.UsageLogging.withAttributionContext(UsageLogging.scala:399)
	at com.databricks.logging.UsageLogging.withAttributionContext$(UsageLogging.scala:396)
	at com.databricks.backend.daemon.driver.DriverLocal.withAttributionContext(DriverLocal.scala:64)
	at com.databricks.logging.UsageLogging.withAttributionTags(UsageLogging.scala:444)
	at com.databricks.logging.UsageLogging.withAttributionTags$(UsageLogging.scala:429)
	at com.databricks.backend.daemon.driver.DriverLocal.withAttributionTags(DriverLocal.scala:64)
	at com.databricks.backend.daemon.driver.DriverLocal.execute(DriverLocal.scala:691)
	at com.databricks.backend.daemon.driver.DriverWrapper.$anonfun$tryExecutingCommand$1(DriverWrapper.scala:622)
	at scala.util.Try$.apply(Try.scala:213)
	at com.databricks.backend.daemon.driver.DriverWrapper.tryExecutingCommand(DriverWrapper.scala:614)
	at com.databricks.backend.daemon.driver.DriverWrapper.executeCommandAndGetError(DriverWrapper.scala:533)
	at com.databricks.backend.daemon.driver.DriverWrapper.executeCommand(DriverWrapper.scala:568)
	at com.databricks.backend.daemon.driver.DriverWrapper.runInnerLoop(DriverWrapper.scala:438)
	at com.databricks.backend.daemon.driver.DriverWrapper.runInner(DriverWrapper.scala:381)
	at com.databricks.backend.daemon.driver.DriverWrapper.run(DriverWrapper.scala:232)
	at java.lang.Thread.run(Thread.java:750)

	at com.databricks.backend.daemon.driver.SQLDriverLocal.executeSql(SQLDriverLocal.scala:130)
	at com.databricks.backend.daemon.driver.SQLDriverLocal.repl(SQLDriverLocal.scala:145)
	at com.databricks.backend.daemon.driver.DriverLocal.$anonfun$execute$23(DriverLocal.scala:731)
	at com.databricks.unity.EmptyHandle$.runWith(UCSHandle.scala:103)
	at com.databricks.backend.daemon.driver.DriverLocal.$anonfun$execute$20(DriverLocal.scala:714)
	at com.databricks.logging.UsageLogging.$anonfun$withAttributionContext$1(UsageLogging.scala:401)
	at scala.util.DynamicVariable.withValue(DynamicVariable.scala:62)
	at com.databricks.logging.AttributionContext$.withValue(AttributionContext.scala:158)
	at com.databricks.logging.UsageLogging.withAttributionContext(UsageLogging.scala:399)
	at com.databricks.logging.UsageLogging.withAttributionContext$(UsageLogging.scala:396)
	at com.databricks.backend.daemon.driver.DriverLocal.withAttributionContext(DriverLocal.scala:64)
	at com.databricks.logging.UsageLogging.withAttributionTags(UsageLogging.scala:444)
	at com.databricks.logging.UsageLogging.withAttributionTags$(UsageLogging.scala:429)
	at com.databricks.backend.daemon.driver.DriverLocal.withAttributionTags(DriverLocal.scala:64)
	at com.databricks.backend.daemon.driver.DriverLocal.execute(DriverLocal.scala:691)
	at com.databricks.backend.daemon.driver.DriverWrapper.$anonfun$tryExecutingCommand$1(DriverWrapper.scala:622)
	at scala.util.Try$.apply(Try.scala:213)
	at com.databricks.backend.daemon.driver.DriverWrapper.tryExecutingCommand(DriverWrapper.scala:614)
	at com.databricks.backend.daemon.driver.DriverWrapper.executeCommandAndGetError(DriverWrapper.scala:533)
	at com.databricks.backend.daemon.driver.DriverWrapper.executeCommand(DriverWrapper.scala:568)
	at com.databricks.backend.daemon.driver.DriverWrapper.runInnerLoop(DriverWrapper.scala:438)
	at com.databricks.backend.daemon.driver.DriverWrapper.runInner(DriverWrapper.scala:381)
	at com.databricks.backend.daemon.driver.DriverWrapper.run(DriverWrapper.scala:232)
	at java.lang.Thread.run(Thread.java:750)

Also, for the DELETE SQL error log:

com.databricks.backend.common.rpc.SparkDriverExceptions$SQLExecutionException: org.apache.spark.sql.AnalysisException: [UNSUPPORTED_FEATURE.TABLE_OPERATION] The feature is not supported: Table `spark_catalog`.`tpch`.`orders` does not support DELETE. Please check the current catalog and namespace to make sure the qualified table name is expected, and also check the catalog implementation which is configured by "spark.sql.catalog".
	at org.apache.spark.sql.errors.QueryCompilationErrors$.operationOnlySupportedWithV2TableError(QueryCompilationErrors.scala:742)
	at org.apache.spark.sql.execution.datasources.v2.DataSourceV2Strategy.apply(DataSourceV2Strategy.scala:328)
	at org.apache.spark.sql.catalyst.planning.QueryPlanner.$anonfun$plan$2(QueryPlanner.scala:69)
	at com.databricks.spark.util.FrameProfiler$.record(FrameProfiler.scala:80)
	at org.apache.spark.sql.catalyst.planning.QueryPlanner.$anonfun$plan$1(QueryPlanner.scala:69)
	at scala.collection.Iterator$$anon$11.nextCur(Iterator.scala:486)
	at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:492)
	at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:491)
	at org.apache.spark.sql.catalyst.planning.QueryPlanner.plan(QueryPlanner.scala:100)
	at org.apache.spark.sql.execution.SparkStrategies.plan(SparkStrategies.scala:82)
	at org.apache.spark.sql.catalyst.planning.QueryPlanner.$anonfun$plan$4(QueryPlanner.scala:85)
	at scala.collection.TraversableOnce$folder$1.apply(TraversableOnce.scala:196)
	at scala.collection.TraversableOnce$folder$1.apply(TraversableOnce.scala:194)
	at scala.collection.Iterator.foreach(Iterator.scala:943)
	at scala.collection.Iterator.foreach$(Iterator.scala:943)
	at scala.collection.AbstractIterator.foreach(Iterator.scala:1431)
	at scala.collection.TraversableOnce.foldLeft(TraversableOnce.scala:199)
	at scala.collection.TraversableOnce.foldLeft$(TraversableOnce.scala:192)
	at scala.collection.AbstractIterator.foldLeft(Iterator.scala:1431)
	at org.apache.spark.sql.catalyst.planning.QueryPlanner.$anonfun$plan$3(QueryPlanner.scala:82)
	at scala.collection.Iterator$$anon$11.nextCur(Iterator.scala:486)
	at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:492)
	at org.apache.spark.sql.catalyst.planning.QueryPlanner.plan(QueryPlanner.scala:100)
	at org.apache.spark.sql.execution.SparkStrategies.plan(SparkStrategies.scala:82)
	at org.apache.spark.sql.execution.QueryExecution$.createSparkPlan(QueryExecution.scala:742)
	at org.apache.spark.sql.execution.QueryExecution.$anonfun$sparkPlan$1(QueryExecution.scala:301)
	at com.databricks.spark.util.FrameProfiler$.record(FrameProfiler.scala:80)
	at org.apache.spark.sql.catalyst.QueryPlanningTracker.measurePhase(QueryPlanningTracker.scala:319)
	at org.apache.spark.sql.execution.QueryExecution.$anonfun$executePhase$3(QueryExecution.scala:353)
	at org.apache.spark.sql.execution.QueryExecution$.withInternalError(QueryExecution.scala:789)
	at org.apache.spark.sql.execution.QueryExecution.$anonfun$executePhase$1(QueryExecution.scala:353)
	at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:1003)
	at org.apache.spark.sql.execution.QueryExecution.executePhase(QueryExecution.scala:350)
	at org.apache.spark.sql.execution.QueryExecution.sparkPlan$lzycompute(QueryExecution.scala:301)
	at org.apache.spark.sql.execution.QueryExecution.sparkPlan(QueryExecution.scala:294)
	at org.apache.spark.sql.execution.QueryExecution.$anonfun$executedPlan$1(QueryExecution.scala:313)
	at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:1003)
	at org.apache.spark.sql.execution.QueryExecution.executedPlan$lzycompute(QueryExecution.scala:313)
	at org.apache.spark.sql.execution.QueryExecution.executedPlan(QueryExecution.scala:308)
	at org.apache.spark.sql.execution.QueryExecution.appendAetherExplanationSection(QueryExecution.scala:382)
	at org.apache.spark.sql.execution.QueryExecution.org$apache$spark$sql$execution$QueryExecution$$explainString(QueryExecution.scala:476)
	at org.apache.spark.sql.execution.QueryExecution.explainStringLocal(QueryExecution.scala:437)
	at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withCustomExecutionEnv$8(SQLExecution.scala:207)
	at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:414)
	at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withCustomExecutionEnv$1(SQLExecution.scala:190)
	at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:1003)
	at org.apache.spark.sql.execution.SQLExecution$.withCustomExecutionEnv(SQLExecution.scala:144)
	at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:364)
	at org.apache.spark.sql.execution.QueryExecution$$anonfun$$nestedInanonfun$eagerlyExecuteCommands$1$1.$anonfun$applyOrElse$1(QueryExecution.scala:245)
	at org.apache.spark.sql.execution.QueryExecution.org$apache$spark$sql$execution$QueryExecution$$withMVTagsIfNecessary(QueryExecution.scala:230)
	at org.apache.spark.sql.execution.QueryExecution$$anonfun$$nestedInanonfun$eagerlyExecuteCommands$1$1.applyOrElse(QueryExecution.scala:243)
	at org.apache.spark.sql.execution.QueryExecution$$anonfun$$nestedInanonfun$eagerlyExecuteCommands$1$1.applyOrElse(QueryExecution.scala:236)
	at org.apache.spark.sql.catalyst.trees.TreeNode.$anonfun$transformDownWithPruning$1(TreeNode.scala:519)
	at org.apache.spark.sql.catalyst.trees.CurrentOrigin$.withOrigin(TreeNode.scala:106)
	at org.apache.spark.sql.catalyst.trees.TreeNode.transformDownWithPruning(TreeNode.scala:519)
	at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.org$apache$spark$sql$catalyst$plans$logical$AnalysisHelper$$super$transformDownWithPruning(LogicalPlan.scala:31)
	at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.transformDownWithPruning(AnalysisHelper.scala:268)
	at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.transformDownWithPruning$(AnalysisHelper.scala:264)
	at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.transformDownWithPruning(LogicalPlan.scala:31)
	at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.transformDownWithPruning(LogicalPlan.scala:31)
	at org.apache.spark.sql.catalyst.trees.TreeNode.transformDown(TreeNode.scala:495)
	at org.apache.spark.sql.execution.QueryExecution.$anonfun$eagerlyExecuteCommands$1(QueryExecution.scala:236)
	at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$.allowInvokingTransformsInAnalyzer(AnalysisHelper.scala:324)
	at org.apache.spark.sql.execution.QueryExecution.eagerlyExecuteCommands(QueryExecution.scala:236)
	at org.apache.spark.sql.execution.QueryExecution.commandExecuted$lzycompute(QueryExecution.scala:190)
	at org.apache.spark.sql.execution.QueryExecution.commandExecuted(QueryExecution.scala:181)
	at org.apache.spark.sql.Dataset.<init>(Dataset.scala:248)
	at org.apache.spark.sql.Dataset$.$anonfun$ofRows$2(Dataset.scala:117)
	at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:1003)
	at org.apache.spark.sql.SparkSession.$anonfun$withActiveAndFrameProfiler$1(SparkSession.scala:1010)
	at com.databricks.spark.util.FrameProfiler$.record(FrameProfiler.scala:80)
	at org.apache.spark.sql.SparkSession.withActiveAndFrameProfiler(SparkSession.scala:1010)
	at org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:108)
	at org.apache.spark.sql.SparkSession.$anonfun$sql$1(SparkSession.scala:838)
	at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:1003)
	at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:817)
	at org.apache.spark.sql.SQLContext.sql(SQLContext.scala:695)
	at com.databricks.backend.daemon.driver.SQLDriverLocal.$anonfun$executeSql$1(SQLDriverLocal.scala:91)
	at scala.collection.immutable.List.map(List.scala:293)
	at com.databricks.backend.daemon.driver.SQLDriverLocal.executeSql(SQLDriverLocal.scala:37)
	at com.databricks.backend.daemon.driver.SQLDriverLocal.repl(SQLDriverLocal.scala:145)
	at com.databricks.backend.daemon.driver.DriverLocal.$anonfun$execute$23(DriverLocal.scala:731)
	at com.databricks.unity.EmptyHandle$.runWith(UCSHandle.scala:103)
	at com.databricks.backend.daemon.driver.DriverLocal.$anonfun$execute$20(DriverLocal.scala:714)
	at com.databricks.logging.UsageLogging.$anonfun$withAttributionContext$1(UsageLogging.scala:401)
	at scala.util.DynamicVariable.withValue(DynamicVariable.scala:62)
	at com.databricks.logging.AttributionContext$.withValue(AttributionContext.scala:158)
	at com.databricks.logging.UsageLogging.withAttributionContext(UsageLogging.scala:399)
	at com.databricks.logging.UsageLogging.withAttributionContext$(UsageLogging.scala:396)
	at com.databricks.backend.daemon.driver.DriverLocal.withAttributionContext(DriverLocal.scala:64)
	at com.databricks.logging.UsageLogging.withAttributionTags(UsageLogging.scala:444)
	at com.databricks.logging.UsageLogging.withAttributionTags$(UsageLogging.scala:429)
	at com.databricks.backend.daemon.driver.DriverLocal.withAttributionTags(DriverLocal.scala:64)
	at com.databricks.backend.daemon.driver.DriverLocal.execute(DriverLocal.scala:691)
	at com.databricks.backend.daemon.driver.DriverWrapper.$anonfun$tryExecutingCommand$1(DriverWrapper.scala:622)
	at scala.util.Try$.apply(Try.scala:213)
	at com.databricks.backend.daemon.driver.DriverWrapper.tryExecutingCommand(DriverWrapper.scala:614)
	at com.databricks.backend.daemon.driver.DriverWrapper.executeCommandAndGetError(DriverWrapper.scala:533)
	at com.databricks.backend.daemon.driver.DriverWrapper.executeCommand(DriverWrapper.scala:568)
	at com.databricks.backend.daemon.driver.DriverWrapper.runInnerLoop(DriverWrapper.scala:438)
	at com.databricks.backend.daemon.driver.DriverWrapper.runInner(DriverWrapper.scala:381)
	at com.databricks.backend.daemon.driver.DriverWrapper.run(DriverWrapper.scala:232)
	at java.lang.Thread.run(Thread.java:750)

	at com.databricks.backend.daemon.driver.SQLDriverLocal.executeSql(SQLDriverLocal.scala:130)
	at com.databricks.backend.daemon.driver.SQLDriverLocal.repl(SQLDriverLocal.scala:145)
	at com.databricks.backend.daemon.driver.DriverLocal.$anonfun$execute$23(DriverLocal.scala:731)
	at com.databricks.unity.EmptyHandle$.runWith(UCSHandle.scala:103)
	at com.databricks.backend.daemon.driver.DriverLocal.$anonfun$execute$20(DriverLocal.scala:714)
	at com.databricks.logging.UsageLogging.$anonfun$withAttributionContext$1(UsageLogging.scala:401)
	at scala.util.DynamicVariable.withValue(DynamicVariable.scala:62)
	at com.databricks.logging.AttributionContext$.withValue(AttributionContext.scala:158)
	at com.databricks.logging.UsageLogging.withAttributionContext(UsageLogging.scala:399)
	at com.databricks.logging.UsageLogging.withAttributionContext$(UsageLogging.scala:396)
	at com.databricks.backend.daemon.driver.DriverLocal.withAttributionContext(DriverLocal.scala:64)
	at com.databricks.logging.UsageLogging.withAttributionTags(UsageLogging.scala:444)
	at com.databricks.logging.UsageLogging.withAttributionTags$(UsageLogging.scala:429)
	at com.databricks.backend.daemon.driver.DriverLocal.withAttributionTags(DriverLocal.scala:64)
	at com.databricks.backend.daemon.driver.DriverLocal.execute(DriverLocal.scala:691)
	at com.databricks.backend.daemon.driver.DriverWrapper.$anonfun$tryExecutingCommand$1(DriverWrapper.scala:622)
	at scala.util.Try$.apply(Try.scala:213)
	at com.databricks.backend.daemon.driver.DriverWrapper.tryExecutingCommand(DriverWrapper.scala:614)
	at com.databricks.backend.daemon.driver.DriverWrapper.executeCommandAndGetError(DriverWrapper.scala:533)
	at com.databricks.backend.daemon.driver.DriverWrapper.executeCommand(DriverWrapper.scala:568)
	at com.databricks.backend.daemon.driver.DriverWrapper.runInnerLoop(DriverWrapper.scala:438)
	at com.databricks.backend.daemon.driver.DriverWrapper.runInner(DriverWrapper.scala:381)
	at com.databricks.backend.daemon.driver.DriverWrapper.run(DriverWrapper.scala:232)
	at java.lang.Thread.run(Thread.java:750)

0 replies

pan3793 · 2023-01-04T05:56:04Z

pan3793
Jan 4, 2023
Collaborator

@zhichaoleo I opened #4076 for the first issue, would you please have a try?

2 replies

zhichaoleo Jan 4, 2023
Author

Thanks for your help. Will have a try.

zhichaoleo Jan 4, 2023
Author

Hi @pan3793 ,

Thanks for your PR and Great work! The SHOW DATABASES; error has been resolved. However the other two errors still exists.
Could you please provide some advices?

Thanks,
Alex

yaooqinn · 2023-01-04T09:32:09Z

yaooqinn
Jan 4, 2023
Collaborator

For delta update&delete operations, we need to add the command specifications to https://github.com/apache/kyuubi/blob/master/extensions/spark/kyuubi-spark-authz/src/main/resources/table_command_spec.json

4 replies

zhichaoleo Jan 5, 2023
Author

Hi @yaooqinn ,

Thanks for your help. I will have a try.

zhichaoleo Jan 6, 2023
Author

Hi @yaooqinn ,

We found that the resource files were added in the master branch and the 1.7.0 version has not been released yet.
Since master branch update quickly, and we have to make sure the stability. Is there any possibility that we can fix this update & delete sql error in kyuubi version 1.6.1?

Thanks,
Alex

yaooqinn Jan 9, 2023
Collaborator

You can comment out the RuleApplyRowFilterAndDataMasking or add a case to match for delta update & delete

zhichaoleo Jan 9, 2023
Author

Thanks! I will have a try.

rijojoseph07 · 2023-04-21T18:19:54Z

rijojoseph07
Apr 21, 2023

Hi @zhichaoleo,

Were you able to make this work with Databricks cluster? If possible, can you share the init scripts or some documents about how to add this plugin to databricks clusters?

I am getting java.lang.ClassNotFoundException: org.apache.ranger.plugin.service.RangerBasePlugin error even after coping the jar to /databricks/jars

Thanks

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Questions about Kyuubi Spark AuthZ Plugin #4063

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 5 comments 6 replies

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Select a reply

Questions about Kyuubi Spark AuthZ Plugin #4063

zhichaoleo Jan 3, 2023

Replies: 5 comments · 6 replies

pan3793 Jan 3, 2023 Collaborator

zhichaoleo Jan 4, 2023 Author

pan3793 Jan 4, 2023 Collaborator

zhichaoleo Jan 4, 2023 Author

zhichaoleo Jan 4, 2023 Author

yaooqinn Jan 4, 2023 Collaborator

zhichaoleo Jan 5, 2023 Author

zhichaoleo Jan 6, 2023 Author

yaooqinn Jan 9, 2023 Collaborator

zhichaoleo Jan 9, 2023 Author

rijojoseph07 Apr 21, 2023

zhichaoleo
Jan 3, 2023

Replies: 5 comments 6 replies

pan3793
Jan 3, 2023
Collaborator

zhichaoleo
Jan 4, 2023
Author

pan3793
Jan 4, 2023
Collaborator

zhichaoleo Jan 4, 2023
Author

zhichaoleo Jan 4, 2023
Author

yaooqinn
Jan 4, 2023
Collaborator

zhichaoleo Jan 5, 2023
Author

zhichaoleo Jan 6, 2023
Author

yaooqinn Jan 9, 2023
Collaborator

zhichaoleo Jan 9, 2023
Author

rijojoseph07
Apr 21, 2023