Does engine idle timeout work in HA mode? If so, how is it work #6426
-
I haven't tested but curious on how engine idle timeout could work in HA mode. For instance, if an engine has sessions across multiple Kyuubi servers, how many SessionManagers are there? and how could the SessionManager know the number of open sessions in total? I roughly go through the code of SessionManager but doesn't find how it achieves HA. Thanks |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments 4 replies
-
Hi @pan3793 Could you please help on it? Thanks a lot |
Beta Was this translation helpful? Give feedback.
-
Yes.
Almost right, but there are some exceptions, for example, |
Beta Was this translation helpful? Give feedback.
It does not matter whether HA is enabled or not, because "engine idle timeout check" happens on the engine side, not the server side.
Each Spark SQL engine (driver) holds a
SparkSQLSessionManager
, and it holds all active sessions (maybe come from one Kyuubi server, and maybe multiple Kyuubi servers).