Conventions for PySpark dataframe typehints

[harrietrs]

When defining a function, it would be useful to follow a convention for PySpark DataFrame typehints, e.g.

from pyspark.sql import DataFrame
import pyspark.pandas as ps

def my_function(my_dataframe: DataFrame) -> ps.DataFrame:
    return my_dataframe.toPandas()

However the above doesn't clearly distinguish between the different data types. Perhaps an alias for the pyspark.sql.DataFrame is required- although I'm not sure of how to make it different from ps.DataFrame (an established alias).

[fzhem]

I have encountered this before and I do the following:
from pyspark.sql import DataFrame as SparkDataFrame
Maybe a bit descriptive but it works.