SparkSession.
getActiveSession
Returns the active SparkSession for the current thread, returned by the builder
SparkSession
New in version 3.0.0.
Spark session if an active session exists for the current thread
Examples
>>> s = SparkSession.getActiveSession() >>> l = [('Alice', 1)] >>> rdd = s.sparkContext.parallelize(l) >>> df = s.createDataFrame(rdd, ['name', 'age']) >>> df.select("age").collect() [Row(age=1)]