The PySpark SparkJobinfo is used to get information about the SparkJobs that are in execution.
Following is the code for using the SparkJobInfo:
class SparkJobInfo(namedtuple("SparkJobInfo", "jobId stageIds status ")):
