Question

What are the main attributes used in SparkConf?

Answer 1

Following is the list of main attributes used in SparkConf:

• set(key, value): This attribute is used for setting the configuration property.
• setSparkHome(value): This attribute enables the setting Spark installation path on worker nodes.
• setAppName(value): This attribute is used for setting the application name.
• setMaster(value): This attribute is used to set the master URL.
• get(key, defaultValue=None): This attribute supports getting a configuration value of a key.