Question 4
Which of the following statements about Spark application architecture is correct?
A Spark program generates a set of tasks that are grouped into stages, each of which executes concurrently with the driver being responsible for collecting results from each stage for final output.
A Spark action generates a job, with each job being broken down into multiple stages where a stage is a set of tasks that can be executed in parallel and stages themselves are interdependent, with each task being the unit of work mapped to an executor.
A Spark program generates a job, with each job being broken down into multiple stages where a stage is a set of tasks that can be executed in parallel and stages themselves are interdependent, with each task being the unit of work mapped to an executor.
A Spark action generates a task that is further broken down into multiple stages where a stage is a set of jobs that can be executed in parallel and stages themselves are interdependent, with each job being the unit of work mapped to an executor.
A Spark program generates a task that is further broken down into multiple stages where a stage is a set of jobs that can be executed in parallel and stages themselves are interdependent, with each job being the unit of work mapped to an executor.