Figure from the original question paper

(A) The given programs are an example of ETL and will be bottlenecked on thestring split happening on the Python VM.

(D) Rewriting the string split to use native PySpark dataframe string functions willbe best suited for performance.

(B) The given programs are together an example of ELT that maximally utilizesthe Spark cluster and no further performance optimizations are required.

(C) By moving the string split into PySpark driver program, I can get rid of thePython program and thus make the program an ELT.

Introduction to Big Data · End Term · 13 Apr 2025 · January 2025 term · Set 1-2

Intro to Big Data End Term 13 Apr 2025 — Question 19

Question 19

+4 marksOne or more correct options

Select all that apply.

A
The given programs are an example of ETL and will be bottlenecked on thestring split happening on the Python VM.
B
The given programs are together an example of ELT that maximally utilizesthe Spark cluster and no further performance optimizations are required.
C
By moving the string split into PySpark driver program, I can get rid of thePython program and thus make the program an ELT.
D
Rewriting the string split to use native PySpark dataframe string functions willbe best suited for performance.

Show answer

Correct answers

A
The given programs are an example of ETL and will be bottlenecked on thestring split happening on the Python VM.
D
Rewriting the string split to use native PySpark dataframe string functions willbe best suited for performance.

See the whole paper Take it as a mock test

Question 19 of 20 in the IIT Madras BS Introduction to Big Data (Intro to Big Data) End Term paper sat on 13 Apr 2025, in the January 2025 term (IIT M IMPROVEMENT FN EXAM QIM2 13 Apr). It carries 4 marks.

Intro to Big Data End Term 13 Apr 2025 — Question 19

Question 19

More questions from this paper