Quiz Space

Intro to Big Data End Term: 22 December 2024, Set QDB4 (September 2024 term)

Question 1

+2 marksOne correct option

What happens when a Spark Structured Streaming pipeline operating with Kafka as the source is subject to a machine failure?

  1. A

    The data being processed when the failure happened will have produced partial results that result in incorrect outputs.

  2. B

    The pipeline will not be restarted automatically.

  3. C

    The pipeline will be restarted automatically by Spark which is able to pick up the exact data from Kafka which was being processed at the time of error

  4. D

    Spark will throw an error and halt

  5. E

    Spark will gracefully shut down, reboot that machine which failed and start the Structured Streaming pipeline again to continue from where it left off

Question 2

+2 marksOne correct option

A company with headquarters (HQ) in the Middle East operates on a Sunday-Thursday weekday schedule with Friday & Saturday as weekend days. It computes end of week revenue numbers by first computing sales for each day at 1AM local time of the next day, and then summing up the weekly sales every Sunday early morning at 3AM local time. This number gets reported to leadership every Sunday morning 9AM local time. As a result of management change, it has decided to relocate its HQ to India. Which of the following changes will need to be done to its ETL pipeline?

  1. A

    No change to business time since that remains constant at 1AM local time, only the schedule for the final weekly sum operation needs to be changed to the operational time of Monday 3AM India time instead of Sunday 3AM Middle East time.

  2. B

    Since time zone has changed as well as week definition too, the definition of business time has changed. So, the ETL has to be rewritten entirely.

  3. C

    Nothing needs to change since daily sales is available at 1AM Middle East time which is anyway behind India time and so the numbers will be available before leadership comes in at 9AM.

  4. D

    Event time has changed since the event of week ending has changed in definition, and so the ETL needs to be changed to consider the new event in the data.

  5. E

    No change required.

Question 3

+2 marksOne correct option

In the class, we saw the UDF for mobilenet_v2. Specifically, the predict() function contained the below lines of code

  1. A

    They check the syntax of the model function so that there are no errors

  2. B

    They load the model into memory so that the loop iteration over each image does not need to do the same operation again and again given model load times are prohibitively expensive for DL models

  3. C

    They invoke PyTorch libraries that have already been setup for model scoring on GCP using APIs embedded within the function

  4. D

    They are Map-style UDFs that make it an embarrassingly parallel computation thus making the execution parallelized and fast.

18 more questions in this paper

Sign in with Google — it is free — to see every question with its answer and explanation, practise it in learning mode, or take it as a timed mock test.

More on the Intro to Big Data End Term 22 Dec 2024 Set QDB4 paper

The IIT Madras BS Introduction to Big Data (Intro to Big Data) End Term paper sat on 22 Dec 2024, in the September 2024 term, set QDB4: 21 questions for 50 marks in 180 minutes. The first 3 questions are below. Sign in with Google — it is free — to see the whole paper with its answers and explanations, in learning mode or as a timed mock test.

FeatureIntro to Big Data End Term 22 Dec 2024 Set QDB4 at a glance
TermSeptember 2024 term
SubjectIntroduction to Big Data
Course codeBSDA5001
Questions21
Marks50
Duration180 min
MCQ13
MSQ8
Official paperIIT M DEGREE AN EXAM QDB4 22 Dec 2024
Negative markingNo negative marking.
Updated

Other sets that day

Same End Term, other subjects

More Intro to Big Data