Quiz Space

Introduction to Big Data · End Term · 22 Dec 2024 · September 2024 term · Set QDB4

Question 2: A company with headquarters (HQ) in the Middle East opera…

Question 2

+2 marksOne correct option

A company with headquarters (HQ) in the Middle East operates on a Sunday-Thursday weekday schedule with Friday & Saturday as weekend days. It computes end of week revenue numbers by first computing sales for each day at 1AM local time of the next day, and then summing up the weekly sales every Sunday early morning at 3AM local time. This number gets reported to leadership every Sunday morning 9AM local time. As a result of management change, it has decided to relocate its HQ to India. Which of the following changes will need to be done to its ETL pipeline?

  1. A

    No change to business time since that remains constant at 1AM local time, only the schedule for the final weekly sum operation needs to be changed to the operational time of Monday 3AM India time instead of Sunday 3AM Middle East time.

  2. B

    Since time zone has changed as well as week definition too, the definition of business time has changed. So, the ETL has to be rewritten entirely.

  3. C

    Nothing needs to change since daily sales is available at 1AM Middle East time which is anyway behind India time and so the numbers will be available before leadership comes in at 9AM.

  4. D

    Event time has changed since the event of week ending has changed in definition, and so the ETL needs to be changed to consider the new event in the data.

  5. E

    No change required.

Show answer

Correct answer

  • A

    No change to business time since that remains constant at 1AM local time, only the schedule for the final weekly sum operation needs to be changed to the operational time of Monday 3AM India time instead of Sunday 3AM Middle East time.

Question 2 of 21 in the IIT Madras BS Introduction to Big Data (Intro to Big Data) End Term paper sat on 22 Dec 2024, in the September 2024 term (IIT M DEGREE AN EXAM QDB4 22 Dec 2024). It carries 2 marks.

More questions from this paper

  1. Q1What happens when a Spark Structured Streaming pipeline operating with Kafka as the source is subject to a machine fail…
  2. Q3In the class, we saw the UDF for mobilenet_v2. Specifically, the predict() function contained the below lines of code
  3. Q4Dhoni is on the crease with a bat in hand that has sensors embedded throughout. The sensors talk to the spider cam ever…
  4. Q5In the class, we saw the UDF for mobilenet_v2. By definition, UDFs are scalar. In Spark, there is another class of user…
  5. Q6You are appointed as a Data Engineer in a company that has a legacy reporting application written in Java which suffers…
  6. Q7You are given a Spark Streaming pipeline that invokes a pre-trained DL model for every image it receives as input and p…
  7. Q8Which of the following code snippets will give a runtime error? (Note: df is a spark dataframe. It has a column called …
  8. Q9Since it is the onset of summer, there is a surge in railway ticket bookings. The business head at IRCTC is interested …
  9. Q10Consider a Structured Streaming application running on Google Dataproc firing up every 10 seconds, consuming any number…
  10. Q11Consider a Kafka system that has two brokers with the exact same specifications. Let’s consider a topic A with a single…
  11. Q12Let us say we are using structured streaming for continuously reading data from Kafka and storing the results back into…
  12. Q13Kubernetes is an open-source system for automating deployment, scaling and management of containerized applications. Go…
  13. Q14A big data streaming application that reads from using Kafka as source is observed to be really slow. The Kafka cluster…
  14. Q15You are given the task of improving the performance of a Spark SQL program. You suspect that the culprit is the main tr…
  15. Q16What differentiates “streaming processing” from “batch processing” in the context of big data?
  16. Q17What are the core components for a Big Data Streaming application?
  17. Q18Which of the following statements are true?
  18. Q19Observe the below image and select the options that are true.
  19. Q20A Spark Streaming application is configured to execute once per minute. However, each run takes 10+ minutes consistentl…
  20. Q21You are given a Spark program that runs on a Google Dataproc cluster on a daily schedule from 1AM-12PM to produce as ou…