Introduction to Big Data, End Term
What happens when a Spark Structured Streaming pipeline operating with Kafka as the source is subject to a machine failure?
What happens when a Spark Structured Streaming pipeline operating with Kafka as the source is subject to a machine failure? A company with headquarters (HQ) in the Middle East operates on a Sunday-Thursday weekday schedule with Friday \& Saturday as weekend days. It computes end of week revenue numbers by first computing sales for each day at 1AM local time of the next day, and then summing up the weekly sales every Sunday early morning at 3AM local time. This number gets reported to leadership every Sunday morning 9AM local time. As a result of management change, it has decided to relocate its HQ to India. Which of the following changes will need to be done to its ETL pipeline? In the class, we saw the UDF for mobilenet\_v2. Specifically, the predict() function contained the below lines of code Figure from the original question paper