Introduction to Big Data End Term: 3 September 2023 (May 2023 term)

Select all that apply.

1. A

   Batch operates on a set of data elements taken together while streaming can also operate on a set of data elements as determined by the window

2. B

   Batch operates on data that is static while streaming operates on data that is dynamically changing

3. C

   Batch processing can assume data as fully specified and complete while streaming cannot make that assumption

4. D

   Batch processing is typically high latency while streaming processing is necessary for real-time latencies

5. E

   Both Streaming & Batch processing can operate on massively large data sets

Select all that apply.

1. A

   Use a message store that supports message replay so that no data is lost in processing.

2. B

   “Hot potato” principle is when the streaming application operates on data from cache (i.e. the hot area of memory) and therefore is able to produce very high throughput

3. C

   Hadoop is best suited for executing Streaming applications

4. D

   Use checkpointing when faced with mission-critical workloads that require 100% accuracy.

5. E

   Handle state pollution by restarting the persistent store software periodically.

Select all that apply.

1. A

   Create all tables as external tables.

2. B

   Ensure cost based optimizer (CBO) is ON.

3. C

   Partition all tables on the same key on which the aggregate is happening.

4. D

   Run ANALYZE on all tables.

5. E

   Cache the table in a step with actions ahead of the SQL statement that is the culprit.