Cloudera Exam CCA175 Topic 1 Question 42 Discussion

Actual exam question for Cloudera's CCA175 exam

Question #: 42
Topic #: 1

[All CCA175 Questions]

Problem Scenario 53 : You have been given below code snippet.

val a = sc.parallelize(1 to 10, 3)

operation1

b.collect

Output 1

Array[lnt] = Array(2, 4, 6, 8,10)

operation2

Output 2

Array[lnt] = Array(1,2, 4)

Write a correct code snippet for operation1 and operation2 which will produce desired output, shown above.

ASolution :
valb = a.filter(_%2==0)
a.filter(_ <4).collect
filter
Evaluates a boolean function for each data item of the RDD and puts the items for which the function returned true into the resulting RDD.
When you provide a filter function, it must be able to handle all data items contained in the RDD. Scala provides so-called partial functions to deal with mixed data types (Tip: Partial functions to deal are very useful if you have some data which may be bad and you do not want to handle but for the good data (matching data) you want to apply some Kind of map function. The following article is good. It teaches you about partial functions in a very nice way and explains why case has to be used for partial functions:article)
Examples for mixed data without partial functions
val b = sc.parallelize(1 to 8)
b.filter(_ <4)xollect
res15: Arrayjlnt] = Array(1, 2, 3)
val a = sc.parallelize(List('cat'\ 'horse', 4.8, 2.5, 2, 'dog'))
a.filter(_<4).collect
error: value < is not a member of Any

BSolution :
valb = a.filter(_%2==0)
a.filter(_ <4).collect
filter
Evaluates a boolean function for each data item of the RDD and puts the items for which the function returned true into the resulting RDD.
When you provide a filter function, it must be able to handle all data items contained in the RDD. Scala provides so-called partial functions to deal with mixed data types (Tip: Partial functions to deal are very useful if you have some data which may be bad and you do not want to handle but for the good data (matching data) you want to apply some Kind of map function. The following article is good. It teaches you about partial functions in a very nice way and explains why case has to be used for partial functions:article)
Examples for mixed data without partial functions
val b = sc.parallelize(1 to 8)
b.filter(_ <4)xollect
res15: Arrayjlnt] = Array(1, 2, 3)
val a = sc.parallelize(List('cat'\ 'horse', 4.0, 3.5, 2, 'dog'))
a.filter(_<4).collect
error: value < is not a member of Any

Show Suggested Answer

Suggested Answer: A

by Glendora at Apr 24, 2023, 03:43 PM

Limited Time Offer

25%

Off

Get Premium CCA175 Questions as Interactive Web-Based Practice Test or PDF

Contribute your Thoughts:

Submit Cancel

Currently there are no comments in this discussion, be the first to comment!