Login to manage your account

Please enter a valid email address.
Forgot Password?
Please enter a valid password.
OR

Don't have an account yet? Sign up

Why should collect() be used cautiously in Spark?

  1. A It pulls the entire dataset to the driver, which can exhaust its memory
  2. B It is slower than count
  3. C It modifies the data
  4. D It requires a shuffle
Answer

It pulls the entire dataset to the driver, which can exhaust its memory

Writing results to storage or using take() for inspection avoids concentrating a distributed dataset on a single node.

All Big data MCQs

Login to manage your account

Please enter a valid email address.
Forgot Password?
Please enter a valid password.
OR

Don't have an account yet? Sign up as