Which of the following code blocks concatenates rows of DataFrames transactionsDf and transactionsNewDf, omitting any duplicates?
DataFrame.unique() and DataFrame.concat() do not exist and union() is not a method of the SparkSession. In addition, there is no union option for the join method in the DataFrame.join() statement.
More info: pyspark.sql.DataFrame.union --- PySpark 3.1.2 documentation
Static notebook | Dynamic notebook: See test 2, Question: 43 (Databricks import instructions)
Currently there are no comments in this discussion, be the first to comment!