You get the error "AssertionError: col should be Column" when you try to add column to DataFrame.
df_col = df_col.withColumn("UniqueID", hash(str(col)))
To solve this just import following and you should get rid of the error. Still did not found the cause but it worked. Will update as soon as cause is found.
from pyspark.sql.functions import *
Happy Coding!
df_col = df_col.withColumn("UniqueID", hash(str(col)))
To solve this just import following and you should get rid of the error. Still did not found the cause but it worked. Will update as soon as cause is found.
from pyspark.sql.functions import *
Happy Coding!
No comments:
Post a Comment