Data On Cloud
This blog contains article, tips and tricks for data engineering projects on Azure Cloud.
Wednesday, 21 October 2020
Reuse logic/code in Databricks Notebook
›
Databricks is great tool and it make processing of large amount of data very easy. While designing Databricks workflow, I came across the ne...
Sunday, 4 October 2020
ADF Copy Activity to Oracle Error-"Error tolerance exceeded. Bulk load operation terminated"
›
Recently I have have been copying data from Azure Data Factory Copy activity to Oracle (on-premise) using Self-Hosted IR. After few days sta...
1 comment:
Friday, 12 June 2020
Query to get resource class of user in Azure Synapse
›
I struggled a bit find to find which user is assigned to which resource class in Azure Synapse. After short effort I prepare this query to ...
1 comment:
Friday, 5 June 2020
AssertionError: col should be Column (Azure Databricks)
›
You get the error " AssertionError : col should be Column " when you try to add column to DataFrame. df_col = df_col.withColum...
Tuesday, 24 March 2020
Issue while connecting Azure Data Factory (v2) to Azure Data Lake Gen2 using Managed Service Identity (MSI)
›
Issue while connecting Azure Data Factory (v2) to Azure Data Lake Gen2 using Managed Service Identity (MSI) Usually documentation of ...
›
Home
View web version
