Question

How do you connect Azure Databricks to an Azure storage account?

Answer 1

1. Create a Storage Account and a private container in which you will upload a blob file.
3. Once you upload the blob file, select Generate SAS from the context menu.
5. Copy the blob SAS Token and save it for future use.
7. Make an Azure Databricks account. Now, click on Create and pick the subscription (if you have any) and the resource group name (if you have any). Select the location where you want to build these data bricks and then the pricing tier.
9. Click Review + Create, then wait for the validation to complete.
11. Once your validation is done, click Create.
13. Once your deployment is complete, click the Go to resource option.
15. Click on Launch Workspace, and it will redirect you to the Azure Databricks page.
17. Now, in the left pane, select Clusters and then Create Cluster, giving the cluster a name and selecting Standard as the Cluster-Mode.
19. Now you must start your cluster and ensure that it is operational.
21. In the left pane, right-click on workspace -> create -> notebook.
23. Now assign a name for the notebook, choose Scala as the default language, and choose the previous cluster you built before clicking on Create.
25. To connect your storage account, place the following code into the notebook.
27. val containerName = ""
29. val storageAccountName = ""
31. val sas = ""
33. val config = "fs.azure.sas." + containerName+ "." + storageAccountName + ".blob.core.windows.net"
35. dbutils.fs.mount(
37.   source = "wasbs://"+containerName+"@"+storageAccountName+".blob.core.windows.net/employe_data.csv",
39.   extraConfigs = Map(config -> sas))
41. val mydf = spark.read.option("header","true").option("inferSchema", "true").csv("/mnt/myfile")
43. display(mydf)
45. You've successfully connected your Azure DataBricks to your storage account if you can retrieve the relevant data.