If you want to get a free copy of the Index, Table of Contents and of Chapter 1, have a look here. Click on the READ AN EXCERPT dropdown and then select the one you would like to review. Figure 1 illustrates how that looks like. Figure 1, how to get a free PDF copy […]
Read More →Category: Big Data
MCA Microsoft Certified Associate Azure Data Engineer Study Guide: Exam DP-203
I am proud to announce the publication of my newest book titled, “Microsoft Certified Associate Data Engineer Study Guide” for the DP-203 exam. The example data used in this book consists of my brainwaves. You can download the data and the source code for all the examples in the book on GitHub here . ADLS, […]
Read More →LSRServiceException – Could not find Linked Service, the linked service does not exist or is not published
I only had 1 SparkPool which was provisioned using Apache Spark version 3.1. So when I created my Regression Azure Machine Learning model it defaulted to that Spark Pool. When I clicked on the Create run button, after some moments, I received the following error… Figure 1, Could not find Linked Service, the linked service […]
Read More →Use external Hive Metastore for Synapse Spark Pool
I wrote this article which is what helped me progress forward with this. External Apache Hive metastore, Azure Databricks, Azure SQL I am following these instructions. Here is the kicker, which is likely something most people may already know, but in order to make this configuration the Hive Metastore must already exist on the Azure […]
Read More →External Apache Hive metastore, Azure Databricks, Azure SQL
I was following this documentation and had some experiences I wanted to document. I wanted to accomplish this. Figure 1, External Apache Hive metastore using Azure Databricks and Azure SQL Figure 2, External Apache Hive metastore using Azure Databricks and Azure SQL The cluster version I used was the most current one. Figure 3, Azure […]
Read More →