If you want to get a free copy of the Index, Table of Contents and of Chapter 1, have a look here. Click on the READ AN EXCERPT dropdown and then select the one you would like to review. Figure 1 illustrates how that looks like. Figure 1, how to get a free PDF copy […]
Read More →Category: Data Store
MCA Microsoft Certified Associate Azure Data Engineer Study Guide: Exam DP-203
I am proud to announce the publication of my newest book titled, “Microsoft Certified Associate Data Engineer Study Guide” for the DP-203 exam. The example data used in this book consists of my brainwaves. You can download the data and the source code for all the examples in the book on GitHub here . ADLS, […]
Read More →Use external Hive Metastore for Synapse Spark Pool
I wrote this article which is what helped me progress forward with this. External Apache Hive metastore, Azure Databricks, Azure SQL I am following these instructions. Here is the kicker, which is likely something most people may already know, but in order to make this configuration the Hive Metastore must already exist on the Azure […]
Read More →External Apache Hive metastore, Azure Databricks, Azure SQL
I was following this documentation and had some experiences I wanted to document. I wanted to accomplish this. Figure 1, External Apache Hive metastore using Azure Databricks and Azure SQL Figure 2, External Apache Hive metastore using Azure Databricks and Azure SQL The cluster version I used was the most current one. Figure 3, Azure […]
Read More →How to reprocess or retrigger a blob triggered Azure Function
Updating or reprocessing data is a big deal. For many companies, the intellectual property which exists in their data a lot of times not only drives the business forward, but it is the business. If that data gets corrupted or worse, lost, then the business can come to an end. When you are working with […]
Read More →JSON is slow, deserialization, DeserializationObject
The expected latency when downloading anything from a server to a client should increase as the size of the file increases. Simply, the bigger the file the longer it takes to download. There is a common step when writing an API that returns a JSON formatted file, which is the deserialization of the data content […]
Read More →How to install Entity Framework Core 2.1
I wrote this post about installing ASP.NET Core 2.1, plus these others which may be of interest: Create a .NET Core 2 application on Linux with Visual Studio Code How to enable C# 7 in Visual Studio 2017 How to install .NET Core 2.0 How to install .NET Standard 2.0 How to install ASP.NET Core […]
Read More →How to create a read only user for a SQL Azure database
I am updating, or should I say, re-coding a website I have from ASP.NET Web Forms (aspx) to ASP.NET Core Razor Pages (chtml). The database it connects to only has a global admin, full access user identity. So I thought that I would fix that and create a need account for read only access. This […]
Read More →How to connect to a database from an Azure Function
I created a simple Azure Function and now I want to connect it to a database. Check out these other articles as well. How to create an Azure Function in Visual Studio Deploy an Azure Function created from Visual Studio Check out all my Azure Function articles here I found this article also useful “Code […]
Read More →ASP.NET Core with Entity Framework Core – ASPNETCORE_ENVIRONMENT
This is another one, Figure 1, that just kind of happened because I dropped my database. Once I re-created the database and my ASP.NET Core application could access it, all was back to normal. Figure 1, ASPNETCORE_ENVIRONMENT environment variable to Development, and restarting the application. Error. An error occurred while processing your request. Development Mode […]
Read More →