Azure

Modern data architecture is necessary for organizations trying to remain competitive. It is not a choice. Organizations are finding it difficult to use the exponentially expanding amounts of data effectively. Importance of Modern Data Architectures Modern data architectures remain relevant, considering that they offer businesses and foster a systematic way of dealing with large quantities of data and, in return, make faster and quicker decisions. Modern businesses rely on these architectures because they provide real-time processing, powerful analytics, and numerous…

Neon is now available on the Azure marketplace. The new integration between Neon and Azure allows you to manage your Neon subscription and billing through the Azure portal as if Neon were an Azure product. Azure serverless and Neon are a natural combination — Azure serverless frees you from managing your web server infrastructure. Neon does the same for databases, offering additional features like data branching and vector database extensions. That said, let’s try out this new integration by building…

Most of the e-commerce applications are zero-tolerant of any downtime. Any impact on application resources can impact the overall availability metrics of the site. Azure Cosmos database is one of the major NoSQL databases used across the industry. Though the Azure Cosmos itself provides 99.99% minimum availability for a single region without an availability zone, how do we further improve the database availability with the options available in the Azure Cosmos? Multi-Region Read and Write Single-region reads will impact the…

When we are working with a database, optimization is crucial and key in terms of application performance and efficiency. Likewise, in Azure Cosmos DB, optimization is crucial for maximizing efficiency, minimizing costs, and ensuring that your application scales effectively. Below are some of the best practices with coding examples to optimize performance in Azure Cosmos DB. 1. Selection of Right Partition Key Choosing an appropriate partition key is vital for distributed databases like Cosmos DB. A good partition key ensures that…

Azure storage accounts are a cornerstone for data storage solutions in the Azure ecosystem, supporting various workloads, from storing SQL backups to serving media files. Automating tasks like deleting outdated or redundant blobs from storage containers can optimize storage costs and ensure efficiency.  This guide will walk you through using PowerShell to safely and effectively delete blobs from an Azure storage account. Whether you’re managing SQL backups, application logs, or other unstructured data, this process can be applied to a…

In this article, we will learn about DevOps and how it is different from the Agile methodology. We will also cover some popular DevOps tools and their roles in the DevOps lifecycle.  You Will Learn What is Docker, Kubernetes, and Azure DevOps What is DevOps and why do we need it? How is DevOps different from Agile? What are some important DevOps tools? How does Docker help DevOps? How does Kubernetes help DevOps? How does Azure DevOps help DevOps? What…

Disclaimer: All the views and opinions expressed in the blog belong solely to the author and not necessarily to the author’s employer or any other group or individual. This article is not a promotion for any cloud/data management platform. All the images and code snippets are publicly available on the Azure/Databricks website. In my other DZone articles, I have discussed what Databricks Unity Catalog is, how the privilege model works in Unity Catalog, schema level, and script to automate permission management at both the catalog…

Disclaimer: All the views and opinions expressed in the blog belong solely to the author and not necessarily to the author’s employer or any other group or individual. This article is not a promotion for any cloud/data management platform. All the images and code snippets are publicly available on the Azure/Databricks website. In this article, I will provide the script to automate permission management at the Unity Catalog schema level. Privileges at the Unity Catalog Schema Level Unity Catalog privilege model The hierarchal privilege model…

Disclaimer: All the views and opinions expressed in the blog belong solely to the author and not necessarily to the author’s employer or any other group or individual. This article is not a promotion for any cloud/data management platform. All the images and APIs are publicly available on the Azure/Databricks website. What Is Databricks Lakehouse Monitoring? In my other articles, I have described what Databricks and Unity Catalog are, and how to create a catalog from scratch using a script. In…