Microsoft Connect(); is a developer event from Nov 15-17, where plenty of announcements are made. Here is a summary of the data platform related announcements: Azure Databricks: In preview, this is a fast, easy, and collaborative Apache Spark based analytics platform optimized … Continue reading →
Better late than never: The Analytics Platform System (APS), which is a renaming of the Parallel Data Warehouse (PDW), released an appliance update (AU6) about a year ago, and I missed the announcement. Below is what is new in this release, also called … Continue reading →
Azure SQL Database Managed Instance is a new flavor of Azure SQL Database that is a game changer. It offers near-complete SQL Server compatibility and network isolation to easily lift and shift databases to Azure (you can literally backup an … Continue reading →
There were so many good presentations at Microsoft Ignite, all of which can be viewed on-demand. I wanted to list the big data related presentations that I found the most useful. It’s a lot of stuff to watch and with … Continue reading →
There are a tremendous amount of Microsoft products that are cloud-based for building big data solutions. It’s great that there are so many products to choose from, but it does lead to confusion on what are the best products to … Continue reading →
I just uploaded a new presentation called “What’s new in SQL Server 2017”. It covers all the new features in SQL Server 2017 (which went GA this past Monday), as well as details on upgrading and migrating to SQL Server … Continue reading →
Many product announcements were made this week at Microsoft Ignite, and I wanted to give a quick overview of all the data platform related announcements: SQL Server 2017 on Linux, Windows, and Docker, generally available on October 2nd. SQL Server … Continue reading →
In SQL Server, scaling out reads (i.e. using Active secondary replicas via AlwaysOn Availability Groups) is a lot easier than scaling out writes. So what are your options when you have a tremendous amount of writes that scaling up will not handle, … Continue reading →
Last week Microsoft released a public preview of a new service called Azure Archive Blob Storage, offering customers a lower-cost cloud storage solution for rarely accessed data. This allows for storage tiering, where organizations can place their critical data on expensive, … Continue reading →
Data virtualization goes by a lot of different names: logical data warehouse, data federation, virtual database, and decentralized data warehouse. Data virtualization allows you to integrate data from various sources, keeping the data in-place, so that you can generate reports … Continue reading →
I previously blogged about Microsoft certification changes, and since then there have been some new Microsoft Big Data certifications exams released: Already live: 70-773: Analyzing Big Data with Microsoft R 70-774: Perform Cloud Data Science with Azure Machine Learning 70-775: Perform … Continue reading →
Microsoft has released a preview of the Azure Analysis Services web designer. This is a browser-based experience that will allow developers to start creating and managing Azure Analysis Services (AAS) semantic models quickly and easily. SQL Server Data Tools (SSDT) … Continue reading →
Azure SQL Data Sync has been ignored for quite some time, but has finally gotten an update (it’s in public preview). This release includes several major improvements to the service including new Azure portal support, PowerShell and REST API support, … Continue reading →
Microsoft has introduced two new disk sizes for Azure IaaS VMs in P40 (2TB) and P50 (4TB) for both managed and unmanaged Premium Disks and S40 (2TB) and S50 (4TB) for both managed and unmanaged Standard Disks. This enables customers … Continue reading →
I have blogged before about data lakes (see What is a data lake? and Why use a data lake?), and wanted to provide more details on this popular technology, some of which I cover in my presentation “Big data architectures and the data lake“. … Continue reading →
I have been working at Microsoft now for 3 years and 4 months (side note: it’s by far the best company I have ever worked for). You would think by now I know about every Azure product, but we release … Continue reading →
The Data Science Virtual Machine (DSVM) is a customized VM image on Microsoft’s Azure cloud built specifically for doing data science. It has many popular data science and other tools pre-installed and pre-configured to jump-start building intelligent applications for advanced … Continue reading →
I had previously blogged about the Data Warehouse Fast Track for SQL Server 2016, a joint effort between Microsoft and its hardware partners to deliver validated, pre-configured solutions that reduce the complexity of implementing a data warehouse on SQL Server … Continue reading →
If you are looking at providing high availability (HA) for SSAS, here are 3 options: Install SSAS on a Windows Server Failover Cluster (WSFC) Here’s a good article. The main issue with this option is that SSAS isn’t cluster-aware, so … Continue reading →
With so many product options to choose from for building a big data solution in the cloud, such as SQL Data Warehouse (SQL DW), Azure Analysis Services (AAS), SQL Database (SQL DB), and Azure Data Lake (ADL), there are various combinations … Continue reading →