HomePresentationMy latest presentations

Comments

My latest presentations — 8 Comments

  1. Hi James,

    Going through the Azure Synapse Analytics deck, I can’t help but think the Apache Spark Runtime is very much in line with Azure Databricks. Is it “just” Databricks under the hood? If not, how would you externally orchestrate the execution of notebooks with something line Apache Airflow? Or even from with Azure Synapse Studio (Azure Data Factory).

    Tuan

    • Hi Tuan,

      The Apache Spark Runtime in Synapse is not Azure Databricks. Rather, it is the open source version of Spark. I’m not yet sure how you can execute Spark notebooks within Synapse from Airflow, but you can call them from Data Integration within Synapse. Data Integration is really just ADF so it works the same as calling notebooks from ADF.

      • Thanks James. That’s interesting. I wonder what Databricks think of that :-). So in ADF there’ll be an activity for executing a notebook against a Spark pool? I also wonder how you’ll develop notebooks and libraries locally and deploy using Azure DevOps. I’m guessing Synapse studio will hold notebooks in a workspace. I’m dying to give it a go but haven’t got access to create a workspace yet.

  2. Hi James,

    Thank you for sharing all these valuable information. Synapse is an exciting product and we hope that it makes it simple to do variety of workloads in one platform.

    I do have a question though, I recently came across this blog (https://www.blue-granite.com/blog/is-azure-sql-data-warehouse-a-good-fit-updated) which provides a well thought decision tree to decide whether SQL DW is an appropriate choice.

    Do you think this would change with Synapse? In fact we would love to see such a decision tree from Microsoft to help us to choose the right tool for different tasks.

    • I think Melissa’s decision tree would change a bit with Synapse, especially around using both non-relational and relational data, as Synapse makes it easy to use both. When Synapse GA’s, I’ll talk with Melissa about updating that tree as well as seeing if Microsoft can do one 🙂

  3. Hi, would it be possible to obtain a copy of “Azure Synapse Analytics Overview” presentation without having to register/download on SlideShare?

    If so, where would I find the download?

    thanks

Leave a Reply

Your email address will not be published. Required fields are marked *

HTML tags allowed in your comment: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>