Download "Microsoft Fabric: Good Notebook Development Practices 📓 (End to End Demo - Part 8)"

Microsoft Fabric End to End Demo - Part 8 - Good Notebook Development Practices Notebooks can very easily become a large, unstructured dump of code with a chain of dependencies so convoluted that it becomes very difficult to track lineage throughout your transformations. With a few simple steps, you can turn notebooks into a well-structured, easy-to-follow repository for your code. In this video, we take a look at a few good practices when working with notebooks as a primary artifact type in your code-base. We'll look at things like using commentary within your notebooks, achieving modularization by structuring your logic into separate classes and functions, and defining "schemas as code" to be explicit about the data you're reading and writing. 00:00 Intro 00:12 Principles underpinning good notebook development 00:56 Methods to achieve good notebook development 02:27 Workspace artifact folder structure 05:27 Notebook structure demo - Commentary 06:19 Defining classes and functions 08:47 Consuming classes and functions - magic commands 09:36 Defining schemas as code 12:05 Consuming schemas when creating Delta tables 13:05 Roundup & Outro Useful links: 📖 Develop, execute, and manage Microsoft Fabric notebooks: https://learn.microsoft.com/en-us/fabric/data-engineering/author-execute-notebook 📖 Create folders in workspaces (preview): https://learn.microsoft.com/en-us/fabric/get-started/workspaces-folders Series contents: 👉 Part 1 - Lakehouse & Medallion Architecture - https://www.youtube.com/watch?v=x_CvCwSbRZI&list=PLJt9xcgQpM61fxyB1aWzWCAEsHZHEZD6w&index=1&ab_channel=endjin 👉 Part 2 - Planning and Architecting a Data Project - https://www.youtube.com/watch?v=miDa4FZY7GU&list=PLJt9xcgQpM61fxyB1aWzWCAEsHZHEZD6w&index=2&ab_channel=endjin 👉 Part 3 - Ingest Data - https://www.youtube.com/watch?v=yptYlWLsVYk&list=PLJt9xcgQpM61fxyB1aWzWCAEsHZHEZD6w&index=3&ab_channel=endjin 👉 Part 4 - Creating a shortcut to ADLS Gen2 in Fabric - https://www.youtube.com/watch?v=11urrDAW-bU&list=PLJt9xcgQpM61fxyB1aWzWCAEsHZHEZD6w&index=4&ab_channel=endjin 👉 Part 5 - Navigating OneLake data locally - https://www.youtube.com/watch?v=DO779ZcAtTk&list=PLJt9xcgQpM61fxyB1aWzWCAEsHZHEZD6w&index=5&ab_channel=endjin 👉 Part 6 - Role of the Silver layer in the Medallion Architecture - https://www.youtube.com/watch?v=pCTl-nqDT_8&list=PLJt9xcgQpM61fxyB1aWzWCAEsHZHEZD6w&index=6&ab_channel=endjin 👉 Part 7 - Processing Bronze to Silver - https://www.youtube.com/watch?v=s_mHaLBlA94&list=PLJt9xcgQpM61fxyB1aWzWCAEsHZHEZD6w&index=7&ab_channel=endjin 👉 Part 8 - Good practices for Notebooks in Fabric - THIS VIDEO! 👉 Part 9 - Projecting Silver to Gold - COMING SOON! If you want to learn more about Fabric, take a look at some of our other content: 👉 Perspectives on #MicrosoftFabric: https://endjin.com/what-we-think/talks/perspectives-on-microsoft-fabric 👉 A Tour Around #MicrosoftFabric: https://endjin.com/what-we-think/talks/a-tour-around-microsoft-fabric 👉 Introduction to #MicrosoftFabric: https://endjin.com/blog/2023/05/intro-to-microsoft-fabric and find all the rest of our content here: https://endjin.com/blog/2023/05/microsoft-fabric-announced