Download "Lakehouse data validation with Great Expectations in Microsoft Fabric"

Download this video with UDL Client
  • Video mp4 HD+ with sound
  • Mp3 in the best quality
  • Any size files
"videoThumbnail Lakehouse data validation with Great Expectations in Microsoft Fabric
play-icon
Table of contents
|

Table of contents

0:00
Coming up
0:29
Why this is so important
4:43
End-to-end project recap
5:37
Plan for this video
6:11
Intro to Great Expectations
8:00
NOTEBOOK 1 START: Installing Great Expectations
9:48
Setting up the GX Data Context
12:47
Adding data sources/ assets to the Context
15:07
Defining our tests (Expectations)
17:46
Defining and running a checkpoint
19:50
Initial look at results
21:37
IMPORTANT! Copying configuration to Lakehouse FIles
24:20
NOTEBOOK 2 START
24:57
Re-initialize data context from Files
26:03
Feeding in fresh data and running the validation
29:01
Handing the results
34:08
Wrapping up
Video tags
|

Video tags

data validation
microsoft fabric
data testing
great expectations
medallion architecture
data engineering
Power BI
extract transform load
business intelligence
lakehouse
data quality
onelake
fabric error messages
power bi error messages
data analytics
You already have UDL Helper installed You can download video in 1 click!
Installed
for
Google Chrome

Description:

10+ hours of FREE Fabric Training: https://www.skool.com/microsoft-fabric/classroom/d154aad4?md=3b108b0e216c46c88d891407ccd8647b End-to-end project playlist: https://www.youtube.com/playlist?list=PLug2zSFKZmV1BHk129X_2xi53ZRwQaTkb GitHub code for the notebooks: https://github.com/LearnMicrosoftFabric Great Expectations docs: https://docs.greatexpectations.io/docs/ When users spot errors in your data or dashboards, they lose trust immediately and it can be very hard to regain that trust. So in this video, we look at (in my biased opinion), THE most important part of any data analysis/ business intelligence/ data science workflow - data validation. We learn how to implement Great Expectations, an industry standard Python library for data testing and validation. The video contains two parts, with a separate notebook for each part: Part 1: Initial setup and configuration of Great Expectations within Microsoft Fabric Part 2: Notebook to run validation on new datasets (for example when loading and validating data between bronze and silver layers of a medallion architecture. --BROWSE MY OTHER FABRIC PLAYLISTS-- DATA ENGINEERING https://www.youtube.com/playlist?list=PLug2zSFKZmV1NvKfnRzG9e3Fl-8QLD5MK END-TO-END FABRIC PROJECT https://www.youtube.com/playlist?list=PLug2zSFKZmV1BHk129X_2xi53ZRwQaTkb INTRO TO MICROSOFT FABRIC https://www.youtube.com/playlist?list=PLug2zSFKZmV0Yaya7NxRQfrrPtfF2vj0K DATA FACTORY https://www.youtube.com/playlist?list=PLug2zSFKZmV3FkUFDxlyrfSJMQ3CeqyEF #microsoftfabric #lakehouse #datavalidation #greatexpectations --TIMELINE-- 0:00 Coming up 0:29 Why this is so important 4:43 End-to-end project recap 5:37 Plan for this video 6:11 Intro to Great Expectations 8:00 NOTEBOOK 1 START: Installing Great Expectations 9:48 Setting up the GX Data Context 12:47 Adding data sources/ assets to the Context 15:07 Defining our tests (Expectations) 17:46 Defining and running a checkpoint 19:50 Initial look at results 21:37 IMPORTANT! Copying configuration to Lakehouse FIles 24:20 NOTEBOOK 2 START 24:57 Re-initialize data context from Files 26:03 Feeding in fresh data and running the validation 29:01 Handing the results 34:08 Wrapping up --LINKEDIN-- Not following the LinkedIn page yet? Here's the link: https://www.linkedin.com/company/learnmicrosoftfabric/ --ABOUT WILL-- Hi, I'm Will! I'm hugely passionate about data and using it to create a better world. I currently work as a Consultant, focusing on Data Strategy, Data Engineering and Business Intelligence (within the Microsoft/Azure/Fabric environment). I have previously worked as a Data Scientist. I started Learn Microsoft Fabric to share my learnings on how Microsoft Fabric works and help you build your career and build meaningful things in Fabric. --SUBSCRIBE-- Not subscribed yet? You should! There are lots of new videos in the pipeline covering all aspects of Microsoft Fabric. https://youtube.com/@LearnMicrosoftFabric?sub_confirmation=1

Mediafile available in formats

popular icon
Popular
hd icon
HD video
audio icon
Only sound
total icon
All
* — If the video is playing in a new tab, go to it, then right-click on the video and select "Save video as..."
** — Link intended for online playback in specialized players

Questions about downloading video

question iconHow can I download "Lakehouse data validation with Great Expectations in Microsoft Fabric" video?arrow icon

    http://univideos.ru/ website is the best way to download a video or a separate audio track if you want to do without installing programs and extensions.

    The UDL Helper extension is a convenient button that is seamlessly integrated into YouTube, Instagram and OK.ru sites for fast content download.

    UDL Client program (for Windows) is the most powerful solution that supports more than 900 websites, social networks and video hosting sites, as well as any video quality that is available in the source.

    UDL Lite is a really convenient way to access a website from your mobile device. With its help, you can easily download videos directly to your smartphone.

question iconWhich format of "Lakehouse data validation with Great Expectations in Microsoft Fabric" video should I choose?arrow icon

    The best quality formats are FullHD (1080p), 2K (1440p), 4K (2160p) and 8K (4320p). The higher the resolution of your screen, the higher the video quality should be. However, there are other factors to consider: download speed, amount of free space, and device performance during playback.

question iconWhy does my computer freeze when loading a "Lakehouse data validation with Great Expectations in Microsoft Fabric" video?arrow icon

    The browser/computer should not freeze completely! If this happens, please report it with a link to the video. Sometimes videos cannot be downloaded directly in a suitable format, so we have added the ability to convert the file to the desired format. In some cases, this process may actively use computer resources.

question iconHow can I download "Lakehouse data validation with Great Expectations in Microsoft Fabric" video to my phone?arrow icon

    You can download a video to your smartphone using the website or the PWA application UDL Lite. It is also possible to send a download link via QR code using the UDL Helper extension.

question iconHow can I download an audio track (music) to MP3 "Lakehouse data validation with Great Expectations in Microsoft Fabric"?arrow icon

    The most convenient way is to use the UDL Client program, which supports converting video to MP3 format. In some cases, MP3 can also be downloaded through the UDL Helper extension.

question iconHow can I save a frame from a video "Lakehouse data validation with Great Expectations in Microsoft Fabric"?arrow icon

    This feature is available in the UDL Helper extension. Make sure that "Show the video snapshot button" is checked in the settings. A camera icon should appear in the lower right corner of the player to the left of the "Settings" icon. When you click on it, the current frame from the video will be saved to your computer in JPEG format.

question iconHow do I play and download streaming video?arrow icon

    For this purpose you need VLC-player, which can be downloaded for free from the official website https://www.videolan.org/vlc/.

    How to play streaming video through VLC player:

    • in video formats, hover your mouse over "Streaming Video**";
    • right-click on "Copy link";
    • open VLC-player;
    • select Media - Open Network Stream - Network in the menu;
    • paste the copied link into the input field;
    • click "Play".

    To download streaming video via VLC player, you need to convert it:

    • copy the video address (URL);
    • select "Open Network Stream" in the "Media" item of VLC player and paste the link to the video into the input field;
    • click on the arrow on the "Play" button and select "Convert" in the list;
    • select "Video - H.264 + MP3 (MP4)" in the "Profile" line;
    • click the "Browse" button to select a folder to save the converted video and click the "Start" button;
    • conversion speed depends on the resolution and duration of the video.

    Warning: this download method no longer works with most YouTube videos.

question iconWhat's the price of all this stuff?arrow icon

    It costs nothing. Our services are absolutely free for all users. There are no PRO subscriptions, no restrictions on the number or maximum length of downloaded videos.