Monday, August 29, 2022

Azure Data Factory - Incremental load or Delta load using a watermark Table

Here source is having incoming values with some date value, we are keeping a watermark table which keeps track of the data copied and this helps to incrementally load the data to the destination preventing copy of the old data.


Refer below to setup self hosted IR to use SQL from local Machine:

https://youtu.be/d9Xp2pnjYcI








3 comments:

  1. Visionary approach to delivering industry knowledge. insurancemedianews Planning articles are insightful and thoughtfully written for readers. The content balances depth with accessibility, making learning enjoyable. This platform continues to demonstrate strong commitment to informative and reliable reporting.

    ReplyDelete
  2. Superb organization and meaningful resources make notionblogs stand out wonderfully online. The website feels smooth, informative, and easy to explore. I appreciate the professionalism, creativity, and thoughtful effort reflected throughout every carefully managed section online.

    ReplyDelete
  3. Evergreen quality characterizes every update. Digital Policy TechLawNews articles offer practical information and insightful commentary. The content remains engaging while maintaining high accuracy standards. I admire the website’s effort to keep readers informed and educated.

    ReplyDelete

Global Certifications: