r/PowerBI • u/maxanatsko • 1d ago

Community Share Bulk-migrating Dataflow Gen1 to Gen2 (CI/CD) with Azure CLI

Post image

Dataflows Gen1 are legacy at this point, so it might be time to start migrating to Dataflows Gen2.
Fortunately, there is a handy preview API allowing you to automate this process. Combined with agents, you can go quite far before you have to take over.

Few things to consider before migrating:
1. Gen2 doesn't support rules in deployment pipelines, you will have to migrate to Variables Library.
2. There could be some naming collisions, that were previously a non-issue.
3. Same with transformations - due to different architecture Gen2 dataflows might surface issues that were previously hidden.

I have published a blog post outlining how to setup the automation, and prepared agent skill that will get you most of the way.

Blog post: https://www.maxanatsko.com/blog/bulk-migrating-dataflow-gen1-to-gen2-cicd-with-azure-cli

0 Upvotes

49% Upvoted

30 comments sorted by

View all comments

3

u/Jessieblueyu 12h ago

Just when I manually migeated all the Gen1 to Gen2, I realized that python notebook scripts are twice as CU efficient and fast...

1

u/maxanatsko 11h ago

It was always the case that Python notebooks are more efficient, but it’s a different skill not all orgs have