{"id":90891,"date":"2021-05-11T17:00:12","date_gmt":"2021-05-11T17:00:12","guid":{"rendered":"https:\/\/www.red-gate.com\/simple-talk\/?p=90891"},"modified":"2024-09-03T20:15:20","modified_gmt":"2024-09-03T20:15:20","slug":"power-query-transforming-desktop-queries-in-dataflows","status":"publish","type":"post","link":"https:\/\/www.red-gate.com\/simple-talk\/blogs\/power-query-transforming-desktop-queries-in-dataflows\/","title":{"rendered":"Power Query: Transforming Desktop Queries in Dataflows"},"content":{"rendered":"

.There are some interesting ways to transform queries from Power BI Desktop to Power BI dataflows in the portal.<\/p>\n

The UI can be a bit confusing. I made some mistakes in the middle as well. Let\u2019s see some options to make the conversion.<\/p>\n

Leaving Blank Query Blank<\/h2>\n
    \n
  1. Create a new dataflow<\/li>\n
  2. Select Blank Query as the source<\/li>\n<\/ol>\n

    <\/p>\n

      \n
    1. Select the gateway used to access the on premise servers<\/li>\n<\/ol>\n

      <\/p>\n

      It seems strange to select a gateway for a blank query. This makes the UI a bit confusing. However, the gateway will be set for the entire dataflow, not only for the blank query<\/p>\n

        \n
      1. On Power BI Desktop, copy the query you would like to convert<\/li>\n
      2. Use CTRL+V on the keyboard to past the query to the Query Window, inside the dataflow<\/li>\n
      3. Click the button Configure Connection<\/em> to define the credential for the query<\/li>\n<\/ol>\n

        <\/p>\n

        Since you already selected the gateway, if the server and database name are configured with the same case as in the gateway, Power BI will recover the authentication information from the gateway automatically.<\/p>\n

        <\/p>\n

        If the case of server and database name is different, it\u2019s better to edit the code first, ensure the case of the server and database name are correct and define the credential later.<\/p>\n

        If you left the gateway empty, you may notice the button Configure Credential<\/em> will not recognize the gateway neither leave you an option to choose it.<\/p>\n

        <\/p>\n

        After having reach the query editor, if you need to change the gateway it needs to be done on the dataflow level. On the menu, Home -> Options -> Project Options<\/em> allows you to set the gateway<\/p>\n

        <\/p>\n

        <\/p>\n

        Blank Query for a single Query<\/h2>\n

        If you would like to convert a single query, you don\u2019t need to get into the query editor. This small secret seems so simple, but it\u2019s not so obvious.<\/p>\n

        Once you select the Blank Query as source, you can past your query from the Power BI desktop in the code area. Power BI will be responsible to understand what you are pasting and will include the code of your query.<\/p>\n

        <\/p>\n

        You still need to define the gateway on the option for this on the same screen.<\/p>\n

        Blank Query for Multiple Queries<\/h2>\n

        This is a combination of the previous methods and there are two ways to do it:<\/p>\n

          \n
        1. First method: add a dummy blank query and past the desktop queries on the editor later. You have the option to choose the gateway for the blank query or configure the gateway later, on the project options for the dataflow<\/li>\n
        2. Second method: create a useful first query, choosing one of your on-premise queries, anyone, and past it on the code area of the first blank query. Then you past the rest on the query area, inside the query editor. You will need to choose the gateway for the first query.<\/li>\n<\/ol>\n

          Web Source<\/h2>\n

          The message you receive when migrating one query using web source from the desktop to a dataflow may appear to be different, but it\u2019s very simple: The Web source requires a gateway. You need to have a gateway with the Web source configured so it will work inside a data flow as well.<\/p>\n

          <\/p>\n

          <\/p>\n

          Functions<\/h2>\n

          When we copy a query using custom M functions, Power BI copy the function as well.<\/p>\n

          Power BI Desktop organizes the functions in folders and for each function we have one query. We can edit the query visually without touching the function code.<\/p>\n

          In the dataflow, on the other hand, only the function is copied. Any future edit will need to be made on the function code.<\/p>\n

          <\/p>\n

          One additional detail: On the desktop, we disable the load of the function query and it works fine. In a dataflow, the function will be imported with Enable Load<\/em> activated and we probably would like to disable it.<\/p>\n

          In fact, if we don\u2019t disable it, the query using the functions may become a computed table, making the refresh only available on premium. Once we disable the load of the functions, the table becomes a regular query and the refresh may be allowed.<\/p>\n

          <\/p>\n

          <\/p>\n

          \nExternal Tool<\/h2>\n

          Marcus Wegener (@PowerBIler<\/a>) created an external tool which exports all queries from a power BI file and allow us to import as a dataflow.<\/p>\n

          The tool exports the queries as a JSON file. We will be able to use the option Import Model<\/em> to create a new dataflow on the portal<\/p>\n

          <\/p>\n

          The external tool is included in the Business Ops<\/a> tool, which help us to install many very interesting and important external tools in Power BI at once.<\/p>\n

          There are some differences between the tool and the simple copy and paste, especially in relation to the validation of the query. Anyway, I\u2019m still trying to understand to what scenario each one will be better.<\/p>\n

          Conclusion<\/h2>\n

          Although everything starts with a Copy\/Paste, transferring Power BI queries from desktop to the portal has some tricks and secrets.<\/p>\n

           <\/p>\n","protected":false},"excerpt":{"rendered":"

          .There are some interesting ways to transform queries from Power BI Desktop to Power BI dataflows in the portal. The UI can be a bit confusing. I made some mistakes in the middle as well. Let\u2019s see some options to make the conversion. Leaving Blank Query Blank Create a new dataflow Select Blank Query as……<\/p>\n","protected":false},"author":50808,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[2,159166],"tags":[4472,101611,143554],"coauthors":[6810],"class_list":["post-90891","post","type-post","status-publish","format-standard","hentry","category-blogs","category-powerbi","tag-dataflow","tag-power-bi","tag-power-query"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/posts\/90891","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/users\/50808"}],"replies":[{"embeddable":true,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/comments?post=90891"}],"version-history":[{"count":1,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/posts\/90891\/revisions"}],"predecessor-version":[{"id":90906,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/posts\/90891\/revisions\/90906"}],"wp:attachment":[{"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/media?parent=90891"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/categories?post=90891"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/tags?post=90891"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.red-gate.com\/simple-talk\/wp-json\/wp\/v2\/coauthors?post=90891"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}