Posted on / by Azka Naqvi / in PowerApps

What’s New in Dataflows in Power Apps?

Microsoft has released a number of new features in Dataflows over the past few weeks. These features allow users to ingest and prepare data seamlessly that can be used by other Power Platform Users as well. These new Features Include:

New Data Connectors

  • SharePoint Folder.
  • Local Folder.
  • HDInsight Spark.
  • Google BigQuery.
  • Generic ODBC.
  • Apache Spark.

New Data Transformations

  • Additional Numbers/Date/DateTime/Duration Transformation UX.
  • Combine File UX.

Other Authoring Enhancements

  • Query Parameters UX.
  • Function Authoring UX.
  • Data Profiling.

Let’s take a look at each of these new Features:

New Data Connectors

Folder:

This Connector can be used to ingest data and files from any local or network-based file system. This can also be used to query or analyze a file’s metadata.

SharePoint Folder:

It can be used for similar purposes as the previous one but this one is available on top of the SharePoint folder either online or on-premises.

HDInsight Spark:

Ability to read Tables from HDInsight Spark Databases.

Generic ODBC:

Enables you to plug in any ODBC driver, specify DNS or connection string and connect your Dataflows to import as well as transform data from different data sources.

Apache Spark:

It allows you to read tables from an Apache Spark Database which can either be in premises or on cloud-based storage.

You can access these new connectors from the Power Query Online Get Data experience in Dataflows.

New Data Transformations

  • Additional Numbers/Date/DateTime/Duration Transformation UX:

Microsoft has added UX support for a number of Date/DateTime/Numbers/Duration transformations on the Toolbar. Power Query Editor can be used to access these operations and this makes it very easy to work with queries that got scalar values of any type. Number Transformations can be Standard and scientific type, Date Transformations include Age, Year, Date only, Quarter, Month, Day, Week and Time Transformations can be Time Only, Minutes, Hours, Seconds, etc.

Combine Files:

One of the most common scenarios with Data Preparation Consists of Combining data from multiples files onto a folder in order to have a unified logical View of the Table. For Example, one such possibility could be to easily append files from a folder that got the same schema but contains data for different time periods in rows while dropping files in the same location on a regular basis. This can now be accomplished with Dataflows easily with the help of Folder or SharePoint Folder connectors or on top of some tubular result from Power Query that has a column for Binary Data.

Other Authoring Enhancements

  • Query Parameters UX:

This new feature enables users to easily define one or a number of parameters to be applied and used in their Dataflows. This can be done by using the Manage Parameters Dialogue on the Power Query Editor which can be accessed from the toolbar. Users can create parameters and enter metadata or apply settings for each parameter like Parameter Name, Parameter Description, Parameter Type, etc.

  • Function Authoring UX:

With the recent updates, Microsoft has made it increasingly easy to author functions on Power Query without the need of writing even a single line of code. Users now got the Create Function option to create a function based on an existing query.

  • Data Profiling:

Data profiling capabilities are now part of the Power Query Online platform. These help authors of Dataflows to easily understand the data and create such data entities that can be used by different users of an organization. Hundreds of Data Transformations are available with Power Query that can be used by users to clean and reshape data to their desired form.

Leave a Reply

Web Design and Website Development Agency New York, United States, USA, India