Skip to content

Deploying Data to Snowflake

Deploying Views to Snowflake#

To deploy a view to Snowflake:

  1. In the Project's Workbench, click on the "Deploy to Snowflake" button on top of the Flow Area. The 'Deploy to Snowflake' dialog opens.

  2. Select "View".

  3. (Optional) Rename the view and enter a deploying message.

  4. Select the target destination from the list below and confirm with "Deploy Data". Deploying to Snowflake proceeds. The highlighted deployed view appears in the Flow Area. Datasets that are deployed to Snowflake maintain a visual link with the original dataset used to deploy it.

Deploying Tables to Snowflake#

To deploy a table:

  1. In the Project's Workbench, click on the "Deploy to Snowflake" button on top of the Flow Area. The 'Deploy to Snowflake' dialog opens.

  2. Select "Table".

  3. (Optional) Rename the view and enter a deploying message.

  4. Select the target destination from the list below and confirm with "Deploy Data". Deploying to Snowflake proceeds. The highlighted deployed table appears in the Flow Area. Datasets that are deployed to Snowflake maintain a visual link with the original dataset used to deploy it.

Scheduling Deploying Tables#

Scheduling the materialization from a Project allows you to keep your target Snowflake table up to date. Scheduling is possible for daily, weekly and customized deploying and is accessable and configurable in the 'Schedule' tab in the Inspector.

Requirements

To create a Snowflake task, a default warehouse is needed. If you don't have set up one, set up the default warehouse:

ALTER USER your_user SET DEFAULT_WAREHOUSE = your_warehouse;

The role that uses this warehouse needs the privileges 'EXECUTE' and 'MANAGE EXECUTE TASK':

GRANT EXECUTE TASK ON ACCOUNT TO ROLE your_role;
GRANT EXECUTE MANAGED TASK ON ACCOUNT TO ROLE your_role;

To configure scheduling:

  1. In the Inspector, switch to the "Deployment" tab.

  2. Click on the "Enable Scheduler" switch. The configuration options appear below.

  3. From the drop-down, select the repeat interval. You can select between 'Daily', 'Weekly' and 'Custom'. The configuration options adapt to the repeat interval.

  4. Adjust the configuration to your needs, e.g. when selecting 'Weekly', mark the days and set the time, select your timezone, and confirm with "Schedule". The configuration is displayed in the 'Schedule' tab.

Re-deploying Datasets#

Once you deployed your dataset to Snowflake you might need to re-deploy it again for several reasons:

  • applied transformations on Datameer views have been changed, deleted or added
  • the table depends on other datasets from other Projects (Note that using an asset from Project A as the source from Project B requires active maintenance when Project B is not scheduled.)

As soon as there are any reasons why the deployed view or table are out of sync with your Snowflake views and tables, the asset is highlighted in red in the Flow Area to let you know it is out of sync.

To redeploy an asset, select the asset and click on "Re-deploy to Snowflake". Re-deploying proceeds. The note from the snackbar confirms the successful re-deploying.