Skip to content

Exporting Files

You can create export jobs to export data from Spectrum to other connections such as a database, remote file server, or export results to a third-party BI (business intelligence) software package. Exported data is the result from executing analyses in a Workbook on the original data set. You can initiate a one-time manual export, or you can configure the job to run each time the Workbook is updated or at a specific time interval.

It is also possible to download data from Spectrum without using an export job.

Exporting to Amazon S3

Exporting to Amazon S3#

INFO

Learn more about Amazon's Simple Storage Service (S3) and its data consistency model.

INFO

Spectrum is not able to export Data without the permission PutObject and DeleteObject to the location one wants to export data to.

Exporting a Worksheet to S3#

To export a worksheet through an Amazon S3 connector:

  1. Click the "+"" button and choose "Export job" or right-click in the "File Browser" and select "Create New" then choose "Export Job".
  2. Select the Workbook to export from in the browser.
  3. Select the worksheet to export from the drop-down menu.
  4. Select the S3 connector and choose the file type used to export.
  5. Fill out the data details including path in the S3 file system.

    INFO: When the 'Replace data' checkbox is marked, if the data is being exported to an existing file path, the previous data is written over by the current export. If the data is being exported to a new file path, the previous data is not written over.

    Example:

    /exports/%year%%month%%day%T%hour%:%min%/12354-%id%.csv

    The above file is being written to a new directly each time the export job runs. A new file is created each time and the old file is not deleted.

    /exports/12354/%year%%month%%day%T%hour%%min%-%id%.csv

    The above file is being written to the same directly each time the export job runs. The incoming export job overwrites the previous export job.

  6. Look over the preview and select how to handle invalid data.

  7. Select the schedule method for when the export job runs.
  8. If needed, add a description and click "Save".
Exporting to Amazon S3 Native

Exporting to Amazon S3 Native#

INFO

S3 Native has multipart technology that use temporary files to improve performance. Learn more about Amazon's Simple Storage Service (S3) and its data consistency model.

Exporting a Worksheet to S3 Native#

To export a worksheet through the S3 Native connector:

  1. Click the "+"" button and choose "Export job" or right-click in the "File Browser" and select "Create New" then choose "Export Job".
  2. Select the Workbook to export from in the browser.
  3. Select the worksheet to export from the drop-down menu.
  4. Select the S3 Native connector.
  5. Under the S3 Options, check the bucket name and output filename.

    INFO: Learn more about the Multipart Upload API and Permissions on AWS documentation. Use the Export formatter to match your export to your S3 settings.

  6. Look over the preview and select how to handle invalid data.

  7. Select the schedule method for when the export job runs. Under "Advanced", add any custom Hadoop properties for the export job and define any logging customizations.
  8. Add a description if needed and , if needed, mark the "Export now" box to begin the export job directly after saving.
  9. Name and save the export job.

Interrupted Export Job#

If an export job is interrupted, run the export job again. AWS automatically reuses all parts exported before from the temporary files.

These temporary files use S3 disk space. AWS recommends setting up a policy to empty files periodically to save costs.

Exporting to OpenStack Swift Server

Exporting to OpenStack Swift Server#

Required Ports#

80 (HTTP) and/or 443 (HTTPS) need to be open to export data.

Exporting a Worksheet to a OpenStack Swift Server#

To export a worksheet through an OpenStack Swift Server connector:

  1. Click the "+"" button and choose "Export job" or right-click in the "File Browser" and select "Create New" then choose "Export Job".
  2. Select the Workbook to export from in the browser.
  3. Select the worksheet to export from the drop-down menu.
  4. Select the "OpenStack Swift" connector and choose a file type.
  5. Fill out the data details including where to export the file to and whether the data should be overwritten. Choose a maximum file size.
  6. Specify how to format the data in the export.
  7. Look over the preview and select how to handle invalid data.
  8. Select when the export job should run.
  9. If necessary, add a description and click "Save".