Skip to content

Importing from a Web Service

Find all information and how-to import from web services here.

Supported Web Services#

Spectrum allows to import from:

  • Atlassian JIRA
  • Salesforce

Importing from a Web Service#

Atlassian JIRA#

To import data from Atlassian JIRA:

  1. Click the "+" button and choose "Import Job" or right-click in the File Browser and select "Create New" → "Import Job". The 'New Import Job' tab appears in the menu bar.

  2. Click "Select Connection". The dialog 'Select Connection' opens.

  3. Click on the connection for JIRA and confirm with "Select". The connection is displayed.

  4. Confirm with "Next". The tab 'Data Details' opens.

  5. Enter the JQL query in the section 'Issue Filter'.

  6. If needed, change the number of records used to auto-detect the type of a column and enter the column names to obfuscate and confirm with "Next". The tab 'Define Fields' opens.

  7. Mark all required columns.

  8. If needed, enter placeholder values and confirm with "Apply".

  9. Decide how to handle invalid data.

  10. Decide whether you want partition data and confirm with "Next". *The tab 'Schedule' opens.

    INFO: If you have checked 'Partition Data', enter a date expression and select the data format from the drop-down.

  11. Decide whether the import shall be triggered manually or on a schedule.

  12. Select the option for data retention.

  13. If needed, enter advanced scheduling configuration like the amount of sample records or the maximum amount of errors to log and confirm with "Next". The tab 'Schedule' opens.

    INFO: Higher values lead to more precise preview results but can rapidly decrease the performance.

  14. If needed, enter an import job description.

  15. Demark the checkbox if the import shall not start immediately after the saving.

    INFO: The check-box is marked per default to start the import right after saving the import job.

  16. If needed, enter the email address for several notifications and confirm with "Save". The 'Save Import Job' dialog opens.

  17. Select the path the data shall be imported to, enter a name and confirm with "Save". Data Import from JIRA is finished.

Salesforce#

Applicable Custom Properties#
Custom Property Example Value Default Value Description
datameer.plugin-webservice.read-timeout.ms 120000 (meets 2 minutes) 120000 sets a HTTP response data read timeout
datameer.salesforce.maxrecords-per-result-request 600000 determined by the Salesforce API endpoint specifies the maximum number of records within a batch
datameer.salesforce.max-parallel-result-request 2 1 specifies the maximum number of batches, that are fetched in parallel
Importing Data with the Salesforce Connector#

  1. Click the "+ (plus) button" and select "Import Job" or right-click in the File Browser and select "Create new > Import Job".

  2. Click "Select Connector", choose the Salesforce connector, and click "Next".

  3. Enter a search Salesforce Query (SOQL) and click "Next".

  4. Review the defined fields and click "Next".

  5. Review the schedule and advanced properties for the job and click "Next".

  6. Create a description for the import job and click "Save".