Spectrum 1.2 - What's New#
Product Description Updates#
Spectrum now supports Amazon EMR 5.33.0 incl. Hive 2.3.7. HBase is excluded like for the former Amazon EMR releases.
Spectrum now supports Amazon EMR 6.3.0 incl. Hive 3.1.2. HBase is excluded like for the former Amazon EMR releases.
Data Warehouse Updates#
You can now ingest data directly into Spectrum via a Data Warehouse connection. Creating a connection and executing an import job is not needed separately. Amazon Redshift, MySQL and JDBC generic connections can be used for importing data via incremental processing.
Importing and exporting can be executed by a Snowflake connection, and via an Export Sheet. Only one Export Sheet is allowed per Workbook.
Workbook Updates#
If one is trying to create an invalid join definition, the join validation will give the user a hint why the join can not be created in a warning dialog.
When changing a formula sheet that points to another sheet, Spectrum now detects this changes and displays a dialog: The user can apply the changes to only the current column or to all columns. This dialog is only displayed, when when more than one column is affected.
Spectrum has now a new toolbar button to expand all column width to make all column names fully visible.
Data Export Updates#
You can now enter one SQL statement to be executed before performing an export in the section 'Pre-Hook' when configuring an export job. If the pre-hook fails, the whole export job will be failing. This will also fail, when the export job has a defined pre-hook statement but the job owner does not have the capability to enter it. Note that the SQL statement is not restricted in any way and it has no unintended effects.
You can now use the new placeholder '%partition%' for the target path and the file names for export jobs. This placeholder can only be used, when the source Workbook sheet is partitioned. When set, the placeholder will be replaced by the partition value returned by a partition filter which is configured in the configuration of the export job. At least, if a filter returns more than one partition, the export job will be creating a separate file or folder for each position.
Spectrum 1.1 - What's New#
User Interface Updates#
Some dialogs, e.g. the 'Create a Joined Sheet' have now an improved layout. Furthermore, some icons and backgrounds have more contrast and are more solid to give you a better user experience while using Spectrum. Also the colors are now matching our CI, e.g. in the Job Graph.
Product Description Updates#
Supported Cloud Distributions#
Spectrum now supports Amazon EMR 5.32.0 incl. Hive 2.3.7. HBase is excluded like for the former Amazon EMR releases.
Spectrum now supports Amazon EMR 6.2.0 incl. Hive 3.1.2. HBase is excluded like for the former Amazon EMR releases.
Connection Updates#
Creating a Snowflake Connection Without a Shared Access Signature#
It is now possible to generate the Shared Access Signature (SAS) for Snowflake connections that have Azure Blob Storage as the export environment out of the credentials. Therefore you don't have to insert the SAS anymore but only the Blob Storage Account, Blob Storage Container as well as the Blob Storage Credentials to create a connection.
Working with Workbooks Updates#
Auto-expanded Column Header#
When renaming a column, the column width is now expanded fully visible without any truncation. After finishing the renaming a column name that is longer than the column width will be truncated again for UI reasons.