--- title: "2020" canonical: "https://docs.vaultspeed.com/space/VPD/3164667925/2020" format: markdown --- > Macro (excerpt) > > > Macro (toc) ### Version 4.2.1 Release date: 20/12/20 - Features: - Added support for **Multi-Active Many to Many Links** with a **subsequence **attribute. - **Metadata export**: Added a new menu item ‘metadata-export’, here you can create an export configuration by selecting which attributes you want to export, and then export the data of a specific release with that configuration. This extends the existing lineage export from the DV, the lineage export is removed from there and instead added as a predefined config on the new page. For an overview of all possible attributes which can be exported, take a look at [https://vaultspeed.atlassian.net/wiki/spaces/VPD/pages/3012853765](https://vaultspeed.atlassian.net/wiki/spaces/VPD/pages/3012853765). - The **DDL **generation now also includes files with **create schema **statements. This can be disabled by changing the new GENERATE_SCHEMA_DEFINITIONS parameter (DV level). - Added a** source Data Vault visualiser**: In the source graphical editor you can now switch to the source Data Vault visualiser (SDVV), this will show what the source will look like as a Data Vault model. If you are in an open release you will first have to generate an intermediate build which will calculate the DV model. The SDVV can show the model in icon mode and in table mode, you can switch between both by right clicking an object switch it and clicking the switch all button in the toolbar. - Added the possibility to **deploy to GIT**: All generated code can now also be deployed directly to GIT (see [https://vaultspeed.atlassian.net/wiki/spaces/VPD/pages/3013148700](https://vaultspeed.atlassian.net/wiki/spaces/VPD/pages/3013148700) for details). - Important changes: - User sessions are now browser based, so you can open VaultSpeed on as many tabs as you want without using up multiple active user slots. - Removed support for TLS1.0 and TLS 1.1 protocols. - Improved cookie security. - Added Auto-deploy for Spark SQL. - Added support for remote CDC with a DB link on SQL server. However, Linked servers are not yet supported by Azure Synapse, so this can not be used there for now. - added a new parameter `USE_IDENTIFIER_PREFIXES`, setting this parameter to 'N', will switch all default object name parameter values to use suffixes and will also move source identifiers in SAT’s to behind the object abbreviated names. It will also move the PIT config name to behind the Dv object name. This ensures that all objects related to a certain HUB are next to each other in alphabetical order. This can only be changed when there is not a Data Vault with a production date yet. - Delta generations can now also be used to generate FMC code. For initial loads, the new flow will only include the mappings for new objects. - quality of life changes: - Added a maintenance mode to indicate when an upgrade is in progress. - Added the possibility to test Kafka source connections. - Renamed the “PIT Objects” tab to “PIT templates” to reduce confusion. - Added the complete PIT object name to the PIT “DV objects” screen instead of only the object name and PIT template name. - On the generations page, if a dropdown only contains a single value it is automatically selected. - The latest releases are now automatically selected on the delta generations page. - In the business views page, allow searching on dv object name and business name. - Added a check to the BV lock button which makes sure that you cant lock a BV if there are double business names or faulty VSS templates. The button will show the cause of the issue when hovering over it. - Searching in source objects now also searches on the short and abbreviated names. - Moved the FMC and Auto deploy menu items into a more logical order. - Improved scaling of HUB grouping screen, it should now fill the available screen space better. - When hovering over non grouped HUBs in the HUB grouping screen, the original (src) hub name is now shown as well as the current hub name. This should make it easier to track down renamed HUBs for grouping. - Disabled GDPR hard delete button for Spark SQL Data Vaults, since deletes are not supported in that case. - added 2 new format masks: “DDMONYYYY” and “DDMONYYYY:HH24:MI:SS”. - Enabled parallel deployments for ODI and Oracle SQL. - The generation info is now shown on the auto deploy page (release names and dates). - Bug fixes: - Fixed deleted tables not getting ignored when checking for double names in the source. - Fixed opening the keys tab only showing the FK’s on the canvas of the source graphical editor instead of all the keys. - Fixed parameters screen showing “null” when entering “0” (only a visual issue, the correct value got stored). - Fixed load type selection on generations page taking a long time to load. - Fixed NHL names not getting locked after setting a production release. - Fixed new and deleted status not showing on the HUB groupings screen. - Fixed incorrect Detail PIT generation when one of the SAT’s in the PIT has no CDC and the transaction timestamp is chosen as the time attribute. - Fixed Mass storage indicator in the source graphical editor appearing multiple times next to an attribute. - Fixed PIT’s not including the subsequence number for multi-active SAT’s. ### Version 4.2.0 Release date: 02/11/2020 > ⚠️ redownload the agent (new jar name & updated client properties) + enable re-import for new source releases, also releases created before cannot be locked until the metadata is harvested again! - Features: - **New source graphical editor**: We revamped the source graphical editor such that it Looks & feels much better and is faster to load and work with. Take a look at our [https://vaultspeed.atlassian.net/wiki/spaces/VPD/pages/3013640220](https://vaultspeed.atlassian.net/wiki/spaces/VPD/pages/3013640220) and try it out yourself. The new features include: easier relation creation, better attribute filtering, better layout (in most cases), a “mini-map” for an overview of the overall structure, keyboard shortcuts (let us know if there are important actions we missed) and more. - Added **Spark SQL** support: Added a new target “database” type APACHE SPARK with ETL language Spark SQL, the actual object storage behind Spark can be Hive, Delta Lake, … This is only for batch mode for now, Spark streaming support is in the works. The DDL for spark can be generated together with the ETL for Spark. Auto-deploy is not yet possible, this will be added later. The ETL code is delivered in the form of SQL files (no procedures). The FMC uses a combination of JDBC(for mtd) and the Spark SQL CLI(for mappings) to execute the Spark code as optimally as possible. Note that source loading & task grouping is not supported at the moment due to restrictions in the Spark SQL language & Drivers. - Added **Non-Historic Links**: Added a new object type, the Non-Historic link, we support 2 variant, with a unique identifier (such as transaction id) and without, it is a new attribute type which can be set in the source editor. This object is a variant of the Many to Many link which does not have a satellite so it does not track changes (no Hash Difference). This means that the DV loading logic only contains an insert. When using a unique identifier it also has a where not exists filter. If a unique identifier is set, the firewall views will also filter out records based on that attribute for when no-CDC is enabled. This object type is great for performance when the Link object only receives inserts. - Open alpha for **VaultSpeed Studio**: Everyone can now try the VaultSpeed studio for free for 30 days, this time starts when the first template is created. This trial is limited to 5 templates. Make sure to read our [https://vaultspeed.atlassian.net/wiki/spaces/VPD/pages/3010363474](https://vaultspeed.atlassian.net/wiki/spaces/VPD/pages/3010363474) to get an idea about what is possible and how you can write Templates. - Important changes: - Agent: - On the Agent page you can now ping the agents, this will display the host names of the machines where agents are running. This can be used to find out if there are multiple agents running(which can cause issues) and where they are. Note that in cases where `polling.seconds` was increased for one of the agents, not all agent will be able to respond before the task finished. you can get around this by pinging multiple times short after each other. Like all agent tasks, This task will run indefinitely when there are no active agents. - On the Agent page you can now kill all agents or after pinging an agent with a specific host name. Note that the Agent will exit with code 0, but depending on how the process is managed it might automatically restart. - The source metadata files now contain the source name instead of the schema name, this will prevent issues due to conflicts when you have multiple sources with the same schema (like the mandatory mtd reimport and simultaneous release creation). - The source metadata files are now always lowercased in order to prevent issues when running the Agent on a case insensitive OS. - Updated Agent name to VS-Agent instead of FA-Agent (reference to the old application name “Foundation Accelerator”). - Updated API endpoints in client.properties, it had an entry for every end point meaning the file would require updating with some releases, this will not be the case anymore in the future. - Added support for PITs on sources with different loading frequencies, the FMC will dynamically scale the BV loading window based on the loading windows of the sources that where loaded before. The PIT logic now contains an update/merge when matched to update PIT records which where incomplete due to mismatched loading frequencies. - Added Same-as Links and Hierarchical Links as aliases for Many-to-Many Links (the only difference between these is the object type in the source editor). - Allowed more parallelism between tasks, the following tasks can be run at the same time now: DDL and ETL generation, deploy and generation. - ETL generation is now blocked if your mapping limit is exceeded. - Added automatic reverse engineer for ODI. - massively Improved automatic deploy speed for SQL by reducing the frequency of task progress updates. - quality of life changes: - Whenever a save/lock/generate button is disabled due to remaining issue in a release, it will now show why in a hover message. - Allow the use of crontabs for defining the BV loading intervals in the FMC instead of only timedelta. - Made the SQL Server default format id values consistent with the default exception values. - Added hover text to DV name management screens to help with long object names. - Removed a bunch of deprecated parameters. - Bug fixes: - Fixed delta generation task failing when you have a lot of sources and logging enabled due to a race condition in the task system. - Fixed a few issues in the generated code for Bigquery. - Fixed an issue where object parameters got duplicated when there is a project with suffixes and one with prefixes. - Fixed an issue where the Bridge editor canvas could not be cleared after saving a Bridge. - Fixed sorting Data Vaults also affecting Data Vault release ordering. - Occasionally exporting business views would throw a “Resource temporarily unavailable” error, we where unable to fix this in the current release, but added a message saying to retry again since the problem seems to be temporary and waiting a minute fixes it. - Fixed BV Views' “generate” toggle being editable for locked releases. ### Version 4.1.17 Release date: 11/10/2020 - Features: - Added support for **Snowflake procedures**: Snowflake ELT code is now wrapped in Javascript procedures, the FMC will now call these procedures instead of needing the generated sql files. - Added **auto deploy for Snowflake**: DDL and ETL can now be deployed to snowflake using the VaultSpeed Agent. - Important changes: - Expanded and improved our testing environment in order to cover more scenarios/parameter combinations. - VaultSpeed Studio improvements after feedback: - Improved the integrated file editor. - Added a view all option to the target definition where you can see all attributes of the target. - Complete revamp of the signature definition screen. - Talend generator rework, generation speed and robustness are improved. - quality of life changes: - Added a download file button to the automatic deployment screen. This allows for downloading generated code through the browser instead of having to obtain it from the agent. - Improved the description of the attribute based sat split. - The upload of CSV files to update short and abbreviated names in the source no longer has to happen through the agent, there is now an option to upload them directly. - Moved automatic deployment menu item out of the generation toll settings since it didn't really belong there. - Improved loading performance of parameter screens. - Disabled the Re-import source metadata slider for the first release of a source, since you always need to import it in that case, and disabling it would produce an incomplete release. - Added an extra tab to the DDL settings page where you can get an overview of all applied settings per layer. - Added a lock icon and info text to DV object names in the naming conventions page when they are locked due to setting a production release. - Added a check to the business views that blocks saving changes if the business name conflicts with another object. - Added a confirmation dialog on source deletion to prevent accidental deletes. - Moved the attribute button for the business views to the tale instead of being hidden in a collapsing row. - Display all attribute types in the sidebar of the source graphical editor. - Split the cookbook in multiple pages on Confluence to make it load faster and be more user friendly. - Added a button to disable/enable the generate button for all business views (to use in combination with filters). - Sorted the releases in the delta generation tab such that the latest one is always first. - Added subscription updates as data points to the generations graph on the dashboard. It will also show when the next subscription reset is. - Added a warning to the dashboard when the mapping counter is above 80% of the subscription limit. - Bug fixes: - Fixed mapping counter on the dashboard not including delta generations and PITs and Bridges. ❗ - Fixed information in source creation screen being removed when clicking save while one the fields conflicts with an existing source. - Fixed Snowflake FMC expecting a flat file structure for the SQL code. The generated code can now just be unzipped in the “path_to_sql” directory. - Fixed slave sources with data quality bad not getting org attributes in the SAT’s if the master source did not have data quality bad enabled. - Fixed incorrect SAT split names in the pre-lock DV overview and SAT split overview when using suffixes instead of prefixes. - Fixed database link drop-down on sources screen appearing behind the edit buttons. - Fixed a few issues with the keys tab in the source graphical editor. - Fixed PIT records having the wrong unknown records when a PIT contains SATs from multiple sources (multi-master). - Removed the ability to set BKs on reference tables in the source graphical editor. - Fixed an issue in the DV graphical overview where link SATs would get the link icon if the LKS suffix contains the LNK suffix. - Fixed SAT split issue warnings not disappearing after fixing them without refreshing. - Fixed some issues with the Kafka source reader, it failed on reading some of the schema details generated by newer versions of Confluent. - Fixed disabled and metadata attributes disappearing from the source graphical overview. - Fixed DV HUB master slave dropdowns, these did not always match the source names in the header. - Fixed attributes that are a business key and a foreign key to a reference table missing a original value attribute (i.e. not coalesced) in the sat. - Fixed dependencies for the prepare delete mappings in the FMC. - Fixed firewall tables missing the pre-post image attribute (persist firewall = Y and update all attributes = N). - Fixed an issue where uk attributes where missing from Satellite objects if use source uk as bk is enabled. - Fixed some issues with the PITs when using CDC with a log position attribute. - Fixed FMC source loading not taking USE_OBJ_SRC_NAME_FOR_CDC_TABLES into account. - Fixed FMC autodeploy using the wrong file name. - Fixed error records having null values for the cdc logposition in the initial load. ### Version 4.1.16 Release date: 24/06/2020 - Features: - **VaultSpeed Studio** (VSS) is releases in closed alpha (i.e. only accessible on request). Vaulspeed Studio allows the user to build Templates for defining additional Business Vault objects. It puts the power of our template language in your hands. VSS allows for the creation of calculated satellites, effectivity satellites, end date satellites (for insert only), custom PITs, custom Bridges and much more. Note that it is optimised for templated logic i.e. logic that can be applied to multiple objects, and not for creating new mappings on a single object. More information can be found in the documentation: [https://vaultspeed.atlassian.net/wiki/spaces/VPD/pages/3010363474](https://vaultspeed.atlassian.net/wiki/spaces/VPD/pages/3010363474) . VSS will be released in open alpha next release. This will include a limited 30 day trail of VSS for everyone, full usage of VSS will require an additional subscription (more details will be given next release or by contacting sales). - Added the ability to define **foreign keys** to **reference **tables, creating relations between an object and a reference table will result in additional ref_fk attributes in the satellite, these foreign key attributes will be coalesced with null values. This, combined with the addition of ghost records to the REF objects allows for inner joins between Satellites and Reference tables. - Added support for **multi active satellites** with a **sub-sequence** attribute in the source. An attribute can be set to be the sub-sequence attribute in the source graphical editor, this attribute in combination with the business key should be unique. - Added a **new source type JDBC**, this allows reading metadata from any source which has a JDBC Driver. This source type is only available with the Extended agent ([https://theagileautomationfactory.atlassian.net/wiki/spaces/AF/pages/1487700336](https://theagileautomationfactory.atlassian.net/wiki/spaces/AF/pages/1487700336) ). The VaultSpeed Agent only contains open source Drivers. If one of your sources has to be accessed using a proprietary JDBC Driver or you have written your own Driver, then this source type can be used to directly connect to it. The FMC can then also load data to the target warehouse using that Driver. - Important changes: - The VaultSpeed application is now also available at [https://app.vaultspeed.com](https://app.vaultspeed.com/). The old url [theagileautomationfactory.com](http://theagileautomationfactory.com/) will now redirect to the new one, but will remain available until at least November. - The grouping, master slave and name management configuration in the DV is now fully versioned. This means that deleted objects will no longer show up in new versions unless they existed in a production release. We also added a status indication for new and deleted objects in the grouping and DV overview screens. This change also introduces some performance improvements for these screens. - Selecting a reset option (i.e. not “keep everything”) when creating a new source release will reset the release to the latest one linked to a DV production release. If no production date is set yet, then it will reset fully like before. - Added an additional attribute type to the source graphical editor: `modification date`, when the cdc type is modification date then setting a column to this type will indicate that it is the cdc_timestamp metadata attribute for a certain object. This will also occur for all attributes matching the cdc_timestamp parameter when crating a release. This means that it is no longer required that these metadata attributes are ignored in the source. - Added the ability to delete entire projects. - Added the ability to define unique keys in the source graphical editor, the can be defined by selecting attributes while holding ctrl/command and then right clicking and selecting unique key (and optionally a name for the key). You can also set an attribute to uk from the attribute sidebar. - Added column type information to the DV attribute data lineage export. - Limited the old Data Vault releases available in the delta generation to only production releases. This is done because compares from a non prod release are not officially supported and could cause errors. - Added additional flexibility to the Presentation layer load functionality in the FMC, see the corresponding section in [https://vaultspeed.atlassian.net/wiki/spaces/VPD/pages/3013672982](https://vaultspeed.atlassian.net/wiki/spaces/VPD/pages/3013672982) . - quality of life changes: - Added multiple record edit and save functionality to source object keys and relations tab. - Added multiple record edit and save functionality to PIT objects screen. - DDL/ETL Generation: the release dropdowns are now sorted in reverse chronological order and the latest release will be selected by default. - The DV overview now also shows the attribute types, this is useful for VaultSpeed Studio, the DDL options and for documentation purposes. - Added tooltips to source and Data Vault release comments field. - Added the ability to update Data Vault Release comments. - Added proper sorting to the PIT DV objects screen. - Creating a source release with an empty comment will no longer insert ‘unknown’, it will now insert nothing. - A source release can no longer be used (including entering edit mode) until all tasks required for building it are finished. - Added tooltips to ODI Settings & Generation screens. - Disabled the Airflow catchup parameter in the FMC when using a dynamic loading window. - You can now close the parameters screen even if there is still an error, this is useful since some errors depend on other variables such as source CDC type. - Bug fixes: - Fixed the SAT split migration scripts. - The Reference tables in the DV and BV graphical overviews now have the proper symbol. - Fixed as issue which could cause the generation of a Data Vault graphical overview to fail. - Fixed filtering attributes when drawing relations in the source graphical editor. - Fixed the Generated mappings graph not showing when no mappings have been generated yet. - Removed unnecessary leave page warning in the SAT split screen. - Fixed an issue in the source graphical editor where objects from the current source would receive the purple border used to indicate objects from other sources. - Fixed unlinked objects list for PIT objects being empty when there are no linked objects. - Fixed missing bk attribute borders in the Bridge editor. - Fixed the “load more tasks” button in the tasks sidebar. - Fixed cross source links not showing op in the keys tab of the source graphical editor. - Fixed text overflow for source selection in the source graphical editor. - Fixed closing the parameter screen not resetting the state. - Fixed news table on the Dashboard overflowing on smaller screens. - Fixed a few issues with the source exclude screens. - Fixed new DB links not immediately showing up in the dropdown when editing a source. - Fixed the search box for sources not filtering on source name. - Fixed DV screen getting stuck in loading state when opening for the first time after login. - Fixed some scaling issues on the source remove object patterns screen. - Fixed a few minor issues with ignoring objects and attribute in the source. - Fixed searching through release not filtering on the proper fields. - Fixed errors in the source objects tabular editor not disappearing after they have been fixed. - Fixed a bunch of minor issues in the ODI Settings & Generation screens. - Fixed data vault and source columns becoming empty after editing a FMC workflow. - Fixed an issue where the sidebar of the source graphical editor could not be closed by clicking on the canvas background. - Fixed missing migration in the delta generation when an object becomes grouped with another object of the same source, since this scenario triggers a change in the source business key and satellite names. - Fixed sat split name not being visible in the graphical editor for satellites with long names. - Fixed abbreviated names using the short name length parameter to determine the max editing length in the source tabular editor. - Fixed the source graphical overview icons not loading properly on Firefox. - Fixed Informix data types not being properly read from the source, due to an issue in the JDBC Driver. - Fixed error_code attribute parameter not getting the correct casing. ### Version 4.1.15 Release date: 24/04/20 - Features: - Added **Referential integrity error handling** logic. After enabling the new `REFERENTIAL_INTEGRETY_VALIDATED` parameter, records for which the referenced key cannot be found will be stored in an error table. These records will not be inserted in the link tables unless the parameter `REFERENTIAL_INTEGRITY_FORCE_LINK_LOAD`is enabled in which case a reference to the unknown record will be added as usual. At every incremental load, the records from the error table will be added to the extraction tables again next load to check whether the reference can be resolved with the new data available. Setting the error codes to a negative number in the error table will prevent that record from being added to the next load. This logic is only used when the referenced object has a business key that is not the primary key, since otherwise no lookup is needed. - Important changes: - In the source graphical editor you can now create a self reference relationship which contains an attribute that references itself i.e. (c,b) → (a,b). This can be done by right clicking the attribute while in relation creation mode. - Added the ability to update and save multiple records at the same time to the following screens: Source objects & attributes, DV name management, DV data types screens, Business vault views. - Added the ability to revert SAT split changes. - Added subscription info to the dashboard. - Added support for switching the ODI FOLDER_SPLIT parameter after having already deployed the project. - quality of life changes: - The side bar input form data was not always cleared after closing it for some pages, this is now the case everywhere. - The “Shortest path query” button in the DV and BV graphical overviews will now generate the path without having to first generate the graph. - Improvements to SAT split graphical editor after feedback: - Add an option to change the number of visible attributes in a split (click the button with 3 vertical dots and go to settings - Added an option to sort the attributes in descending order in the context menu. - Added a show only unused attributes option to the context menu. - Attributes can now be removed from a split or added to another split by dragging and dropping. - Long table names are now displayed correctly. - Improvements to normal SAT split editor: - Added attribute ordering. - Improved handling of multiple splits. - Long table names are now displayed correctly. - The split name will no longer disappear when you scroll down the attribute list of a split. - Source releases: show the comment field as empty if it was not filled in instead of “undefined”. - Removed the unused type property from the source objects. - Disabled objects with errors are no longer displayed at the top of the objects list in the source graphical editor. - Added a data vault selector to the DDL settings when applying the setting to a source based layer. - Added short and abbreviated names to the data lineage export for improved tractability. - For sources with CAST_SOURCE_ATTRIBUTES enabled, the data type in the source editors is now a dropdown containing the possible values instead of a text field. - Bug fixes: - Fixed detail PIT hash key collisions when a record is updated multiple times per second and the general timestamp format is not set precise enough, the hash key calculation will now use a fixed format with maximal precision. - Fixed notification multiplication when pressing "Copy code to clipboard" in the BV graphical overview. - Fixed a few graphical issues in the source graphical editor (button alignments, hover animations etc.). - Fixed newly created database links not being available in the dropdown on the sources page without refreshing the page. - Fixed format mask dropdowns in source editors. - Fixed an issue with the DV name management where errors would not show up due to the page being loaded before checks where executed. - Fixed long table names not being displayed properly in the SAT split screen. - Fixes to the data type migration scripts in the delta generation. **This required changing the ordering numbers in the DDL files!** (e.g. `_3_GENERATE_DDL_EXT_` → `_03_GENERATE_DDL_EXT_`) so if these where used for deployment procedures make sure to update those. - Fixed objects appearing in the linked and unlinked objects list in the PIT objects view. - Fixed LNK table names not immediately being updated after changing the short name in the DV name management screen. - Fixed foreign key indicator in source graphical editor not being updated properly after removing relationships. - Fixed dragging an object in the source graphical editor while in edit mode leaving the attributes behind. - Fixed relationship lines in the source graphical editor connection to the center of an object when you click on an object. - Fixed an issue with the source graphical editor object placement when displaying a lot of objects, which could cause objects to overlap. - Fixed attribute scroll breaking in the source graphical editor when scrolling to quickly in an object with a lot of attributes. - Fixed empty warning message popping up for new users due to an empty task list. - Fixed missing quotes around isdatatype function for Oracle. - Fixed release status not being updated in the source selector of the source graphical editor. Now you no longer have to refresh the page after locking a release in order to select that release in another source and draw cross source relations to it. - Fixed tooltip for long error messages in the log book not fitting on the screen. ### Version 4.1.14 Release date: 21/03/20 - Features: - Added basic **Data lineage** export, on the DV overview screen you can now download a CSV with the dependencies between the Data Vault and source objects and attributes. - Added **table type** selector to **DV DDL options, **you can now set different options per object e.g. different settings for the temp tables, different partitioning for lnk objects (on OBJECT_F_H_KEY instead of OBJECT_H_KEY). - Added a graphical editor for splitting satellites (the normal editor remains available). More information can be found in [https://vaultspeed.atlassian.net/wiki/spaces/VPD/pages/3081207861](https://vaultspeed.atlassian.net/wiki/spaces/VPD/pages/3081207861) . - Added business vault loading to the FMC. - Important changes: - Improved performance of the source checks, this will improve loading times and save times when modifying the source structure. - Fixed the mapping counter, it should now properly reset the count when a new subscription period starts. - The schema parameters are now templated, so the string "PROJECT" in the parameter values will be replaced by the layer name (so source name for source parameters). - Added an option to delete attribute based splits or regular splits across multiple objects. - Removed the limitations from the bridges editor, you can now create bridges with multiple ‘arms’, instead of only a single line. - Renamed the FMC plugin for Airflow. When new FMC code is deployed, the plugin needs to be updated. - quality of life changes: - Made sure that the parameter ordering is always the same on all parameter screens. - Improved performance of the source graphical editor for systems with lower end graphics processors. - improved robustness of CSV short/abbreviated names import by adding extra checks and casing. - Added extra input cleaning when editing source object and attribute short and abbreviated names. - When saving the source model, it launches 2 tasks, after one af them is finished you could already access the HUBS&SATS page by refreshing the release, this screen would however not work properly yet since the second tasks was not completed. This will no longer be possible. - Driving key flag can now be enabled in the many to many link object dialog instead of only on the relationship dialog. - Added a search bar to the attribute list in the object side bar for the source graphical editor. - improved column ordering in the DV DDL. - The source graphical editor now shows multiple lines between objects if there are multiple relationships. Clicking one shows the relations between the attributes. - Added the possibility to delete DDL settings from a certain layer. - Bug fixes: - Fixed sat logic to cover some extreme cases with multiple inserts/updates and deletes of the same key in one load, which where not always handled correctly. - Fixed unknown reference not taking the data type into account such that it always used the varchar unknown value when calculation the referenced unknown hash key. - Fixed unique keys not getting updated when altering business keys in the delta generation. - Fixed deleting a “remove object name pattern”, this would some times remove the wrong line in the interface (only fixed after refreshing the page). - Fixed saving a source model not being properly disabled in some cases (when using the graphical editor) if there are still objects with errors. - Fixed no popup being shown when hovering above short name in tabular source editor. - Fixed driving key color not always showing correctly in the source graphical editor. - Fixed format mask not being editable in the tabular source editor. - Fixed DDL generation with failed get files task still showing up in the auto-deploy generation list. - Fixed PIT snapshot view filter such that it will no longer contain future dates. - Fixed PIT with insert on delete logic not filtering out the deletes. - Fixed source graphical editor not always refresh the error indication in the objects dropdown after fixing them. - Fixed incorrect length indication in T-SQL data type castings for certain data types. - Fixed DDL attribute order of the bridges. ### Version 4.1.13 Release date: 24/02/20 - Features: - Added support for **Links across sources **to the** graphical editor.** After selecting another source in the editor it is possible to add objects from that source to the canvas, relationships can then be drawn to those objects and existing relationships can be disabled/edited . - Important changes: - Added a parameter to disable the generation of primary keys, unique keys and indexes (this requires that the generate foreign key parameter is disabled) This is mainly useful for Greenplum Databases. - Added a parameter to disable the  ENABLE_PARALLEL_DML  statements for Oracle, since enabling this can cause issues in some configurations. - Reworked detailed PIT logic such that it no longer contains a record for every date in the sats, bet only for dates where something changed to a specific key. - quality of life changes: - Updated the default value of the CDC reliable parameter to N since only 35% of all sources had this enabled. - After locking a Business Vault, the screen will go back to the releases list instead of becoming blank or staying the same. - Bug fixes: - Fixed remote schemas in ODI when using remote journaling. - Fixed auto-deploy for T-SQL. - Fixed issues in the source graphical editor with the depth selection, it returned more than expected. - Fixed some issues when removing an element from a hub group, leaving only one hub in that group. The remaining object did not get ungrouped properly which could cause issues later. - Fixed multi-attribute unique key creation, when using the auto naming function it would create a separate key for every attribute, instead of one. - Fixed satellite objects not showing up in the business vault shortest path query generation. - Fixed an issue where for file sources some objects could be duplicated during the import. - Fixed pagination for Data Vault parameter overview. - Fixed the right-click menu in the source graphical editor not switching properly between object and attribute type selection. - Removed workarounds from Snowflake Airflow operator since the bug that required them is fixed now and broke our workaround. - Added a workaround for a bug in the Snowflake Airflow operator which caused it to skip some SQL statements. - Fixed pagination of the source objects, the navigation buttons would occasionally disappear. - Fixed autocomplete for object selection in the source graphical editor wrapping the text. - Fixed hash delimiters $, & not working properly. - Fixed null attributes incorrectly getting replaced by exception values when using a CDC system that delivers only the changed attributes. ### Version 4.1.12 Release date: 16/02/20 - Features: - Added support for **Links across sources.** relations between source can be read from the source (defining them in the graphical editor will be added next release). These links will become business vault objects in order to not create strong dependencies between source loads. A new table will be created in the FMC schema in which you should store the load cycle ids of all source loads between business vault loads. These ids will be used to determine which records changed since the last BV load, such that the incremental load will load only those. The incremental load includes logic for resolving missing references in the next load. - Added new type of delete logic, **INSERT_ON_DELETE**, when this parameter is enabled, deletes will insert a new record in the sat instead of executing an update, these delete records will be end dates just like regular records. This parameter has no effect when using INSERT_ONLY_LOGIC. - **Improved **performance and look of the **source graphical editor**. The objects will now also be displayed in a tree like structure to give a better overview of the source structure. - Important changes: - Added a button for generating only REF table mappings to the DDL/ETL generations screen. - Added a warning to the sat split screen when a split element becomes empty due to a column deletion. You can then choose to leave it as is or add another attribute to it or remove it. - The modification date is now loaded from the source in the initial load. - Deletes in case of insert only or source cdc type different from change data capture will no longer have empty attributes. - quality of life changes: - Added a notice to the BV screens when the selected release is locked, since it was not always clear, especially on the bridges screen. - Added an option to the sat split screen to show only the attributes which are not yet added to a split element. - When using cdc update all attributes N, the minimum length of fields in the extraction tables will be adjusted based on the chosen no change indication values. - Added pagination to dv overview. - Added the ability to edit and save multiple parameters at the same time to all parameter screens, until now it was only available for the system parameters. - The lock and save button for the source HUBs & SATs screen is now in the header. - Added a warning to the ODI settings screen that the user needs to update the Maximum Table/Column Name length in ODI when ORACLE_12_1_OR_HIGHER is Y. - Added pagination to bridges side bar. - Improved performance of parameters screen. - Bug fixes: - Fixed an issue in the sat split screen where an attribute would be removed from the wrong split if it was added to more then 1 split element. - Fixed an issue where the DDL for the remote objects (in case of remote journalling) would have the syntax of the wrong database type if the source and target database types are different. - Fixed the depth in the source graphical editor. - When grouping objects that have a relation between them, the DV generation failed. This will now generate the correct self reference LNK on the grouped HUB. - Fixed drawing relations in combination with the search in the source graphical editor. - Fixed a bunch of graphical issues in the source graphical editor. - Fixed some issues with detail PITS and PITs based on TRANS TIMESTAMP. - Fixed cdc reliable HUB incr load not checking for existing records which could cause duplicate key violations with case insensitive BK's. ### Version 4.1.11 Release date: 05/01/20 - Features: - Added support for **Bridge tables**, see [https://vaultspeed.atlassian.net/wiki/spaces/VPD/pages/3039232005](https://vaultspeed.atlassian.net/wiki/spaces/VPD/pages/3039232005)  for a walkthrough. - Added the ability to** import and export Business names**. Objects and attributes not included in the csv will get their generate flag disabled. The format can be found by doing an export or at [https://vaultspeed.atlassian.net/wiki/spaces/VPD/pages/3011182668](https://vaultspeed.atlassian.net/wiki/spaces/VPD/pages/3011182668) . - Added a parameter **DATA_TYPE_CASTING** which enables casting of source data with out using data quality bad logic. This is useful when data arrives in text format from a staging area but was extracted from a database with proper formatting. - Important changes: - Improved performance of the web application by adding lazy loading. Web pages that can show a lot of data such as source objects and attributes, will now only render the items that are visible thus improving browser performance. - Changed the name of "Direct Link" to "Many to Many Link". Direct link was an internally used name and it was not always clear what it meant. - Added the ability to define an attribute as primary key in the source graphical editor. - Improved the performance of the generate ETL metadata task, it should be about 5 times faster. - Attributes can now be placed in more than one SAT split. - The source graphical and object editors are now available through a sub-menu "editor" in the top bar of the sources page. Also, made the mass update, download names, and upload names buttons available from both editors and made them more compact. - quality of life changes: - When creating a DV release, the source releases list is now ordered properly and shows the release number and comment instead of just the number. - Removed the graphical FK creation from the relations screen, creating FK's should be done using the source graphical editor since the other one has less functionality and had a few bugs. - Hub grouping improvement: when dragging an unlinked group onto the plus button it will rate a HUB group with the name of that HUB. We also made sure that the add button is always the first one in the list. A delete button was also added such that you do not have to drag all hubs out of a group in order to remove it. - In the source graphical editor, you can now right-click on an object to set its object type (similar to the attribute type functionality). Also added a tooltip with the object name, such that you can still know which object is which when zooming out. - Removed abbreviated names being split into words with underscores even when their length does not exceed the max length. This was only needed when the names needed to be shortened. - Bug fixes: - Fixed the multi-active button not being editable in the source objects view. - Fixed agent auto-deploy failing due to an authorization timeout when the deploy takes a long time, it should now reauthorize properly. - Fixed the Golden Gate IL Export list containing only 1 source. - Fixed an issue where the source graphical editor would not update properly after creating a new source prototype build. - Fixed an issue where the PIT DDL contained incorrect foreign key definitions. - Fixed missing scroll bar in the task filter list. - Fixed business view screen losing its scroll bar after editing an attribute. - Fixed an issue where a record with an empty table name could appear in the select objects table. - Fixed an issue with the HKEY calculation of a PIT, the cast of the snapshot timestamp used the wrong format causing unique key violations. - Fixed an issue with PIT tables, when 2 PIT configurations were added to a DV object, then some parts of the mapping code were duplicated. - Fixed an issue where the hash key calculation could contain double foreign business keys.