CData Arc (formerly ArcESB) Changelog

What's new in CData Arc (formerly ArcESB) 23.4 Build 8801

Feb 6, 2024

Key Features:
Added:
Added the ability to create custom roles with up to 10 policies, allowing users access to only certain actions within specific workspaces. For more details, see the Custom Roles section.
Added the ability to specify expected volumes for connectors. If these volumes are not met within the specified time frame, users are made aware via alerts, dashboard widgets, and a dedicated tab in the Activity page (previously Logs). For more details, see the Service Level Agreements (SLAs) section.
UI improvements for the flow designer, including but not limited to, the ability to delete connectors within the settings pane, showing the connector type in the shape for a connector on the canvas, as well as the description for a connector on hover.
A new “Include files in Receive folders” setting has been added to Settings → Advanced → Cleanup Options. Complete flows usually include terminal connectors that consume files, ensuring they do not accumulate at the end of flows. In flows where this is not the case, files would accumulate in the Receive folders and could potentially cause performance issues. Enabling this setting ensures that these files are cleaned up. Note that as part of this change, the directory structure of the archive changed to keep logs separate from message data.
Added a new xpathcount formatter. This can be used within xmlDOMSearch operation calls, or in scripts within XML Map in order to easily determine the number of elements in the document that match the given xpath.
Changed:
Relaxed locking requirements for the Admin API to improve performance and concurrency.
Versions of MySQL prior to 8 are now deprecated as an Application Database.
Improvements to performance and stability for Derby and SQLite databases when they are used as an Application Database.
The dbQuery op previously produced an output attribute for every column returned from the query, even when the value for that column’s value was null. In order to facilitate detection of null columns, they are now excluded on the output item produced by the op. Scripts that utilize dbQuery to obtain column values that might be null should be updated to include the def formatter to ensure that errors do not arise from the absence of these attributes on the output item.
Some scripting operations, specifically connector operations like x12Scan, must be called through the connector.rsc endpoint with an auth token. The ability to call these operations directly is now deprecated and will be removed in a future release.
Connectors:
Added:
Connectors that interact with remote file systems (SFTP, File, S3, etc.) now preserve the full remote path by adding a RemotePath header to messages received by the connector.
The Email Send connector now supports sending multiple attachments in one email through the use of Batch Groups.
Email addresses for alerts can now be overridden at a connector level in the Alerts tab.
Connectors that use OAuth for authentication now show a warning when the tokens that were retrieved are unable to be refreshed.
Added the ability to format EDI data when previewing these messages within the UI.
The REST connector now allows for form fields on requests to be populated from message headers and ArcScript. As part of this change, the existing “Dynamic” option for form fields was renamed to “XML”, and new “Header” and “ArcScript” options were added.
The Email Send connector now allows for the Content-Type of attachments to be determined by a new “Extension Map” setting, as well as a Content-Type header on input messages.
Changed:
The AS2 connector now positively acknowledges an incoming request before the full request body is read when an asynchronous MDN is requested.
Improved the X12 connector’s exception messages and support for the Upload Test File feature, particularly the way it interacts with other features of the connector, like Nest Master-Detail Loops.
EDI connectors now generate an alert when a negative acknowledgement is received.
Connectors that translate flat file formats (like CSV, TSV, and PSV) now preserve original column names in a flatfile:column attribute on the translated XML when it differs from the translated version. These connectors also read from this attribute when translating from XML to flat file formats in order to determine the header name.
The Kintone connector moved from beta to full release status.
Fixed:
Fixed several minor issues in the Flat File connector.
Improved the Validate connector to better handle validations of messages that contain many repeated elements.
Fixed an issue in the Split connector where significant whitespace was not preserved in output XML in some situations.
Fixed the IsNull operator in the Branch connector to better handle missing headers and XML elements that are explicitly set to null with the xsi:nil attribute.
The FTP Server and SFTP Server connectors now utilize the Subfolder header on messages to place messages from the flow in their appropriate directories within the server’s root directory.
Performance and stability improvements in the SFTP Server connector, especially when Temp File Extensions are used, and clients drop connections unexpectedly.

New in CData Arc (formerly ArcESB) 23.4 Build 8789 (Jan 26, 2024)

Key Features:
Added:
Added the ability to create custom roles with up to 10 policies, allowing users access to only certain actions within specific workspaces. For more details, see the Custom Roles section.
Added the ability to specify expected volumes for connectors. If these volumes are not met within the specified time frame, users are made aware via alerts, dashboard widgets, and a dedicated tab in the Activity page (previously Logs). For more details, see the Service Level Agreements (SLAs) section.
UI improvements for the flow designer, including but not limited to, the ability to delete connectors within the settings pane, showing the connector type in the shape for a connector on the canvas, as well as the description for a connector on hover.
A new “Include files in Receive folders” setting has been added to Settings → Advanced → Cleanup Options. Complete flows usually include terminal connectors that consume files, ensuring they do not accumulate at the end of flows. In flows where this is not the case, files would accumulate in the Receive folders and could potentially cause performance issues. Enabling this setting ensures that these files are cleaned up. Note that as part of this change, the directory structure of the archive changed to keep logs separate from message data.
Added a new xpathcount formatter. This can be used within xmlDOMSearch operation calls, or in scripts within XML Map in order to easily determine the number of elements in the document that match the given xpath.
Changed:
Relaxed locking requirements for the Admin API to improve performance and concurrency.
Versions of MySQL prior to 8 are now deprecated as an Application Database.
Improvements to performance and stability for Derby and SQLite databases when they are used as an Application Database.
The dbQuery op previously produced an output attribute for every column returned from the query, even when the value for that column’s value was null. In order to facilitate detection of null columns, they are now excluded on the output item produced by the op. Scripts that utilize dbQuery to obtain column values that might be null should be updated to include the def formatter to ensure that errors do not arise from the absence of these attributes on the output item.
Connectors:
Added:
Connectors that interact with remote file systems (SFTP, File, S3, etc.) now preserve the full remote path by adding a RemotePath header to messages received by the connector.
The Email Send connector now supports sending multiple attachments in one email through the use of Batch Groups.
Email addresses for alerts can now be overridden at a connector level in the Alerts tab.
Connectors that use OAuth for authentication now show a warning when the tokens that were retrieved are unable to be refreshed.
Added the ability to format EDI data when previewing these messages within the UI.
The REST connector now allows for form fields on requests to be populated from message headers and ArcScript. As part of this change, the existing “Dynamic” option for form fields was renamed to “XML”, and new “Header” and “ArcScript” options were added.
Changed:
The AS2 connector now positively acknowledges an incoming request before the full request body is read when an asynchronous MDN is requested.
Improved the X12 connector’s exception messages and support for the Upload Test File feature, particularly the way it interacts with other features of the connector, like Nest Master-Detail Loops.
EDI connectors now generate an alert when a negative acknowledgement is received.
Connectors that translate flat file formats (like CSV, TSV, and PSV) now preserve original column names in a flatfile:column attribute on the translated XML when it differs from the translated version. These connectors also read from this attribute when translating from XML to flat file formats in order to determine the header name.
The Kintone connector moved from beta to full release status.
Fixed:
Fixed several minor issues in the Flat File connector.
Improved the Validate connector to better handle validations of messages that contain many repeated elements.
Fixed an issue in the Split connector where significant whitespace was not preserved in output XML in some situations.
Fixed the IsNull operator in the Branch connector to better handle missing headers and XML elements that are explicitly set to null with the xsi:nil attribute.
The FTP Server and SFTP Server connectors now utilize the Subfolder header on messages to place messages from the flow in their appropriate directories within the server’s root directory.
Performance and stability improvements in the SFTP Server connector, especially when Temp File Extensions are used, and clients drop connections unexpectedly.

New in CData Arc (formerly ArcESB) 23.3 Build 8698 (Oct 26, 2023)

Key Features:
Added:
The Java Edition now includes a guided setup experience for Windows, with the capability to run as a service. For Linux installations, a .tar.gz file is now available. Both options now include a JRE so an external installation is no longer necessary.
Added the ability to format message content in the preview modal for XML and JSON files.
Added the ability to filter the dashboard for transactions from the current day. Trends are assessed by comparing metrics to the same time period from the previous day.
Metric cards on the dashboard now include links to more detailed information, where applicable.
SSO issuer certificates are now refreshed daily, or upon failure to verify the signature in a JWT.
Changed:
All CData drivers included in the application have been updated to 2023.
Alerts for errors that pertain to a connector now mention the Id of the workspace that the connector resides in.
Flow APIs now do not create locks by default to allow for greater concurrency.
Fixed:
Fixed an issue where database connectors receiving a large number of records in a single receive operation could result in an Out of Memory exception in some environments. The Arc messaging engine now appropriately buffers message data to disk when a large number of messages are produced in a single receive operation.
Fixed an issue causing the process of populating message-related metadata from the transactions table to fail if SQL Server was used as Application Database. This only affected the working set of data present at the time of upgrading.
Fixed an issue causing health checks to fail to report the disk usage of Application Directory when set to a UNC path. If Archive Directory is set to a separate disk, it is now checked as well.
When copying one or more connectors into the same workspace as the original connectors, the copies are now placed directly beneath the original connectors.
Minor security fixes to address low level vulnerabilities.
Connectors:
Added:
Added a Kintone connector.
Rebuilt the lookup experience in database connectors to provide several key improvements:
The Lookup action now allows for selecting multiple columns and records within the same operation.
Added a designer to the Lookup action to assist in building queries, referencing information from input files, and testing the configuration directly in the settings tab.
Added the ability to target a stored procedure with a lookup through the Lookup Stored Procedure action. The existing Execute Stored Procedure action has been improved to match this design.
Changed:
When a custom script or condition in the XML Map connector causes the connector to throw an error, the error now references that node by name.
XML Map no longer hides namespace definitions in the mapping editor.
Improved the performance of services that receive files passively, especially for connectors like AS2 when requests do not match a configured trading partner profile.
The Validate connector now allows for linked schemas to pass through it. For example, in a Database → Validate → XML Map flow, the XML Map connector can now reference the schema from the Database connector for mapping.
Improved the performance of the PDF Label connector.
The FTP Server connector now requires the reuse of the PI SSL session in the DI channel by default.
The Magento connector has been rebranded to the Adobe Commerce connector.
The Excel connector now allows for the specification of a range of cells where the table should be found in Table mode.
Fixed:
The SharePoint connector now better handles long filenames.
Fixed an issue in the UI of the SFTP connector that caused the server thumbprint to be overwritten when creating a new public key.
Application connectors like Salesforce, Shopify, etc. now properly handle aggregate columns when a custom query is defined.
The Email Receive connector now properly handles message attachments that are not part of MIME encoded entities.

New in CData Arc (formerly ArcESB) 2022 23.3 Build 8686 (Oct 13, 2023)

Key Features:
Added:
The Java Edition now includes a guided setup experience for Windows, with the capability to run as a service. For Linux installations, a .tar.gz file is now available. Both options now include a JRE so an external installation is no longer necessary.
Added the ability to format message content in the preview modal for XML and JSON files.
Added the ability to filter the dashboard for transactions from the current day. Trends are assessed by comparing metrics to the same time period from the previous day.
Metric cards on the dashboard now include links to more detailed information, where applicable.
SSO issuer certificates are now refreshed daily, or upon failure to verify the signature in a JWT.
Changed:
All CData drivers included in the application have been updated to 2023.
Alerts for errors that pertain to a connector now mention the Id of the workspace that the connector resides in.
Flow APIs now do not create locks by default to allow for greater concurrency.
Fixed:
Fixed an issue where database connectors receiving a large number of records in a single receive operation could result in an Out of Memory exception in some environments. The Arc messaging engine now appropriately buffers message data to disk when a large number of messages are produced in a single receive operation.
Fixed an issue causing the process of populating message-related metadata from the transactions table to fail if SQL Server was used as Application Database. This only affected the working set of data present at the time of upgrading.
Fixed an issue causing health checks to fail to report the disk usage of Application Directory when set to a UNC path. If Archive Directory is set to a separate disk, it is now checked as well.
When copying one or more connectors into the same workspace as the original connectors, the copies are now placed directly beneath the original connectors.
Minor security fixes to address low level vulnerabilities.
Connectors:
Added:
Added a Kintone connector.
Rebuilt the lookup experience in database connectors to provide several key improvements:
The Lookup action now allows for selecting multiple columns and records within the same operation.
Added a designer to the Lookup action to assist in building queries, referencing information from input files, and testing the configuration directly in the settings tab.
Added the ability to target a stored procedure with a lookup through the Lookup Stored Procedure action. The existing Execute Stored Procedure action has been improved to match this design.
Changed
When a custom script or condition in the XML Map connector causes the connector to throw an error, the error now references that node by name.
XML Map no longer hides namespace definitions in the mapping editor.
Improved the performance of services that receive files passively, especially for connectors like AS2 when requests do not match a configured trading partner profile.
The Validate connector now allows for linked schemas to pass through it. For example, in a Database → Validate → XML Map flow, the XML Map connector can now reference the schema from the Database connector for mapping.
Improved the performance of the PDF Label connector.
The FTP Server connector now requires the reuse of the PI SSL session in the DI channel by default.
The Magento connector has been rebranded to the Adobe Commerce connector.
The Excel connector now allows for the specification of a range of cells where the table should be found in Table mode.
Fixed:
The SharePoint connector now better handles long filenames.
Fixed an issue in the UI of the SFTP connector that caused the server thumbprint to be overwritten when creating a new public key.
Application connectors like Salesforce, Shopify, etc. now properly handle aggregate columns when a custom query is defined.
The Email Receive connector now properly handles message attachments that are not part of MIME encoded entities.

New in CData Arc (formerly ArcESB) 2022 23.2 Build 8630 (Aug 22, 2023)

Key Features:
Added:
Added the ability to filter by ConnectorId in the Messages tab.
Added the ability to download the logs for various UI interactions, like the Send Test Email button in Settings → Alerts, and Connect buttons for OAuth.
Added a button in the preview modal for messages and logs to copy contents to the clipboard.
Added support for EC keys to SSO.
Added a QueryPassthrough input to the dbQuery, dbNonQuery, and dbCall operations.
Changed:
Relaxed the locking requirements for Flow APIs to allow for better performance and parallelism.
Health check alerts for memory usage now mention the InstanceId of the node that triggered the alert to make it easier to diagnose problems in multi-node environments.
Increased the password complexity requirements for new passwords.
Fixed:
The Windows edition setup now appropriately detects if Application Directory is within Installation Directory and skip the process of modifying the permissions of that folder.
Alerts are now triggered for certificate and license expirations regardless of the selection for error notifications.
Fixed some minor UI issues in the flow designer.
Connectors:
Added:
Many improvements to the XML Map connector, including designer driven support for variables, more flexible conditions, notifications, real-time validation for ArcScript, and the ability to test the mapping directly in the Settings tab.
Added the ability to define multiple criteria for a source value in the Branch connector, and create a separate path in the flow for each criteria.
Added the ability to define more than two output paths for a Copy connector.
Added an XSD connector.
Added the ability to discard the response body in the REST connector. The Output Behavior setting provides options for None, Request, and Response.
The Zip connector now supports creating an archive from all the Batch Messages in a Batch Group.
HIPAA schemas are now included with the X12 connector.
Changed:
The BatchMerge connector now uses a better default for the Local File Scheme setting that ensures that output files are written a with an XML extension.
Performance improvements in many connectors.
The CSV, TSV, and PSV connectors now allow for root XML elements with any name. Previously, “Items” was required to be the root element name.
Fixed:
Fixed an issue causing Execute Stored Procedure actions to fail in the PostgreSQL connector for some stored procedures.
Fixed an issue preventing the SharePoint connector from downloading files with long names in the Windows edition.
The SharePoint connector now appropriately detects new document libraries that are created after a connection is already established.
Fixed an issue causing files that failed to receive a successful asynchronous acknowledgement to be resent more than the configured number of attempts.
Fixed an issue in the FlatFile connector that prevented proper detection of the control field in complex multi-line position delimited files.
Fixed an issue preventing some files in the Additional Paths within the SFTP Server connector from being served to clients in some rare situations.
Fixed an issue preventing the FTP and SFTP client connectors from downloading very large files in some situations.
Connectors that handle incoming HTTP requests now wait until the application has fully started before serving requests. Previously, there was a small window where the connector could attempt to serve the request and result in an error due to some resources not being fully initialized.
The X12 connector no longer uses the Repetition Char setting (‘^’ by default) for documents using versions before 00404.

New in CData Arc (formerly ArcESB) 2022 23.0 Build 8601 (Jul 22, 2023)

New in CData Arc (formerly ArcESB) 2022 23.0 Build 8517 (May 2, 2023)

Key Features:
Added:
Added a new Dashboard page to provide an overview of activity when logging into the application, assess trends, and identify problems that might need attention. As part of this change the Status page has been removed, and the logs that were previously found there have been moved to their own dedicated Logs page.
Added the ability to view the entire lifecycle of a message as it travels through the flow in one place. More details can be found here.
Added a new Searching and Filtering experience for all tables, including designer-driven support for filtering by tracked headers on messages. Input and Output tabs for connectors now check for new data to show in the table in the background, and show an indicator if more data is available to be shown.
Changed:
The Scheduler tab for Reports now shows the time zone in which the schedule will run.
Updated the Embedded Jetty Web Server to 10.0.10 to address CVE-2022-2048.
The Add User and Edit User modal in the Users tab within the Settings page now allows rate limiting options to be set for users who have access to the Admin API.
The todate formatter now allows for a third strictInputFormat input to force the formatter to fail if the specified input format does not match the input exactly.
Relaxed the validation of the Content-Type header for the Flow API to allow for various other attributes to be present.
Updated the SQLite library in the .NET edition to more closely match the expected .NET runtime for the application. As part of this change, the .NET edition now requires Visual C++ 2013 Update 2 and packages that version within the setup.
Fixed:
Fixed an issue migrating early versions of caching metadata to the state database for connectors like S3, SFTP, and FTP.
Fixed various locking issues that could potentially be seen under very high concurrency.
Updated the build of the SQL driver to address various stability issues when using SQL Server as AppDB.
Improved the performance of the flow designer when the list of sample flows could not be obtained, or took a very long time to be returned due to poor network conditions.
Fixed an issue causing query parameters to not be added as message headers for certain body types in the Flow API.
Fixed a rare issue where certain sequences of characters in headers could cause display issues.
Fixed a medium level security vulnerability in the .NET Embedded Web Server.
Connectors:
Added:
SFTP Server connectors now add an SFTPServer-Virtual-Path header to received messages so the path at which those files are received by the connector can be referenced later in the flow.
The SOAP connector now allows for KeyIdentifier references for the Security Token Format.
Changed:
The validation of incoming requests for the AS4 connector was improved to also include the Service and Action on the request.
Various HIPAA schemas were added to the list of available values in the GS08 setting in the X12 connector.
New instances of Zip connectors now compress items directly to the root of the archive when operating in Scheduled Send mode. Existing instances of Zip connectors continue to use a static “Send” folder within the archive to place these files.
Improved the IBM MQ connector’s JMS support to properly handle binary messages.
The following connectors have moved out of beta into full release:
AMQP
Databricks
Dynamics 365
Exact Online
FHIR
Odoo
Sage Intacct
Snowflake
Stripe
Zoho Inventory
EDI connectors now support EDI-InterchangeReceiverIdQualifier and EDI-InterchangeSenderIdQualifier headers to specify their respective values on acknowledgements.
Updated all CData drivers that are bundled with the application.
Fixed:
Improved batch processing for database connectors to properly include NULL values as parameters instead of directly in the query.
Updated the SharePoint driver to address issues receiving files in the SharePoint connector for certain environments.
Fixed an issue that caused various connectors to be unable to retrieve OAuth tokens within workspaces that contained reserved characters.
Fixed an issue in the Email Receive connector that prevented the retrieval of emails that contained reserved characters in the to, from, and cc fields.
Fixed an issue preventing Public Key authentication in the SCP connector to work for some server configurations.
Addressed an inconsistency in the response that the API connector served in Java for calls that targeted a resource by Id.
The following connectors have been removed from the application:
DataRobot
Wasabi

New in CData Arc (formerly ArcESB) 2022 22.0 Build 8473 (Mar 16, 2023)

Added:
The Import and Export experience has been rebuilt from the ground up, adding the ability to perform global imports and exports, selective imports, conflict resolution, and more.
The CData SQL Driver can now be utilized for Application Database connections that utilize a SQL Server database. As a result, connectivity to each backend database type that is supported is possible without installing any additional drivers.
Added the ability to route a copy of successfully processed input messages down an alternate path in the flow through a new “Show Success Path” context menu option on connector shapes in the flow designer.
Reports now include a Since Last Run option for the Time Period.
Added the ability to generate certificates with a keys size of 4096.
Added the ability to import the sample flows from https://arc.cdata.com/flows/ directly in the flow designer.
Changed:
The .NET Edition now runs as a Windows Service by default for new installations.
Significant performance improvements across the whole UI, especially in environments that leverage a networked file system.
Improved the performance of loading large Batch Groups in the UI.
Improved the performance of tracked headers in the Application Database.
Added a None option to the Auth Scheme option in Settings → Alerts.
The Alerts tab in the Advanced page now allows the user to opt in to using the global proxy settings.
The cleanup routine now obeys the Cleanup Type specified for the cleanup of Sent and Send folders in addition to the Logs folder.
Fixed:
Fixed an issue in the Java Embedded Web Server that prevented the server from starting in some rare situations. This was due to an externally hosted DTD that started redirecting to a new location. As a result of this change, the embedded web server prefers local references to external ones.
Fixed a rare issue retrieving profile settings for some services in environments with very high concurrency.
Improved the memory utilization for the FTP Server Connector.
Fixed various minor UI issues in Safari.
Fixed an issue in the Salesforce Connector where OAuth tokens would not be refreshed in some scenarios.
The SQLite dll that ships with the .NET Edition has been updated to address CVE-2022-35737.
Fixed an issue in the sysExecute op where unexpected inputs were causing errors.
Fixed an issue with SSO when the web interface is accessed through a proxy.
Fixed an issue with the Weekly Status Report that caused inaccurate results in some rare situations.
Connectors:
Added:
Added Submit Vendor Shipment Confirmations, Submit Vendor Order Acknowledgement, and Submit Vendor Payments actions to the Amazon Marketplace Connector.
Changed:
Errors that arise from a passive receive now trigger an alert.
Attempts to manually receive files in MFT Connectors where no files were found to download now allow for the download of logs in order to understand why no files were downloaded.
The Notify Connector now allows for the evaluation of expressions in the message that it sends.
Database type connectors (Database, CData, Salesforce, etc.) now allow for their state data to be reset from the UI in order to be able to reprocess rows of data that may have already been processed in a previous execution attempt.
Connections within the Settings → Connections tab of Arc now allow for the retrieval of logs associated with Connect and Test Connection attempts.
More examples have been added to various scripting contexts as new snippets.
All connectors now output using Arc’s Message format by default. Previously, a connector that was not connected to another connector in the flow would write output to the Receive folder in raw format. If this behavior is still desired, a File Connector should be used instead.
The Add Table modal in Database type connectors now supports the ability to search through the available tables.
The CustomerAddress column in the Invoices table for the Stripe Connector is now translated as an XML aggregate to allow for a more seamless mapping experience.
The Square Connector has moved out of Beta into Full release.
The Tally Connector has moved out of Beta into Full release.
The WooCommerce Connector has moved out of Beta into Full release.
The DataRobot Connector is now deprecated and planned for removal in CData Arc 2023.
Fixed:
Message headers added through the _message item in the Script Connector are now appropriately reflected on output messages.
Fixed an issue in the SFTP Server Connector that caused some client connections to be dropped when multiple authentication methods are attempted in the same connection.
The Dynamics 365 Connector now shows the OAuth Client Id and OAuth Client Secret fields in the Connection modal in order to utilize grant types for which no OAuth information is embedded.
Fixed an issue in the Zoho Inventory Connector that caused an Invalid URI to be produced when testing the connection.
Fixed an issue that resulted in AS4 Connector configurations carried over from previous versions not being compatible with the current version.

New in CData Arc (formerly ArcESB) 2022 22.0 Build 8462 (Mar 7, 2023)

Key Features:
Added:
The Import and Export experience has been rebuilt from the ground up, adding the ability to perform global imports and exports, selective imports, conflict resolution, and more.
The CData SQL Driver can now be utilized for Application Database connections that utilize a SQL Server database. As a result, connectivity to each backend database type that is supported is possible without installing any additional drivers.
Added the ability to route a copy of successfully processed input messages down an alternate path in the flow through a new “Show Success Path” context menu option on connector shapes in the flow designer.
Reports now include a Since Last Run option for the Time Period.
Added the ability to generate certificates with a keys size of 4096.
Added the ability to import the sample flows from https://arc.cdata.com/flows/ directly in the flow designer.
Changed:
The .NET Edition now runs as a Windows Service by default for new installations.
Significant performance improvements across the whole UI, especially in environments that leverage a networked file system.
Improved the performance of loading large Batch Groups in the UI.
Improved the performance of tracked headers in the Application Database.
Added a None option to the Auth Scheme option in Settings → Alerts.
The Alerts tab in the Advanced page now allows the user to opt in to using the global proxy settings.
The cleanup routine now obeys the Cleanup Type specified for the cleanup of Sent and Send folders in addition to the Logs folder.
Fixed:
Fixed an issue in the Java Embedded Web Server that prevented the server from starting in some rare situations. This was due to an externally hosted DTD that started redirecting to a new location. As a result of this change, the embedded web server prefers local references to external ones.
Fixed a rare issue retrieving profile settings for some services in environments with very high concurrency.
Improved the memory utilization for the FTP Server Connector.
Fixed various minor UI issues in Safari.
Fixed an issue in the Salesforce Connector where OAuth tokens would not be refreshed in some scenarios.
The SQLite dll that ships with the .NET Edition has been updated to address CVE-2022-35737.
Fixed an issue in the sysExecute op where unexpected inputs were causing errors.
Fixed an issue with SSO when the web interface is accessed through a proxy.
Fixed an issue with the Weekly Status Report that caused inaccurate results in some rare situations.
Connectors:
Added:
Added Submit Vendor Shipment Confirmations, Submit Vendor Order Acknowledgement, and Submit Vendor Payments actions to the Amazon Marketplace Connector.
Changed:
Errors that arise from a passive receive now trigger an alert.
Attempts to manually receive files in MFT Connectors where no files were found to download now allow for the download of logs in order to understand why no files were downloaded.
The Notify Connector now allows for the evaluation of expressions in the message that it sends.
Database type connectors (Database, CData, Salesforce, etc.) now allow for their state data to be reset from the UI in order to be able to reprocess rows of data that may have already been processed in a previous execution attempt.
Connections within the Settings → Connections tab of Arc now allow for the retrieval of logs associated with Connect and Test Connection attempts.
More examples have been added to various scripting contexts as new snippets.
All connectors now output using Arc’s Message format by default. Previously, a connector that was not connected to another connector in the flow would write output to the Receive folder in raw format. If this behavior is still desired, a File Connector should be used instead.
The Add Table modal in Database type connectors now supports the ability to search through the available tables.
The CustomerAddress column in the Invoices table for the Stripe Connector is now translated as an XML aggregate to allow for a more seamless mapping experience.
The Square Connector has moved out of Beta into Full release.
The Tally Connector has moved out of Beta into Full release.
The WooCommerce Connector has moved out of Beta into Full release.
The DataRobot Connector is now deprecated and planned for removal in CData Arc 2023.
Fixed:
Message headers added through the _message item in the Script Connector are now appropriately reflected on output messages.
Fixed an issue in the SFTP Server Connector that caused some client connections to be dropped when multiple authentication methods are attempted in the same connection.
The Dynamics 365 Connector now shows the OAuth Client Id and OAuth Client Secret fields in the Connection modal in order to utilize grant types for which no OAuth information is embedded.
Fixed an issue in the Zoho Inventory Connector that caused an Invalid URI to be produced when testing the connection.
Fixed an issue that resulted in AS4 Connector configurations carried over from previous versions not being compatible with the current version.

New in CData Arc (formerly ArcESB) 2022 22.0 Build 8455 (Feb 27, 2023)

Added:
The Import and Export experience has been rebuilt from the ground up, adding the ability to perform global imports and exports, selective imports, conflict resolution, and more.
The CData SQL Driver can now be utilized for Application Database connections that utilize a SQL Server database. As a result, connectivity to each backend database type that is supported is possible without installing any additional drivers.
Added the ability to route a copy of successfully processed input messages down an alternate path in the flow through a new “Show Success Path” context menu option on connector shapes in the flow designer.
Reports now include a Since Last Run option for the Time Period.
Added the ability to generate certificates with a keys size of 4096.
Added the ability to import the sample flows from https://arc.cdata.com/flows/ directly in the flow designer.
Changed:
The .NET Edition now runs as a Windows Service by default for new installations.
Significant performance improvements across the whole UI, especially in environments that leverage a networked file system.
Improved the performance of loading large Batch Groups in the UI.
Improved the performance of tracked headers in the Application Database.
Added a None option to the Auth Scheme option in Settings → Alerts.
The Alerts tab in the Advanced page now allows the user to opt in to using the global proxy settings.
The cleanup routine now obeys the Cleanup Type specified for the cleanup of Sent and Send folders in addition to the Logs folder.
Fixed:
Fixed an issue in the Java Embedded Web Server that prevented the server from starting in some rare situations. This was due to an externally hosted DTD that started redirecting to a new location. As a result of this change, the embedded web server prefers local references to external ones.
Fixed a rare issue retrieving profile settings for some services in environments with very high concurrency.
Improved the memory utilization for the FTP Server Connector.
Fixed various minor UI issues in Safari.
Fixed an issue in the Salesforce Connector where OAuth tokens would not be refreshed in some scenarios.
The SQLite dll that ships with the .NET Edition has been updated to address CVE-2022-35737.
Fixed an issue in the sysExecute op where unexpected inputs were causing errors.
Fixed an issue with SSO when the web interface is accessed through a proxy.
Fixed an issue with the Weekly Status Report that caused inaccurate results in some rare situations.
Connectors:
Added:
Added Submit Vendor Shipment Confirmations, Submit Vendor Order Acknowledgement, and Submit Vendor Payments actions to the Amazon Marketplace Connector.
Changed:
Errors that arise from a passive receive now trigger an alert.
Attempts to manually receive files in MFT Connectors where no files were found to download now allow for the download of logs in order to understand why no files were downloaded.
The Notify Connector now allows for the evaluation of expressions in the message that it sends.
Database type connectors (Database, CData, Salesforce, etc.) now allow for their state data to be reset from the UI in order to be able to reprocess rows of data that may have already been processed in a previous execution attempt.
Connections within the Settings → Connections tab of Arc now allow for the retrieval of logs associated with Connect and Test Connection attempts.
More examples have been added to various scripting contexts as new snippets.
All connectors now output using Arc’s Message format by default. Previously, a connector that was not connected to another connector in the flow would write output to the Receive folder in raw format. If this behavior is still desired, a File Connector should be used instead.
The Add Table modal in Database type connectors now supports the ability to search through the available tables.
The CustomerAddress column in the Invoices table for the Stripe Connector is now translated as an XML aggregate to allow for a more seamless mapping experience.
The Square Connector has moved out of Beta into Full release.
The Tally Connector has moved out of Beta into Full release.
The WooCommerce Connector has moved out of Beta into Full release.
The DataRobot Connector is now deprecated and planned for removal in CData Arc 2023.
Fixed:
Message headers added through the _message item in the Script Connector are now appropriately reflected on output messages.
Fixed an issue in the SFTP Server Connector that caused some client connections to be dropped when multiple authentication methods are attempted in the same connection.
The Dynamics 365 Connector now shows the OAuth Client Id and OAuth Client Secret fields in the Connection modal in order to utilize grant types for which no OAuth information is embedded.
Fixed an issue in the Zoho Inventory Connector that caused an Invalid URI to be produced when testing the connection.
Fixed an issue that resulted in AS4 Connector configurations carried over from previous versions not being compatible with the current version.

New in CData Arc (formerly ArcESB) 2022 22.0 Build 8423 (Jan 23, 2023)

Added:
The Import and Export experience has been rebuilt from the ground up, adding the ability to perform global imports and exports, selective imports, conflict resolution, and more.
The CData SQL Driver can now be utilized for Application Database connections that utilize a SQL Server database. As a result, connectivity to each backend database type that is supported is possible without installing any additional drivers.
Added the ability to route a copy of successfully processed input messages down an alternate path in the flow through a new “Show Success Path” context menu option on connector shapes in the flow designer.
Reports now include a Since Last Run option for the Time Period.
Added the ability to generate certificates with a keys size of 4096.
Added the ability to import the sample flows from https://arc.cdata.com/flows/ directly in the flow designer.
Changed:
The .NET Edition now runs as a Windows Service by default for new installations.
Significant performance improvements across the whole UI, especially in environments that leverage a networked file system.
Improved the performance of loading large Batch Groups in the UI.
Improved the performance of tracked headers in the Application Database.
Added a None option to the Auth Scheme option in Settings → Alerts.
The Alerts tab in the Advanced page now allows the user to opt in to using the global proxy settings.
The cleanup routine now obeys the Cleanup Type specified for the cleanup of Sent and Send folders in addition to the Logs folder.
Fixed:
Fixed an issue in the Java Embedded Web Server that prevented the server from starting in some rare situations. This was due to an externally hosted DTD that started redirecting to a new location. As a result of this change, the embedded web server prefers local references to external ones.
Fixed a rare issue retrieving profile settings for some services in environments with very high concurrency.
Improved the memory utilization for the FTP Server Connector.
Fixed various minor UI issues in Safari.
Fixed an issue in the Salesforce Connector where OAuth tokens would not be refreshed in some scenarios.
The SQLite dll that ships with the .NET Edition has been updated to address CVE-2022-35737.
Fixed an issue in the sysExecute op where unexpected inputs were causing errors.
Fixed an issue with SSO when the web interface is accessed through a proxy.
Fixed an issue with the Weekly Status Report that caused inaccurate results in some rare situations.
Connectors
Added:
Added Submit Vendor Shipment Confirmations, Submit Vendor Order Acknowledgement, and Submit Vendor Payments actions to the Amazon Marketplace Connector.
Changed:
Errors that arise from a passive receive now trigger an alert.
Attempts to manually receive files in MFT Connectors where no files were found to download now allow for the download of logs in order to understand why no files were downloaded.
The Notify Connector now allows for the evaluation of expressions in the message that it sends.
Database type connectors (Database, CData, Salesforce, etc.) now allow for their state data to be reset from the UI in order to be able to reprocess rows of data that may have already been processed in a previous execution attempt.
Connections within the Settings → Connections tab of Arc now allow for the retrieval of logs associated with Connect and Test Connection attempts.
More examples have been added to various scripting contexts as new snippets.
All connectors now output using Arc’s Message format by default. Previously, a connector that was not connected to another connector in the flow would write output to the Receive folder in raw format. If this behavior is still desired, a File Connector should be used instead.
The Add Table modal in Database type connectors now supports the ability to search through the available tables.
The CustomerAddress column in the Invoices table for the Stripe Connector is now translated as an XML aggregate to allow for a more seamless mapping experience.
The Square Connector has moved out of Beta into Full release.
The Tally Connector has moved out of Beta into Full release.
The WooCommerce Connector has moved out of Beta into Full release.
The DataRobot Connector is now deprecated and planned for removal in CData Arc 2023.
Fixed:
Message headers added through the _message item in the Script Connector are now appropriately reflected on output messages.
Fixed an issue in the SFTP Server Connector that caused some client connections to be dropped when multiple authentication methods are attempted in the same connection.
The Dynamics 365 Connector now shows the OAuth Client Id and OAuth Client Secret fields in the Connection modal in order to utilize grant types for which no OAuth information is embedded.
Fixed an issue in the Zoho Inventory Connector that caused an Invalid URI to be produced when testing the connection.
Fixed an issue that resulted in AS4 Connector configurations carried over from previous versions not being compatible with the current version.

New in CData Arc (formerly ArcESB) 2022 22.0 Build 8336 (Nov 1, 2022)

New in CData Arc (formerly ArcESB) 2022 22.0 Build 8215 (Jun 30, 2022)

New in CData Arc (formerly ArcESB) 2022 22.0 Build 8208 (Jun 23, 2022)

New in CData Arc (formerly ArcESB) 2021 21.0 Build 8126 (Apr 5, 2022)

New in CData Arc (formerly ArcESB) 2021 21.0 Build 8017 (Dec 15, 2021)

Added:
Added the ability to choose between using the global or connector-specific proxy settings in the AS2 Connector.
The EmailReceive Connector now supports an Attachment Filter setting.
Added a Salesforce Connector.
Added a Shopify Connector.
Added a GET Request Body toggle to the Advanced page of the REST Connector. This toggle provides the ability to use the input file as the body of a GET request.
Added the ability to provide a custom response to requests in the Webhook Connector.
The X12 Connector now provides complete schema examples for mapping when connected to an XML Map Connector.
The XML Map Connector now allows for searching the list of Source and Destination Files when more than 10 files are available.
Added a Magento Connector.
Added a BigCommerce Connector.
Added an Apache Kafka Connector.
Added new versions of each connector in the Database category with a new single-action design. The older (multi-action) database connectors, as well as the Lookup Connector, are now deprecated and will be removed in a future release.
Added the ability to surface headers from the response as metadata on the output message in the REST Connector.
Changed:
Math formatters now use the BigDecimal type by default in the .NET Edition. Previously, double was used, which could lead to precision loss. To revert back to using double, set the FormatterNumberType key to double in the appSettings section of Web.Config.
The dbCall and dbQuery scripting operations now accept parameters through paramname#, paramtype#, and paramvalue# inputs instead of inparam:*. As a result of this change, inparam is no longer functional.
The Home Directory settings for GISB and OpenPGP Connectors are now deprecated.
The EmailSend Connector now uses a single connection when sending multiple messages through a single worker in the automation service.
The AS2 and RNIF Connectors now use Batch Groups for attachments.
The batchResults attribute in Output Mappings for Database Connectors is now deprecated. The Max Records setting in the Advanced tab should be used instead.
Database connectors (e.g. MySQL, SQLite, etc.) are now in their own category and are licensed as part of the Professional tier. Existing licenses for these connectors will still be respected to preserve backward compatibility.

New in CData Arc (formerly ArcESB) 2021 21.0 Build 7996 (Nov 23, 2021)

Major Features:
Added:
Health Checks are now performed hourly. These checks trigger alerts based on the size of the Application Database, memory usage, disk usage, and the number of files in single folders.
Added a Connections tab in the Settings page for connectors that are capable of using shared connections.
Added support for lockouts in the SFTPServer and OFTPServer Connectors to prevent DDoS attacks.
Batch Groups & Batch Messages are now supported.
Connectors:
Added:
Added the ability to choose between using the global or connector-specific proxy settings in the AS2 Connector.
The EmailReceive Connector now supports an Attachment Filter setting.
Added a Salesforce Connector.
Added a Shopify Connector.
Added a GET Request Body toggle to the Advanced page of the REST Connector. This toggle provides the ability to use the input file as the body of a GET request.
Added the ability to provide a custom response to requests in the Webhook Connector.
The X12 Connector now provides complete schema examples for mapping when connected to an XML Map Connector.
The XML Map Connector now allows for searching the list of Source and Destination Files when more than 10 files are available.
Added a Magento Connector.
Added a BigCommerce Connector.
Added an Apache Kafka Connector.
Changed:
math formatters now use the BigDecimal type by default in the .NET Edition. Previously, double was used, which could lead to precision loss. To revert back to using double, set the FormatterNumberType key to double in the appSettings section of Web.Config.
The dbCall and dbQuery scripting operations now accept parameters through paramname#, paramtype#, and paramvalue# inputs instead of inparam:*. As a result of this change, inparam is no longer functional.
The Home Directory settings for GISB and OpenPGP Connectors are now deprecated.
The EmailSend Connector now uses a single connection when sending multiple messages through a single worker in the automation service.
The AS2 and RNIF Connectors now use Batch Groups for attachments.
The batchResults attribute in Output Mappings for Database Connectors is now deprecated. The Max Records setting in the Advanced tab should be used instead.

New in CData Arc (formerly ArcESB) 2021 21.0 Build 7964 (Oct 24, 2021)

Major Features:
Added:
Health Checks are now performed hourly. These checks trigger alerts based on the size of the Application Database, memory usage, disk usage, and the number of files in single folders.
Added a Connections tab in the Settings page for connectors that are capable of using shared connections.
Added support for lockouts in the SFTPServer and OFTPServer Connectors to prevent DDoS attacks.
Batch Groups & Batch Messages are now supported.
Connectors:
Added:
Added the ability to choose between using the global or connector-specific proxy settings in the AS2 Connector.
The EmailReceive Connector now supports an Attachment Filter setting.
Added a Salesforce Connector.
Added a Shopify Connector.
Added a GET Request Body toggle to the Advanced page of the REST Connector. This toggle provides the ability to use the input file as the body of a GET request.
Added the ability to provide a custom response to requests in the Webhook Connector.
The X12 Connector now provides complete schema examples for mapping when connected to an XML Map Connector.
The XML Map Connector now allows for searching the list of Source and Destination Files when more than 10 files are available.
Added a Magento Connector.
Added a BigCommerce Connector.
Added an Apache Kafka Connector.
Changed:
Math formatters now use the BigDecimal type by default in the .NET Edition. Previously, double was used, which could lead to precision loss. To revert back to using double, set the FormatterNumberType key to double in the appSettings section of Web.Config.
The dbCall and dbQuery scripting operations now accept parameters through paramname#, paramtype#, and paramvalue# inputs instead of inparam:*. As a result of this change, inparam is no longer functional.
The Home Directory settings for GISB and OpenPGP Connectors are now deprecated.
The EmailSend Connector now uses a single connection when sending multiple messages through a single worker in the automation service.
The AS2 and RNIF Connectors now use Batch Groups for attachments.
The batchResults attribute in Output Mappings for Database Connectors is now deprecated. The Max Records setting in the Advanced tab should be used instead.