Softpedia >Windows >Internet >Servers >Database Utils >CloverETL Designer Community >  Changelog

CloverETL Designer Community Changelog

What's new in CloverETL Designer Community 4.0.3.007

Feb 25, 2015
  • Fixes:
  • Fixed: Server fails to start on Weblogic12 with message 'Cannot initialize engine'
  • Fixed: Too many files in the sandbox make file event listener fail
  • Fixed: CloverDataWriter produces invalid clover data format when appending
  • Fixed: Persistence of A1digest for HTTPDigestAuthentication should be configurable
  • Fixed: View data on component using SFTP URL throws exception
  • Fixed: SandboxPermission should be deleted with UserGroup
  • Fixed: Log4j error message when starting Server
  • Fixed: Exceptions in server's command line when selecting Group assignment

New in CloverETL Designer Community 4.0.2 (Feb 25, 2015)

  • Features & Improvements:
  • Improved validation of installed Java version
  • Better error reporting for invalid settings of secure server configuration parameters
  • Added PARENT_RUN_ID and ROOT_RUN_ID parameters
  • Fixes:
  • Fixed: event listeners do not trigger event in case of subgraphs
  • Fixed: adjusted priority for explicitly propagated metadata
  • Fixed: missing tracking info on edges with no record

New in CloverETL Designer Community 4.0.1 (Feb 25, 2015)

  • Compatibility:
  • HTTPConnector authentication behavior has changed–see more details
  • Fixes:
  • Fixed error with Designer hanging when opening graph with subgraph from non-existent sandbox
  • Fixed problem with deleting locked files
  • Documentation now contains the correct configuration property for configuring secure JCE provider class
  • Solved error with exporting previously-exported subgraph parameters
  • Fixed problem with server failure with NPE after starting with invalid encryption configuration

New in CloverETL Designer Community 4.0.0 (Feb 25, 2015)

  • Subgraphs:
  • Subgraph support in Server runtime
  • Editing of subgraphs in Designer
  • Wrapping components into new subgraphs
  • Automatic metadata propagation
  • Subgraph functionality extended to standalone Designer
  • Improved subgraph editor
  • Configure subgraphs as components
  • Explicit metadata propagation
  • Open subgraphs on Ctrl + mouse click
  • Updated CloverETL perspective
  • Server Administration & UX:
  • Optimized Execution History tree for large numbers of jobs (10k+)
  • Added filtering of Executions History by sandbox
  • Always show and expand nested jobs when searching for job by its run ID
  • Use syntax highlighting in Server Console
  • Display warning on startup if Java memory is low
  • Features & Improvements:
  • Added graph Cleanup action to remove unused elements
  • Added filter to Palette for searching in components
  • Added MongoDB components to Community Designer
  • Added JSONExtract component to Community Designer
  • Added support for SSL client certificate in HttpConnector
  • Added ability to export debug data to a CSV file
  • Renamed EmailSender attribute "Use TLS" to "Use STARTTLS
  • Simplified New ETL Graph wizard
  • Added escapeURL function for ordinary strings, not just complete URLs
  • Removed Marquee tool from palette
  • Added filename to UniversalDataReader log after error
  • Launch Service parameter names are derived from dictionary
  • Added a new toolbar in the Edit Component dialog with common actions
  • Jobs can have an execution label defined
  • Improved edge routing algorithm
  • Improved the user interface of AddressDoctor component
  • Improved performance of CloverDataReader (removed unnecessary deserialization)
  • Added new allocation type (run on all nodes)
  • Highlight unused objects in Outline
  • Better defaults of DataGenerator
  • Sleep component without connected ports
  • Better metadata editing using keyboard
  • TableauWriter component
  • Open a running or finished job in Designer
  • Updated CloverDataReader and CloverDataWriter components
  • Loop support in ETL graph
  • Loop component has new attribute "Token logging"
  • SpreadSheetWriter can write into existing sheet in streaming mode
  • Added and improved CTL functions
  • Cleanup of graph context menu
  • Add and remove custom component properties
  • Link to component from console
  • Select parameter for a component attribute in a dialog
  • Configurable JCE provider for encrypted Server configuration
  • Server cron scheduling supports seconds
  • Possibility for the Execution History of Server Console to show only jobs that the user has access to in sandbox
  • Tasks History in Server Console filters on Status column
  • Compatibility:
  • CloverETL requires Java 7
  • Upgraded versions of supported application containers of Server
  • Upgraded libraries that were in very old versions
  • Added support of MySQL 5.6 as Server configuration database
  • Sybase is no longer supported as Server configuration database
  • Deprecated components are now hidden
  • Removed old FactTableLoader wizard
  • CTL: fixed substring() inconsistency with 2 and 3 parameters
  • CTL: split() now returns empty list if input is null
  • CTL: indexOf() now accepts null values
  • Fixed EmailReader propagating CC to all succeeding records
  • Removed CTL compatibility check wizard
  • CloverETL Server supports Tomcat 7
  • CloverETL Designer is bundled with Eclipse 4.3
  • New Runtime for Designer
  • XLSDataReader and XLSDataWriter are deprecated
  • XMLExtract: explicit mapping has priority over implicit automap by name
  • Accessing non-existent tracking field in jobflow output mapping fails
  • Subgraph debug input and output components identified by position in graph
  • Additional graph parameters are set by Runtime (such as RUN_ID).
  • Removed special ZIP support in CloverDataReader and CloverDataWriter
  • Database connection shared by multiple components in graph does not perform commit if the graph fails.
  • Fixed DeleteFiles recursive delete deleting the whole sandbox if fileURL was empty
  • Removed "Export metadata to XSD" wizard
  • Removed "Export graphs" wizard
  • New Designer Runtime:
  • New Runtime layer in Designer
  • Improved Execution user interface
  • Extended graph parameters:
  • Public graph parameters
  • Graph parameters have a type
  • CTL2 as parameter value
  • Editor for parameter files
  • Content assist for server parameters
  • Fixes:
  • Fixed sanboxes.home not being accessible during initial deploy, Server not starting after restart
  • Fixed asterisk in Samba URL causing unexpected behavior
  • Fixed AddressDoctor configuration dialogs missing some options
  • Fixed job type icon sometimes not displayed in Server Console
  • Fixed SortWithinGroups losing records
  • Fixed exception when unregistering JDBC driver on JBoss
  • [ETL Developers (This item is most useful for developers; it either brings new functionality for transforming data or brings optimizations)] Fixed CTL2 performance issues in locale and timezone manipulation
  • Fixed EOF as delimiter not working for fixed length metadata
  • Fixed MongoDBWriter handling of null values
  • Fixed MongoDBWriter batch mode error handling
  • Fixed RunGraph component not supporting running jobs in separate JVM
  • Fixed CTL error reporting issues in ExtFilter
  • Fixed DB Lookup not accepting key longer than 10 digits
  • Fixed space preceding a * in wildcard mapping not reporting error in Designer or Runtime
  • Fixed FTP disconnect error not correctly reported
  • Fixed Server bundle not starting if path to its installation contained the space character
  • Designer Runtime improvements:
  • Secure paramers support in local projects
  • Set engine properties

New in CloverETL Designer Community 3.5.0.036M2 (Nov 1, 2013)

  • CloverETL Data Quality:
  • The goal of the CloverETL Data Quality package is to meet the need to understand and monitor the quality of your data. Data Quality starts with discovery – an ability to get quick insight into potential quality issues with a dataset. To see patterns, distribution of missing fields, incorrect data types, and more. This insight helps you decide how to further handle the dataset. Do you have really unclean data, calling for a rigid workflow with manual correction steps? Or can an occasional error here and there be fixed automatically?
  • Put Data Quality To Work
  • Once you have identified potential issues, the tools in the CloverETL Data Quality package will help you analyze and validate data in the transformations. With the newly introduced Validator, you can visually define data quality rules and apply them within your workflow easily. Adding the power of jobflows to the mix, you can fully embrace a powerful data quality strategy using CloverETL.
  • Please note the CloverETL Data Quality package will ultimately replace our Data Profiler extension. With the Data Profiler as part of the package, users will benefit from more comprehensive Data Quality tools.
  • Visual rule-based data filtering. Replace coding with visual business rules designer.
  • Encrypted Parameters
  • JSONExtract
  • Server Status Monitoring
  • Configuration Migration
  • Server Usability Improvements
  • Features:
  • External CTL files are now supported – Introducing standalone editor for CTL files. Full validation and context is available except component related information like edges connected and metadata declarations. (CLO-1731)
  • CTL editor has better context-assist (data types, local variables) (CLO-2199)
  • Improved graph export to HTML - components are interlinked, graph image is an active image map with link
  • New function round(number, precision) (CLO-1812)
  • EXASolution connectivity (CLO-1591)
  • HTTPConnector has a new option "Stream input file" for better performance (CLO-1937)
  • HTTPConnector has new mapping field "requestContentByte" and "contentByte", adding byte support on top of the existing string variants. (CLO-1032)
  • New attribute "Sorted input" on writers that support partitioning by key. This optimizes performance as files for keys in order can be closed immediately after writing. (CLO-812)
  • Duplicate external metadata (creates an internal copy) (CLO-1114)
  • Fixes:
  • Fix-length file parsing fixed when metadata contains autofilling fields as last fields
  • JavaBeanReader performance improved by using "nodeName" direct access rather than XPath
  • SpreadsheetDataReader mapping dialog was not opening for corrupt style information in Excel files. (java.lang.IndexOutOfBoundsException fixed)
  • Fixed file operations paths: relative vs. absolute path for remote location – see attached issue for explanation (CLO-1509)
  • Function removeNonPrintable() no longer removes non-ASCII accented characters (e.g. chars ä, ö, etc.) (CLO-1814)
  • Fixed JSONReader: fields containing underscores were not populated in implicit mapping (CLO-1015)
  • HTML graph export – fixed performance and star ($out.0.* = $in.0.*) mapping redering (CLO-1449)
  • Removed limitation for "maximum cache size" in the lookup dialog (CLO-1037)
  • Fixed Server not being able to process a task (in a listener or scheduled) without "clustering" enabled (CLO-1658)