March 15th, 2012· Added new macro @inputPath to contain the path to the input file, with a
· trailing slash. This lets you easily create output folders at the input path location.
· Added new macro @inputExtension to contain the extension of the current input file.
· Output Filter's Single Output Filename, new File Extension and New Path can
· now all contain macros.
· Added support for Open Office Writer (.ODT), Calc (.ODS) and Impress (.ODP) file types as new compressed file types.
· HTML Restriction filter now supports entity names with embedded colons (:) and hyphens (-) which is essential for working with Open Office files and other XML types.
· EasyPattern keyword [backwardSingleQuote] renamed to [graveAccent] as the original name was incorrect.
· The right-click context menu on the Filter Tree now allows groups of selected
· filters for 'Make Into a Subfilter' and 'Promote'.
· Fixed operation of log 'overwrite' option - the log cache would not clear
· previous logs created since TextPipe was started. Logs were also not being closed at the completion of a filter job, hence they could not be deleted.
· Macros and environment variables are now allowed to contain numbers, provided that the first character is not a number.
· The right-click context menu of the replace string now inserts captured variable names instead of $1, $2 etc when you ask it to insert a CSV, Tab or XML string. This makes it far easier to identify which fields belong where, as well as making the replacement string less sensitive to changes to the search pattern.
· New optimization for named captured variables - TextPipe replaces these with the captured variable number behind the scenes - so you get the ease of use benefits of named variables, with no speed decrease.
· EasyPatterns now allow a literal (ie a string of characters) inside a 'not'
· expression, e.g. not 'ABC', or not EBCDIC('HDR').
· Mainframe copybook filter can now remove FILLER fields inside OCCURS blocks.
· Supported but not installed code pages now show 'NOT INSTALLED' beside them.
· Fixed AV's when saving or loading a file when running under Windows 7.
· Sort filter set to maximum allowed memory of 2GB to avoid integer overflows.
February 7th, 2012· New filter to perform a calculation on restricted text e.g. add 1.5 to a
· field.
· Comment filter now allows Unicode text.
· Windows Home Server no longer considered a 'Server' platform.
· Log files now support Unicode.
· Fixed action of 'Skip/Replace in Rest of File' when used inside a restriction - previously it carried forward for the rest of the job, instead of the rest
· of the current file.
· Remove multiple whitespace filter now generates detailed log information.
· Trial Runs now generate the same logging data as real runs.
· Fixed missing filters from Lite Edition.
· TextPipe only registers its COM object during install and for the /REGSERVER
· command line option - preventing errors on less-than-admin use.
· Restored action of F9 button to start running when the All Filters view is
· selected.
· Opening and Updating zip file log messages are now clickable.
· Updated third-party zip DLL to improve Windows x64 support.
· Fixed handling of double backslashes in the replacement term for
· search/replace lists when consecutive search was selected.
· Unicode strings are now converted to UTF8 when the perl pattern filter has
· UTF8 mode selected.
· Restrict to matching/non-matching filenames now works with files of unlimited size.
February 7th, 2012· Fixed Sort filter allowing duplicates.
· Entering \x{1234} when UTF-8 mode is enabled for a perl pattern match now
· does not show a validation message.
· Updated PCRE engine.
· Fixed scrolling of found text into view in Prompt On Replace dialog.
· New [Add Files] button on Files to Process tab.
· Combo boxes now work with right-click context menus.
· Search/replace list import now supports Unicode.
February 7th, 2012· Updated PDF libraries for extraction from more recent file formats.
· Added large [Add Files] button to Files to Process tab.
October 24th, 2011· Capture Text, Break on Value Change window now shows length of strings and
· current cursor position.
· Updated internal PCRE (Pattern Matching ) engine to v8.13 and support for
· Unicode 6.0.0.
· Updated Unicode internal libraries to support Unicode 4.1 for Normalization
· etc.
· COM callees are now notified of Stack violations (e.g. during pattern
· execution) or other critical errors via the existing 'FilterWindow.errorText'
· variable.
· Only modified files are added back into Zip files such as .zip, .docx, .xlsx
· and .pptx.
October 14th, 2011· Updated x64 extension to only show current file name, not full path.
· Better checking for changed files with Extract matching/non-matching lines
· and Remove matching/non-matching lines.
· All Available Filters tree now show properly when the text 'Search...' is
· translated.
· Fixed errors with TP Engine not unloading cleanly, and not returning data.
September 16th, 2011· Windows Explorer x64 extension working!
August 18th, 2011· Fixed Browse buttons not resizing correctly.
· Converted file list field to Unicode.
· New 'Close' buttons in basic forms (editor, copybook tree viewer).
· Now handles 'Convert Word/Excel to text' inside subfilters, prior to the job
· starting (e.g. for processing exclusion lists etc).
· Fixed Mainframe copybook filter handling of OCCURS .. DEPENDING ON .. when
· the Trim Fields option was checked.
· Fixed display of Unicode text in various multi-line edit fields.
July 27th, 2011· Fixed crash on filter run when working with files.
· New 'Open Containing Folder' for filter lists.
· Fixed bug when double-clicking on filenames.
· Filter search now works for filters like 'Sort' - where previously the invisible short cut character & prevented this from working.
· Search/replace lists now returned to naïve UTF-8 handling.
· Binary test now works for Unicode filenames.
July 19th, 2011· Fixed bug with the way that PlaySound was called at the end of the filter job
· which caused crashes.
July 8th, 2011· New search function to quickly find matching filters or external files.
· Simultaneous search now works with patterns - not just Exact match.
· Filter move Up/Down buttons in short cut menu.
· Enable/Disable prompting in short cut menu to easily debug large groups of
· filters.
· Secondary output filters are no longer removed when pasting.
· Log files are now opened in their associated app rather than in Notepad when
· double-clicked or when [Show] button clicked.
· Better Unicode filename support when filenames are launched by double-
· clicking on text fields.
· Updated internal pattern matching libraries.
· TextPipe Engine now logs just as the GUI can.
· Unicode filenames now supported by Merge Filename; Output Extension, New Base Folder and Single Output Filename; Split Filename; Log filename; Map comment; String filters' filenames, Search/Replace List filename.
· Unicode filename support in status grid, file grid, processing etc.
· New macro @filterPath.
April 13th, 2011· Dimmed filters now cannot be double-clicked to add them.
· While loading a search/replace list, TP now responds to events.
· Link Filter now in every edition.
· List filename now gets loaded properly.
April 11th, 2011· Added .ODT as a compressed file type so that OpenDocument documents can be handled just like Office .DOCX format compressed XML files.
· New Files to Process field to load files from a list file (note - this
· ability was already available from the command line with /L= and from COM via addFileList).
· The Replace List filter now has a button to paste a list from the clipboard.
· Added new exit code of 255 for abnormal termination due to textpipe.exe being killed or an unexpected error.
· Deferred hooking into Windows HTML help system for faster startup.
· Migration of filters from Pro to Standard, and Casing filters from Standard
· to Lite.
March 24th, 2011· New file date and file size filters to help select files to be processed.
· New context menu items for filter list, to duplicate, demote or promote
· filters.
· Renamed variables in Extract-generated .vbs and .js scripts for consistency
· and readability.
· Lite and Standard version now show dimmed menu items for unavailable options.
· Upgraded PCRE pattern engine.
· Improved speed of double-quoting and trimming mechanism in Mainframe Copybook
· filter.
· New EasyPatterns [DayNameLocal] and [MonthNameLocal].
· Default for loading older Mainframe Copybook filters without Force Quotes
· options is now set to unchecked.
· Fixed EasyPattern keyword 'atomic'.
· Fixed coInitialize/coUninitialize COM errors with repeated running of the
· scripting filter.
February 14th, 2011· Comment filters and other filters with multi-line values now display just the
· first non-blank line in My Filter List.
· Various GUI fixes.
· ew macro @outputFilename to output the name of the output file without the
· path.
· Correct detection of Windows XP x64 as a non-server O/S.
· Updated code to detect My Documents and AppsData folder under Windows 7.
· Convert Excel to Text filter now outputs a form feed (ASC 12) character
· between worksheets.
· Filter lists are now freed on completion. E.g. Filters that load large
· suppression lists (e.g. 300MB Remove matching lines filters) can now be run
· repeatedly without restarts.
· Better error trapping for Out of Memory errors and other exceptions that
· occur during filter execution.
· Many memory leaks fixed, making working with large files multiple times far
· easier.
October 27th, 2010· The Output Filter setting of 'Backup Mode' now does indeed rename the
· original input file to '.bak' rather than operating on the output filename.
October 19th, 2010· Setting the global variable @CLIPBOARD using a Capture Filter or a named
· variable in a search pattern now sets the Windows clipboard as well.
· Missing Recently Used files are now removed from the list.
· New 'atomic' keyword allows EasyPatterns to match either all or none of a
· group
· Mainframe Copybook Filter in the Server Edition no longer automatically adds
· a Split CPU filter.
September 8th, 2010· Shell extension now supports Unicode filenames – fixed error with only the first letter of menu options being shown.
August 25th, 2010· Mainframe copybook filter now allows trailing minus sign to identify signed
· fields e.g. PIC 9(11)V99-.
· Fixed problem where status messages were occasionally lost or doubled up.
· Improved Unicode file handling.
August 13th, 2010· Fixed bug with output files causing file rename errors.
August 11th, 2010· Sound on completion when run from command line now uses settings from
· Preferences (rather than being forced on). Can be overridden using
· /PLAYSOUND.
· Updated Explorer Context Menu to support Unicode.
· Now uses updated zip library.
· Partial support for Unicode filenames.
· Fixed bug with Ignore Case always enabled, for Count Duplicate Lines and
· Remove Duplicate Lines filters.
· Fixed bug where @ and $ signs in the replace string were handled incorrectly-
· when used in the Search/Replace list filter in sequential mode.
July 1st, 2010· Log file is now closed and re-opened every 30 seconds so that the file size
· increases over time. If you open the file it will still show the currently
· written data.
· Fixed input file gathering - new files are now available for processing
· immediately rather than grouped by folder. Previously, folders with thousands
· of files would cause an apparent stop in processing.
· Uninstaller now does not require explorer.exe (Explorers and Task bar) to be
· closed; reboot or logoff required as before.
· Cancel button now does not pause thread until [Ok] clicked, due to conflicts
· with suspending the thread.
May 19th, 2010· Fixed bug in MultiCPU version with Split CPU filter stopping output files
· being written.
· Merge filename is now added to the COM output files list.
· Fixed TextPipe Engine bug with Edit Distance search/replace and Convert to
· Word List not working on first filter execution.
· Fixed Insert Filter option changing filename and inserting extra Output
· filter.
May 11th, 2010· If the Output file cannot be written to (e.g. the network resource is no
· longer available), then the Input filter option to Delete Input Files is
· ignored. The Open Output Files On Completion option is also ignored in this
· case.
· When run from the command line, errors (such as no matching files to process)
· now do not require manual intervention. They are available in the log if it
· is turned on.
· If TextPipe cannot create a temporary file on the target drive (e.g. if it is
· a network drive), then it falls back to creating it on the local machine in
· %TEMP% and copies it across at the end of the job.
April 15th, 2010· Fixed bug with HTML filter when 'Include text' is unchecked, the restriction
· is designed to match text between open and close tags, and the open tag has no text after the tag name e.g.
April 7th, 2010· Split filename can now include macros using @varname syntax.
· Database filter now copes with multiple record sets from a single query.
· Changed installer to not require admin, for Vista and Windows 7.
· TextPipe now does not require admin rights to run - which in Windows
Explorer:
· restores ability to double-clicking a filter to open it
· restores the TextPipe context menu
· restores drag and drop.
· Clipboard input and output can now both be in Unicode format.
· New COM method terminate() to allow filters to be stopped when called from
· execute() or executeClipboard().
· TextPipe Engine now supports the Split CPU filter.
· Fixed bug that occurred with T-Filters and Uppercase/Lowercase filters. The
· Upper/Lower filters overwrote memory so that modified text could occur in the
· alternate stream of the T-Filter.
· Fixed filter 'Restrict to filenames matching pattern'.
February 24th, 2010· Mainframe copybook filter - now displays a red bar at column 72 - any data beyond here gets truncated in line with mainframe commenting standards.
· COM function addSimpleFilter() now exports the isUnicode option.
· Much more complex pattern matches now allowed - increased limit of capturing
· patterns from 99 to 65535.
· Removed environment variable capability from the split filename because of conflicts with %f, %e and %d macros for the file name, extension and number.
February 18th, 2010· Mainframe copybook filter - alpha fields now have quotes added around them, and existing quotes are doubled up to escape them.
· Environment variables now allowed in the split filename.
December 3rd, 2009· Added [alphanumeric] and [numeric] to EasyPatterns.
· Fixed validation when a Restrict to Filename NOT matching filter was missing
· subfilters.
· Fixed bug in invocation from shell extension.
December 3rd, 2009· Modified TextPipe and TextPipe Engine so that error messages are now
· available through the ErrorText variable when called via COM.
· Output file size was missing from the log.
November 24th, 2009· Fixed Unicode Search/Replace error that caused file corruption beyond 64Kbytes.
November 20th, 2009· Fixed error with clearing of output strings.
November 18th, 2009· Script errors that occur at Run Time are now logged as warnings in the log
· rather than stopping the filtering.
· Fixed error with parsing of output strings.
November 5th, 2009· Fixed shell extension not starting filters correctly.
October 29th, 2009· New 'Prepare Query' option for database filter to make SELECTs more
· compatible
· Fixed elapsed time display when duration was less than 1 second
· New Edit MenuPreference to control if Word Wrap is on by default in edit
· controls
· New command line option /fromshellext to indicate if a filter is being run
· from the Windows Explorer shell extension. Existing files in a filter
· triggered from Windows Explorer are now cleared and a warning given
· Added new COM function addMainframeCopybookFilter() to recreate Mainframe
· Copybook Filters
October 13th, 2009· Pre-compiling of replace expressions for faster replacing
· UTF-8 grep support
· simultaneous search for 300,000+ phrases
· new grep option to ignore empty matches
October 6th, 2009· New pre-compiling of replace expressions for faster replacing.
· New 'Break on Change' option for captured variables makes debugging far
· easier.
· Revamped the simultaneous search/replace filter to work with lists of
· 300,000+ replacements. New Longest First option.
· Copybook filter now copes with nested OCCURS where the nesting contains only one field (special case).
· Copybook filter now copes with OCCURS DEPENDING fields.
· Copybook filter now outputs the header only once - very useful inside the
· restrictions that are required for processing variable format files.
· Copybook wizard - fixed disabling of trailing delimiter on last field.
· New command line option /CLOSEONCOMPLETION - which closes the filter window when a thread completes. This is typically used with a /Z command line file and a large set of filters.
· New option for Count Duplicates Filter to change the format of the results -
· e.g. put tab between the count and the string, reverse the order etc.
· Grep filter now has an option to match UTF-8 characters for Unicode text.
· Convert to Word List filter now allows words with numbers such as Catch-22,
· 24-7, 5th, 7-Eleven etc.
· Remove duplicate lines AND Count duplicate lines filters now do not require
· that the duplicate lines be adjacent (i.e. that the list is pre-sorted).
· However, it now has the restriction that it cannot speedily remove or show
· duplicates from files LARGER than main memory.
· Grep filter has now been changed so that it does NOT match empty lines.
· TextPipe is now much faster when logging is disabled.
· TextPipe no longer records output file names beyond a count of 10000. These
· filenames are only used for .BAK file recovery, and they cause a performance
· slow down when millions of files are being processed.
· Fixed function for removing empty output files. The input file was being
· deleted if the output file had zero size.
· Fixed problem with duplicate data appearing in large sorts requiring merge
· files with 2 or more merge stages.
· Reverted handling of blank fields/blank lines to pre 8.3.5 handling. Pad to
· Width and Add Left Margin filters cannot be used for blank fields (use an Add
· Footer filter to give a blank field some width first).
· Fixed bug in HTML Restriction filter where the action of the 'Include start
· and end tag' option was inverted.
July 24th, 2009· Simultaneous search replace,
· remove empty output files,
· Mainframe Copybook enhancements
July 17th, 2009· New Simultaneous search replace option for FiltersSearchSearch and Replace List Filter- use when your search and replace terms overlap each other e.g. replace 1->7, 7->10, 10->1.
· Copybook filter now recognises field names starting with numerics e.g. 14B-
· DATE.
· Copybook filter now copes with nested OCCURS, and numbers the generated field names correctly.
· New 'Copy to Clipboard' option when a hex dump is displayed from a field's
· context menu.
· New Output filter option to remove empty output files (those with a size of 0
· KB).
June 24th, 2009· Fixed performance of Trim option of mainframe copybook filter.
May 5th, 2009· Fixed handling of blank fields when using Restriction Filter and a subfilter
· such as Pad to Width, or Add Left Margin
· Fixed file modification detection when using subfilters of a Search/replace
· or HTML Restriction filter
· Fixed memory leak that occurred when the Skip Binary files option was used
· Fixed VBScript/JScript code generated - missing end of line for
· TPWindow.inputDeleteFiles
April 23rd, 2009· Fixed bug with [Delete BAK files] button not being enabled.
· Installer changes to support Vista better.
March 27th, 2009· Fixed bug with Converting Excel spreadsheets to text when the output was set to the clipboard.
· If logging is enabled, a setting of 'Don't log to file if line count is less
· than' = 0 now causes all lines to be logged, rather than none. To disable
· logging, uncheck the logging flag. This primarily affects calling filters
· from the TextPipe Engine.
· The copying of all predefined global variables from the command line
· (@name=value) now occurs no matter how the filter is called.
· Enhanced Windows Explorer Context Menu handler to better handle huge sets of files (20,000+).
March 10th, 2009· Fixed bug in using UNC paths \servershare etc - these conflicted with the
· environment variable parser's desire to eliminate duplicate \
· Changed Directory scanning routines to allow files with any attributes.
March 4th, 2009· Fixed bug in using external reference file for Replace->Search/replace list
December 16th, 2008· Now recognizes the new Office 2007 format .xlsx (e.g. search/replace lists).
· Fixed line count statistics displaying -1 for subfilters that are never
· invoked.
· Default is now to process compressed files (.zip, .docx, .xlsx, .pptx).
· Restored play sound on completion for command line filters.
December 14th, 2008· Removed file copy on first run from Engine version
October 14th, 2008· Fixed buffer underrun problem with search/replace filter, where maximum match sizes larger than 4KB were not correctly performed.
September 11th, 2008· Version 8.1.10
· New 'Paste File List from Clipboard' button on Files To Process tab.
· Files to Process grid is now refreshed after loading a File List.
· Embedded Help is now loaded correctly from the application folder.
· URLs can now be inserted or loaded from a File List without being interpreted
· incorrectly as filenames.
April 21st, 2008· Globals can now be set on the command line using the syntax @name=value with a space between each set of values.
March 26th, 2008· New extended logging for Remove Blank Lines, Remove Blanks from Start/End of Line.
February 22nd, 2008· When run from the command line, TextPipe now does not show a dialog on errors such as a filter file could not be loaded. An exit code is set and the log file written instead.
· Fixed a bug where the Analyse function on the Files Grid did not return a result.
February 14th, 2008· Fixed a bug where the Copybook Filter used the wrong parser if PIC was preceded by a tab instead of a space.
February 5th, 2008· Mainframe filters now insert implied decimals correctly when the fields are blank padded.
· Right-clicking a filter now shows a 'Help on this filter' link which quickly takes you to the help file without needing to add the filter. Using HelpEmbedded Help also constantly updates to show you help on the current filter.
January 9th, 2008· Now warns if the user tries to use the Trial Run area to process a Mainframe Copybook (a file must be used).
· Task Menu filters now open a status window so that progress and/or errors can be reviewed.
· The evaluation version (even an expired version) can now be used to check if a filter is compatible with the Pro, Standard or Lite version.
· The Restrict to Filename filter (used to rename files on the fly) now skips processing filenames inside zip/docx/xlsx/pptx files.
January 9th, 2008· Now warns if the user tries to use the Trial Run area to process a Mainframe Copybook (a file must be used).
· Task Menu filters now open a status window so that progress and/or errors can be reviewed.
· The evaluation version (even an expired version) can now be used to check if a filter is compatible with the Pro, Standard or Lite version.
· The Restrict to Filename filter (used to rename files on the fly) now skips processing filenames inside zip/docx/xlsx/pptx files.
October 24th, 2007· * Fixed bug with Search/Replace in Exact mode, if the Action was set to 'Remove', the text was not actually removed.
· * Added collection and logging of statistics to Lite and Standard editions.
September 12th, 2007· Grep functions can now match blank lines using the pattern ^$.
· Fixed script generation for addUnicodeConversionFilter2.
· Fixed COM function TextPipeFilter.compiledFilterStartJob.
· Grep functions can now match blank lines using the pattern ^$.
· Fixed Copybook Filter choosing incorrect parser if 'pic' used rather than
· 'PIC'. Copybook Filter now accepts field names that include spaces. Parse
· tree output now includes periods so that it is still a valid copybook. Fixed
· field width for P (Packed) type when using alternate style copybooks.
June 23rd, 2007· New Word Concordance filter under FiltersConvert.
· New filter Restrict to Blocks of Lines - useful for adding text after every XX lines.
· Reinstated Filters menu for accessibility, and File Menu items Link to Filter, Insert a Filter, Search for a filter.
· Refined the pattern generated by filter Restrict to Between Tags.
May 25th, 2007· New Multi-Processor support (in Server version) with FiltersSpecialSwitch
· CPUs to direct filtering to different CPUs. This enables massive performance
· enhancements for large data crunching tasks.
· Vista install support.
· Now detects Unix files being loaded into Trial Run area, and warns the user
· and offers to add an End-Of-Line conversion filter.
· Mainframe Copybook Wizard - fixed incorrect implied decimal.
· - has been completely re-written as a filter. The parser now shows the line
· number of any parse error, handles INDEXED BY clauses, logs warning if
· invalid record at end of file, XML output option.
· - now handles non-PIC style copybooks
· TextPipe now highlights the filter in error correctly, taking into account
· comment filters.
· New macro @filterFilename to output the filter filename.
· TextPipe.filterFilename is also available in the scripting filter.
· Comment filters are now shown in green italics to make the filter list more
· readable.
· Fixed pattern generated by filter Restrict to Between Tags.
· An inability to log messages to the log file now causes a Windows Event Log.
· Tightened up the Analyse File Format function to correctly identify BOM and
· DOS End-Of-Lines in files.
· Fixed /Q exit on completion race condition which caused TextPipe to not exit
· reliably. This only occurred when a new processing thread started and
· finished before (!) the main thread processed the /Q command.
· Fixed EasyPattern bracket optimization. Now shows the line number of any
· error, and fixed [PhoneNumber] pattern.
· Fixed Perl/EasyPattern exception with named captured variables and Prompt on
· Replace was turned on, when the named captured variable did not match
· anything.
· Remove remaining memory Info log item on Merge sort.
March 9th, 2007· Explorer Context Menu now shows the filename without the extension
Convert Excel to CSV filter now does not use a TEMP file in C:
· The Mainframe Copybook Wizard now correctly discards INDEXED BY statements.
September 14th, 2006· Mainframe Copybook Wizard now handles PIC fields both before and after OCCURS
· TIMES for single field OCCURS statements.
· Optimized tree updating as field data is changed.
· Changed install paths for Windows Vista.
Find us on Google+
