[arcade] ClrMamePro 4.014b

ClrMamePro 4.014b

• fixed: not initialized variable causes 7z decompress warnings in Windows 8.1 (64bit only)

2025-04-20 clrmame V0.4 released

UI:

• scanner, fixed showing of empty and complete machines
• scanner, fixed showing of non rom/sample/disk related machine/file/folder issues

Core:

• added: read/write support for zstandard compressed zip files

  • rebuilder, two zstd compression methods added, newly created/added files will use it (existing destination files which don't get replaced won't be updated). Source files which don't use the set compression method won't be taken into account when checking for a direct archive copy
  • scanner, automatically detects if you prefer zstd or deflate compressed zips and uses the preferred setting the case that new files are added.
  • with both, rebuilder/scanner you can theoretically end up with zip files which have files in it with different compression methods. Rebuilder: if you rebuild to existing files, scanner, if you already have a mixture of archives using different compression methods.

• added: scanner, reporting 'wrong' chd version. Current expected version is 5, warning is not shown for baddumps. Version and baddump warning can be altered in settings.xml

• misc: changed the behaviour of devices which have romOf dependencies. When fully merging such devices they are now handled like parent/clone machines. On the one hand it makes sense since there are merge attributes indicating that such sets belong together but there are also cases where they are distinct. This is now aligned with clrmamepro, but still something which might need further discussion

• misc: updated cli11 to 2.5.0

• misc: updated spdlog to 1.15.2

• misc: updated bit7z to 4.0.10

• misc: scanner, using absolute pathnames for error reporting in path scan

• misc: scanner, only trace-log machines with issues in fixing phase

• fixed: scanner, typo "uneeded"

• fixed: scanner: detection of empty but unneeded folders in archives

• fixed: scanner, backup of chds in software list collections can fail

• fixed: scanner, archives which match a valid rompath subfolder name (e.g. softwarelist name via pattern or automatically) are falsely iterated like a folder instead of listing them as unneeded (wrong placed)

• fixed: crash on rom definitions without a crc

• fixed: filter enrichment might miss sampleof dependencies

• fixed: doing archive backups from a folder and backup archive already exists creates a new archive instead of merging files in

2025-02-26 clrmame V0.3 released

UI:

• added: optionally hide/show roms/disks/samples output via context menu
• fixed: remove datasource XML file when hash folder changed (should only happen when XML file was internally created from an exe export)

Core:

• added: "available:" filter which limits the machine selection to files you have. You might notice a count difference in total vs filtered even when you got all files. This is based on the fact that a) empty sets are excluded and b) there are clones which are totally included in their parent, so -in split mode- you don't have a standalone file/folder for it. So don't worry about the count.
• misc: "file:" filter, in case you work with softwarelist collections, you'd need to prefix single entries with sl-name#pacman (e.g. a2600#pacman) to specify which set you're refering to. Not needed for single sl files or standard dats though.
• misc: some earlier cancel returns in fix wrong named disk/sample/rom/machine
• misc: dupe output now shows all found paths belonging to a machine
• misc: updated spdlog to 1.15.1
• misc: limited AUTO thread switch to 25 threads as max (or less depending on your hardware). You can still manually select more or less if you like
• fixed: dupes can be listed multiple times
• fixed: backups for unneeded folders can create wrong and very long folders due to wrong encapsuling
• fixed: backup can miss empty unneeded folders at first scan
• fixed: fill-in file from addpath/backup path was removed (when requested) even when fill-in copy failed and you might had a 0 byte new archive
• fixed: log pattern in commandline mode

2025-01-20 clrmame V0.2 released

UI:

• added: #thread selector
• added: scanner, Clipboard->Copy Machine Names option
• fixed: rebuilder log Copy To Clipboard misses linefeed

Core:

• added: you can define a thread pool size which is used for parallel scanning rebuilding/etc. Either you keep auto (default value) or pick the number of threads used for the pool yourself. "auto" picks a high value when you work with compressed files and a low value when using decompressed ones. A low value is better when you run into file seek overhead issues. If you're not happy with auto, you can try to tweak it yourself.
• fixed: scanner and rebuilder ignore output path, mergemode, pattern changes when xml data hasn't changed
• misc: more effective reimplementation of thread pools and thread queueing
• misc: prefetching sha1s on an archive if needed (speed increase, espically for archives with lots of files)
• misc: rebuilder: major update / reworked internal logic, less complex, way smaller memory footprint especially for dats out of hell (dats with thousands of dupe files), faster.
• misc: scanner, smaller memory footprint and speed update for "dats out of hell"
• fixed: scanner, accidently getting a crc32 on sub folders showing an error
• fixed: scanner, detection of unnneeded empty sub folders failed
• fixed: scanner, using old archive name when trying to remove some unneeded files causing can't remove files/can't access messages
• misc: updated bit7z to 4.0.9
• misc: updated pugixml to 1.15
• misc: use "-" instead of "_" for replacing illegal file chars (cmpro align)
• misc: monitoring hash folder for -listsoftware exports. In case of a change, cached data is ignored and a new export is generated. This is more for users which update their hash folders during the development phase of MAME on a regular basis and don't want to recompile the binary.
• misc: use one version number, fixed a tooltip typo ;-)

2024-12-03 clrmame / Scanner V0.08 / Rebuilder V0.15 released

UI:

• misc: restore default window positions when positions get out of range
• misc: increase display time of tooltips
• misc: slightly regrouped ui elements
• added: scanner, context menu option to restore old scan results on startup and selection

Core:

• misc: updated spdlog to 1.15.0
• misc: updated to 7zip 24.09
• misc: don't reload xml and build up structures when they are already in memory and need no refresh
• misc: align and share rebuilder/scanner common routines
• added: scanner, samples, supporting flac
• fixed: scanner, typo in wine script
• fixed: scanner, internal sha1 check for files with identical crc32 but different sha1 values isn't run
• fixed: scanner, samples, wrong named files (case check only) aren't fixed
• fixed: scanner, samples, wrong named files (case check only) also appear as unneeded
• fixed: scanner, samples, decompressed files are marked as unneeded
• fixed: scanner, samples, machines which reference themselves via sampleOf are marked as unneeded in full mode
• fixed: scanner, confusing 'can't remove/backup' messages in case of circular renames between different sets
• fixed: scanner, confusing 'can't remove/backup' messages in case a wrong file with a right name is replaced with a fill in

2024-11-01 clrmame / Scanner V0.07 / Rebuilder V0.14 released

UI:

• misc: scanner, contextmenu option to sort by name instead of description
• misc: Linux/Wine, users can get data from a (linux) mame binary. A wrapper script is included (requires a chmod +x ./wrapper.sh once though)
• misc: Linux/Wine, minor changes regarding line breaks or layout

Core:

• misc: in case of a -listsoftware data basis (either exe export or dat), additional sl hashes are added from either the used exe's hash folder (prio 1) or HashFolder specified in the settings xml file (prio 2).
• fixed: some absolute paths aren't made 32k path length aware, this can lead to sideeffects, e.g. when doing backups (esp. in Linux/Wine)
• fixed: scanner, removal of matched files from addPath/backup only works when at least one file was missing
• fixed: scanner, removal of unneeded files stopped after first error during a delete process so that other files in the queue were skipped
• fixed: scanner, fixing wrong named files/folders which only differ by a character case change fails
• fixed: scanner, unneeded sample files are detected but not reported or fixed
• fixed: scanner, (rare) "can't read" error message when accidently testing a folder for being a chd
• fixed: scanner, (rare) fixing wrong named files/folders which only differ by a character case but map to multiple machines keeps only 1 instance (e.g. 3DO->3do & 3dobios)
• fixed: scanner, circular renames inside a machine throw rename errors and only get resolved in a second run

2024-09-27 clrmame / Scanner V0.06 / Rebuilder V0.13 released

Core:

• misc: set current folder change back to application folder after scan/rebuild to avoid folder locking
• fixed: scanner, already moved "missing but fixable" unpacked files removes the moved file afterwards when they were also marked as unneeded in their source position
• fixed: scanner, a failed file operation on "missing but fixable" removes the file when they were also marked as unneeded in their source position
• fixed: obsolete error message when using file filters
• fixed: avoid 'can't read' ios_base::failbit set errors on files where the file length is smaller than the minimal buffer for the operation (e.g. id or header read)
• fixed: scanner, obsolete "can't access" messages during fix unneeded due to not correctly filtering already removed archives

UI:

• misc: SHIFT clicking the clear buttons clear the full combo box
• misc: when context menu show info->size is enabled, also show the sum on software list level
• misc: remember last used tab on close/start
• fixed: restore window positions incl. vertical break isn't always working

2024-09-19 clrmame / Scanner V0.05 / Rebuilder V0.12 released

Combined rebuilder/scanner in one commandline and one UI version, let's name it clrmame for now

Core:

• misc: scanner, remove matches from AddPath option now removes ALL matches, no matter if they were just real fill-ins for a missing file or already existing in a rompath
• misc: hiding sample specific problems while loading datfile in rebuilder and in scanner when no sample paths are set
• misc: scanner, skip not accessible unneeded files (loglevel trace can show information about them)
• fixed: using relative paths fails after first scan due to wrong current folder
• fixed: when an elapsed time takes less than 0 seconds, no value as elapsed time is shown ;-)
• fixed: hash calculation of empty files
• fixed: scanner, some unneeded files won't be removed but aren't reported either when fix is enabled

UI:

• added: scanner, context menu option to show clone names (in full merge mode only) which have issues right beside the set name up to 5, if there are more, you can see all in tooltips
• misc: merged rebuilder and scanner, switchable via tabs, can run in parallel (unless path sharing issues are detected)

2024-08-30 Scanner V0.04 / Rebuilder V0.11 released

Core:

• added: scanner, option to remove fill-in files from addpaths (this can include backup when 'act as' option is on). Only files which were actually needed in the rompaths are removed
• misc: changed elapsed time format and show an overall duration
• fixed: handling of loadflag="continue" fails in software list based xmls
• fixed: scanner, fixing missing roms/disks can accidently move the rom/disk when it shouldn't
• fixed: scanner, parentfolders of fill-in files can be touched (timestamp update) when they shouldn't
• fixed: scanner, fix missing roms/disks can accidently look in a folder where the match is not present leading to can't access/can't backup messages

UI:

• added: checkbox for upper mentioned remove fill-in files option
• misc: updated some flyovers

2024-08-22 Scanner V0.03 / Rebuilder V0.10 released

UI:

• added: scanner, always have software list collection sublevels (before a complete sl list only showed the complete top level)
• added: scanner, context menu option to auto expand scan results tree
• added: scanner, context menu list options are now also available on software list level
• fixed: active paths are not always remembered correctly when switching xmls or on initial load
• fixed: scanner, empty sofware lists show complete instead of empty icon
• fixed: scanner, scan results tree/log split isn't refreshed after minimizing/maximizing window

Core:

• added: long path/filename support (32k)
• misc: update to bit7z 4.0.8
• misc: scanner: propagate changed file timestamp up to rom/samplepath level
• misc: scanner: improved preferredPackMethod a bit
• misc: scanner: whenever possible, move (instead of copy/delete) missing but fixable chds or decompressed roms
• fixed: erroneously allow as an machine name character
• fixed: scanner, stopping the scan during fix operations doesn't have an effect
• fixed: scanner, freeze when fixing unneeded decompressed files (or chds) (0.02.1)
• fixed: scanner, wrong named files which are also fill-ins for missing files can trigger an obsolete file removal operation (sdiamond MAME.268)
• fixed: scanner, unneeded files/folders contain multiple identical entries (aa3020 MAME.268)
• fixed: scanner, fixing a wrong named folder failed when additional pattern folders were involved (copy error)
• fixed: scanner, fixing a wrong named folder failed when folder can have multiple new names (aa3020/a3010/aa5000 MAME.268) (move error)
• fixed: scanner, preferred path lookup for software list collections never returned additional pattern folders (copy error)
• fixed: scanner, preferred path lookup for wrong named machines which only consist of chds failed (freeze during backup)
• fixed: scanner, removal of unneeded files can result in an empty folder which isn't removed

2024-07-15 Scanner V0.02 / Rebuilder V0.09 released

UI:

• added: scanner log and tree can be X/Y resized now (mouse click+move between the 2 controls)
• added: clear button to clear all combo boxes for current 'profile' (rebuilder and scanner)
• added: clear button to remove not existing XML/EXE entries
• misc: increased the number of remembered xml entries to 10 (rebuilder and scanner)
• added: controls for unnneeded masks, include backup as addpath
• misc: improved storing of per-xml data
• fixed: filtermode setting isn't restored

Core:

• added: support more XML based datfiles
• added: unneeded masks (regular expression to filter out specifc unneeded files/folders) (e.g. ^.*(CHD|SL)$)
• added: handle backup as addpath option
• added: filter option supports prefix 'file:' to specify a file holding setnames used for filtering
• fixed: several obsolete "can't remove" errors based on not taking an in between rename into account
• fixed: machine/rom/disk/sample names may contain illegal path characters (incl. ending with .). Remove characters and warn about it
• fixed: prevent rom/disk with identical names but different hashes to get overwritten in decompressed standalone or full merged mode (e.g. sgi_mips chds). Filename gets prefixed with hash. MAME might fail loading it but at least the file is not lost
• fixed: fix-missing can skip one file from a batch and doesn't fix or report it fixed: application quits when directory scans cause an exception (e.g. access right denied)

2024-06-20 Scanner V0.01 released

• initial release

2024-06-20 Rebuilder V0.08 released

• only settings.xml is used now
• added required backup path option
• added xpath filtering
• added multiple input paths support
• using combined scanner/rebuilder core now
• updated 3rd party libs

2023-11-28 Rebuilder V0.07 released

• fix software list rom sizes determination (wasn't limited to loadflag value)
• fix software list merging (SL/SL collections don't use merge attributes, so lookup by hash in a parent/clone relationship)
• don't use # in default pattern (rompath) names since such names would be cut off when used in mame.ini due to comment handling
• pattern names can't end with '.' (Windows doesn't like this), replaced cases with "_"
• minor changes to the stats count output
• updated 3rd party libs (spdlog, bit7z, pugixml)

2023-05-04 Rebuilder V0.06 released

• run source and destination file matching in multiple threads (speed up)

2023-04-14 Rebuilder V0.05 released

• general unicode handling overhaul, utf8 chars in pathnames, patterns, xml, files, folders, archives, console output should be fine now

2023-03-12 Rebuilder V0.04 released

• support reading of (split)rar/(not split)7z and writing of 7z files
• detection of zip, 7z, rar, chd files by byte signature (instead of extensions, but not within archives)
• selectable tempfolder in settings.xml
• minor speed up due to upfront matching size check
• updated various 3rd party libs, added 7z.dll
• ctrl-c will stop the rebuilding and cleans up temporary files/folders
• various internal cleanup

2022-10-05 Rebuilder V0.03 released

• use a real move operation in case of copy/deleting single files (incl. chds)
• add option -u, --uselinks to generate filesystem hard or sym links instead doing a file copy or move operation

2022-08-16 Rebuilder V0.02 released

• since MAME can't handle subfolders in decompressed sets, decompressed sets and chds are always stored flat in folders (no clone/dependency subfolders in full or standalone mode). When kept compressed, the archives will hold subfolders
• not existing romOf reference leads to removed merge information for the machine

2022-07-13 Rebuilder V0.01 released

• initial release

4.034

• fixed: due to a cache flag error, in non-merged mode, cmpro took merge attribute information for names into account which is wrong
• fixed: setinfo, falsely hide empty parent set and its clones in tree when parent is empty but clones got content
• fixed: scanner, falsely list empty parents set in full merged mode as wrong named when parent is empty
• fixed: scanner, falsely list empty parent set in full merged, multi-software list mode as missing when set exists in various software lists
• fixed: miss list generator falsely lists sampleonly sets when they only reference parent samples
• fixed: scanner, falsely show wrong case set messages when missing option is turned off
• misc:  allow romclones to be sampleparents
• misc:  switched to visual studio 2017 (also for updater)
• misc:  updated zipArchive lib to 4.6.5, 7z sdk to 18.01