HPCC Systems 10.4.0.0 Platform Release Announcement

This release delivers improvements in cloud storage behavior (AWS S3), operability and diagnostics, and deployment/configuration flexibility across the HPCC Systems Platform.

Highlights include enhancements to the AWS S3 implementation, new scope filtering in XRef, expanded event recording for troubleshooting, improvements to packaging workflows, and new client tools to accelerate ECL development from JSON/XML inputs.

Performance Improvements

Cloud Storage (AWS S3)

• HPCC-35296 Improve AWS S3 implementation — Improves the AWS S3 integration and overall behavior in S3-backed environments.

Notable Changes and Features

Client Tools / Developer Productivity

• HPCC-35980 New client tools: json2ecl and xml2ecl — Adds two new client utilities, json2ecl and xml2ecl, to help convert JSON/XML into ECL more quickly and consistently.
• HPCC-35986 Document json2ecl xml2ecl Client Tools — Adds documentation for the new json2ecl / xml2ecl tools to support adoption and correct usage.

Cross-Reference (XRef)

• HPCC-35248 Add scope filters to XRef — Adds scope filtering to XRef to help operators narrow analysis and improve usability on larger systems.

Observability / Event Recording

• HPCC-35848 Add an IndexOpen event to the event recording — Adds an IndexOpen event to recorded telemetry to support troubleshooting and analysis.
• HPCC-35637 Add RecordingSource events to Roxie and ESP — Extends event recording in Roxie and ESP with additional RecordingSource events for better traceability.

Indexing and Compression Controls

• HPCC-35992 Allow index nodesize to be set in the compression string — Adds configurability for index node sizing via the compression string, enabling more control over index storage/behavior.

Tooling and Developer Workflow

• HPCC-31731 Add ecl --poll support when compiling workunits — Adds --poll support to the ecl CLI when compiling workunits, improving command-line workflow automation and visibility.
• HPCC-35907 Add option to testsocket to request summary stats — Extends testsocket with an option to request summary statistics for easier diagnostics.

Platform and Deployment

• HPCC-35715 Add the option to specify a target plane to package services — Adds support for specifying a target plane when packaging services, improving deployment flexibility.
• HPCC-35718 Allow package maps to include files that are not in superfiles — Allows package maps to include files not contained in superfiles, broadening packaging options.
• HPCC-35845 Add roxieMode and transportProtocol to the values schema — Adds roxieMode and transportProtocol to the values schema to support more explicit configuration.

Documentation Updates

• HPCC-35859 Document index default compression options — Documents default index compression options for clearer operational guidance.
• HPCC-35986 Document json2ecl xml2ecl Client Tools — Adds documentation for the new json2ecl / xml2ecl tools to support adoption and correct usage.

Additional Notes

For more details, follow the linked pull requests in each section.