Corporate Memory 23.3.2¤
Corporate Memory 23.3.2 is the second patch release in the 23.3 release line.
The highlights of this release are:
- Explore and Author:
- new charts catalog module added, which allows for defining BI widgets / charts which can be integrated into shapes
- preview release of our generative AI / LLM based Ontology and Query Assistant
- Build:
- operate BUILD like never before by using the new keyboard shortcuts (press “?” in the build module to learn the details)
- several improvements to the workflows view: create new datasets and other workflow-operators in place, dependencies and execution order is now explicitly modeled, show schema or ports
- Automate:
- new
project variable
command group plus several addition to existing commands
- new
This release delivers the following component versions:
- eccenca DataIntegration v23.3.2
- eccenca DataManager v23.3.1
- eccenca DataPlatform v23.3.1
- eccenca Corporate Memory Control (cmemc) v23.3.0
More detailed release notes for these versions are listed below.
eccenca DataIntegration v23.3.2¤
We’re excited to bring you the latest update to DataIntegration v23.3, featuring numerous enhancements, bug fixes, and deprecations.
v23.3.2 of DataIntegration ships the following fixes:
- Entities with values larger than 65k cannot be serialized.
- JSON property path evaluation fails for missing key.
v23.3.1 of DataIntegration ships the following improvements:
- Workflow operator validates XML datasets against a provided XML Schema.
- Support entering a custom ID when cloning a project or project task.
- “Evaluate Template” operator has a new option for evaluating the template on the entire input set at once.
v23.3.1 of DataIntegration ships the following fixes:
- Long task parameter values cannot be fully seen in task config preview.
- Project export does not fail if project files cannot be read.
- Unexpected inputs of a node are not executed anymore.
- Transform report does not count entities in child mappings.
- Rule operator parameter auto-complete default values do not have a label when creating a new operator.
v23.3.0 of DataIntegration adds the following new features:
- plugin base library updated to v4.3.0 (changelog)
- Support for custom plugin icon.
- New
distinct by
Workflow operator that removes duplicated entities based on a user-defined path. - Endpoint to download the DataIntegration vocabulary.
- Mappings allow custom target types
- If the new custom data type is selected, a new input field type allows the user to enter a type URI.
- Added variables widget to Workflow view.
- Added hotkey access to actions in DI workspace.
- Workflow editor:
- Validate ports and connections and show warnings for found issues.
- Have menu option to show input/output schema for ports that either expect or output a fixed schema.
- Support dependency connections between workflow nodes to specify non-data execution dependencies.
v23.3.0 of DataIntegration introduces the following changes:
- The threshold field for distance measures has been improved:
- For boolean distance measures, the threshold is not shown as it has no effect.
- For normalized and unbound measures, the range of allowed values as well as an improved tooltip has been added.
- A error message is shown if the entered threshold is not valid for the given distance measure.
- Parse JSON operator now works with multiple entities.
- Updating or deleting project variables will update all affected tasks transactionally:
- The user is not allowed to delete a variable that is used in a task parameter template.
- The user is not allowed to change a variable to a value that violates restrictions in a task that uses it
- If the task parameter has a specific type (such as integer) and the template now evaluates to an incompatible type.
- If the task imposes other restrictions on a parameter (for instance, does not allow values below 0).
- base image switch to bookworm (python:3.11-slim-bookworm)
- If a path uses a property filter, an error will be thrown on writing data to a Knowledge Graph, if the property is not a valid URI.
- Support expanding all rule trees after expanding all rows in the transform evaluation.
- Change input ports definition of
Upload File to Knowledge Graph
operator from an empty fixed schema to variable inputs to make it better compatible. - Transform page: When switching between tabs, e.g. from mapping editor to evaluation tab, the currently active rule stays active.
- JSON
#text
path now returns the formatted JSON as documented.
v23.2 of DataIntegration ships the following fixes:
- Project variables widget showing the variables of the wrong project.
- Python package uninstall is not able to remove crucial packages anymore.
- Reload failed tasks after project/workspace reload.
- Reloaded failed tasks are missing the original label and description.
- Fix property pair alignment.
- Hotkey and quick search modal are not always shown on top of other modals.
- Testing for invalid documents downloaded from GDocs fixed and adapted to new behavior of wrong requests.
- Error message in ‘SPARQL endpoint’ plugin to mention prohibited URL redirect to a different protocol.
JDBC endpoint
dataset: Setting the user via JDBC URL while leaving the user parameter blank does not work.
eccenca DataManager v23.3.1¤
We are excited to announce the latest update to DataManager v23.3, which introduces new features, improvements and bug fixes.
v23.3.1 of DataManager ships the following fixes:
- Workspace configuration: explore
defaultGraph
is now correctly evaluated.
v23.3.0 of DataManager adds the following new features:
- Implemented Charts module with Shacl integration.
- Added option to show edges without the shapes on the EasyNav canvas and in the sidebar, i.e. the node expansion is still shaped.
- Query module allows simple query creation with an form assisted dialogue.
v23.3.0 of DataManager ships the following changes:
- Internal:
- Query module is migrated from Redux to a Context storage.
- Query module is extracted to a separate common component.
- ResourceSelect doesn’t request options anymore if they have already been requested earlier.
shui:listQuery
allows usage of the{{username}}
placeholder, which is replaced by the name (i.e.not the IRI) of the logged in user.
v23.3.0 of DataManager ships the following fixes:
- Fixed broken navigation (workspace part of URL was lost).
- CMEM Manual Testing 23.2 e2e - Don’t do redundant redirects in the Module context.
- Navigation tree in the Thesaurus module was collapsed after a subitem select.
- Use more space for visualization catalogue if available.
eccenca DataPlatform v23.3.1¤
We’re excited to bring you the latest update to DataPlatform v23.3, featuring numerous enhancements, bug fixes, and deprecations.
v23.3.1 of DataPlatform ships following fixes:
- Backport of fix for URI Template ordering, when storing shaped resource + sub-resource with uriTemplate for each
v23.3.0 of DataPlatform ships following fixes:
- Fixed non-working query cancelling in GraphDb 10.3
- Wrong caching on facet query calls
v23.3.0 of DataPlatform adds the following new features:
- Added endpoint for removal of system resources i.e. bootstrap data
- GraphDb embedded development build
v23.3.0 of DataPlatform ships the following changes:
- Dataplatform health check update:
- activation of spring boot kubernetes health groups
liveness/readiness
. - creation of health group
sparql
which can be (de)activated:management.health.sparql.enabled
: (De)activates check from DP to store backend (default: true).management.health.sparql.fixedDelayInMilliseconds
: delay in ms between store checks (default: 5000).management.health.sparql.timeoutInMilliseconds
: timeout on how long to wait for store to answer check request (default: 5000).
- health group
sparql
contributes to readiness state / overall health endpoint. - GraphDB health check uses Gdb endpoint for repository.
- activation of spring boot kubernetes health groups
- Charts configuration API and Shacl integration.
- Breaking change: remove property
authorization.abox.prefix
(fixed default: http://eccenca.com/). - Workspace configuration adjustments:
Application presentation
added properties companyName, applicationName, bannerBackgroundColor.EasyNav module
added property shapePropertyView.- Chart configuration module.
- Change default system workspace values.
- Spring Boot v3.1.x
- Support for the
{label}
parameter in uri templates.
eccenca Corporate Memory Control (cmemc) v23.3.0¤
We’re excited to bring you the latest update to Corporate Memory Control (cmemc) v23.3, featuring numerous enhancements, bug fixes, and deprecations.
v23.3.0 of Corporate Memory Control adds the following new features:
project variable
command groupcreate
command - create a new project variabledelete
command - delete a project variableget
command - get the value or other data of a project variablelist
command - list available project variablesupdate
command - update data of an existing project variable
admin workspace python
command groupopen
command - open a package pypi.org page in the browserlist --available
option - list published packagesuninstall --all
option - reset the whole python environment
project
command groupcreate --label
option - give a label for the created projectcreate --description
option - give a description for the created project
dataset
command groupupdate
command - update the configuration of an existing dataset
workflow
command groupexecute --progress
option - show a progress bar
admin store
command groupbootstrap --remove
option - delete the bootstrap data
v23.3.0 of Corporate Memory Control introduces the following changes:
workflow execute
command - more debug info when polling for workflow info- Upgrade to
click
v8 (see Migration Notes). - Upgrade to debian 12 based image:
3.11.6-slim-bookworm
Migration Notes¤
Info
We do not guarantee forward compatibility for configuration, data or projects. I.e. importing a project created with DataIntegration v23.2 into DataIntegration v23.1 (or older) might not work.
Backward compatibility will be ensured or migration paths explained. I.e. projects created with DataIntegration v23.1 can be imported into DataIntegration v23.2.
DataIntegration¤
There is a known issue and existing workaround with the new dependency port feature: you may receive a message like this when running your workflows:
Workflow Execution Error: Not all workflow nodes were executed! Executed 2 of 7 nodes.
In this case, open the affected workflow in DataIntegration and click the save button once (no changes are required). After saving it will work again.
DataPlatform¤
Due to the removal of the authorization.abox.prefix
configuration option, a change in your setup may be required.
Warning
Even if you have not changed this value (to anything other than http://eccenca.com/
), please remove the authorization.abox.prefix
configuration property from your DataPlatform application.yml
. This property must be absent or DataPlatform will not start.
From v23.3 AccessCondition
s are only regarded if their IRIs use the prefix http://eccenca.com/
(e.g. have an IRI like http://eccenca.com/170f25c2-3b92-40d7-b247-5bba42dbe22a
). Required action:
- If you have been using a different prefix for your
AccessCondition
s, change the prefix of these resources. E.g. by:- search / replace the old prefix with the new one in your RDF graph backup
-
using a
SPARQL query
like:PREFIX eccauth: <https://vocab.eccenca.com/auth/> INSERT { GRAPH <urn:elds-backend-access-conditions-graph> { ?new_acl a eccauth:AccessCondition . ?new_acl ?p ?o . } } WHERE { # this Graph IRI corresponds to your `authorization.abox.accessConditions.graph` configuration # default <urn:elds-backend-access-conditions-graph> GRAPH <urn:your-custom-namespace> { ?acl a eccauth:AccessCondition . ?acl ?p ?o . BIND(IRI(REPLACE(STR(?acl), "urn:your-custom-prefix", "http://eccenca.com/")) AS ?new_acl) } } ;
Update of client-authentication-method
property needed
Due to an upgrade of the spring boot library the client-authentication-method
property needs to be chaged to client_secret_basic
in your DataPlatform application.yml
:
spring.security.oauth2.client.registration.keycloak.client-authentication-method: client_secret_basic
(was basic
which is not working anymore)
cmemc¤
- The upgrade to
click
v8 involves new completion functions (see completion manual)- Old:
_CMEMC_COMPLETE=source_zsh cmemc
- New:
_CMEMC_COMPLETE=zsh_source cmemc
- Old: