Known issues and limitations for AI Factsheets

Setting the Status field to an empty string results in AI use case not loading

Applies to: 4.8.3 or later
Fixed in: 4.8.5

If you set the Status field for an AI use case to an empty string, then the AI use case page will fail to load and you might see the error: Cannot read properties of undefined (reading 'charAt'). This is most likely to happen when you are defining the use case from IBM OpenPages.

To resolve the problem, update the Status field to provide a value.

Upgrade to AI Factsheets service 4.8.3 displays incorrect navigation

Applies to: 4.8.3 Fixed in: 4.8.4

AI Factsheets 4.8.3 includes an updated user interface and main navigation. You now access AI use cases and External models in the AI Governance section of the main navigation menu.

You might find that after the upgrade from 4.8.x to 4.8.3, the main navigation menu is not updated and incorrectly displays Model inventory in the Catalogs section of the main navigation menu.

To resolve this problem, manually restart the zen-watcher pod.

Upgrade of any service might fail on cluster with IBM Knowledge Catalog installed and upgraded when AI Factsheets is installed in same cluster

Applies to: 4.8.2
Fixed in: 4.8.3

Problem: Upgrading AI Factsheets or any other Cloud Pak for Data service can fail under these conditions:

• IBM Knowledge Catalog is installed in the same cluster as AI Factsheets.
• IBM Knowledge Catalog is upgraded.

Resolution: Run this command from the Red Hat OpenShift Container Platform cluster:

oc delete ZenExtension fs-routes -n $PROJECT_CPD_INST_OPERSANDS

User without access to tracked models cannot view the attachments in the factsheet from lifecycle tracking page

Applies to: 4.8.2
Fixed in: 4.8.3

If you are an administrator user with OpenPage and Factsheet integration configured, you might be unable to view some factsheet data, such as attachment details, for some AI models being tracked.

To resolve this issue, the project/space owner containing the AI model being tracked must explicitly add you as a project/space collaborator. You will then be able to view the attachment details in the factsheet.

Last modified information for updated assets tracks both user-made and internal changes

Applies to: 4.8.0 and later

The last modified information displayed for an asset tracks both changes done directly by a user and changes done internally by services. For example, the factsheet for a tracked model might indicate that the most recent modification was done by System.

Upgrade IBM Knowledge Catalog and Watson Studio before you upgrade AI Factsheets

You must upgrade IBM Knowledge Catalog and Watson Studio before you upgrade AI Factsheets. If you try to upgrade the AI Factsheets service to latest version before you upgrade IBM Knowledge Catalog and Watson Studio, users might see some inconsistencies and unexpected results with usage of the AI Factsheets service until all of the upgrades are complete.

Integration limitation with OpenPages

When the AI Factsheets is integrated with OpenPages, the fields created in the field groups MRG-UserFacts-Model or MRG-UserFact-Model and MRG-UserFacts-ModelEntry or MRG-UserFact-ModelUseCase are synced to modelfacts_user_op and model_entry_user_op asset type definitions. However, when the fields are created from the OpenPages application, avoid specifying the fields as required, and do not specify a range of values. If you mark them as required or assign a range of values, the sync will fail.

Common namespace required for related services

For AI Factsheets to log the appropriate information, all supplemental and compatible components must be installed in the same namespace. This includes the following services:

• Watson OpenScale
• IBM OpenPages
• IBM Knowledge Catalog
• Watson Studio
• Watson Machine Learning

Tracking pauses during upgrade process for IBM Knowledge Catalog

If you used AI Factsheets as part of IBM Knowledge Catalog before 4.6 and must install it again as a standalone service, tracking updates will be suspended from the time of the IBM Knowledge Catalog upgrade until AI Factsheets is installed. The facts for the models that are created or updated in that gap will not be tracked by AI Factsheets. You need to update the metadata of the model such as name, description, tags.

See Upgrading AI Factsheets for more details.

OpenPages model use cases and some external assets owned by System in model inventory

When the AI Factsheets service is integrated with IBM OpenPages, the model use cases that sync with the model inventory are owned by System because they are created by the Factsheets service. Existing model assets created from OpenScale evaluation facts are also owned by System. New external model assets created with OpenScale evaluation facts provide the option to assign them to an asset owner. For more information, see Adding an external model to the model inventory.

If you have Administrator access to a catalog, follow these steps to assign a user as owner:

1. Open the asset in the catalog and select the Assets tab.
2. Add the user (who has access to the catalog) who will be assigned ownership as a collaborator.
3. Click the Edit icon for Asset owner in the About this asset section.
4. Select the username to assign as owner.

Parent topic: Limitations and known issues