Follow these steps to create a catalog, and manage assets in the catalog.

You can use your own data files, or download the sample data files from the catalog assets github repository.

Create and manage access to a catalog

  1. Click Catalogs > View All Catalogs to get to the Your Catalogs page, and then click New Catalog.
  2. Specify these properties:
    • A name and optional description for the catalog.
    • The IBM Cloud Object Storage service. A dedicated storage bucket for the catalog is automatically created.
    • Whether to enforce data policies on the catalog. If you enable it, you can’t disable it. See Data governance.
  3. Click Create. Your new catalog opens. You can start adding assets and collaborators to it. You have the Admin role within the catalog.

To add one or more collaborators to a catalog:

  1. On the Access control page, click Add Collaborator.
  2. Enter the user’s name or IBMid in the Collaborators field and then select the user in the search results. You can copy multiple IBMid email addresses, separated by spaces, and paste them into the Collaborators field.
  3. Specify the role for all users:
    • Viewer: can only look at the catalog
    • Editor: can use, add, and control access to assets.
    • Admin: has full control of the catalog.
      See Catalog collaborator permissions.
  4. Click Add.

Add assets to a catalog

To add a local file to a catalog:

  1. Click Add to catalog > Local file.
  2. Browse for the file or drag it onto the drop area.
  3. Specify the asset properties.
  4. Click Add. The asset is added to the catalog and the file starts loading into the catalog’s storage. Do not leave the catalog before the file finishes loading.

To add a connection asset:

  1. Click Add to catalog > Connection.
  2. Choose a data source.
  3. Enter the connection information required for your data source. Typically, you need to provide information like the host, port number, user name, and password.
  4. For on-premises databases, choose a Secure Gateway service or configure a new Secure Gateway service.
  5. If there’s a Discover data assets option for the data source, you can add all tables from the connection as data assets to a project. Select Discover data assets and choose a project. Then you can evaluate and refine the tables before you publish them to the catalog. See Discovering data assets from a connection.
  6. Click Create.

To add a connected data asset to a catalog:

  1. Click Add to catalog > Connected asset.
  2. Select an existing connection asset as the source of the data. If you don’t have any connection assets, click Create Connection and create a connection asset.
  3. Select the data you want and click Add. For partitioned data, select the folder that contains the files. If the files are recognized as partitioned data, you see the message: This folder contains a partitioned data set.
  4. Specify the other asset properties.
  5. Click Add. The asset appears on the catalog Browse page.

To add a folder asset from a connection to a catalog:

  1. If necessary, create a connection asset. Include an Access Key and a Secret Key to your IBM Cloud Object Storage connection to enable the downloading of files within the folder asset. If you’re using an existing IBM Cloud Object Storage connection asset that doesn’t have an Access Key and Secret Key, edit the connection asset and add them. The Access Key and Secret Key are the HMAC credentials access_key_id and secret_key_id
    and you generate them in your IBM Cloud Object Storage credentials by adding the inline configuration parameter {"HMAC":true}. For more information, see IBM Cloud Object Storage Service credentials.
  2. Click Add to catalog > Connected asset.
  3. Click Select Source to select an existing connection asset as the source of the data.
  4. Select the folder you want and click Add.
  5. Specify the other asset properties.
  6. Click Add. The asset appears on the catalog Browse page.
  7. Click the folder asset name to view the contents of the folder asset. Click the eye (eye icon) icon next to a file name to preview the contents of the files within the folder that have these formats:
    • CSV
    • JSON
    • Parquet

To publish an asset from a project to a catalog:

  1. From the project, select the assets that you want to publish to the catalog, and click Publish.
  2. Choose the catalog and fill in the asset properties. If any of the assets require a connection, those connections are listed and will be added to the catalog as connection assets, including connections to IBM Cloud Object Storage for uploaded files. If you don’t want to publish a connection, you can remove it. All assets that require the removed connection are removed from the list of assets to publish.
  3. If you are publishing a dashboard asset, you can provide a preview by taking and attaching screen captures.
  4. Click Publish. The assets are added to the catalog and you are the owner of them.
  5. After an asset appears on the catalog Browse page, click its name to view and update it.

Add assets from a catalog to a project

To add catalog assets from within a project:

  1. From your project, click the Find and Add Data icon (Shows the find data icon.).
  2. Click the Catalog tab and choose a catalog name.
  3. Select the assets you want and click Add to Project.
  4. If prompted, choose or create a required service instance.
  5. Review your selection and click Add. If the assets require connections, the connection assets are also listed to be added to the project, including connections to IBM Cloud Object Storage for uploaded files.

To add assets to a project from the catalog:

  1. From the catalog Browse page, search for the assets you want to add and select them.
  2. Click Add to Project.If any of the assets require a connection, those connections are listed and will be added to the project as connection assets, including connections to IBM Cloud Object Storage for uploaded files. If you don’t want to add a connection, you can remove it. All assets that require the removed connection are removed from the list of assets to add.
  3. Choose the project name.
  4. If prompted, choose or create a required service instance.
  5. Click Add.

Join The Discussion

Your email address will not be published. Required fields are marked *