Viewing knowledge token dashboards

Knowledge Token dashboards provide insights into how Knowledge Tokens (KT) are consumed when users interact with Archie Chat or use Archie Enrich features. It also includes KT consumption insights for the AI Context Engine Service (Data Analyst Agent and Catalog Agent).

Use these dashboards to:

Monitor Knowledge Token usage by users within your organization.
View the top questions asked via the Catalog Agent in data.world.
Analyze trends in Archie Chat and Archie Enrich activities. Also includes trends in the AI Context Engine service (Data Analyst Agent Events)

Key Knowledge token dashboards

Explore the following dashboards available on the Knowledge Token dashboard page. These dashboards provide visibility into run execution, Knowledge Token spend, and user engagement.

Knowledge Token (KT) Spend and Run Activity Metrics

These dashboards track Knowledge Token expenditure and activity metrics across agents.

Table 1.

Dashboard	Details	Source for the dashboards
Total KT Spend	Displays the cumulative amount of Knowledge Tokens spent across the platform.	Audit events aice_kt_consumption_events_audit aice_kt_consumption_events_audit_last_90_days
Total Runs	Indicates the number of runs that involved Knowledge Token expenditure.
Total Knowledge Token Spend by Agent Type	Breaks down Knowledge Token spend according to different agent types, offering a comparative view.
Average Knowledge Token Spend per Run by Agent Type	Calculates the average Knowledge Token expenditure per run, segmented by agent type.
Count of Knowledge Token Spend Events by Agent Type	Counts the number of Knowledge Token spend events, categorized by agent type.
Average Run Duration in Seconds by Agent Type	Displays the average duration of runs, segmented by agent type, measured in seconds.

Spend Metrics by Service

These dashboards track the spending associated with specific services, providing temporal insights.

Table 2.

Dashboard	Details	Source for the dashboards
Knowledge Token Spend by Date	Presents a time series analysis of Knowledge Token spending, highlighting trends over specific periods.	Audit events aice_kt_consumption_events_audit aice_kt_consumption_events_audit_last_90_days
Archie Chat Spend by Date	Tracks the spending on the Archie Chat service across different dates.
Archie Enrich Spend by Date	Monitors the expenditure on the Archie Enrich service over time.
Data Analyst Agent Spend by Date	Monitors expenditure associated with the Data Analyst Agent (AI Context Engine service).

User Engagement Metrics

These dashboards focus on user interactions, highlighting popular queries and consumption patterns.

Table 3.

Dashboard	Details	Source for the dashboards
Top Questions	Lists the most frequently asked questions by users, indicating areas of high interest or concern.	Audit events aice_kt_consumption_events_audit aice_kt_consumption_events_audit_last_90_days
Knowledge Token Consumption Events	Details each event where Knowledge Tokens were consumed, providing granular insight into usage patterns.

How to Interpret Event Types in the Knowledge Token Consumption Events dashboard?

Understanding event types helps filter and analyze Knowledge Token usage effectively:

Archie Chat Events: These represent chat-based interactions driven by the agent named “catalog-agent.
Archie Enrich Events: These are not tied to a specific agent name. Instead, they can be identified by a value greater than zero in the kt_bulk_archie_enrich field, which indicates that enrichment activity occurred.
Data Analyst Agent Events: These are interactions triggered by the agent named answer-agent.

Exploring knowledge token data on the dashboard

To explore knowledge tokens data on the dashboard:

In the Admin portal, go to the Dashboards page and click Knowledge Tokens in the left pane.
The dashboard displays key knowledge token metrics.
Hover over any dashboard, click the Three dot menu, and select Export. Next, choose a method for exporting or copying the data.
The data can be saved as a PNG screenshot or copied as text values.
Click the Three dot menu in any dashboard and select Refresh data to update the dashboard.
To expand a specific dashboard, hover over it and click Maximize Element.

Filtering and analyzing Knowledge Token data

Each dashboard includes filter options to refine data and analyze Knowledge Token usage trends in detail.

To filter and analyze knowledge token usage trends:

Hover over a dashboard and click Filters.
Use the following filtering options for all the dashboards on the page.
- Run Date: The calendar date when the agent run occurred.
- Bulk Operation: Indicates whether the run was part of a bulk operation.
- Organizations: Choose specific organizations to filter the data and refine the results.
- User Name: The name of the user who used the knowledge token.
Use the following additional filtering for the Knowledge Token Spend by Date, Data Analyst Agent Spend by Date, Archie Enrich Spend by Date, and Archie Chat Spend by Date dashboards:
- Date grouping: Group the data by Daily, Weekly, Monthly.
Sort and organize data:
1. Click the Column header name in the dashboard to access sorting options. Use available sorting options to arrange data effectively.
2. Click Column details to view summaries and insights about a specific column.
Copy and analyze data:
1. Right-click any value inside a table and select Copy to clipboard to copy specific data values.
2. To view total values, right-click and select Show all totals. For example, total searches by the most active users.

In this section: