Introduction

The Copilot Usage Insights app offers a comprehensive and detailed overview of how the AI copilot is being utilized throughout the entire organization. It provides a thorough breakdown of usage statistics, categorized by different agents and large language models (LLMs). Additionally, the app provides user adoption behavior and calculates the success rate percentage, giving valuable insights into the effectiveness and engagement levels of the AI copilot.

Configuration Parameters

  • Client Selection: You can select a single client from the dropdown list. Only the selected client data will get into the report.
  • Analysis Period: Select a period from the dropdown list. The options are Last 24 Hours, Last 7 Days, Last Month, Last 3 Months, or Specific Period.
  • Supported Formats: Reports will be generated in a XLSX formats.

Reports Output

Once the report is generated, it will consist of the following sections:

  • Summary: This section provides the configuration details.
  • Executive Summary: This section provides the executive summary and success rates.
  • Agent Usage and Efficiency: This section provides information on the usage per agent.
  • LLM Provider and Model Insights: This section provides details on tokens and LLM calls by providers or models.
  • Usage Adoption and Behavior: This section contains information about the top users by tokens or LLM calls and insights on their behavior.
  • Glossary: This section contains detailed information about each section presented in the report tab, helping you to understand the generated data better.

Sample of reports in XLSX format: