Performance Analytics

 

Performance Analytics

Performance Analytics in MLevel allows administrators and trainers to quickly evaluate performance data to identify learning opportunities within their organization. Because all dashboards refresh every 15 minutes this data is accessible near-real time. This document acts as a guide for explaining the purpose of each dashboard found in MLevel and how to interact with them. These dashboards can be accessed at https://analytics.mlevel.com using administrative credentials. Please reach out to support@mlevel.com with any questions.

Defining Your Data Set

Before viewing any data found within Performance Analytics, you must first define your data set in the left navigation menu before selecting one of the dashboards. The steps and explanation for each filter is outlined below.

1. Select a Tenant Filter: The tenant filter applies to a learning environment. Tenants in MLevel can be used to indicate specific environments for different organizations within a company or different geographic regions. If your MLevel environment only has one tenant, this option will automatically be selected and you should leave it as-is. If your MLevel environment has multiple tenants, select the tenant(s) that contain the mission(s) you are interested in reporting on.
2. Select a Group Filter: The group filter applies to the user group(s) that exist within each environment. Depending on your use case, these groups can be created to accommodate anything as specific as a new hire class to something as large as a Sales Region. By default, all Groups that an admin has access to will be selected. 

Once you’ve made your selections, it will be applied automatically to any of the dashboards you select. If you would like to change those filters, simply update your Tenant and Group selections, and either select a new dashboard or select the current one again to display the data filtered by your new selections.

The Today Dashboard

The first dashboard is the Today dashboard, which shows what programs learners are interacting with and how they are doing. On this dashboard, you will find:

• A roll-up of statistics for users created, users who have played, questions answered, and missions published or republished.
• A chart indicating which missions have been played that day. Click on the mission to filter the other sections of this dashboard to focus solely on that Learning Program.
• A similar chart showing which activities have been played that day. This can also be filtered by selecting an activity.
• Roster Performance - shows who has played an MLevel mission that day and their average mastery. This will filter by mission if a specific mission or activity is selected by clicking on the relevant orange column.

The Performance Dashboard

The second dashboard is the performance dashboard, which shows mastery by day and by question. Some of the other things you can see on this tab are:

• A menu to filter the dashboards to show information from one or more specific missions. Use the search feature or scroll through the menu to select specific learning program(s).
• A Date Filter – By default, this filter automatically displays all available data for the selected mission. Click into either Date Range field to open a date picker widget to isolate data found in a specific date range.
• A list of participants that includes their average mastery percentages. Click on any of these learners and select “Drillthrough” to access their User Performance card.
• Mastery per Question, includes both the number of times each question was answered and the percent of times that question was answered correctly.
• A summary detailing total engagement and average mastery.

Knowledge

The Knowledge dashboard focuses specifically on topic mastery, using tags from questions to identify learners’ knowledge gaps. This dashboard includes:

• A menu to filter the dashboard by mission(s). Use the search bar or scroll down the menu to select a specific learning program.
• A list of accuracy by topic for a specific mission.
• A list of mastery by activity for a mission.
• A list of accuracy by specific tag (concept) for a mission.
• Right-click on a topic to drill down into questions associated with that topic.

This dashboard can also be filtered by date range if multiple cohorts of users access the same learning program.

Question Performance Card

After drilling into a topic, a list of available questions will be presented. To access the Question Performance Card, right click on a question, move to the “Drillthrough” option, and select “Question performance”:

This will bring you to the Question Performance Card:

On this card, you can see:

• How many times a question has been answered, how many unique users have answered that question, and the percent of times it has been answered correctly.
• How many times each specific answer has been selected for a question.
• Also, by drilling into a specific answer, you can see a list of users that chose that answer at least once.

Completion

MLevel’s completion dashboard quickly identifies how many users have engaged with and completed their mission(s).  On this screen:

• Filter by date.
• Review a summary of total engagement

Administrators have the ability to drillthrough to the high level completion statistics and export the completion records for learners who have accessed the program. To access those records, you will right click on the name of a mission while on the Completion dashboard and select "Drillthrough":

After selecting "Drillthrough", you will see the below report. You can then use the three dot menu up and to the right of the report to export the individual completion data for that mission for your records.

If you would like to see the data for a different mission, use the green back arrow and to return to the previous menu.

Groups

MLevel’s Groups tab displays the engagement of users by user group. The groups displayed will match what is listed in the filter, but this dashboard gives you the opportunity to look at the roster engagement holistically rather than mission by mission.  Drilling into a user group displays how many times users have engaged with the platform, their average mastery, and the number of missions they have played:

• Use the menu in the top right corner to focus on a group’s performance in a specific mission or set of missions by selecting the relevant learning programs from the list.

From this list, you have the ability to drill in to a specific user to see their engagement with the platform by accessing their User Performance Card.

User Tags 

The Tags dashboard is similar to the Groups tab, except it segments users by the individual pieces of information associated with a user instead of segmenting them by the groups created by an administrator:

Designers can drill into these cohorts the same way that they are able to drill into user groups in the groups tab to see how these users engage with the platform.

User Card

When examining user data in the Performance, Groups, or Tags dashboards, right click on a user’s name and select the Drillthrough option to view a record of their knowledge across the platform:

After right-clicking and selecting the option illustrated above, you’ll see the learner’s User Performance Card:

From this page, you can:

• Review a summary of how many times they have played on the platform, the number of questions they have answered, and their overall average mastery.
• See any topic the learner has answered a question about, and their accuracy percentage for each of those topics.
• See the learner’s average mastery for any mission they have played
• See both their plays by day and their mastery by day
• Review all the activities a learner has played, with a row and date stamp for each activity. Right click on activity play and select "Drillthrough" to see the questions a learner answered in that activity and whether they got them right or wrong.

Interacting with the Dashboards

Filters

Various filters are available within each dashboard, including a date picker and the option to filter for specific missions.

For selection filters, click the option you would like to select once to focus specifically on that selection. Then, click on it again if you would like to remove it from the filter. Once a choice is selected, you can choose other options as well to examine data that corresponds to those options.

Drillthrough

If you want to see more specific information about a specific question or user, you can right click on the text you are interested in and select the “Drillthrough” option to access more information about that question or about that user.

Focus Mode

Focus mode allows you to zoom in on a specific chart within the overall dashboard. To turn on focus mode, hover over the chart you would like to focus on. You’ll then see an arrow icon you may select to focus on that specific chart:

When in Focus Mode, select the “Back to Reports” option to return to the original dashboard.

Exporting Data

To export the underlying data from a report as an Excel document, hover over the table or report you are interested in. You will then see an ellipses (three dots) icon appear in the top right corner of that space:

Select “Export Data” from that list to download the information into an Excel file. Choosing “Summarized Data” will export a replica of the table in the platform, while the underlying data will export the information with additional identifying columns for each user.