Follow

Performance Analytics

 

This document acts as a guide for explaining the purpose of each mLevel analytics dashboard, followed by a guide on interacting with the various dashboards. These dashboards can be accessed at http://analytics.mlevel.com using administrative credentials. All of these dashboards refresh every 15 minutes unless otherwise specified. Please reach out to support@mlevel.com with any questions.

The Today Dashboard

today.png

The first dashboard is the Today dashboard, which shows what programs learners are interacting with and how they are doing. On this dashboard, you will find:

  • A roll-up of statistics for users created, users who have played, questions answered, and missions published or republished.
  • A chart indicating which missions have been played that day. You can click on the mission to filter the other sections of this dashboard to focus solely on that Learning Program.
  • A similar chart showing which activities have been played that day. This can also be filtered by selecting an activity.
  • Roster Performance - shows who has played an mLevel mission that day and their average mastery. This will filter by mission if you select a specific mission or activity from the list.

The Performance Dashboard

performance.png

The second dashboard is the performance dashboard, which shows mastery by day and by question. Some of the other things you can see on this tab are:

  • A menu to filter the dashboards to show information from one or more specific missions. Use the search feature or scroll through the menu to select your specific learning program.
  • A menu to filter the dashboards to show information by user group. This can be used in conjunction with the mission filter.
  • A Date Filter – use the sliders to adjust the date range you would like to see data from. The filter will automatically adjust at first to include all available data for the selected learning programs
  • A list of participants that includes their average mastery percentages. You may click on any of these learners and select “Drill Down” for information on the specific questions they interacted with.
  • Mastery per Question, including both the number of times each question was answered and the percent of times that question was answered correctly.
  • A summary detailing total engagement and average mastery.

Knowledge

updated_knowledge.png

The knowledge dashboard focuses specifically on topic mastery, using tags from questions to identify your learners’ knowledge gaps. This dashboard includes:

  • A menu to filter the dashboards to show information from one or more specific missions. Use the search feature or scroll through the menu to select your specific learning program.
  • A list of mastery by topic for a specific mission
  • A list of mastery by activity for a mission
  • A list of mastery by specific tag for a mission.
  • You can also right-click on a topic here to drill down into questions associated with that topic.

This dashboard can also be filtered by date range if you have multiple cohorts of users access the same learning program.

Completion

3.png

mLevel’s completion dashboard allows you to quickly see how many users have engaged with and completed your mission. This page refreshes at 4 AM Eastern Standard Time every day. On this screen, you can:

  • Use the selection menu at the top of the screen to specific one or more missions to collect completion data on.
  • Filter to only show users who have completed the mission or started the mission but not completed it
  • Filter by date.
  • Review a summary of total engagement and average mastery on the platform

Groups

groups.png

mLevel’s Groups tab allows you to examine the engagement of your users by user group. Drilling into a user group allows you to see how many times users have engaged with the platform, their average mastery, and the number of missions they have played:

new_groups_tab.png

You can also use the menu in the top right corner to focus on the groups performance in a specific mission or set of missions by selecting the relevant learning programs from the list.

From this list, you can also drill in to a specific user to see their specific engagement with the platform on the User Performance Card.

Tags 

The Tags dashboard is similar to the Groups tab, except it segments users by the individual pieces of information associated with a user instead of segmenting them by the groups created by an administrator:

tags.png

Designers can drill into these cohorts the same way that they are able to drill into user groups in the groups tab to see how these users engage with the platform.

User Card

4.png

When examining user data in the Performance, Groups, or Tags dashboards, you can right click on a user’s name and select the Drillthrough option to records of their knowledge across the platform:

After selecting that option, you’ll see the learner’s User Card:

user_card.png

From this page, you can:

  • Review a summary of how many times they have played activities on the platform, the number of questions they have answered, and their overall average mastery.
  • See any topic the learner has answered a question about, and their percent mastery of those topics
  • See the learner’s average mastery within any mission they have played
  • See both their plays by day and their mastery by day
  • Review all the activities a learner has played, with a row and date stamp for each activity. You can then right click on activity play to see the questions a learner answered in that activity and whether they got them right or wrong.

Question Performance Card

question_performance.png

After drilling into a topic, you will see a list of available questions. To access the Question Performance Card, right click on a question, move to the “Drillthrough” option, and select “Question performance”:

This will bring you to the Question Performance Card:

7.png

On this card, you can see:

  • How many times a question has been answered, how many unique users have answered that question, and the percent of times it has been answered correctly.
  • How many times each specific answer has been selected for a question.
  • Also, by drilling into a specific answer, you can see how often learners who chose that answer at least once have gotten this question correct.

Interacting with the Dashboards

Filters

Various filters are available, including a date slider and the option to filter for specific missions. To use a sliding filter, simply drag one end of the filter or the other to specify the range of information you would like to examine.

For selection filters, click the option you would like to select once to focus specifically on that selection. Then, click on it again if you would like to remove It from the filter. Once a choice is selected, you can choose other options as well to examine data that falls under any of those options.

Drillthrough

If you want to see more specific information about a specific question or user, you can right click on the text you are interested in and select the “Drillthrough” option to access more information about that question or about that user.

Focus Mode

Focus mode allows you to zoom in on a specific chart within the overall dashboard. To turn on focus mode, hover over the chart you would like to focus on. You’ll then see an arrow icon you may select to focus on that specific chart:

8.png

When in Focus Mode, select the “Back to Reports” option to return to the original dashboard.

Exporting Underlying Data

To export the underlying data from a report as an excel document, hover over the table or report you are interested in. you will then see a three dot menu appear in the top right corner of that space:

9.png

Select “Export Data” from that list to download the information into excel. Choosing “Summarized Data” will export a replica of the table in the platform, while the underlying data will export the information with additional identifying columns for each user.

 

Was this article helpful?
0 out of 0 found this helpful
Have more questions? Submit a request

Comments

Powered by Zendesk