• How to Resolve Formatting Issues for Data Export Reports in Microsoft Excel

    Microsoft Excel has local settings that can cause formatting errors when viewing Data Export Reports from your Udemy for Business account in the program. This article includes troubleshooting resources you can use to resolve some of these formatting issues.

    Import data through Excel

    If you find that your Data Export Reports are misformatted when viewed in Excel (i.e. all entries are in one row with no columns, separated by commas), please follow the steps outlined in this Microsoft article. It includes instructions on how you can import data through Excel, so that the report appears correctly.

    Additionally, Excel may have autofit settings enabled that can cause data cells to appear ‘squished’. If you need to adjust the column width or row height of the Excel file, please review this Microsoft article.

    Additional support

    If you have questions regarding the steps outlined in the articles above, or continue to have formatting issues after attempting the steps, we recommend contacting Microsoft Support.

    Once you've followed these steps, please try to download and open the reports again. You should be able to see them as expected.

    If you have any additional questions or continue to encounter issues, you can also contact us here.

    Read Article
  • The Ratings and Reviews Admin Dashboard

    We want to empower our Udemy for Business Admins with actionable insights to help guide and optimize their learning programs. As an Admin, through our ratings and review dashboard, you will not only be able to see how your employees have rated courses they’ve taken in Udemy for Business, but also any reviews employees left on the course as well. We encourage you to utilize learner sentiment about courses to continuously make improvements to your course recommendations, the content within learning paths, and course selections for specific programs, etc.

    How to access the Ratings and Reviews Dashboard

    To access the Ratings & Reviews dashboard hover over the Manage menu in the top right of the screen and choose Ratings and Reviews.

    ratings_and_review_menu.png

    Top 5 rated courses

    This section will show the top 5 rated courses at your organization as well as the average internal rating for those courses. This will help you to understand well-received courses at a glance and the general sentiment about the courses  from your learners. 

    top_5_rated.png

    Courses must have at least 3 ratings and have been active within the last 30 days to be included. (If there are none eligible in the last 30 days then the top 5 over the last 90 days is shown.)  

    Recent ratings and reviews

    This section contains all the ratings and reviews from learners at your organization (from June 30, 2020). You can filter by date range, user name, and the rating. They are sorted by most recent first. This will help you to understand the overall sentiment learners have about courses.

    You can click on any rating to see all other ratings left by  learners at your organization enrolled in the same course.  This will help you to see how learners are reacting to Udemy for Business courses. 

    recent_ratings_and_reviews2.png


    Course Insights Dashboard

    Rating information is also included on the Course Insights dashboard  where the average internal rating for each course is shown (when there are  at least 3 ratings for the  course).

    You can filter by the category enabling you to discover  the highest-rated courses for a specific subject.  

    More information is available in the Course Insights article.

    Group Admin Access

    Group Admins currently do not have access to ratings and review dashboards.

    How are internal course ratings calculated?

    The average internal rating is calculated by the sum of all ratings from employees within the organization, divided by the total number of employees that rated the course.

    We calculate and show the average internal rating for a course only when at least 3 ratings have been provided by learners at your organization. 

    Ratings and review data is only included from June 30th 2020. 

    NOTE* The internal rating is representative of only your organization and is calculated differently from the course rating that learners see, which includes ratings from all learners on Udemy. 

    Data freshness

    The data freshness notice shows the latest time  when  all data has been last updated. The Top 5 rated courses section is up to date at this time, however, the Recent Ratings and Reviews section is updated in real-time. 

    Read Article
  • How to Access And Review The Group Membership Log

    The Group Membership Log includes extensive information about what actions a group has completed and what employees have been added or removed.

    Admins can access the Group Membership log of every group. Group admins, however, can only access the Group Membership Log for the groups that they are group admins for. 

    For more information on how to create user groups, please click here.

    How to access the group membership log

    The Group Membership Log can be accessed by doing the following:

    1. From the Manage dropdown menu at the top, select Manage Users
    2. On the left hand side of the page, click on the group you wish to review
    3. Click on the ellipses that appears to the left of Invite New Users, and select Group Membership Log

    group_membership_log.png

    What information does the Group Membership Log include? 

    The log reports on:

    • Date: Date action was completed
    • Name: Name of employee that was added or removed 
    • Email: Email of employee that was added or removed 
    • Action: Action performed 
    • Group: Group that log is reporting on 
    • By: The method in which the user was added/removed from the group - i.e. SSO data, CSV upload, name of Admin/Group Admin, etc.  

    Note: The Group Membership log includes data from 23 March 2018 onwards.

    Read Article
  • How to Generate and Download Learning Paths Reports

    Admins and group admins can download three data export reports to view deeper insights into Learning Paths activity.

    Path activity report: Provides detailed path activity for all public paths. Some of the fields in the report include Path ID, Path Title, Path total steps, No. of Users Enrolled and Total Consumption in Minutes among others. Available on the Path Insights overview page.

    Path user activity report: Provides details on enrollments and activity per user for the path listed. Some of the fields in the report include User First Name, User ID, User Groups, Path Assigned Due Date and Path Date Completed among others. Available on the Path Insights page for a specific path.

    Path item activity report: Provides deeper insights into item activity per user for the path listed.  Some of the fields in the report include Item section title, Path item ID, Path item object type, Path item object ID and Path item duration among others. Available on the Path Insights page for a specific path.

    To download the path activity report, navigate to Path Insights > Export. Here’s a list of fields included in the path activity report:

    Path_Insights.png

    To download the path user activity and path item activity reports, click on a specific path > Export.

    path_report.png

    NOTE: Only Admins and Group Admins have access to the Path Insights page and the ability to download these reports. If a path is private, Admins and Group Admins must be the editor or enrolled in the path to be able to view Path Insights for the path and download these reports.

    Additionally, the Path User Activity Report and Path Item Activity Report are available on the Path Insights page for a specific path. As long as the Admin or Group Admin is enrolled, or is the editor of that particular path, they will be able to download these reports.

    Read Article
  • Activated Versus Deactivated Users

    Activated users are users that currently hold a license and have joined their Udemy for Business account. This means they have visited at least once to activate that license. 

    Deactivated users are users who have had their licenses removed and can no longer access the Udemy for Business portal. Some deactivated users may also have been anonymized, which means that their personally identifiable information has been deleted. Their learning data, however, is preserved. 

    When viewing the User Activity dashboard the number of active users is counted as a percentage of the total number of users who were licensed in the account during the time range selected.  This includes any users that joined (visited for the first time) before the end of the time range. It may also include deactivated users, if they were deactivated after the start of the time range. By calculating it this way, we ensure that all activity that occurred during the time range is included in the calculations.

    If you download the User Activity Report or User Course Activity Report from the User Activity Dashboard any users that were active during the time range will be included. Any of these that are currently deactivated will be marked deactivated in the report. 

     

    Read Article
  • When is Data Updated?

    The User Adoption funnel is updated in real time. The User Activity, Path Insights, Ratings & Reviews, and Course Insights dashboard, as well as all Data Export Reports, are updated several times per day.

    The date and time up to which data is included is indicated by a data freshness notice in the top right of each dashboard.

    data.png

    For more information regarding what reports and dashboards are available, please click here.

    Read Article
  • Data Export Reports: FAQ

    This article includes answers to some of the frequently asked questions our team receives regarding data export reports, and what information is featured in certain columns.

    For steps on how to generate and download a report, please click here.

    What information is included in the Minutes Video Consumed Column of User Activity and User Course Activity Reports?

    The Minutes Video Consumed column in the User Course Activity and User Activity reports

    • Include rewatches 
    • Do not include any parts of a lecture that are skipped
    • Do not take into account video playback speed.

    Examples: 

    Rewatches: If a user watched 1 hour of the course on Monday, and then on Tuesday, they watched the same 1 hour once again. In this case, the user spent two hours learning on Udemy for Business that week, and this would be reflected in both reports.

    Playback Speed: If the user watched 2 hours of content in 1 hour, by viewing the content at 2x the speed, the report would reflect they spent 2 hours viewing the course.

    Skipped Parts of a Lecture: if a user starts watching a 10 minute lecture and after 1 minute, they skip to the end of the lecture, we will only report the actual time they spent on the lecture, in this case about 1 minute. The lecture will however be marked as complete.

    The Minutes Video Consumed column only includes time that users spent watching video lectures, and not time they spent reviewing lectures that do not include videos. Lectures that do not include videos, however, still count towards course completion. For example, a User Activity Report could indicate that a user has completed four lectures, but there is no time recorded in the Minutes Video Consumed column, if those four lectures were not video lectures.

    Which specific result is posted in the Final Results for Quizzes column of  User Progress Reports?

    The Final Result column (column M) of User Progress Reports includes the last score a user recorded in the quiz. For example, if a user receives 80% on their first try, and then receives 90% on their second and final attempt, 90% will be posted in the column. Please note that there is no limit to how many times a user can retake a quiz.

    What information is provided in the User Groups Column?

    Data Export Reports feature a User Groups column which display all groups that a user is part of. Admins and Group Admins are able to easily see group membership details when exporting user reports, including 'all users' within a group. Groups are not present in the Reporting API, but customers can use our User API to get group data. In addition, when exporting reports, the list of groups is scrollable for easier selection.

    What does the First Date Complete column of the User Course Activity report indicate?

    User Course Activity Reports feature a First Date Completed column, which records the date the course was first completed by the learner. As a result, if the instructor adds new lectures or content, the date and time stamp won't be lost. If the learner completes the extra content it will be recorded as "Date Completed". The column is present in both the CSV and the Reporting API.

    How is the Course Duration column calculated in the User Course Activity Report?

    The course duration column in the user course activity report indicates how many minutes of video content the course includes. As a result, practice test courses may have a 0 or a small number listed in the course duration column, since practice tests typically feature little to no video content.

    What does the Practice Activities Completed Successfully column indicate in the User Course Activity Report?

    The No. of Practice Activities Completed Successfully column in the user activity report indicates how many practice activities the user has completed successfully. Practice activities include quizzes, coding exercises, and practice tests. (If the practice activity was started but not completed or was completed unsuccessfully it will not be included in this count.)

    If there is a row in the User Activity Report with 0 minutes consumed and 0 practice activities complete, this indicates that the user started but did not complete one or more practice activities. Or that they started and completed one or more practice activities unsuccessfully.

    Do reports include the course progress of unenrolled users?

    If a user unenrolls from a course, or their enrollment is transferred from another account, including an account at the Udemy marketplace, some activity data will be reflected in the User Course Activity report. Many of the report fields, however, are dependent on the original enrollment record and will therefore have no data if a learner unenrolls.

    If you have any questions regarding this please contact us. 

    Read Article
  • User Adoption Funnel

    Our User Adoption Funnel not only provides you with a view into how people are adopting learning, but also gives you the power to take direct action to get people to sign up, enroll in a course and start watching their first lecture.  

    While adoption can mean different things for different organizations, at Udemy for Business we define ‘adoption’ as the point at which users have watched their first lecture, after having joined and enrolled in a course.

    The Organization Adoption Rate is the number of users that have watched their first lecture as a percentage of the total number of licenses you have purchased.

    We present your user adoption in a funnel because it best describes the different steps users must take from when they first get access to Udemy for Business until they reach the point where they’re learning, ie. watching their first lecture.

    We highlight the steps of the funnel where there is a drop off in users joining, enrolling or watching a lecture to help you understand which users are not yet adopting Udemy for Business and help you take action so you can encourage them to get started. If a Single sign-on (SSO) integration (see below) is enabled in your organization then a version of the funnel with more relevant adoption metrics will be displayed.

    This report is in real-time and shows data since the creation of your organization's account.

    user_adoption_funnel.png

    Licenses

    This is the total number of licenses you have purchased for your employees on Udemy for Business.

    Invitations Sent

    This column shows you the number of invitations you have sent to your team. It includes users who have either accepted an invitation and joined your Udemy for Business account or still have a pending invitation. Cancelled invitations are not included.

    Details of invitations sent, and users who have not accepted their invitations is not shown for accounts that have SSO login enabled.

    Joined

    These users have accepted their invitation to join your Udemy for Business account and have already logged in at least once.

    Users that drop out of the adoption funnel at this step are the users that have not accepted their invitations yet. You can use the Email These Users link to remind them to claim their account, or  the Manage Invitations link in the report for quick access to your pending invitations list.

    Enrolled

    These users have enrolled in at least one course. The course may have been assigned to them or it may have been something they found and selected themselves.

    Users that drop out of the adoption funnel at this step are the users that have logged in at least once but have not yet enrolled in a course. You may wish to assign or recommend a course to help them get started. Or you can use the Email These Users link to remind them to start learning or export a list of these users and send it to the appropriate manager to follow up.

    Watched

    These users have watched their first lecture of one of the courses they have enrolled in.

    Users that drop out of the adoption funnel at this step have enrolled in at least one course, but have not yet completed their first lecture. It might be worth sending them some encouragement. You can use the Email These Users link to remind them to start learning or Export a List of these users and send it to the appropriate manager to follow up.

    Adoption by Groups

    If you have groups set up you can see how adoption is going for a specific group by selecting the group from the dropdown at the top of the page.

    The Group Adoption Rate is the number of users that have watched their first lecture as a percentage of the invitations you have sent.

     

    SSO-enabled organizations

    If SSO is enabled in your organization, the adoption funnel will contain a scaled down version of the metrics provided in the Adoption Funnel.

    Data on numbers of users joined, enrolled and watched will be displayed. Data on licenses and invitations is currently not displayed, as users are provisioned via SSO.

    sso_enabled.png

    We encourage you to also view the User Activity and Course Insights Dashboards (not available for Team Plan customers) to get additional insight on your users’ learning and engagement activity. 

    Read Article
  • Course Insights (Enterprise Plan Only)

    The Enterprise Plan includes our Course Insights Dashboard, which provides you with a comprehensive view of the courses your users are learning. It also enables you to discover the most popular courses in your organisation, based on Active Users, Average Minutes Watched (per active user), enrolled users, assigned users and ratings provided by learners within your organization. 

    Sorting and filtering Course Insights

    You can sort by the number of Active Users, the Average Minutes Watched (per active user), the number of enrolled users or the number of assigned users, depending on which metric is most important to you.

    You can use the filters to discover popular courses within the following: 

    • groups 
    • time ranges
    • categories

    For example, you can use the time range filter to see how many courses were active and how many users were active in each course within the Data Science category during the last 30 days. You can choose time ranges with day granularity within the last 120 days. Prior to this, monthly time ranges can be selected. 

    Definition of active 

    A user is active in a course if they self-enrolled, or were assigned to it, or made progress in any lecture or practice activity. 

    A course is active if there is at least one active user in it. 

    Course_Insights.png

    While the time-range filter on this dashboard enables you to see course activity within the selected time range, the average ratings shown on it are the ratings given by your users over all-time (since June 30th 2020), regardless of what time range is selected. This enables you to see the overall rating for courses that are currently trending at your organization.

    Viewing learner ratings and reviews

    From the Course Insights dashboard you can navigate into each course to discover which users are enrolled and to see any ratings and reviews that learners at your organization have left on the course.

    Viewing Learner Activity

    From the Course Insights dashboard, you can click into any course to view learner activity. Important: When a learner enrolls in a course or is assigned a course, they will appear on this page in realtime. Their activity data, however, won’t be shown until the next data refresh. To learn about how frequently data is refreshed, click here.

     

    learner.png

    Read Article
  • User Activity (Enterprise Plan Only)

    One of the insights features that is available to Enterprise Plan Users is the User Activity Dashboard, which provides you with a macro view of how active users are in their Udemy for Business accounts. By clicking User Activity from the Manage drop down menu, you can review several activity metrics for your account, and export user activity and trend activity reports.

    Some of the user activity metrics that are featured on this dashboard include total activity, average activity per user, average activity per active user, and active user base. In addition, the activity trend chart and the most active users are listed here.

    user_activity.png

    Data in this dashboard is updated regularly. Please click here for more information.

    For more information on how deactivated users are handled compared to active users, please click here.

    Read Article
  • How to Generate and Download a Report

    Under Manage --> Data Export Reports, you have three reports you can download.

    • User Activity Report: Get information at the user level (e.g. how many courses has each user enrolled in, learning time per user, etc). View your top learners across your company or by specific group.
    • User Course Activity Report: Get information at the enrollment level. Understand the courses individuals and groups are learning and sort by active users, minute per active user, and enrollments.
    • User Progress Report: Get information at the lecture level. This is our most granular report and you'll see quiz results for example.

    To download your report(s) you can follow the steps below:

    1. Select the report type you wish to export by clicking on the applicable radio button. 

    data_report_options.png

    2. Choose the users you want to include. You can select to view your data by all users or by users in groups.

    choose_users_you_want_to_include.png

    3. Specify the timeframe and click on Generate Report.  The current day and future dates cannot be selected.    

    *Note: Data generated will be dependent on the time you run a report. For example, if you generate a report on January 3rd, 2020 before 5 pm GMT, it will include data up to January 1st, 2020. If you generate a report on January 3rd, 2020 after 5 pm GMT, however, it will include data up to January 2nd, 2020.

    choose_timeframe.png

    Once your report has been generated and is ready to be exported, you will receive an email notifying you of this. The report will also be listed under the Recent Reports section of the page.

    Deleting a Report

    If you wish to delete a report you have previously generated, you can do so by following these steps:

    1. Scroll down the Export Data Reports page to Recent Reports
    2. Click on the trashcan icon beside the report you wish to delete
    3. Confirm you wish to delete the report

    delete_report.png

    For more information about the fields in the reports please click here. If your data export reports are appearing misformatted when opened in Microsoft Excel, please click here.

    Read Article
  • What Reports and Dashboards are Available?

    Udemy for Business provides a number of dashboards and reports that you can use to understand how people in your company are learning.

    Under Manage User Adoption you’ll see how many and which users in your organization have adopted the Udemy Learning account and have started using it (this dashboard is available to Team plan users). For more details click here.

    Under Manage →  User Activity you’ll understand more about user activity within your Udemy Learning account. For more details click here.

    Under ManageCourse Insights you’ll understand more about what users are learning within the Udemy Learning account. For more details click here.

    Under Manage --> Data Export Reports, you have three reports you can download to export data to create your own customized reports inside another tool. These reports are also available for download from the other dashboards where relevant. For more details click here.

    Under Manage  → Ratings and Reviews Admin Dashboard: through the ratings and review dashboard you can see how your users have rated courses they’ve taken in Udemy for Business, and any reviews they’ve left on the course. For more details click here.

    Data in these dashboards and reports is updated regularly. Please click here for more information. 

    Read Article