SID is a dashboard that uses a proprietary method for judging the efficacy of online social learning interactions – we call it Social Intelligence. SID allows you to measure quality of engagement with social learning initiatives and gain insight into the actual interactions of their learners.
These insights provide course facilitators with the tools to measure how course content has been received by learners and identify which learners have excelled or struggled with course content. This allows course facilitators to improve course content and provide personal advice to learners.
Note: SID is available for LXP Pro clients. If you are not a Pro client would like to know more about SID, or even try it, just get in touch with your Account Manager or Customer Success Manager.
SID is only accessible by the roles Org Admin and Course Admin.
For each course SID is included under Social Intelligence in the Reports section.
How does it work?
SID scores comments based off Presence (Semantic Analysis) and Sentiment (Sentiment Analysis) on Stream comments.
Presence in SID estimates how much engagement the comment displays. The example above is a clear, engaged comment. A passive comment might be something like ‘nice article - thanks for sharing’.
Comments are scored 0-1, where 0 = Passive and 1 = Engaged.
A Sentiment score for comments is calculated based off the words and phrases used.
Sentiment is often highest in the first level where people are enthusiastically welcoming each other to the course.
You might expect Sentiment to be negative - for example, if users are discussing ‘Difficult Conversations’ or problems as part of a course.
The SID ‘Higher Order Thought’ Classifier demonstrated 96% accuracy against our expert human trainer, when measured against a wide array of context specific course data.
This displays the last 15 comments made by each user.
Blue = engaged
Grey = comment made, but passive
Gap = no comment
You can use this for:
- Identifying high performers
- Choosing good examples to share in your communications
- Identifying those who need additional support
- Providing clear feedback to learners based on their scores and comments
- A general sense of what’s being said ‘right now’ in the course
- Setting a clear achievable goal - say a 10 or 15 comment streak
This shows the current ‘Top 5’ comments based on Presence score. The use cases are much the same as for Dashboard 1, but it goes straight to the comment content.
This shows data for individuals on the course, looking at total comments made, average Presence score across them, and the ratio between those two factors. Hover over to view an individual. Use the slider to change the range - for example, you may want to filter out outliers who are likely to be facilitators.
- Identifying patterns of engagement - eg. Are there lots of comments but low Presence? Can the discussion prompts be improved to help with this?
- Identify high performers and those needing additional support
Thought Progression & Sentiment Analysis
This shows both Presence and Sentiment score at a Course level, by Level.
Hover over to see total comments and average scores.
Note: You might expect Sentiment to be negative - for example, if users are discussing ‘Difficult Conversations’ or problems as part of a course.
You can use this for:
- Looking at patterns of general engagement and presence across the whole course
- Overall sentiment analysis
- Comparing levels
This course-level data is something you may wish to capture for each cohort or course to help set/measure KPIs around engagement/presence and/or to make comparisons between different ‘editions’ of courses as you make improvements.
This show volume of comments and ratio of engaged/passive comments per Object.
You can use this for:
- Analysis of performance at Object level - for improving the course. (Note - of course it could be either the input content, or the discussion prompt, or both affecting this)
- Identifying poor performing Objects for improvement , replacement or removal (open more rows at the bottom of the table for poorer-performing Objects).
- Identifying where engaged discussion is taking place - your organisation might be interested is what is being said here, or the course design/facilitation team might look for good examples here
- Identifying where to deploy facilitation most effectively