We are releasing SID into the Administration section of Curatr LXP for Pro clients this month.
If you are a Pro client, just contact us to turn it on for you! Learning Locker will need to be connected (but as a Pro client you have this anyway).
If you are not a Pro client would like to know morez about SID, or even try it, just get in touch with your Account Manager or Customer Success Manager.
Thank you to all of you who provided feedback for the previous version - we’ve made some changes to the UI as a result.
What is it?
It’s a dashboard that uses a proprietary method for judging the efficacy of online social learning interactions – we call it Social Intelligence. SID allows you to measure quality of engagement with social learning initiatives and gain insight into the actual interactions of their learners.
Using modern deep learning techniques established by our experts and data scientists, SID gives you the ability to track a learners emotional and cognitive state throughout a course allowing you to connect directly with your users and understand their progress in a more human way.
It provides insights into the quality of learner comments through a social course in terms of sentiment and engagement. These insights provide course facilitators with the tools to measure how course content has been received by learners and identify which learners have excelled or struggled with course content. This allows course facilitators to improve course content and provide personal advice to learners.
Where can it be accessed?
SID can be accessed from with your course in the Reports area of the admin area for your course.
Note: You will need to ask us to turn it on for you).
How does it work?
There are two components: Semantic Analysis and Sentiment Analysis
SID takes comments from the platform, parses them into xAPI statements, and stores them in Learning Locker. Learning Locker can then pass on new comments to our Social Intelligence
models. The Machine Learning layer is a true ‘neural network’, and not a set of predefined rules. Technically, this is a proprietary Recurrent Neural Network.
Comments are scored 0-1, where 0 = ‘passive’ and 1 = ‘engaged’. The open example below is a clear ‘engaged’ comment, a passive comment might be something like ‘nice article - thanks for sharing’. This score is called ‘Presence’ in the dashboard.
The Machine Learning layer is a true ‘neural network’, and not a set of predefined rules. We have only been able to create this model due to the thousands of comments and contributions that have been ‘hand-marked’ by data scientists over years of Social Learning research.
For this, we use a standard data set based on the AFFIN wordlist. This is a list of 2477 words and phrases, all assigned a number between minus five (negative) and plus five (positive).
The various dashboards in SID show visualisations based on this data:
Shows the individuals’ last 15 comments.
Blue = engaged
Grey = comment made, but passive
Gap = no comment
You can hover over to see the actual comments and the Presence (Semantic Analysis - 0-1) and Sentiment score (- 5 - + 5)
You can use this for:
- Identifying high performers
- Choosing good examples to share in your communications
- Identifying those who need additional support (click below the table to show more rows)
- Providing clear feedback to learners based on their scores and comments
- A general sense of what’s being said ‘right now’ in the course
- Setting a clear achievable goal - say a 10 or 15 comment streak
This is new, in response to your feedback.
This shows the current ‘Top 5’ comments based on Presence score. The use cases are much the same as for Dashboard 1, but it goes straight to the comment content.
This shows data for individuals on the course, looking at total comments made, average Presence score across them, and the ratio between those two factors.
Hover over to view an individual - in the example here, Ian has made a lot of comments, but the Presence score is low.
Use the slides to change the range - for example, you may want to filter out outliers who are likely to be facilitators.
You can use this for:
- Identifying patterns of engagement - eg. Are there lots of comments but low Presence? Can the discussion prompts be improved to help with this?
- Identify high performers and those needing additional support
This shows both Presence and Sentiment score at a Course level, by Level.
Hover over to see total comments and average scores.
In the example below, Presence is increasing as people engage more deeply with the topics, Sentiment is highest in the first level where people are enthusiastically welcoming each other to the course!
Note: You might expect Sentiment to be negative - for example, if users are discussing ‘Difficult Conversations’ or problems as part of a course.
You can use this for:
- Looking at patterns of general engagement and presence across the whole course
- Overall sentiment analysis
- Comparing levels
This course-level data is something you may wish to capture for each cohort or course to help set/measure KPIs around engagement/presence and/or to make comparisons between different ‘editions’ of courses as you make improvements.
This show volume of comments and ratio of engaged/passive comments per Object.
You can use this for:
- Analysis of performance at Object level - for improving the course. (Note - of course it could be either the input content, or the discussion prompt, or both affecting this)
- Identifying poor performing Objects for improvement , replacement or removal (open more rows at the bottom of the table for poorer-performing Objects).
- Identifying where engaged discussion is taking place - your organisation might be interested is what is being said here, or the course design/facilitation team might look for good examples here
- Identifying where to deploy facilitation most effectively
If you have any questions about SID please direct them to your Account Manager, Customer Success Manager or the Help Centre. You can also arrange a demo for your organisation through the same route.
At the end of last year, we introduced Pro pricing to simplify the offer for larger organisations/those requiring something more bespoke.
If you were an existing client then and are not sure of your current status and/or how to access all the Pro features, please get in touch.
As you know, Curatr became an LXP at the end of last year with the addition of a range of features. Many of these were designed specifically to meet long-standing and popular requests for functionality that the Courses side wasn’t suited to.
- Personal pathways
- Individualised, intelligent, recommendations
- Blended programmes that include both Courses and other resources/activities/tasks etc,
- Making additional resources and tasks available alongside a course and tracking use of these
- Better individual reporting
- Full Search of content and activities available
...and many other things!
We are aware that we have some existing clients who have not yet ‘turned on’ the Career functions and/or may not know how to make best use of them.
This functionality including 2000+ curated resources and suggested activities across 21 common Focus Areas - Leadership, Commercial Awareness, Project Management, Finance, Presentation Skills etc etc, a recommendation engine and reporting, and is available to ALL Curatr clients (Pro or not) at no additional cost.
The content includes a range of Content (for example, podcasts, blogs, videos) and Experiences (shadowing, projects, attending conferences etc)
You can also add your own content and create your own Focus Areas, with or without the content we provide for free.
‘Career’ can be enabled for either the whole organisation or specific groups.
If you would like more information, or help in setting up pilots for this, just get in touch and we’ll follow up with you directly.