Workforces, Statistics, and Feedback.

The Hivemind platform empowers our clients to use collective human judgement to solve complicated problems in their unstructured data. Many of our clients employ external workforces to perform this work, and our latest release makes the management and orchestration of tasks using many workforces easier.

Qualifications

Qualifications have been the mechanism that allow precise targeting of tasks to specific users in Hivemind. As part of the workforces feature in this release they are now more powerful.

The new Qualifications screen allows users to create qualifications describing skills and teams within their organisation and share these with partner organisations.

 
 

As an example, an organisation called Omega Inc. provides workforces to Alpha CorpOmega Inc. can define qualifications that identify skills or qualify their team members to do certain tasks. They can choose to share these with Alpha Corp who can assign them to tasks that they wish Omega Inc workers to complete.

For workforces using Hivemind Workbench tasks are now segregated by organisation. There is an organisation filter on the side navigation identifying how tasks are being filtered on the main tasks page allowing the contributor to change which organisations tasks they see.

 
change-org3.gif
 

Task creators can use any qualifications shared with them to target external workforces. In addition to this, more granular logic can now be described using qualifications. You can now define groups of qualifications on a task and see how many contributors are being targeted by those groups. This adds the ability to send tasks to multiple distinct groups.

 
 

Contributor Statistics

Also in this release is a complete redesign of the contributor statistics pages in both Workbench and Studio. We now present data in a clearer tabular format and allow you to drill into that data for more detail on how your contributors are performing, and how much time they are spending across their assigned tasks.

As part of this feature, there is a new metric called “daily standardised task time” which allows the productivity of different contributors to be compared even if they have completed a different combination of tasks.

Feedback

Task creators now have the option to enable feedback on a task. Feedback provides a way of quickly notifying a contributor that their previous work has disagreed with the consensus answer. This feedback is presented to contributors in Hivemind Workbench.

The benefits of enabling feedback are that it prevents prolonged periods of wasted effort, flushes out ambiguity in task instructions, and provides a systematic way of improving data quality.

Changelog

  • Workforces — we’ve made the routing of tasks to multiple external workforces even easier.

  • More power with qualifications — now groups of qualifications can be defined and used to target multiple workforces.

  • Contributor Statistics — A complete redesign of contributor statistics allowing easy analysis of contributor performance.

  • Feedback — let contributors know when they have disagreed with the consensus answer as a way of improving data quality and reduce wasted effort.

  • Task timeouts — Task creators can now set the timeout time of a task from the Instances Settings page in the task creation/edit screens in Hivemind Studio.

Thanks to Alexander Dawes.