In some instances, you may wish to assign multiple users to rate particular submissions due to their particular area of expertise or interest. To make this easier, you can use the Bulk Assignment feature where you can assign selected users quickly. Those users can rate those Submissions with the help of the Bulk rate feature.
Two new features have been added to make this even easier:
- Bulk assignment of users as Evaluators
- Bulk rate functionality to rate multiple assigned Submissions at once
1. Bulk assignment of users as Evaluators
As the Application Owner and/or the Campaign Manager of a Campaign, you can assign multiple evaluators to multiple Submissions via the Campaign Management tab.
ProTip: Use the Filters in the Campaign Management tab to narrow down the list of Submissions. This will help you to select the Submissions you want to assign to certain users based on attributes.
For example, as an Application Owner or Campaign Manager, you may want to filter for certain Technology Areas and then assign the Expert(s) of that area.
How to assign Evaluators
- Navigate to the Campaign Management tab. (1)
- There are multiple ways to narrow down the list of Submissions via the filter section: (2)
- Search for certain Submissions via the search field in the Search filter tab. (3)
- Filter down the list of Submissions you want to assign, e.g. by certain criteria such as “Technology”. Click on the Filter button and apply the Filter tab criteria as desired. (3)
- Apply rating filter via the Rating filter tab. (3)
- Once the filters are applied, click on the Bulk Assign icon on top of the Kanban Board column. (4)
- In the Assign evaluators popup window (5), you can search for users or double click in the search field to get suggestions (6). After you have selected all necessary users, don’t forget to click Save. (7)
Assign Evaluators in Time-Bound- vs. Always-On-Campaigns
The process of assigning evaluators is the same for Time-Bound- and Always-On-Campaigns on the ITONICS system. For both Campaign types, there is the Bulk Assign icon at the top of the Kanban Board column.
The only difference is that there can be multiple active (rating) phases for Always-on-Campaigns and therefore you can assign Evaluators for Submissions in different phases.
In Time-Bound-Campaigns, there can only be one active rating phase.
The difference between Assigned Evaluators and users with rating permission
Assigned Evaluators: Those users have access to the Campaign Management tab and are able to use the Bulk Rate feature to rate their assigned Submissions.
Users with Rating permissions: Those users are assigned via the Campaign Workflow Configuration for each rating phase.
Those users are allowed to rate all Submissions from the respective phase.
Note 1: Assigned Evaluators are automatically given view permissions for the assigned Submissions, regardless of whether their user role has the view permissions from the Campaign Workflow Configuration.
Note 2: Assigned Evaluators do not necessarily need the rating permissions that can be assigned from the Campaign Workflow Configuration.
Note 3: Assigned users via the Campaign Workflow Configuration do not have access to the Campaign Management tab and therefore not to the Bulk Rate feature.
How to remove Evaluators
On each Submission Detail page, a new tab called Evaluators is added (1). Check out the article about Tab Configuration to find out how to change the title of that Tab according to your own wording.
In this tab all Evaluators for each rating phase (2) are listed. There is a Filter section (3) where you can search for usernames or Email addresses, as well as filter for the respective Rating Phase.
Next to the Filter button there is a Manage Evaluator button (2). Clicking on it opens a popup that lists the Evaluators of the active rating phase. You can check multiple users and click the Remove selected Evaluators button at the top of the popup window.
2. Bulk rate functionality to rate multiple assigned Submissions at once
General Tip: Use the powerful Filters in the Campaign Management tab to narrow down the list of Submissions.
For Always-On Campaigns and for Time-Bound Campaigns there are 2 options available on how to access the bulk rate functionality:
- From the Campaign Management Tab
- From the Campaign Detail Page
Always-On Campaign
- Navigate to the Campaign and open the Campaign Management tab. (1)
- On each Board column you find a Bulk Rate icon (2). The columns represent the Campaign phases.
- Quick filters will help you to filter for your Not rated by me and already Rated by me Elements per phase. (4)
- (prerequisite: You only see the icon if you are assigned as Evaluator in that phase)
- Navigate to the Campaign Details Page tab. (1)
- In the sidebar you find action buttons that give you access to your Rate all Elements and Rated only unrated Elements per phase. (2)
- (prerequisite: You only see the icon if you are assigned as Evaluator in that phase)
Time-Bound Campaign
- Navigate to the Campaign and open the Campaign Management tab. (1)
- On the Kanban Board column of the active rating phase, a Bulk Rate icon is visible(2). The columns represent the Campaign phases.
- Quick filters will help you to filter for your Not rated by me and already Rated by me Elements. (3)
- (prerequisite: You only see the icon if you are assigned as Evaluator)
- Navigate to the Campaign Details Page tab. (1)
- In the sidebar you find action buttons that give you access to your Rate all Elements and Rated only unrated Elements. (2)
(prerequisite: You only see the icon if you are assigned as Evaluator in that phase)
Rate assigned Elements
Click on the Bulk Rate icon or quick filter button, a popup window opens.
- On the left hand side of the window the different rating criteria is visible. Use the different bars to set your rating. Note: You can also leave a comment for each rating criteria. (1)
- On the right hand side of the window you see the Title, Image, and Abstract of the Element you are about to rate. (2)
- There is an icon to open that Element in a new Browser tab. (3)
- You can always click on the Discard button to cancel the rating. (4)
- There is a rating progress indication at the bottom of the page. The number shows you how many Elements you already have rated and how many you have to rate in total. (5)
- There is a Save and Next button at the bottom of the window. Click the button to save the rating and move to the next Element. (6)
