|
|
|
This page is under construction |
|
|
\ No newline at end of file |
|
|
|
# The Reviewing Process for the CodeAbility Sharing Platform
|
|
|
|
|
|
|
|
A certain trust level in the quality of the shared material is key to the success of the CodeAbility Sharing Platform.
|
|
|
|
|
|
|
|
The Sharing Plattform uses a peer reviewing concept to assure a basic level of quality for the contained material.
|
|
|
|
|
|
|
|
Exercises that have successfully undergone the review will have assigned a badge "peer reviewed".
|
|
|
|
|
|
|
|
.
|
|
|
|
|
|
|
|
Also those review results will gain a higher significance in the search results in future.
|
|
|
|
|
|
|
|
## 0. Register as a reviewer
|
|
|
|
|
|
|
|
Any registered user of the platform can apply to act as a reviewer. To this end you can activate the switch on the _Peer Reviewing_ page.
|
|
|
|

|
|
|
|
|
|
|
|
After successful activation, the review administrator can assign you exercises for review.
|
|
|
|
|
|
|
|
## 1. Request a review for your own exercise
|
|
|
|
|
|
|
|
As an author of an exercise, that is already available on the sharing platform, you can request a review. To this end you can use the button "Select a resource to be reviewed by peers" on the "Peer Reviewing"-page.
|
|
|
|
|
|
|
|

|
|
|
|
|
|
|
|
Select an exercise and click the "Send Request" button on the end of the page.
|
|
|
|
|
|
|
|
Currently the reviewed resource must be public. We are working on a concept, to make non-public reviewd resource available to registered peer reviewers.
|
|
|
|
|
|
|
|
## 2. Assignment of peer reviewers by the review administrator
|
|
|
|
|
|
|
|
The review administrator is notified for the reviewing request and will assign one or more peer reviewers to review the selected resource.
|
|
|
|
|
|
|
|
## 3. The review itself
|
|
|
|
|
|
|
|
The reviewer will get notified by email of the outstanding reviewing task.
|
|
|
|
Also he will see a mark on the menu about the outstanding reviews.
|
|
|
|
|
|
|
|

|
|
|
|
|
|
|
|
The reviewer will see the list of open reviews on the "Peer Reviewing" page.
|
|
|
|
|
|
|
|

|
|
|
|
|
|
|
|
The reviewer should carefully revise the shared resource.
|
|
|
|
Currently the sharing platform does not yet have a detailed definition of the required quality level. However as a rule of thumb, a reviewer should check for the following aspects of the exercise:
|
|
|
|
- is the provided meta data correct and helpful?
|
|
|
|
- is the content correct? E.g.
|
|
|
|
- is the problem statement for the students helpful and consise?
|
|
|
|
- is the provided sample solution correct and complete?
|
|
|
|
- can you - as a reviewer - give the author hints to further improve the provided material, e.g. links to related material, further aspects to be considered in the exercise?
|
|
|
|
|
|
|
|
With clicking on "edit" the reviewer can provide the review feedback to the author:
|
|
|
|
|
|
|
|

|
|
|
|
|
|
|
|
The review can have three outcomes:
|
|
|
|
- REVIEW_COMPLETED: the review was successful, the material has the required level of quality.
|
|
|
|
- IMPROVEMENTS_REQUESTED: the review showed some flaws in the material. The author is requested to improve the material further and to resubmit it for another review.
|
|
|
|
- REVIEW_REJECTED: the reviewer considers the provided material not to be raisable to an adequate quality level.
|
|
|
|
|
|
|
|
The reviewing process is anonymous. I.e. the author will get the review results from the reviewers, however the assigned reviewers will not be disclosed.
|
|
|
|
|
|
|
|
## 4. Optional: The improvement cycle
|
|
|
|
In case one or more reviewers request improvements on the resource, the review administrator can forward the review results to the author.
|
|
|
|
|
|
|
|

|
|
|
|
|
|
|
|
After improving the content, the author can resubmit the review request.
|
|
|
|
|
|
|
|
## 5. After the successful review
|
|
|
|
When the review administrator considers the review results as final, he can finish the reviewing process and assign a reviewing badge to the exercise.
|
|
|
|
|
|
|
|
The user can see the number of review badges he/she has already earned on the navigation bar.
|
|
|
|
|
|
|
|
 |
|
|
\ No newline at end of file |