An Evaluation and Examination of Quiz Tool within Open-Source Learning Management Systems

—Most open-source learning management systems are equipped with a quiz tool, which plays an important role in measuring and evaluating the achievements of a student in a particular e-course. Currently, numerous open-source LMSs are available in the market. In this study, some analysis and comparisons were made between the most used open-source LMSs, including Moodle, ATutor, Eliademy, Sakai, Dokeos, ILIAS, OpenOLAT and Opigno. The study is mainly based on the functionality of the quiz tool that is available within the selected LMSs. This paper study and evaluate the availability of certain features that are divided into sub-categories: questions, result/feedback and quiz setting features.


Introduction
E-Learning is essential in every educational/training institution.The virtual learning environment has emerged to overcome the distance and time barriers in learning.A virtual learning environment is built by using a learning management system (LMS).LMS is a web-based application used for facilitating distance learning and for managing and categorising course materials for both instructors and learners (Alshammari et al., 2016;Blake and Morse, 2016).
LMS support the learning process by establishing a virtual relation activity between instructors and students over the Internet (Zadeh et al., 2017;Anggrainingsih et al., 2016;Yulianandra et al., 2017).According to Wichadee (2015), three main tools must be available in an LMS, namely: a study skill tool, which is used to create course materials (e.g.presentation materials, quizzes and assignments), a communication tool (e.g.announcement boards, forums and chat functions) and a productivity tool.
In this paper, we are concerned with the assessment tool in open-source LMSs.As part of e-learning, online exams, also known as online assessments or computer-based exams, are used to evaluate the achievements of students in an online course.Assessment tools support the educational process by facilitating record keeping,

2
Open-Source LMSs LMS is a software used to help students and instructors in e-Learning (Hussain et al., 2011).The purpose of LMSs is to deliver knowledge contents online, open-source LMS must be available, usable, scalable, interoperable, stable and secure (Machado and Tao, 2007;Al-Busaidi and Al-Shihi, 2012).
Adopting an open-source software can reduce the cost of high-quality products and quickly fix bugs and errors by relying on online communities (Namisiko et al., 2014).
Moreover, an open-source code can be modified to suit any institution without affecting its security or quality (Hussain et al., 2011).
In order to select the appropriate open-source software, Wheeler (2011) suggested the use of four steps: identify candidates, read existing reviews, compare the leading programs' basic attributes to your needs, and analyze the top candidates in more depth.In addition, open-source LMS must support six functions: creation, organisation, delivery, communication, collaboration and assessment (Khalkhali, 2014).Moreover; an open-source LMS must have course management functions, support SCORM, able to use creation tools such as Microsoft Word, Microsoft PowerPoint and Adobe Flash, support multiple languages and be able to work with other LMSs (Aydin and Tirkes, 2010).
Usually, users choose LMS software mainly because of its functionality and ease of use.A user-friendly software is important to increase number of users and easily make good interaction between users (Yulianandra et al., 2017). Many

Study Method
Dozens of open-source LMSs are available in the market.The selected software had been evaluated by comparative and contrastive observational approach and Business Readiness Rating (BRR).Information were conducted from many opensource LMSs websites (Table 1), demo programs and examine reviews of the quiz tool feature given at internet.The chosen open-source LMSs were investigated in detail according to features of quiz tool.Eight LMSs had been selected and their quiz tools had been evaluated and compared reflecting the availability of quiz tool features (questions, result/feedback and quiz setting).The most demanded Open-source LMS are selected to be evaluated: Moodle, ATutor, Eliademy, Sakai, Dokeos, ILIAS, OpenOLAT and Opigno.
Table 1 lists URL of selected open-source LMS, each of which is briefly described as follows:

Moodle
Moodle stands for modular object-oriented dynamic learning environment.This LMS was developed by Martin Dougiamas in 2002 as a course management or management learning system.Moodle was written in PHP, distributed under the GNU general public licence and supports over 100 languages.The basic idea of Moodle lies in its 'social constructivist pedagogy' (Yaowen, 2013), that is, maintaining a positive interaction between the teacher and the student.Moodle offers numerous functions that support the educational process, including chats, forums, quizzes, lessons, assignments and glossaries (Patel and Patel, 2017;Moodle, 2018).

ATutor:
ATutor is an open-source web-based learning content management system released in late 2002 for developing online courses and creating e-Learning content.This application was written in PHP and distributed under the GNU general public licence.ATutor offers excellent features for both instructors and students, including functions for creating online courses, developing, reusing, and sharing e-Learning content and ability to integrate with social networks (Mihaelaion, 2012; ATutor, 2018).

Eliademy
Eliademy is an e-Learning platform that allows teachers and students to create, share and manage online courses.This application is based on the virtual learning environment of Moodle (Eliademy, 2018; Tanaś, 2015).Eliademy was developed by CBTec Oy, launched all over the world in 2013 and supports 32 languages.Courses in Eliademy use documents, pictures and videos, support quizzes and assignments and allow teachers to give feedback to students (Perwonegoro and Syafei, 2016).

Sakai
Sakai is an open-source software that provides a flexible environment for improved teaching, learning, research and collaboration.Sakai was developed by the University of Michigan, Indiana University, Massachusetts Institute of Technology and Stanford University from previously available tools.This Java-based software became freely available on March 2005 and has been translated into more than 20 languages.Sakai offers the standard LMS features as well as some additional options for creating courses, launching collaborative projects and conducting research (Sakai, 2018).

Dokeos
Dokeos is an open-source e-Learning software that manages learning and collaboration activities.This application was developed in 1999 at the University of Louvain in response to a triple need for training, motivation and evaluation.Dokeos has been translated into 31 languages and is available in different versions, although only the Dokeos community edition can be downloaded for free (Dokeos, 2018).

ILIAS
ILIAS is a web-based LMS that provides a flexible online working and learning environment with integrated tools.Knowledge materials may also be available for non-registered users.ILIAS was developed at the University of Cologne in 1998, written in PHP, published under the GNU general public licence and translated into 28 languages.This application is considered one of the first LMSs that have been used in universities (ILIAS, 2018).

OpenOLAT
OpenOLAT is an open-source web-based LMS for teaching, education, assessment and communication.OLAT stands for 'online learning and training'.This application was initiated as a branch of 7.1 OLAT and developed using Java at the University of Zurich in 2011.OpenOLAT provides many features for both students and teachers (OpenOLAT, 2018). Opigno: Opigno is an open-source e-Learning platform based on Drupal.This application is distinguished because of its high compatibility with SCORM and TinCan as well as its adaptable integration with other Drupal systems.Opigno offers student management features and many easy-to-use tools needed in learning.

Quiz Tool Features
An excellent assessment tool and quiz tool in open-source LMSs must include features for both the teacher and the student.For teachers, an assessment tool must be able to create quizzes and homework quickly, add questions easily, provide feedback and support, and randomise questions.Meanwhile, for students, an assessment tool must allow them to review a question, retake a quiz if needed and obtain results and feedback directly after answering a question correctly or incorrectly (Kruger et al., 2015).Another important feature of an assessment tool is the availability of a question bank, which is a secured pool of questions that helps users save time (Abu Mansour, 2017).
In this paper, we examined features of the quiz tool within the selected open-source LMSs.The following are a summarized list of important features; each is divided into sub-categories including:

Questions feature
This feature includes some important categories, such as: iJET -Vol.15, No. 10, 2020 1. Question type: This feature involves the types of questions that can be created using an assessment tool (e.g.multiple choice questions, fill in the blanks, numerical matching and ordering).2. Randomised questions: This feature allows instructors to present their questions to students in a random order.3. Question bank: This feature allows instructors to create, preview and update their questions in a database and then insert all or only part of these questions into their quizzes.4. Category: This feature helps instructors efficiently use the question bank by dividing their questions into different categories based on specific topics.5. Import and export file: This feature allows instructors to import their questions from different sources and then save and export these questions to other file types.

Result and Feedback Feature
This feature includes the following categories: 1. Grade report • For instructors, this feature allows them to generate a statistical report of the test results • For students, this feature offers them their test grades and total grades to find out if they have passed or failed their exams

Feedback
• For instructors, this feature helps them find out the strengths and weaknesses of their students in certain topics based on their test results.They can also generate a statistical report for each student • For students, this feature gives them feedback on all the questions they have answered incorrectly in a test • Course outcome: This feature helps link each question to the course outcomes as mentioned in the course curriculum

Quiz setting feature
Assessment tools is supposed to offer a quiz setting feature for both instructors and students to control the following: 1. Layout: This feature allows users to customize the appearance of questions in a test, either showing only one question per page or multiple questions in a page.2. Quiz attempts: This feature shows how many times a student can attempt taking a quiz.3. Time limit: This feature presents the time left for a student to complete a test as well as records the time s/he began and completed the test.

Authentication:
This feature ensures the security of a test and instructs students on how they can take the test.

Results and Discussion
Results were extracted by examining open-source LMS demo programs and analysing the quiz tool features from websites of Moodle, ATutor, Eliademy, Sakai, Dokeos, ILIAS, OpenOLAT and Opigno.
The results of the comparison based upon Questions feature are summarized in Table 2.The results showed that the selected open-source LMSs offer many types of questions, including multiple choice, fill in the blanks, numerical matching, ordering, hot spots and essays.Moodle and Dokeos provide more types of questions compared with the other LMSs.Dokeos provides several options for assessment, including e-Learning, paper formats and face-to-face evaluation sessions.
Moodle and Opigno have the ability to integrate with H5P to provide more interactive types.The ability to randomize questions in test for every student is available in all open-source LMSs.Question bank and Category are also available in all assessment tool except Eliademy.Question bank is known as question pool in Sakai and ILIAS and scenario in Dokeos.
Questions can be imported and/or exported in all open-source LMSs except for Eliademy.QTI XML is the main file format used in these LMSs.Moodle supports more file formats in importing and exporting files, Opigno supports more file formats in exporting and both Dokeos and Opigno support the importing of Excel files only for multiple choice questions.
Regarding Result and feedback feature, the results showed (Table 3) that all opensource LMSs provide grade reports to both the instructor and student albeit with some differences.Moodle and ATutor immediately provide statistical reports to instructors.Sakai immediately presents the results only if the type of question is not short answer/essay, file upload and audio recording.Dokeos requires manual grading for paper format questions and/or face-to-face evaluation sessions.Opigno displays the results to users during or after a quiz.
Providing feedback to students is optional in these LMSs.Students can receive feedback either immediately after answering each question or after completing a test.Opigno provides automatic and manual feedback features, whilst unlike the other LMSs, Moodle can link each question to the course outcomes.
Table 4 shows the results of LMSs based on their quiz setting feature.All these LMSs have built-in editors that allow users to customise their quiz layouts as well as specify a timeframe for a test to be completed.Each user can decide when to start and end a test.Students may attempt taking the quiz only once or for an unlimited number of times.However, OpenOLAT only allows students to attempt completing a quiz for a maximum of 20 times.
All these LMSs ask for a course login password from the users.For security reasons, Moodle and ILIAS ask users for a second password to access a test.Dokeos and ILIAS can send exclusive invites to certain students to take a test, whilst Moodle iJET -Vol.15, No. 10, 2020

Conclusion
Many institutions are currently using open-source LMSs to improve their educational and training processes.As part of these processes, assessments are performed to evaluate both the student and the course.Open-source LMSs offer an assessment tool, also known as a quiz tool, to design and manage tests.
The selection of the most appropriate open-source LMS greatly depends on the requirements of an institution.Each open-source LMS provides several important features.
This paper investigates several open-source LMSs, including Moodle, ATutor, Eliademy, Sakai, Dokeos, ILIAS, OpenOLAT and Opigno, based on their quiz tools.Three features are analysed and examined in the study, namely, questions, result and feedback and quiz setting features.We can briefly say that Moodle emerges as the best open-source LMS based on its quiz tool.And Eliademy LMS is the least since it does not include a question bank, category neither import/export file.
The results showed that Moodle and Dokeos provide a large number of question types.All these LMSs provide grade reports and quiz feedback to their users.Moodle is the only open-source LMSs that can link each question to the course outcomes.Both Moodle and ILIAS ask users to provide a second password before accessing a test.
researchers have compared different open-source LMSs based on certain factors and items.For instance, Anggrainingsih et al. (2016) compared Moodle, ATutor and ILIAS based on their flexibility and maintainability.Desai et al. (2015) compared Moodle, Canvas, Gibbon, OLAT, Blackboard, Bright Space and Sakai CLE based on their usability, services, functions, technical requirements and standards.Cavus and Zabadi (2014) compared ATutor, Claroline, Dokeos, Ilias, Moodle and Sakai based on their communication functions and the user-friendliness of their interfaces.Hussain et al. (2011) compared OLAT, ATutor, Moodle, eFront, Bodington and Sakai based on their learning models, modules, hardware and software requirements.

Table 1 .
URLs of Selected Open-Source LMSs

Table 4 .
Comparison results based on the quiz setting criterion