Application of Classroom Response Systems ( CRS ) : Study to Measure Student Learning Outcome

Classroom Response Systems is a scanner system in the form of technology that is used in the classroom, which allows students to answer a question with an input directly inputted into the data, so that the application of learning outcome measurement becomes effective and efficient. This study uses qualitative methods and is implemented in 120 students and is a formative research. This study describes the use of Classroom Response Systems (CRS) when measuring student learning outcomes. The research subjects were students of the Mathematics Education and Elementary School Teacher Education Department who had heterogeneous abilities. Research findings show that students consider CRS can improve class dynamics in theoretical lectures. On the other hand, almost all students have agreed with the assertion that CRS is easy to use, although some of them have warned that recipients do not always record their responses. Keywords—Classroom Response Systems, Clickers, Learning Outcome


Introduction
Over the past 15 years, teachers input data by correcting students' answers manually one by one and spending lots of paper, which causes pollution. To reduce paper use, technology-based learning systems are needed. This can be started from measuring learning outcomes, because large classes take a long time if the measurement of learning outcomes is done manually. This can also inhibit the giving of feedback to students, so that a system that is accurate and precise in measuring student learning outcomes. IT and communication in learning play an important role to facilitate the by teachers to students [1], and its application can have a potential impact that can improve the quality of learning [2].
Many efforts can be taken by the teacher to overcome the problem. One effort that can be taken is the use of technology when measuring student learning outcomes as it has now developed, the classroom response systems (CRS) [3], [4] CRS is a scanner system that is used in the class to allow students to answer a question easily [5] with the answers directly inputted into the data, so that the application of learning outcome measurements becomes effective and efficient. CRS is an interactive technology that allows instructors to ask questions and immediately collect responses from all classes [3]. The system automatically calculates the response and instantly projects the results in a graphical format for the entire class to see. This system has evolved over the past 15 years. This system can use an application called Plickers that is accessible to everyone.
Students may feel intimidated by fellow students because of prior knowledge of the object. Anonymity and direct feedback are the main advantages of the plickers response system [6], [7]. Each student can answer each question without fear of embarrassment if their answer is incorrect. This greatly increases students' willingness to participate in class more than just traditional question and answer processes. In addition, plickers also offer fun diversions during college making time spent more attractive to students and lecturers [8], [9] 2 Method The method used in this study is qualitative, so the data obtained in this study is also qualitative [10], which is in the form of development data and student learning outcomes. The instrument used is the questions inputted into Plickers. This research was carried out on 120 students consisting of 30 students of mathematics education program in Universitas Madura, Elementary Teacher Education in Universitas PGRI Madiun, Islamic Education in Universitas Muhammdiyah Sidoarjo and Institut Agama Islam Negeri Jember respectively.
It is important to emphasize that in the perspective of this research, research subjects must understand that the value in this study is formative (not summative) and during this research process, feedback are needed to be given to subjects such as in further technological development.  Figure 1 shows the process of using classroom response systems to make questions in a test to measure student learning outcomes. To achieve the results of an instruction, there are several stages that must be gone through, which are sending questions or questions, gathering answers, and then discussing together and revising or probably adding questions.

Contructing classroom response systems on plickers
The ease of technology nowadays makes classroom response systems can be made through websites from an application that has been developed previously, namely Plickers. This program consists of a barcode for each student and some data inputted through the website such as student name data and questions that will be given to students. Figure 1 shows the first page of using plickers on the website. Figure 2 shows the process of inputting student name data in a class, while Figure 3 shows the process of inputting problem data and answers. The correct answer will be marked in green. Answers can also be automatically shuffled by clicking "shuffle choice".

. Preface to input questions and answers
iJET -Vol. 14, No. 14, 2019 In figure 3 show what the mataries for this research in this question is about fraction. Not only for fraction, this systems can make student to have choose a better choice in mathematic logic. With a new system that can make student develop their skills in mathematic logic with classroom response systems through Plickers.
After constructing classroom response systems through Plickers, the application is validated with several categories, which are usefulness, efficiency, functionality, portability, and learning content [11]. Usability, efficiency, functionality and portability are validated by 3 technology expert lecturers, while learning content is validated by 3 education expert lecturers.  Table 1 shows the results of the validation of several experts with a maximum scale of 5, while the average results obtained are 4,372 which are categorized with Arikunto conversion calculations are considered as very good [12].

Plickers usage
The use of plickers is easy. Students are only needed to carry and play a barcode in Figure 4, which is different for each student. The barcode is paired with the name of the student who has been inputted on the website as shown in Figure 2. The barcode can be downloaded on the plicker website. Barcode classification is divided into three, namely regular, medium, and large. The regular one consists of 40 barcodes, the medium consists of 100 barcodes, while the large one consists of 200 barcodes. We can adjust the needs of students only with these three categories. It can be seen that there is a number 1 on the barcode that represents the student number or subject number that has been inputted on the website. To make things easier, i i's better to use student register number the in school data. The letter of ABCD represents the student's multiple choice answers, while the letter above is the correct answer according to students.
When implementing classroom response systems through plickers, the names of students who have given their answers and how many students have given their answers will look like in Figure 5. In the figure, there are numbers that indicate the number of students who have answered the question. If there are students who have not answered, they will be visible through the computer. After the process of scanning students 'answers from the barcodes, a diagram of the results of the students' answers is obtained. The diagram shows how many percent of students answered correctly as in Figure 6. Figure 7 shows the value of problem number 1 for each student with 20% correct score due to the fact that there are 5 questions in this test and 0% wrong value. Figure 8 shows student learning outcomes in the overall test. All values can be seen, from the highest to the lowest.

Discussion
The scoresheet on student test results creates usefulness and efficiency in using technology to measure student learning outcomes. CRS makes it easy for teachers or lecturers to measure student learning outcomes just by using one sheet of paper for each student.
Data from CRS can also facilitate learning as a measuring tool for student learning outcomes. The ability of CRS to gather understanding from students and find out changes in student knowledge through an effective system allows this system to be used for research and to collect learning documents.
Some research states that CRS can make students more attentive and focused when answering questions [13] [14], so that student learning outcomes can be collected quickly and do not require preparation for the old class. Some other research states that by using CRS, students think individually so that there is a lack of group ability [7].
That is also the result of this study. Students work on questions individually but they experience ease in determining answers and focus on reading questions and thinking about these answers.
Research shows increased learning based on the use of 2 electronic voice systems in classrooms [15] suggesting that this might be a useful tool for improving student learning. In addition, direct feedback will be available to students through the use of Plickers. Finally, the use of multiple choice questionnaires for examinations was introduced this year as an adaptive strategy assessment of various levels of learning outcomes [8].
Learning by operating technology is facilitated by CRS-based learning [16]. The use of manual systems is more difficult because they involve adding and matching between answers with questions manually, calculating answers from students, and several other things that are done manually [17].
In the question-driven instruction approach, the use of CSR to pose, gather answers, and discuss questions, forms the main points of instruction in the classroom. The success of the approach depends in part on the quality of the questions used. Effective questions must be designed with clear pedagogic objectives and have three elements consisting of content objectives, processes (cognitive), and metacognitive goals. The purpose of the content is the subject matter to be discussed. In general, it must be conceptual and fundamental and must often integrate ideas from various parts of the curriculum [16].
Fies and Marshall stated that research is limited regarding the use of School Response Systems (SRS) for formative assessment [18]. This is especially true in elementary and secondary schools. However, an exploration research conducted by Polly, et al. found that using SRS in basic math classes helps teachers with formative assessment by providing data to inform the direction of instruction and track student progress [19]. Therefore, the use of quizzes in the classroom using Plickers as a teaching strategy is considered in line with the assessment method.
Regarding the relationship between CRS and learning, almost all students have reported that the tool allows them to get quick feedback about their responses, providing instant monitoring of their learning during lectures [20]. Although some research has stated that this system also carries all kinds of obstacles to their learning, the majority of participants consider that, at some level, this system contributes to better knowledge than mere theoretical concepts.

Conclusion
This study explains the use of CSR when measuring student learning outcomes. The findings indicate that students consider that CRS improves the dynamics of the class in theoretical lectures [18] [21]. On the other hand, almost all students have agreed with the assertion that CRS is easy to use, although some of them have warned that recipients do not always record their responses [20]. This study explains the use of CSR when measuring student learning outcomes. The findings indicate that students consider that CRS improves the dynamics of the class in theoretical lectures [18] [21]. On the other hand, almost all students have agreed with the assertion that CRS is easy to use, although some of them have warned that recipients do not always record their responses [20].