Development of Technological Pedagogical Content Knowledge (TPACK) for English Teachers: The Validity and Reliability

—This paper discusses a study proposed to analyze technology affecting English Language Teaching (ELT). To begin with, English is an important language in a society where it acts as a bridge to connect different races in a society. However, in the circumstance of 21st-century education specifically for English Language Teaching (ELT) which has been affected by Industrial Revolution 4.0, technology plays an important part as it offers the potential to enhance teaching processes and facilitate the learning of English as Second Language (ESL). For this purpose, Technology Pedagogy Content Knowledge (TPACK) paves a way to determine the correlation between technology, pedagogy and content knowledge among the English teachers on how they incorporate these technology tools in their English teaching. Hence, because of this reason, English teachers will answer a TPACK questionnaire which was adapted from two different questionnaires to understand further how English teachers employ the technologies in ELT. Therefore, by holding on to this purpose, a questionnaire was adapted from two different major questionnaires that related to TPACK. As neighbour to the previous sentence, this research was about this adapted questionnaire that had gone through content validation by experts with more than 10 years of teaching experience in English subject. The methodology that had been used in this research was quantitative method. The data obtained was presented in the form of descriptive statistics and was analyzed by using Microsoft Excel to calculate the Content Value Index (CVI) and Kappa Values for validity. Also, the data was presented in the form of table as it can eliminate any incomprehensibility that arises in interpreting the data. Thus, as the result, the finding of this research had supported the face and content validity and this proved that the result had high reliability and validity. Hence, this adapted questionnaire will be further research in a pilot study to test the efficiency of this instrument.


Introduction
Education plays one of the most important roles in developing society. It is worth mentioning that English is generally used as a second language which is viewed as an important medium to communicate in different countries especially in Asia. Malaysia as one of the Asian countries has been focused on the importance of English Language in education. Alternately, Malaysia also undergoes Industrial Revolution 4.0 and this has given a tremendous impact on education specifically in the use of technologies; thus making integration of technologies a great requirement in teaching and learning. This, henceforth, defines 21 st -century learning and teaching. Consequently, the significance of technology in education has been acknowledged as one of the important parts in the 10 shifts as outlined by the Malaysian government in National Education Blueprint (2015 -2025). With this being outlined in the national education policy, English teachers are required to be well-equipped with the application of technology skills in order to deliver a competent teaching. This is supported by Chai, Koh, and Tsai (2010) who further asserted educators need to be self-equipped with knowledge and skills pertaining to technology and utilize them to produce more effective teaching and learning process. In return, this should help to reduce English Language Anxiety (ELA) among ESL learners.
English Language Anxiety (ELA) has been a kind of penumbra in English Language Learning as it can impact comprehension of English among ESL learners. In Malaysia, as stated by Latif (2015), even though the students have learned English for more than 10 years, they still face challenges in using the English language efficiently. Accordingly, Horwitz, Horwitz, and Cope (1986) expressed that second language learners often feel stressed, nervous and anxious in learning a second language. This is due to the fact that some of the learners will more than often encounter the "mental block" during the language learning process. This condition can happen to both beginner and advanced learners (Latif, 2015). This shows that anxiety may still hinder the learning process despite the complexity of the learning process and students' level of proficiency in the English language. There are many factors contributing to this problem and one of which is believed to originate from English teaching methodology especially when English teachers are unable to utilize technology to facilitate teaching in a classroom.
The integration of technology in classroom activities is thought to be a great facilitator in teaching and learning while the teachers still play a key role in this situation (Ramanair, Rethinasamy, & Misieng, 2017 Ramanair et al., 2017). This proves that by using technology tools in the classroom is important as it fulfil the necessity of a 21 st -century learning environment. This is further supported by Kasim and Singh (2017) that professed technology offers opportunities for teachers to design different contexts and learning environment in the teaching and learning process to suit their learners' level of proficiency. Hence, it will indirectly make it easier for teachers to deliver lessons in the classroom and also to cater the needs of the students.
However, Kongi (2015) stated that modernity may bring along stress to learners despite their ability to cope with available technology outside the classroom. This may occur since most learners still face anxieties during traditional teaching and learning process, and inserting technology may add more pressure to them due to the methodology being recently developed (Balchin & Wild, 2016). The existence of this situation may also be rooted in teachers' limited and unskilled use of technology (Sarhandi, Khan, Buledi, & Asghar, 2016). Also, teachers' incompetency in use of technology and inadequacy of facilities in school to support the content of lessons have created obstruction for teachers to be able to manipulate technology tools in order to deliver competent teaching, especially in ELT. Sahin (2011) stated that for a teacher to be successful in teaching, they need to selfdevelop the pedagogy, technology and their content areas individually as different teacher has different approaches in teaching. In this light of analysis, by integrating technology in the English classroom requires teachers to have knowledge about technology (Ramanair et al., 2017). This is so that teachers should be able to manipulate the technologies to create the suitable approaches to support the students' learning. When a teacher integrates technology into instructions, it allows students to participate in the subject (Sahin, 2011;Schrum et al., 2007;Sweeder & Bednar, 2001). In contrast, if a teacher who is unable to utilize technology to deliver competent teaching to ESL learners of the current generation, this will likely to influence their anxiety level.
Therefore, it is important to find a way to integrate technologies in instructions to facilitate teaching by integrating technologies in instruction through investigating the reasons for deficiency in teachers' technology skills specifically in ELT. If there is a problem, surely there will be a way to overcome the problem. Hence, in this situation, even though a model to incorporate technology into curriculum seems to be a complex task for educators (Garofalo, Kasim and Singh (2017) who claimed this extended version of TPACK is especially necessary for ESL teachers to provide a proper learning environment for digitally students. For this purpose, Technology Pedagogy Content Knowledge (TPACK) is used as a way to determine the correlation between technology, pedagogy and content knowledge among English teachers and it is hoped to be able to overcome the problem that arise in using technological tools in ELT. Mishra and Koehler (2006) defined Technology Pedagogy Content Knowledge (TPACK) as a basic concept of effective teaching that combining technology and pedagogical techniques in order to construct new apprehension from the existing knowledge among students. Archambault and Crippen (2009) also believed that TPACK involves a whole understanding of the complexity of relationship among students, teachers, contents, technologies, and practices. Hence, this brought Archambault and Crippen (2009) to produce a questionnaire that studies about this correlation in TPACK. From the other perspective, Nordin and Faekah (2016) defined TPACK as an understanding of the connection and interaction between technological knowledge, content knowledge and pedagogical knowledge in the learning process.
Therefore, through concepts gathered from literature related to teachers' knowledge about technology pedagogy and students' learning, this study is carried out based on the model inspired by Mishra and Koehler (2006) to organize teachers' knowledge and explore in depth about its relationship with students' understanding in English learning. In line with this, several studies have acknowledged the need to develop a more reliable and valid instrument to measure TPACK. Several TPACK surveys that were developed and tested on teachers in the United States had high internal reliability (  This framework has urged the need to develop and understand technological, pedagogical and content knowledge to effectively integrate technology in teaching. TPACK model focused on how these three domains can enhance the technological tools in ELT. The three domains are known as TK (Technological Knowledge), PK (Pedagogical Knowledge) and CK (Content Knowledge). A combination of TK, PK, and CK that form TPACK allows teachers to present the effective subject content to their learners by using the most suitable and available technology with the correct pedagogy (Mishra & Koehler, 2006;Nordin & Faekah, 2016). Specifically, the explanations about these three domains are explained in a detailed summary.

Technological knowledge (TK)
This domain refers to teachers' knowledge about traditional and new technologies that can be utilized in teaching and facilitate the learning among the learners as well (Koehler et al., 2014).

Pedagogical knowledge (PK)
This domain focuses on the teachers' knowledge about wide and variety of instructional practices, strategies, and methods to facilitate students' learning in the classroom(Koehler et al., 2014).

Content knowledge (CK)
This domain related to any subject matter that focused on teachers' knowledge which required them to fully use the knowledge in teaching subjects at school (Koehler et al., 2014).
Since these domains are crossing each other, other four components were derived from these overlapping main domains which are known as TCK (Technological Content Knowledge), PCK (Pedagogical Content Knowledge), TPK (Technological Pedagogical Knowledge) and TPACK (Technological Pedagogical Content Knowledge), thus creating a fully developed model which is better-known as TPACK. Therefore, the explanations for the other four components are as following:

Technological content knowledge (TCK)
This component focuses on the knowledge related to the relationship between technology and content. In most situations, disciplinary knowledge is often defined and limited by technologies and their functions in teaching (Koehler et al., 2014).

Pedagogical content knowledge (PCK)
This component referred to Shulman's (1986) point of "an understanding of how particular topics, problems or issues are organized, represented and adapted to the diverse interests and abilities of learners, and presented as instructions" (p.8) (Koehler et al., 2014).

Technological pedagogical knowledge (TPK)
This component relates to the perception of technology which can be helpful or in another way, limiting the specific pedagogical in teaching (Koehler et al., 2014).

Technological pedagogical content knowledge (TPACK)
This component writes about the knowledge that related to the complex relations among the technology, pedagogy, and content which will help teachers to create a proper and content-specific teaching approaches in the classroom (Koehler et al., 2014).
TPACK allows teachers to have a deep understanding about each domain and components of this framework as it can facilitate teachers to coordinate, manipulate and orchestrate technology, pedagogy, and content into a teaching method, especially in ELT. A further point that needs to be noted is that TPACK is a form of knowledge that exists in an impulsive amalgam of traditional and modern technologies. This will facilitate the ELT, especially in 21 st -century teaching and learning. As stated by Köse (2016), it is important to expose the perceptions of the language teachers' selfefficacy in integrating the technology into language teaching in order to create effective and successful language learning and teaching. This is because, teachers have different pedagogical that suit the learners' need in learning. Also, the factors that hinder technology integration should be studied further in order to help teachers to overcome problems when it comes to combine technology and their teaching methods to enhance ELT.

Development of instrument
In this research, TPACK is not just a framework created to understand and justify teachers' use of technology in the classroom. It is also used to study the level of comprehension about the importance of technologies to be integrated into teaching content. Hence, by noticing how important TPACK in ELT is, there are various approaches and different theories that employ technologies in teaching. Because of this reason, researchers are continuously seeking for a new and suitable prospect to combine technologies and knowledge into effective teaching. This happened as technologies will keep on progressing and changing prior to the change of time and era. Also, there are other researchers that came out with different instruments to study TPACK

Instrument validation
Before an adapted or a developed questionnaire is used to conduct the pilot study, the questionnaire had to go through validity and reliability tests. Reliability and validity of the instrument is an important analysis which it can be used to consider the effectiveness of the instrument used (Kaplan & Saccuzzo, 2005;McIntire & Miller, 2007). Hence, for the purpose of this research, validity is necessary to study how established questionnaire which tallies with the research objectives.
Teaching evaluation becomes crucial in pedagogy field especially when it comes to 21 st century teaching and learning. Therefore, numerous researches are indeed important to assess teaching effectiveness related to utilizing technologies tool. Thus, there is a demand to have a validated, reliable and comparable presentation of data for the sake of improving teaching quality. Because of this reason, this study is aimed to examine the validity and reliability of TPACK that will be administered among English teachers. In addition, this study is also intended to explore further statistical analytic thinking to validate TPACK among English teachers.
As stated by Nordin and Faekah (2016), TPACK questionnaire was developed in the USA and has not been tested in a Malaysian education setting. Hence, due to that reason, the questionnaire in this research will be brought to the next step which is through the validity test. Therefore, the validity tests that are used were face validity and content validity. The researcher distributed this questionnaire to five teachers who are experts and well-adapted in English learning methodologies. They have also attended a special workshop about 21 st -century learning and teaching organized by Ministry of Education. The instrument was self-distributed to the panel of experts complete with the official letter issued by Faculty of Education, UiTM Puncak Alam.
The questionnaire contained 35 items which were divided into seven components that question about technology's knowledge, content, pedagogy and how English teachers integrate the technologies into the ELT. This test instrument would be based on numerous opinions from these experts based on their professional ethics and teaching experiences (Sangoseni, Hellman, & Hill, 2013). Hence, the comments and suggestions from the pane lists are welcomed in this research. For the face validity, it is necessary to have a guideline to avoid any incomprehensible and vague data. Therefore, Oluwatayo (2012)'s proposals were used to evaluate the face validity of this questionnaire as listed below:  Appropriateness of grammar.  The clarity and unambiguous of items.  The correct spelling of words.  The correct structuring of the sentences.  Appropriateness of font size.  The structure of the instrument in terms of construction and flow of the format.
The validity used to calculate the inter-rater reliability was calculated by using Cohen's Kappa. Two of the pane lists were asked to answer "YES" or "NO" for all 35 items. This is necessary to demonstrate the degree of the data collected in the study.
The data collected will be studied whether it represents the variables measured in research (McHugh, 2012).
From other perspectives, Content Value Index (CVI) was used to study the content validity in this research. As stated by Lynn (1986), CVI is about the number of agreement from the pane lists in examining research validity. It depends on the number of pane lists involved in the research as there might be less than three pane lists and more than five pane lists. Lynn (1986) further advised that panel experts should be a minimum of three experts yet if it is probably unnecessary to have more than 10. Therefore, for this research, five pane lists were selected to participate in this research due to convenience purpose and time limitation.
Nonetheless, some researchers never demonstrate their calculation for CVI in content validity. This was supported by Polit and Beck (2006) who stated authors of scale development papers almost never demonstrate the methods they used to compute S-CVI. Thus, the result must be shown in a table to clarify any uncertainty raised from the research. The table is considered a great alternative to explain the method used to calculate S-CVI. Hence, by going through this study, a great CVI index of 1 should be achieved as it reflects all of the pane lists agreeing with the items (80% or 0.8 to represent a high-level agreement) (Sangoseni et al., 2013). On the other hand, a low CVI of less than 80% reflects the items as unable to reach the objectives proposed in the research.

Results and Findings
In light of this analysis, all panel members are academicians who work as English teachers for the secondary schools. Their number of years in practice ranged from 15 years to 35 years. Therefore, the average years of teaching experience for all panelists are about 25 years. This period of time should be considered as adequate for them to study technology's knowledge since they are used to both traditional and modern methods. The reason lies in 21 st -century learning and teachings being introduced in the year of 2014: the year when teachers are encouraged to fully utilize technologies in teaching.
Hence, for face validity, a suggestion proposed by the experts "to split the doublebarrel questions" in ensuring validation for this questionnaire. Although the suggestion "to split the double-barrel questions" does not exist in the list proposed by Oluwatayo (2012), it was important for the researcher to consider for this questionnaire as it will be able to avoid double meanings in one sentence. Also, this suggestion is indeed important for the researcher to make sure that the essence of this questionnaire is preserved in this research. This is also helpful for the researcher to come out with the items that directly question what is needed to be asked about TPACK in this adapted questionnaire. All of the comments and suggestions by the panel experts are as shown in Table 2. On the other hand, the result for calculation of inter-rater reliability had yielded the result presenting the percentage of inter-rater agreement was 88 % (Kappa value = 0.88, p = 0.000 < 0.005) which is considered as strong (McHugh, 2012). The data received proved that the items in this questionnaire are already valid within this validity test. For content validity, all 35 items were analyzed by the content experts. Hence, the sentence structure for B3, B6, B9, B11, B15, B16, B18, B20, B26, B30, B32 were corrected by the researcher based on the comments and suggestions received from the pane lists. As a result, the CVI for each item is represented in Table 3 as follows.

Discussion
For Face Validity, Oluwatayo (2012) proposed five notions or criteria that have to be fulfilled in research. As stated in Table (1), all the pane list agree with the first statement "Grammar correction" which specifically means that the sentences must be changed to present tense. As stated by panel 1 and panel 2, this is due to the items are investigating the current occurrences among teachers, not happened in the past. Aside from that, none of the pane lists commented on "The clarity and unambiguity of questions". This is because the items are adapted questions from a well-established questionnaire by Schmidt et al. (2009) and Archambault and Crippen (2009). So, the purpose of these items is well delivered in each of the statements. For the third and fourth items which are "The correct spelling of words" and "The correct structuring of the sentence" received no comments from the pane lists as the questionnaire had been proofread by the researcher's supervisor who happens to be an English lecturer, ranked as an Associate Professor. For "the appropriateness of font size", the researcher used Times New Roman and size 14 for the questionnaire to eliminate any technical doubts emerging from this research. For "the structure of the questions", none of the pane lists commented on this part either. It is believed that since the items were adapted from an established questionnaire and had been proofread, the structure of the questions remained in established sentences. However, for " split the double barrel questions", there are pane lists (Panel 1, Panel 3 and Panel 4) asked the items to be separated into two items and avoid using the conjunction "and" in one item. The reason is due to it might create two different meanings in one item which leads to ambiguity within the items.
From other perspectives, the inter-rater reliability was calculated using Cohen's Kappa Index. Even though there are many methods to calculate inter-rater reliability such as Fleiss's Kappa and IRR, Cohen's Kappa was used for this research as it is more convenient and requires a shorter time. Cohen's Kappa was employed because only two raters are needed compared to Fleiss's Kappa that needs three or more pane lists. Since all of the items are adapted items from two different questionnaires, Cohen's Kappa produced was 0.88 and considered strong (McHugh, 2012). Hence, this questionnaire may be used in the research later.
As for the Content Validity Index (CVI), pane lists' approval was indeed important to study the degree of the correct items that correspond with the purpose of the research. Indeed, Content Validity Index used in this study actually did not focus on the level of agreement because CVI measures the proportion of agreement among a group of experts. This was supported by Masuwai, Tajudin, and Saad (2016) that stated CVI focuses more on the quotient of agreement by the pane list rather than the level of agreement. This allows CVI to be very useful in eliminating any uncertainty and permits direct interpretation which helps in building more dependable and logical data about the content validity. All the items that were maintained from the original version are considered relevant to the thematic domains based on high CVI produced in this validity test. Obviously, all the comments and corrections recommended by the panels were well thought out for revisions (Masuwai et al., 2016). Therefore, the items of this questionnaire were concluded in the table as follows:

Conclusion
This new instrument which combined two questionnaires is found to establish an adequate and acceptable measurement of performance which will be needed for future descriptive studies on how technology can affect ELT among English teachers. The validity test used in this research has proven that this adapted questionnaire has adequate face and content validity and thus, can be further used for the next study.