CUHK
News Centre

1 Apr 2014

CUHK Releases Students’ Results in Computer-based Assessment in PISA 2012

1 Apr 2014
Share
Print

There has been widespread concern over the opportunities and challenges brought about by the coming of the information age and the expansion of the internet to the field of education. To reveal how competent Hong Kong students are in using digital technologies and online information, the Hong Kong Centre for International Student Assessment of the Institute of Educational Research at The Chinese University of Hong Kong (CUHK) released today (1 April) the results of Computer-based Assessment (CBA), as part of the Programme for International Student Assessment (PISA) 2012. 

The results of PISA 2012 on students’ performance in reading, mathematics and science were released in December 2013. As PISA aims at studying students’ ability to apply knowledge in daily life, it incorporated CBA of problem solving, mathematics and reading on top of the conventional written assessment to tie in with the latest trend. From April to May 2012, 2,714 students aged 15 from 148 schools were randomly selected for the CBA.  They were requested to answer questions by searching and exploring interactive simulations produced by a computer programme in 40 minutes. Their parents and schools were also requested to provide background information through questionnaires. 

Survey results 

Among the 44 countries and economies participating in the CBA, Hong Kong students ranked fourth in both problem solving and mathematics, and third in reading (Table 1). For CBA problem solving, Hong Kong students attained an average score of 540, lagging behind students in Singapore (562), Korea (561) and Japan (552), and being on a par with Macao students. For CBA mathematics, the average score of Hong Kong students was 550, which was lower than those of Singapore (566), Shanghai (562) and Korea (553). For digital reading, Hong Kong students scored an average of 550, which had significantly improved from 515 in PISA 2009, despite the fact that they were outperformed by students in Singapore (567) and Korea (555). 

Among the six levels of CBA problem solving scale, level 5 and above belong to top levels while level 2 is the baseline level (Figure 1). Results showed that 19.3% of Hong Kong students reached the top levels, outperforming the average of 11.4% of the Organisation for Economic Co-operation and Development (OECD). This percentage was lower than those of Singapore (29.3%), Korea (27.6%) and Japan (22.3%), but higher than that of Macao (16.6%) (Figure 2). On the other hand, 89.6% of Hong Kong students reached the baseline level, outperforming the OECD average of 78.6% but being outperformed by Korea (93.1%), Japan (92.9%), Macao (92.5%) and Singapore (92.0%) (Figure 3). 

Information technology resources in families and schools 

The study analysed the impact of availability of information and communication technologies (ICT) resources in families and schools on Hong Kong students’ performance. A great majority of students (over 98%) had access to computers and internet at home. Results showed that students having access to computers at home, including desktop computers, notebook computers and tablet computers, outperformed significantly those without by 59 score points in CBA problem solving, a finding which is similar to that of digital reading in 2009. In view of the strong negative impact of lack of computers at home on students’ learning, the Government should provide support and appropriate ICT resources for students of these families, despite their small number. 

In the school aspect, while over 80% of students had access to computers and internet at school, there are 20.7% of schools which reported a shortage of computers, 7.6% a shortage of internet access resources, and 23.0% a shortage of educational software. Shortage of these ICT resources was said to have affected teaching quality at schools (Figure 4). While Hong Kong’s policy on information technology in education has been strengthened over the last decade, these results indicated that about 10 to 20% of schools still sensed a shortage of ICT resources and this percentage had increased since 2009. Education policymakers should be aware of the current needs for ICT resources of schools and provide them with renewal of computer hardware and software so as to meet the needs of today’s society. Further research is also needed to promote the effective use of ICT at schools, thereby enhancing students’ performance regardless of their backgrounds. 

Online activities and CBA performance 

PISA analysed the relationship between various online activities and CBA performance. Activities found to be positively correlated with students’ performance included using email, reading news on the internet, obtaining practical information from the internet, and participating in social networks. On the contrary, students who frequently downloaded music, films, games or softwares from the internet had poorer performance (Figure 5). 

As for the attitudes towards problem solving, the level of perseverance of Hong Kong students was higher than the OECD average, while their openness was far below the OECD average (Figure 6). These two kinds of attitudes were found to be significantly positively correlated with students’ performance in CBA problem solving, CBA mathematics and digital reading (Figures 7 to 9). Despite their satisfactory performance in these three areas, the above finding indicates that there is room for improvement in the attitudes towards problem solving among Hong Kong students. 

About PISA 

PISA is a triennial international study organized by OECD with over 70 participating countries in 2012. It aims at evaluating the basic knowledge and skills essential for participation in society among students aged 15. In 2012, the Computer-based Assessment covered three key areas including problem solving, mathematics  and reading which were set out by scholars from all participating countries or economies, reviewed by international academic specialists and approved by special commissions of the countries or economies. In the information age, digital technologies will play a more important role in PISA assessment.