Page 10 - ELG2304 Apr Issue 484
P. 10

.
        EXAM NEWS


        Leaning into PISA’s language test




        In 2025 the OECD is launching its Foreign

        Language Assessment (FLA) as part of its famous

        suite of PISA tests. Designed by Cambridge
        University Press and Assessment, the test will
        give us a reliable global picture of the levels

        of English in schools. Cambridge’s Director

        of Education Transformation and Impact,                                                                    CREDIT: OECD
        Dr Hanan Khalifa, explains its importance.


               The PISA FLA is an incredibly   has been designed to meet the very   mini study. For example, we looked at
        HK significant and groundbreaking   specific set of requirements needed   the feasibility of the tests in terms of
        project, which will provide the     to help people use English for work,   design, accessibility, technology, and
        comparative data that is needed about   study, or migration, and it is also   practicalities. This is the first time
        how English is actually taught in schools   different from single-level tests, such   that PISA includes an assessment of
        around the world.                   as Cambridge First,                 listening and speaking, and the main
                                                                                conclusion of the pilot was that the data
        The full scope of the study has not yet   Why have three skills instead of all   collection worked.
        been published, but as with the other  Q four? Could this is any way skew
        well-established elements of PISA, it   the results?                    It also confirmed the need to have the
        will cover a wide range of factors which   Due to practical and logistical   students sitting the listening and speaking
        affect educational outcomes. Along   HK constraints, the 2025 cycle     parts together in a separate room, to not
        with the English assessment, there will   will focus on reception (reading and   disturb the students taking the regular
        also be questionnaires sent to teachers,   listening comprehension) and production   PISA tests. We were delighted that the
        students, schools, and parents to help   (speaking). The additional demands of   test worked as expected, confirming the
        paint a really rich picture of English   testing writing, given the high numbers   2025 FLA is feasible.
        teaching.                           of PISA test takers, means it would not
          The questionnaire for students.   be feasible at this stage. The Programme   What questions can the tests
        For instance, will cover background   intends to explore the assessment of the  Q answer?
        information about the students      remaining modes of communication in       We’re not trying to second guess
        themselves: their attitudes, homes, and   future iterations of the FLA.   HK the results of the study, but there
        experiences. This in will provide added                                 is one big question. What works?
        richness to the analysis of the students’   Also it is important to note that this
        performance and hopes to highlight   isn’t a competition. The … focus is on   To unpack this, it is important to look
        what might work better for each student   identifying factors which contribute   at the bigger picture. At Cambridge we
        according to their characteristics.  to successful language learning within   work with schools all over the world
                                            and across countries. For this reason,   and we see fantastic English teaching
             There is likely to be a huge   it should not be thought of as a ‘league   practices and strategies that get
        Q  variation in language levels, from   table;’ it’s much more than that.   amazing results.
        A1 to C1, can one test encompass them?  Nevertheless the OECD has a tried and   However, without large-scale
               We have designed a test which   tested methodology for ensuring that the   comparative data on how English is
        HK covers the full range of levels   outcomes of the tests do facilitate robust,   taught and learnt in schools, it’s difficult
        up to C1, a test that is optimised for   meaningful comparison          to know where to focus resources.
        this purpose.                                                           Should it be on teacher training?
        The reading and listening tests employ a  Q                             Curriculum development? Or on
                                                Is it computer marked?
                                                                                encouraging children to learn English
        multi-stage adaptive design, meaning that   The reading and listening tests   as early as possible? This is why we’re
        students’ performances in initial sections  HK include only multiple-choice   so excited about the results of the PISA
        of the test determine, in part, the final   and matching question types, both of   FLA as it will answer these questions
        assignment.                         which can be automatically marked. The   and many more.
          Speaking is non-adaptive; the     speaking responses will be recorded and
        characteristics of the spoken output   centrally marked by expert Cambridge
        will determine the proficiency level. All   examiners.                               Dr Hanan Khalifa is
        speaking tasks are designed both to be                                               Director of Education
        accessible to lower-level students and   You have just completed a pilot             Transformation and
        to provide appropriate opportunities for  Q test, what did you find?                 Impact, at Cambridge
        higher-level students to demonstrate      The pilot was a proof of                   University Press and
        their ability. The context is very   HK concept and validation of the
        different from a test like IELTS, which   testing methodology, rather than a         Assessment.
        10                                                                                               April 2023
   5   6   7   8   9   10   11   12   13   14   15