Archived decisions

Hampshire County Council

Schools Monitoring Panel

Item 6

19 October 2004

Report of evaluation of the Sold Services of HIAS

Report of the County Education Officer

Contact: John Clarke, Deputy County Education Officer, Tel 01962 846459 [email protected] or

Chris Wilson, Senior Inspector/Adviser (Strategic Management), Tel 01962 846517 [email protected]

1 Summary

1.1 This is the second county-wide survey evaluating the services HIAS sells to schools under service level agreement (management partnership). One of the outcomes of the Best Value review of the sold services of HIAS (2001) was to undertake a more regular evaluation of the sold services and to build this into the business unit's budget. This evaluation is part of a range of evaluations to survey the quality and impact of the work of the inspection and advisory service.

1.2 This report to the Panel supports Aim 1 of the Corporate Strategy (maximising life opportunities) and Aim 5 (improving services).

2 The Survey

2.1 The evaluation was undertaken through a rolling sample of schools purchasing work from HIAS from April 2003 to March 2004. The undertaking given to headteachers was that no primary or special school would be approached more than once, and no secondary school more than three times, with no secondary school department approached more than once. The aim was to ensure that all inspector/advisers who sold work to schools would have at least one of their visits evaluated, and to ensure that all schools in Hampshire who purchased work from HIAS were approached on at least one occasion.

2.2 A total of 422 responses were received from 532 surveys sent out, a response rate of 79.3%. This represented 88.0% of the maintained schools in Hampshire contacted, as some schools were contacted on more than one occasion. Where schools were not contacted, they were schools who had not purchased any time from HIAS within the reasonable time span for the work to be evaluated. Generally requests were not made to evaluate work more than six months after the visit had taken place. Because of the nature of the work undertaken by inspector/advisers, some staff, particularly those in curriculum subject teams, and within these particularly those in the foundation subjects whose work is not susceptible to national strategies, tended to undertake the greater proportion of sold services. Care was taken to ensure that the work of these staff was not disproportionately evaluated compared with the work of all staff in HIAS.

2.3 The survey was sent to named schools with the member of HIAS identified against the day and date of visit. Headteachers were invited to respond to a number of questions as follows:

    The inspector/adviser:

    · established a good rapport with me

    · established a good rapport with staff

    · gave good information in advance about what would be involved in the visit

    · wrote helpful reports about the school when required

    · was professional

    · challenged me/the school to strive for higher levels of performance

    · helped me use data to evaluate school performance and set targets

    · had good knowledge/understanding of school improvement issues

    · provided effective support through giving practical and relevant advice

    · was not afraid to give hard messages when necessary

    · delivered messages sensitively

    · has had a positive impact on this school.

    Headteachers were invited to grade responses to these questions on a scale from 0 (not applicable), 1 (very strongly agree) to 6 (very strongly disagree). Headteachers were also invited to write any additional comments on the response sheet.

3 Results

3.1 The overall average grade across all responses from all phases of schools was 1.72 (1.77 in 2002/03) representing agreement with items on the survey between "very strongly agree" and "strongly agree". The primary school aggregate score was 1.70 (1.74), secondary 1.86 (1.90), and special 1.37 (1.89). This represents across all phases generally strong agreement with all the statements in the survey and indicates the work purchased by schools from HIAS as part of the schools' plan to improve has been effective and has had impact. Taken together with other evaluations into the work of HIAS, this survey suggests that in both the purchased services and the work supported by centrally retained budgets, HIAS staff have a significant impact on the work undertaken with schools to cause school improvement.

3.2 Across all items there was a generally high level of agreement. There was, relatively, least satisfaction in response to question 3 "Gave good information in advance about what would be involved in the visit" and question 7 "Helped me use data to evaluate school performance and set targets", although in both cases greater satisfaction was expressed than in 2002/03. With only the exception of question 4, all responses showed the same or improved levels of satisfaction compared with the previous year's survey. Although the item relating to the use of data was often not applicable, the improved response suggests staff and schools are making more use of data in self evaluation and school improvement.

3.3 Items with the strongest agreement were "Was professional" (1.39 average grade), "Established a good rapport with me" (1.52 average grade), and "Provided effective support through giving practical and relevant advice" (1.58 average grade). All items gained agreement between "very strong" and "strong". In particular, there was strong agreement that the inspector had had a positive impact on the school through the work in that visit (1.77 average grade compared with 1.82 in the previous year's survey).

3.4 The additional comments from headteachers were generally supportive of the work HIAS undertakes and in a number of cases exemplify the impact the advice had on the school's health.

3.5 The individual responses were fed back to inspector/advisers at the end of the 12 month period, although any responses indicating disagreement were passed to them and to line managers for discussion during the year.

3.6 We are very grateful to the headteachers and other staff who contributed to this evaluation because it has helped HIAS frame some of its development needs and its consideration of how the service can work with schools to enable and sustain school improvement.

4 Legal implications

4.1 None.

5 Financial implications

6.1 None.

6 Personnel implications

6.1 None.

7 Impact assessment

7.1 Race and equality impact assessment has been considered in the development of this report and no adverse impact has been identified.

8 Crime prevention issues

8.1 None.

9 Views of the Local County Councillor

10.1 Not sought in the drafting of this report.

Recommendations

1 That the report is noted.

2 That further work is undertaken to assess the impact of the work of HIAS on standards of achievement and the quality of education in schools.

Section 100 D - Local Government Act 1972 - background documents

The following documents discuss facts or matters on which this report, or an important part of it, is based and have been relied upon to a material extent in the preparation of this report.

NB: the list excludes

1. Published works

2. Documents which disclose exempt or confidential information as defined in the Act

None