The Queensland Studies Authority has responsibility for quite a number of assessments. In other presentations people will refer to the Queensland Comparable Assessment Tasks (QCAT), an assessment bank, the National Assessment Program - Literacy and Numeracy, the Queensland Core Skills Test (QCS) and External Exams. For all of these assessments we convene scrutiny panels who are expected to provide expert advice about the quality of the instruments - face, content and construct validity as well as equity considerations. This paper will discuss the tool we have devised to assist panellists in providing constructive feedback to ensure that the assessment is of the highest quality.