| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
Full Paper |
Radiological Sciences Unit, The Hammersmith Hospitals NHS Trust & Imperial College, Charing Cross Hospital, Fulham Palace Road, London W6 8RF, UK
| Abstract |
|---|
|
|
|---|
| Introduction |
|---|
|
|
|---|
MR image quality assessment, performed by medical physicists, usually forms a major part of the acceptance procedure. Although the development of MR image quality measurements has been ongoing for many years and most institutions carry out some degree of routine QA, there is, as yet, no published systematic study presenting evidence for the effectiveness of these measurements in acceptance testing. Firbank et al [1] recently presented a review of ongoing QA procedures for an individual MR system.
Protocols for image quality and QA have been published by various groups, including the European Community Concerted Action [2], the National Electrical Manufacturers Association (NEMA) [37], the American Association of Physicists in Medicine (AAPM) [8], the Institute of Physics and Engineering in Medicine [9] and the American College of Radiology [10]. The NEMA standards provide a range of methodologies for image quality parameter measurement including geometric distortion, uniformity and signal-to-noise ratio (SNR) [3]. In Europe, the Eurospin Test System is sometimes promoted as a standard set of test objects suitable for acceptance testing of clinical MRI equipment [11]. These test objects were designed with the specific purpose of assessing scanners for the identification and characterization of biological tissues by nuclear magnetic resonance, in a concerted research project. Their use in acceptance testing of modern MR systems is severely limited by their design, by virtue of being basically restricted to single slice mode.
There are no generally adopted published acceptance criteria, although the AAPM has published some guideline recommendations [12] and the NHS Estates Agency gave an illustration in their Health Guidance Note on MRI [13]. This paper addresses the issue of the effectiveness of an MR acceptance protocol developed at Charing Cross Hospital that uses custom designed test objects, acceptance criteria and methodologies broadly consistent with the NEMA standards. Specific questions asked were:
Other questions of interest include whether scanner performance has improved with respect to the acceptance criteria, and whether these local acceptance criteria are reasonable and merit widespread adoption.
In addition to image quality measurements, an audit was performed of installation safety aspects for 11 of the MR units. Safety issues and recommendations have been addressed by the Medical Devices Directorate (MDD) [14], the National Radiological Protection Board [15] and the International Electrotechnical Commission (IEC) [16].
| Methods |
|---|
|
|
|---|
|
|
Parameters dependent upon coil
The SNRs for head coil, body coil, and all other coils, including phased array, were assessed for a standard spin echo (SE) sequence; TR=500 ms, TE=15 ms, 250 mm FOV, 256 x 256 matrix, and N x 5 mm slices. The number of slices N varied according to the capability of the scanner. Uniformity was assessed for head and body coils.
Parameters dependent upon sequence (for head coil)
These parameters included image SNR, geometric parameters, resolution and ghosting. Sequences evaluated included: two-dimensional (2D) multislice SE; turbo SE/fast SE (TSE/FSE); 3D (spoiled) gradient echo (SPGR); 2D turbo fast low angle shot, inversion recovery-prepped SPGR; half Fourier TSE/single shot FSE (HASTE/SS-FSE); gradient and spin echo (GRASE); and single shot echo planar imaging.
Parameters sensitive to position in magnet
These included the geometric parameters and fat saturation. They were assessed at the isocentre, and at a 200 mm offset in the coronal orientation, in a shoulder-like position. Additionally, geometric and slice parameters were assessed for the three principal image planes using SE.
In all cases acceptance tests took place after manufacturers had completed their commissioning procedures to their own satisfaction. Typically 60 image series were acquired with a total of 300400 individual images. Image acquisition took between half a day and one whole day. An engineering representative of the manufacturer was usually present during data acquisition.
Image evaluation
Where possible images were evaluated by transferring image data by CD, Magneto-Optical Disk or network to a Sun workstation running AnalyzeTM software (Analyze Direct Inc., Lenexa, KS). Where transfer was not possible, all measurements were made on the MR console or independent workstation in situ. In these instances line profiles necessary for analysis were read out manually pixel-by-pixel from the manufacturer's line profile graphs.
Acceptance criteria
An outline of specific criteria is given in Table 1
. These follow a two-tier scheme. Failure to meet the minimum standard constituted a hard fail and requires remediation. Failure to meet the expected value constituted a soft fail, and may require further investigation by the manufacturer, leading to re-testing or, ultimately, remediation as for a hard fail.
|
For geometric parameters, the criteria are based upon the known linearity specifications of the gradient systems. All other criteria were based upon the authors' experience and manufacturers' published data or technical specifications.
Following analysis, a report was presented to the institution and forwarded to the manufacturer at their discretion. Follow-up testing or discussions took place at the invitation of the institution. Follow-up involving the medical physics team occurred in most, but not all, instances where criteria were not met.
Safety questionnaire
In 11 systems from 1996 onwards, a safety evaluation was completed. This was based upon a 100 point questionnaire derived from MDD and IEC publications [14, 16] and addressed the following areas.
The questionnaire was completed with the assistance of a senior member of local MR staff, usually the superintendent, and the manufacturer where required.
| Results and discussion |
|---|
|
|
|---|
|
Is effective corrective action taken in cases of non-compliance?
There were five categories of outcome following hard or soft failure.
Grouping together categories 13 as favourable, a verifiable beneficial outcome was obtained for 49% of all occurrences of non-complaint measurements.
Which parameters have yielded the most effective remediation?
A breakdown of outcomes by parameter is shown in Table 2
. Favourable outcomes were obtained for 81.8% of SNR problems, 66.7% of slice problems and 58.3% of linearity/distortion problems. In practice, SNR outcomes usually involved the replacement or retuning of a coil. Fat suppression and ghosting failures did not result in any replacement or re-calibration.
|
|
|
|
|
|
Results for head coil ASNR are shown for all 17 systems in Figure 5
. The mean value was 12 880 Hz1/2 ml-1 T-1 (SD 2150). This is within 3% of the expected value for a measurement with an experimental error of 8% [19]. Using a one-tailed normal distribution, 95% of values should lie within 1.7 SD of the mean, or above 9 227 Hz1/2 ml-1 T-1. This is within 8% of the minimum criterion and no systems gave less ASNR than this minimum. The 5th and 95th percentile values were 10 482 Hz1/2 ml-1 T-1 and 17 893 Hz1/2 ml-1 T-1, respectively. In this study none of the systems hard failed for the head coil SNR. All SNR failures related to specialist coils and were such that diagnostic quality of clinical images would have been compromised.
It should be noted that the present use of ASNR differs from that of a previous publication [20], in that no correction is made for relaxation effects (T1 and T2) in the present paper. Applying this correction gives a mean ASNR of 13 500 Hz1/2 ml-1 T-1 with a standard deviation of 2100 Hz1/2 ml-1 T-1 for the 22 systems investigated by McRobbie [20]. The same paper quoted a theoretical maximum SNR of 23 600 Hz1/2 ml-1 T-1 for a quadrature head coil reducing to 19 900 Hz1/2 ml-1 T-1 when T1 and T2 corrections are applied for the specific sequence. This figure does not, however, include coil losses or noise in the electronics, and assumes only an inductive component and idealized radio frequency field geometry. By comparison, Redpath and Wiggins [21] reported an achievable SNR of 17 100 Hz1/2 ml-1 T-1 for one example of a transmit-receive head coil, the value dropping to 14 500 Hz1/2 ml-1 T-1 when relaxation correction is applied. These values agree sufficiently well with our proposed minimum and expected values.
An analysis is not presented here for the more specialized coils, as individual manufacturer design considerations become more important and a similar body of theoretical and published data is sparse.
Geometric values are shown in Figure 6
. Mean values, worst values, SDs and 5th and 95th percentile values are shown in Table 3
. The mean of means for linearity, distortion and position was 0.95% and the mean of worst values per system was 1.96%. The 95% probability values were between 1.62% and 1.95% for linearity, distortion and position, and 0.6 mm for slice width. These agree well with the minimum acceptable values of 2% and 0.5 mm, respectively. The criteria of 1%, 2% and 0.5 mm for the head coil/isocentre therefore appear to be reasonable.
|
|
Data for non-suppression of the water signal by fat saturation supported the original criterion of 90% water retention. Using 1.7 SD from the mean gives a possible minimum value of 91.8%. However, the mean value was 97.4% and the modal value 100%. An inadvertent water saturation to 90% of equilibrium magnetization could have untoward consequences for the appearance of clinical images. In particular, as fat saturation is usually applied in a non-spatially selective manner, the partial water saturation may result in spurious T1 weighting. 70% of scanners achieved over 98% for this parameter and in 2000 the minimum criterion for measurement at the isocentre was changed from 90% to 98%.
What are the most common safety issues relevant to a new installation?
The mean number of failures/inadequate answers to the safety questionnaire per scanner was 4.7%. The most common failures were for lack of, or inadequate, warning signs (13%), poor layout (11%), staff/patient lockers missing or not delivered at time of testing (9%), inadequate storage (8%) and poor waveguide position (6%). Other items occurring more than once included poor coil storage, inadequate labelling of ancillary equipment, inadequate labelling of quench or stop buttons, poor visibility of the scanner from the control room, inappropriate or missing fire extinguishers, no lock on the magnet room door and the door alarm fitted but not working. Other noteworthy items that occurred only once included no emergency off button in the magnet room, intercom failure, CCTV not installed although ordered and no manufacturer's documentation. Although not safety-related, other anecdotal occurrences included the failure of a manufacturer to notice that they had not supplied any coils other than those built in, and non-installation of sequences and software that had been ordered.
| Conclusions |
|---|
|
|
|---|
The majority of safety issues related to design compromises in the suite layout and inadequate use of signs. The involvement of an appropriately qualified and experienced MR safety expert, the "designated professional" as proposed in the MDD guidance, at the initial planning stages is supported and recommended.
| Appendix |
|---|
|
|
|---|
|
|
where
x,
y,
z are voxel dimensions in centimetres, NEX is number of excitations (integer) and NPE is phase encode product (integer). For two-dimensional Fourier transform, NPE is simply the number of phase encode steps. ISNR is
|
|
where S is the mean pixel number over a region of interest (ROI) covering 75% of the test object cross-sectional area (170 cm2) and <
> is the mean standard deviation of four artefact-free ROIs situated outside the test object. The combined ROI contained at least 400 pixels. A Raleigh distribution correction factor of 0.66 is used to express the SNR in terms of a normal distribution of noise. For non-uniform coils, a smaller signal ROI was selected commensurate with the intended clinical use of the coil.
Uniformity
Uniformity was measured from the mean integral uniformity I on a slice-to-slice basis.
|
|
where M is the maximum and m the minimum uniformity over an ROI encompassing 75% of the phantom area in each slice. The use of pre-measurement filtering as recommended by the National Electrical Manufacturers Association was found to be unnecessary. Additionally, a whole volume integral uniformity was measured with a volume of interest containing all slices.
Geometric linearity and distortion
Non-linearity indices Lx and Ly are defined with respect to the frequency and phase axes as
|
|
|
|
where X is the measured distance (frequency), Y the measured distance (phase) and L the true length in the test object (180 mm), averaged over all slices.
Distortion is defined as the maximum deviation D from the mean
|
|
where d is the measured radial distance between points in the test object. The maximum value over the scan volume, i.e. all slices, is used (<d>slices).
Spatial resolution
Spatial resolution was assessed visually from the line pair test patterns with 2.5, 3.3 and 5 line pairs per cm, and from the measurement of modulation across the test patterns as follows:
|
|
Line spread functions
Line spread functions (LSF) were generated by successive subtraction of pixel values of a profile across the angled edge according to the method of Judy [22]. Full width half maxima (FWHM) were used as a measurement of spatial resolution. The asymmetric nature of the LSF precluded accurate determination of modulation transfer functions [17].
Slice position
Slice position was measured from the in-plane displacement of the shadows of the two crossed rods, and expressed as a percentage of the multislice coverage in the slice select direction.
Slice width
Slice width was measured from the rescaled geometric means of the FWHM of the slice ramp shadows.
Ghosting
Ghosting used the standard off-centre bottle technique with measurements in each quadrant of signal, phase ghost, quadrature ghost and pure background noise. The phase ghost ROI was positioned in the area of maximum artefact. Average ghost-to-signal ratios (GSRs) for all slices were calculated as
|
|
where g is the mean pixel value of ROI within the ghosting region, b is the mean pixel value in the ghost-free region of image and S is the mean pixel value in the primary image of the sample.
| Acknowledgments |
|---|
Received for publication July 9, 2001. Revision received November 27, 2001. Accepted for publication January 7, 2002.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
C J Koller, J P Eatough, P J Mountford, and G Frain A survey of MRI quality assurance programmes. Br. J. Radiol., July 1, 2006; 79(943): 592 - 596. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Zhuo and R. P. Gullapalli AAPM/RSNA Physics Tutorial for Residents: MR Artifacts, Safety, and Quality Control RadioGraphics, January 1, 2006; 26(1): 275 - 297. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| BJR | DMFR | IMAGING | ALL BIR JOURNALS |