BJR
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS

British Journal of Radiology (2003) 76, 519-524
© 2003 British Institute of Radiology
doi: 10.1259/bjr/67551353

This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Pilling, J R
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Pilling, J R

Full Paper

Picture archiving and communication systems: the users' view

J R Pilling, FRCR

Radiology Department, Norfolk and Norwich University Hospital, Colney Lane, Norwich NR4 7UY, UK


    Abstract
 Top
 Abstract
 Introduction
 Method
 Results
 Discussion
 Conclusion
 References
 
A study was undertaken to assess the acceptability to users of a Picture Archiving and Communication System (PACS). A questionnaire was issued to 208 users. Some questions required a graduated score in response and others a free text response. 101 responses were received from a cross section of hospital staff. The majority of users judged PACS to be a major advance for the hospital, with high quality images, less frustration than using film and an improvement in their working lives. They judged that it had made a positive change in their working practices and had met their expectations. They welcomed the access it gave them to Radiology reports. There was more ambivalence about the impact it had made to the efficiency of clinic consultations and the conduct of ward rounds. Free text responses were made concerning the benefits and disadvantages of PACS. Analysis of these demonstrated many more benefits than disadvantages. The Radiology department has been enabled to address the concerns of staff raised through the questionnaire, and has been encouraged by the positive responses. PACS has been accepted well by a wide cross section of hospital staff. It has improved their working lives and made a major contribution to the working of the hospital as a whole.


    Introduction
 Top
 Abstract
 Introduction
 Method
 Results
 Discussion
 Conclusion
 References
 
Picture Archiving and Communication Systems (PACS) are becoming recognised as the most appropriate means of acquiring, archiving and communicating all forms of radiology imaging because of the benefits listed in Table 1Go. It is an expensive technology but is becoming increasingly affordable. The first installation in the UK was at the Hammersmith Hospital in 1995. The benefits which it brought to the hospital, compared with film based imaging, have been documented [1]. It is being seen as an indispensable part of the drive towards a full Electronic Patient Record.


View this table:
[in this window]
[in a new window]
 
Table 1. Potential benefits of picture archiving and communication systems

 
The Norfolk and Norwich University Hospital is a new 989 bed acute hospital serving a population of approximately 550 000. As part of the new hospital build a fully filmless PACS was installed. As part of the PACS project all CT and MRI scans and 97% of plain radiographs were archived on to PACS starting in March 2001. This ensured that a substantial image archive existed prior to moving to the new hospital. The move to the new hospital took place over 6 weeks during November and December 2001. Prior to the move discussions had taken place with, and a questionnaire had been circulated to, all Clinical Directors seeking their requirements for the availability of previous radiographs in wards and clinics and also to determine their needs for film digitization. No films were digitized prior to the move. Clinic staff were permitted to request previous radiographs from the film file after they had established that relevant examinations existed. These films were viewed on portable light boxes which had been moved from the old hospital. It was recognised that there would be a continuing need for light boxes for the indefinite future in order to view images submitted from outside hospitals as part of tertiary referrals. Clinicians were encouraged to select relevant prior examinations, at the time of consultation, from the film packet and submit them for digitization and inclusion in the PACS archive for future reference. After 12 months the number of these requests had diminished considerably.

Within the new PACS environment it became possible to copy Radiology reports to the PACS. Reports are generated in two ways, either directly by voice recognition (VR) or by direct transcription on to the Radiology Information System (RIS). In the case of VR the report is authorized immediately after it has been dictated, and then it is immediately sent from the RIS and appears on the PACS within 10 s. Following transcription the report is authorized in the usual way and is sent to PACS only after authorization. Any delays in transcription or authorization lead to delays in the report being available on PACS.

Staff were trained in the use of the PACS before moving to a fully filmless operation in the new hospital. Within the confines of the new hospital film is not generated. For screening mammography, which takes place at a dedicated Breast Screening Unit on a Community Hospital site, film is still generated. Symptomatic mammography is undertaken on the new hospital site and is filmless. Film is generated only for operating theatres and for referral to other centres. Experimentation with image access in operating theatres is currently taking place, using a combination of diagnostic and web based PACS workstations, however the utility and convenience of hard copy is hard to match in this particular environment.

It was recognised that many different staff need to access images and radiology reports as part of their duties and training was offered to all staff who thought they needed radiology image or report access. Over 2000 users were given passwords for the system and this included doctors, nurses, clinic staff, ward receptionists, secretaries and paramedical staff as well as the staff in radiology.

As part of the PACS installation a web server was installed to permit access to images from PCs anywhere in the hospital over the ordinary hospital network, as part of the hospitals intranet. To ensure that image quality was optimum on PCs in the most critical areas 460 new PCs with 17 inch flat screen LCDs were installed. These were designated as "Image Review Workstations".

New technology will only be accepted by users if they can see that it makes their working lives easier. The initial acceptability of the PACS was good, with numerous compliments and very few complaints. After 6 months of operation the current study was undertaken to document the acceptability of PACS amongst users outside Radiology and to determine whether there were any areas of concern which required addressing.

A limited user survey [2] was undertaken at the Hammersmith Hospital, prior to the development of the web browser technology, with many fewer users having access to the system. Their survey concentrated on medical staff and on the availability of images and reports before and after the PACS installation.

There have been several studies which have attempted to demonstrate the benefits of PACS to users, but many of these have concentrated on particular groups of users such as radiology trainees [3], users in a particular department [4] or have been more focused in their approach [5].

This study concentrates on the impact that PACS has made to the working of the hospital as a whole and on the working lives of individual staff in many different disciplines.

A number of clinicians had communicated the fact that PACS had made an impact both on their ward rounds and clinic sessions. In particular a paediatric surgeon had altered his ward round practice so that he reviewed all images and notes in the office with his team before starting his round. He found that the ensuing round was quicker and that the parents of his patients appreciated the speedier consultation at the bedside.

These communications provoked the inclusion of questions 4 and 5.


    Method
 Top
 Abstract
 Introduction
 Method
 Results
 Discussion
 Conclusion
 References
 
A questionnaire was devised with the assistance of the hospital Quality Department. It used a combination of responses to statements and questions, graduated from 1 to 6, and some opportunities for free text opinion. Respondents were invited to allocate a score from 1, if they thought they could not agree with the question or statement at all, to 6 if they were in complete agreement with the statement or question. The statements/questions are documented in Table 2Go, with an indication of the values of a score of 1 and 6 in relation to each question.


View this table:
[in this window]
[in a new window]
 
Table 2. Picture archiving and communication systems (PACS) questionnaire results

 
The questionnaire was sent out to a total of 208 users, of which just over 50% were doctors and the remainder nurses, secretaries, reception, clerical and other staff.

The replies were collated by the Quality Department. The responses were tabulated.

The free text comments were analysed and grouped appropriately. Several respondents made more than one point in the free text sections and each point was recorded separately. Some respondents did not complete the free text sections.


    Results
 Top
 Abstract
 Introduction
 Method
 Results
 Discussion
 Conclusion
 References
 
Respondents
The numbers of respondents and their job titles are listed in Table 3Go.


View this table:
[in this window]
[in a new window]
 
Table 3. Respondents

 
Tabulated responses
The full results are listed in Table 2.Go


    Discussion
 Top
 Abstract
 Introduction
 Method
 Results
 Discussion
 Conclusion
 References
 
Question 1: PACS is a useful advance for the Trust
The results were very encouraging with 97% agreeing strongly or very strongly that PACS had been a useful advance for the hospital. This was taken as an endorsement of the success of the project as a whole. It was gratifying that such a large project, allied to the largest hospital move in the history of the NHS, could have been such a resounding success.

Question 2: How do you rate the quality of the images on the Image Review Workstations?
The choice of hardware for the Image Review Workstations was vindicated by the assessment of users that the image quality was good, all the responses scored between 4 and 6. Users had been consulted about their requirements for viewing images and their choice of 17 inch flat screen LCDs proved to be very good.

Question 3: How useful is it to have access to radiology reports on PACS?
The availability of radiology reports alongside the images was considered useful by the majority with 93% scoring 5 or 6 for this response. For many staff the existence of a report is as important as the images themselves and the possibility to view both items simultaneously is a great strength of PACS.

Question 4: Has PACS improved your patient consultation?

  1. by helping to show patients their radiology images.
  2. by reducing the time spent finding images for review.
  3. by reducing the time spent finding radiology reports.
  4. by making consultations more time efficient.

For clinicians in outpatient clinics PACS had improved their consultations with the majority scoring 4 to 6 on all four sections of question 4. The ability to easily demonstrate images to patients, the improved efficiency in finding images and reports, and the overall improved efficiency of the consultation all showed a favourable response. The unavailability of film packets in outpatients has been a frustration of film based systems. For clinicians whose practice is heavily dependent on radiology images, such as orthopaedic surgeons and respiratory physicians, the advent of PACS has made a substantial difference to the conduct of their clinics.

The relatively large number of responses in the N/A line reflects the wide range of staff groups responding to the survey, some of whom could not express an opinion on this question nor on the following question.

Question 5: What change has PACS made on the conduct of ward rounds?

  1. by changing the way ward rounds are conducted.
  2. by making it more difficult to review images during a ward round.
  3. by forcing a change in the way ward rounds are conducted PACS has had an impact.
  4. by making changes in the way images are reviewed at the beginning of a ward round.

Question 5 was worded to explore how much PACS had impacted the conduct of ward rounds. It can be seen that this impact was widespread and that most clinicians had altered the conduct of their ward rounds. Some found image review more difficult but a few found it easier with the majority of respondents finding little impact. Similarly the impact of PACS forcing a change in the conduct of ward rounds met with a fairly widespread response. There was no clear view that viewing images at the commencement had enabled a more efficient ward round. This was because, for some clinicians, their patients are spread out over many different wards and image viewing was the least of their problems so far as efficiency was concerned.

Question 6: Has PACS caused you more or less frustrations than using film?
Overall clinicians preferred PACS to film and found it much less frustrating. One of the declared benefits of PACS is the reduction in frustration afforded by the instant availability of images and the need no longer to handle films and film packets physically. It would have been surprising if this question had been answered any less positively.

Question 7: Has PACS improved your professional life?
The response to this question was very surprising. The fact that 93% of respondents scored 4 to 6 on this question shows the impact of PACS on improving the working life of many different staff groups. Radiographs are an integral part of the working lives of many different healthcare professionals, but to find such a positive response from such a wide variety of staff groups indicates the substantial impact that PACS has made on the perception of the quality of working life experienced by staff.

Question 8: To what extent has PACS changed your working practices?
For the majority of staff groups PACS has resulted in a significant change in working practice with 81% scoring 4 to 6 for question 8. When asked to amplify the reasons for this change the most common factors were improved access to images, the ability to discuss images over the telephone, because the images were available in many places simultaneously, the improved time management that PACS enabled and the absence of lost images. A full breakdown of comments can be found in Table 4Go.


View this table:
[in this window]
[in a new window]
 
Table 4. Improvements in working life

 
Question 9: To what extent has the introduction of PACS met your expectations?
This question investigated the degree to which clinicians expectations had been met. 30 "PACS Roadshows" were held for staff before the move to introduce them to the impact of PACS on the working practices of the new hospital. 90% of respondents scored between 4 and 6 in favour of PACS meeting their expectations. A lot of effort went into the PACS Roadshows and the response from staff at the time was fairly muted. Clearly the message had been communicated well and staff found their expectations were met.

Question 10: Please list below the three main work related benefits/disadvantages you have encountered since the introduction of PACS?
The final question allowed respondents to express three benefits and three disadvantages of PACS.

An analysis of results showed that some respondents had not offered an opinion and that others had offered up to three comments in both categories. These were grouped together under headings as shown in Tables 5Go and 6Go.


View this table:
[in this window]
[in a new window]
 
Table 5. Benefits of picture archiving and communications systems

 

View this table:
[in this window]
[in a new window]
 
Table 6. Disadvantages of picture archiving and communications systems

 
Benefits of PACS (Table 5Go)
The perceived benefits of PACS match well the proclaimed benefits which have been trumpeted by PACS suppliers and PACS enthusiasts alike (Table 1Go). Many of the free text comments reflect the responses to the questions, some are very general ("Excellent") and some highlight advantages neither in the questionnaire nor a recognised benefit, such as "good for teaching".

Disadvantages of PACS (Table 6Go)
It should be noted overall that there were fewer comments in this section than in the benefits section (Table 5Go). Eight respondents made a single entry saying that there were "no disadvantages".

The most obvious disadvantage hinges around the problems of old images being available and the ease of comparison of new PACS images with old film images. Despite substantial efforts to excite the interest of clinicians in this problem before the move, it was only after the move that the need for digitization of previous examinations became a practical reality. Several technical problems needed to be solved and the digitization programme was slow in getting started and met with several delays. The criticisms were fully justified, but at the 6 month stage the system was working much more smoothly though not perfectly.

It would be ideal to have a universal log on to all computer systems and that is the declared aim of the IT department. Technical hurdles still need to be overcome before a single log on becomes a reality. It is frustrating to have to log on to several different systems during one clinical session, and when those systems have time dependent automatic log offs the scope for frustration increases.

The lack of radiological reports has nothing to do with PACS itself but is a radiology management function.

The inadequate provision of PCs in some wards and departments also has nothing to do with PACS itself. Each department was given the responsibility for ensuring that they had adequate provision of PCs. Some were more successful in foreseeing their needs than others.

Some of the comments revealed weaknesses of the implementation of PACS, such as inadequate training being offered, but a small number of comments were completely ill founded, the system has been 100% reliable with no unplanned downtime and yet comments were received about images being unavailable. One respondent was believed to have thought that the questionnaire was about the PAS (Patient Administration System) because of rather unusual responses to the questions.

The responses have given the Radiology department the opportunity to address some of the grievances, but also to enjoy the comments of appreciation.

Many of the advantages (Table 1Go) which have been used in the promotion of PACS have been endorsed by this survey. In the surveys quoted from other institutions [25] PACS has met with an enthusiastic response from users, yet there is still much caution being exercised about the introduction of PACS in the UK. Much of this emanates from a concern about the financial cost of PACS, which is not inconsiderable. It is regrettable that financial restrictions should be hampering the introduction of a system which would bring substantial benefits to a wide range of health service employees.


    Conclusion
 Top
 Abstract
 Introduction
 Method
 Results
 Discussion
 Conclusion
 References
 
The response of the users to the implementation of a whole hospital PACS indicated that it had been a useful advance for the hospital, with images of good quality available alongside reports. It had enabled some improvement in the way in which outpatient clinics and ward rounds were conducted. For most respondents the system had lessened frustration, improved their working lives and met their expectations. The perceived benefits of PACS outnumbered the disadvantages and reflected the widely documented benefits of PACS in the literature.


    Acknowledgments
 
The author thanks the Quality Department at the Norfolk and Norwich University Hospital, and in particular Lyn Taylor, for help in compiling and distributing the questionnaires and in compiling the results. Also Maxine Bullock, the PACS System Adminstrator, for her help in analysing the free text comments.

Received for publication October 11, 2002. Revision received April 4, 2003. Accepted for publication April 29, 2003.


    References
 Top
 Abstract
 Introduction
 Method
 Results
 Discussion
 Conclusion
 References
 

  1. Bryan S, Weatherburn G, Buxton M, Watkins J, Keen J, Muris N. Evaluation of a hospital picture archiving and communication system. J Health Serv Res Policy 1999;4:204–9.[Medline]
  2. Watkins J. A hospital-wide picture archiving and communication system (PACS): the views of users and providers of the radiology service at Hammersmith Hospital. Eur J Radiol 1999;32:106–12.[CrossRef][Medline]
  3. Mullins ME, Mehta A, Patel H, McLoud TC, Novelline RA. Impact of PACS on the education of radiology residents: the residents' perspective. Acad Radiol 2001;8:67–73.[Medline]
  4. Reiner BI, Siegel EL, Hooper F, Pomerantz SM, Protopapas Z, Pickar E, et al. Picture archiving and communication systems and vascular surgery: clinical impressions and suggestions for improvement. J Digit Imaging 1996;9:167–71.[Medline]
  5. Bryan S, Weatherburn GC, Watkins JR, Buxton MJ. The benefits of hospital-wide picture archiving and communication systems: a survey of clinical users of radiology services. Br J Radiol 1999;72:469–78.[Abstract]



This article has been cited by other articles:


Home page
Arch. Dis. Child.Home page
K. G Yallop and E. Makin
Difficulties with the picture archive and communication system for the transferred patient
Arch. Dis. Child., March 1, 2007; 92(3): 279 - 279.
[Full Text] [PDF]


Home page
J. Am. Med. Inform. Assoc.Home page
A. P. Gurses and Y. Xiao
A Systematic Review of the Literature on Multidisciplinary Rounds to Design Information Technology
J. Am. Med. Inform. Assoc., May 1, 2006; 13(3): 267 - 276.
[Abstract] [Full Text] [PDF]


Home page
Am. J. Roentgenol.Home page
J. E. Roos, B. Chilla, M. Zanetti, M. Schmid, P. Koch, C. W. A. Pfirrmann, and J. Hodler
MRI of Meniscal Lesions: Soft-Copy (PACS) and Hard-Copy Evaluation Versus Reviewer Experience.
Am. J. Roentgenol., March 1, 2006; 186(3): 786 - 790.
[Abstract] [Full Text] [PDF]


Home page
Rheumatology (Oxford)Home page
Z. Paskins and A. Rai
The impact of Picture Archiving and Communication Systems (PACS) implementation in rheumatology
Rheumatology, March 1, 2006; 45(3): 354 - 355.
[Full Text] [PDF]


Home page
Br. J. Radiol.Home page
D MacVicar
Are you sitting comfortably?
Br. J. Radiol., July 1, 2005; 78(931): 581 - 581.
[Full Text] [PDF]


Home page
Br. J. Radiol.Home page
D Blunt and D O'Regan
Using PACS as a teaching resource
Br. J. Radiol., June 1, 2005; 78(930): 483 - 484.
[Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Pilling, J R
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Pilling, J R


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
BJR DMFR IMAGING  ALL BIR JOURNALS