Home   >   CSC-OpenAccess Library   >    Manuscript Information
Full Text Available

This is an Open Access publication published under CSC-OpenAccess Policy.
Publications from CSC-OpenAccess Library are being accessed from over 74 countries worldwide.
Asking Users: A Continuous Evaluation on Systems in a Controlled Environment
Suziah Sulaiman, Dayang Rohaya Awang Rambli, Wan Fatimah Wan Ahmad, Halabi Hasbullah, Foong Oi Mean, M Nordin Zakaria, Goh Kim Nee, Siti Rokhmah M Shukri
Pages - 34 - 42     |    Revised - 20-02-2009     |    Published - 15-03-2009
Volume - 3   Issue - 1    |    Publication Date - February 2009  Table of Contents
usability, continuous improvement, decision making, evaluation
A continuous evaluation on the usability of an existing system is necessary in order to ensure users’ satisfaction when interacting with the system. Seeking users’ subjective opinions on the usability of a system could capture rich information and complement the respective quantitative data on how well the system is in supporting an intended activity. This paper presents a case study that identifies usability issues of the systems currently used in the main control room of an oil refinery plant. A set of survey questions was distributed to the control operators of the plant in which 31 operators responded. Results from the quantitative data suggest that in general respondents were pleased with the existing system. However, it could be claimed from the data that experienced operators are more concerned with the technical functionality while the lesser experienced are towards the usability of the system interface. The respondents’ subjective feedback provides evidences that strengthen the findings. The operators’ responses also revealed several issues especially on the system display, system design, trending, and information representation. The current working environment was also commented to affect the performance of the workers.
1 Google Scholar 
2 Academic Journals Database 
3 ScientificCommons 
4 Academic Index 
5 CiteSeerX 
6 iSEEK 
7 Socol@r  
8 ResearchGATE 
9 Libsearch 
10 Bielefeld Academic Search Engine (BASE) 
11 Scribd 
12 WorldCat 
13 SlideShare 
15 PdfSR 
1 J. Ketchel and J. Naser. “A Human factors view of new technology in nuclear power plant control rooms”. In Proceedings of the 2002 IEEE 7th Conference, 2002
2 J.S. Czuba and D.J. Lawrence. “Application of an electrical load shedding system to a large refinery”. IEEE, pp. 209-214, 1995
3 S. Faisal, A. Blandford and P. Cairns. ”Internalization, Qualitative Methods, and Evaluation”. In BELIV ’08, 2008
4 J. Preece, Y. Rogers and H. Sharp, “Interaction Design: Beyond Human Computer Interaction”, John Wiley & Sons Inc. (2002)
5 S. Sulaiman. “Usability and the Software Production Life Cycle”, In Electronic Proceedings of ACM CHI, Vancouver, Canada, 1996.
6 C.M. Burns, Jr. Skraaning , G. Jamieson, G. A. Lau, N. Kwok, J. R. Welch and G. Andresen, "Evaluation of Ecological Interface Design for Nuclear Process Control: Situation Awareness Effects”, International Journal of Human Factors, vol. 50, pp. 663-679, 2008
7 Vicente, K. J., Mumaw, R. J., & Roth, E. M., "Operator monitoring in a complex dynamic work environment: A qualitative cognitive model based on field observations", Journal of Theoretical Issues in Ergonomics Science, vol. 5, pp. 359-384, 2004.
8 P. Savioja and L. Norros . “Systems Usability -- Promoting Core-Task Oriented Work Practices” ,In Law E. et.al. (eds.) Maturing Usability. London: Springer(2008).
9 L. Norros and M. Nuutinen. “Performance-based usability evaluation of a safety information and alarm system", International Journal of Human-Computer Studies 63(3): 328-361, 2005.
10 P. Savioja, L. Norros and L. Salo. “Evaluation of Systems Usability”, Proceedings of ECCE2008, Madeira, Portugal, September 16-19, 2008.
11 S.H. Han, H. Yang and D.G. Im. “Designing a human-computer interface for a process control room: A case study of a steel manufacturing company”. International Journal of Industrial Ergonomics, 37(5):383-393, 2007
12 S. Guerlain, G. Jamieson and P. Bullemer. “Visualizing Model-Based Predictive Controllers”. Proceedings of the IEA 2000/HFES 2000 Congress, 2000
13 I.M. Begg, D.J. Darvill and J. Brace. “Intelligent Graphic Interface Design: Designing an Interactive Control Room User Interface”, IEEE, pp. 3128 – 3132, 1995
14 G.A. Jamieson. “Empirical Evaluation of an Industrial Application of Ecological Interface Design”, In Proceedings of the 46th Annual Meeting of the Human Factors and Ergonomics Society, Santa Monica, CA:Human Factors and ergonomics Society, October 2002
15 G.A. Jamieson, "Ecological interface design for petrochemical process control: An empirical assessment," IEEE Transactions on Systems, Man And Cybernetics, vol. 37, pp. 906-920, 2007
16 F. Chen, E.H.C. Choi, N. Ruiz, Y. Shi and R. Taib, R. “User Interface Design and Evaluation For Control Room, Proceedings of OZCHI 2005, Canberra, Australia, November 23-25, 2005, pp. 1-4.
17 J. Preece, Y. Rogers and H. Sharp “Interaction Design: Beyond Human-Computer Interaction”, John Wiley & Sons Inc.(2002)
18 S. Greenberg and B. Buxton. “Usability Evaluation Considered Harmful?” In Proceedings of ACM CHI. Florence, Italy, 2008
19 A. Snodgrass and R. Coyne. “Interpretation in Architecture: design as a way of thinking”, London:Routledge (2006)
Dr. Suziah Sulaiman
- Malaysia
Dr. Dayang Rohaya Awang Rambli
- Malaysia
Mr. Wan Fatimah Wan Ahmad
- Malaysia
Mr. Halabi Hasbullah
- Malaysia
Mr. Foong Oi Mean
- Malaysia
Mr. M Nordin Zakaria
- Malaysia
Mr. Goh Kim Nee
- Malaysia
Dr. Siti Rokhmah M Shukri
- Malaysia