7.6 Evaluation

2026 Syllabus Objectives

  • Evaluate a solution including the efficiency of the solution, the ease of use of the solution, and the appropriateness of the solution
  • Compare the solution with the original task requirements
  • Identify any limitations and necessary improvements to the system
  • Evaluate the users' responses to the results of testing the system

What is Evaluation? 🔍

https://cambridgeassistant.com

Evaluation is the process of assessing how well a new system has worked once it is up and running. This critical phase occurs after implementation and testing, and may lead to maintenance or re-design of the system.

Key Point: The evaluation stage feeds back into the design stage of the systems life cycle. If strong evidence suggests that changes need to be made, parts of the system may need to be re-designed.

The Evaluation Process

https://cambridgeassistant.com

When evaluating a new system, the systems analyst performs a comprehensive assessment by examining multiple aspects of the system's performance and usability.

Tasks Performed During Evaluation

The analyst will undertake the following evaluation tasks:

1. Comparison with Original Requirements

  • Compare the final solution with the original requirement specifications
  • Verify that all intended features and functionalities have been implemented

2. Identify System Limitations

  • Identify any limitations in the system that restrict its effectiveness
  • Document areas where the system does not perform as expected

3. Identify Necessary Improvements

  • Identify any necessary improvements that need to be made
  • Prioritize enhancements based on their impact on system performance

4. Evaluate User Responses

  • Evaluate the user's responses to using the new system
  • Gather feedback on user satisfaction and experience

5. Compare Test Results

  • Compare test results from the new system with results from the old system
  • Analyze whether the new system meets or exceeds performance benchmarks

6. Compare Performance Metrics

  • Compare the performance of the new system with the performance of the old system
  • Measure improvements in speed, efficiency, and reliability

Methods of Evaluation 📊

https://cambridgeassistant.com

To gather comprehensive evaluation data, analysts use various practical methods:

Observation Methods

Observing Users Performing Set Tasks

  • Watch users as they complete specific tasks using both old and new systems
  • Compare ease of use, efficiency, and user comfort levels
  • Document any difficulties or confusion encountered

Measuring Time to Complete Tasks

  • Measure the time taken to complete tasks, comparing old with new
  • Quantify improvements in efficiency
  • Identify processes that may have become slower

User Feedback Methods

Interviewing Users

  • Interview users to gather responses about how well the new system works
  • Conduct one-on-one or group discussions
  • Obtain detailed qualitative feedback about user experiences

Distributing Questionnaires

  • Give out questionnaires to gather responses about the ease of use of the new system
  • Collect structured feedback from a larger user base
  • Analyze patterns in user satisfaction and concerns

Sign in to view full notes