|
5 Post implementation issues
【purpose and objectives】05.12.6
A post-implementation review is normally carried out a few months after the new system has gone live. Its main purpose is to review whether the system has met its defined business objectives and to consider whether the delivered functionality matches the business need. The review will also focus on any difficulties encountered in using the system (for example, problems of usability, requirements not quite met, requirements that have changed since implementation) and actions will be agreed to tackle these difficulties. The review is normally a joint exercise between the users and suppliers of the system.
An end-project review is where the project formed to deliver a system, service or product is brought to an orderly close. The review often confirms the closure of the project by formally signing acceptance letters or undertaking an equivalent sign-off procedure. The end-project review examines how the project has been run with the prime aim of identifying good and bad practice that can be fed back into the project management standards. For example, continual failure to meet deadlines may be diagnosed as due to optimistic estimating. Hence, the end-project review panel may recommend changes to the model that produced those estimates.
【why it is important to conduct a post-implementation review】04.12.1
As in the scenario, a post-implementation review is held a few months after the system has gone live. Participants include representatives of the users of the software, the people who wrote or supplied it and appropriate senior management who can action any requests and resolve any issues. The review identifies perfective or corrective action required to improve the system, including technical modifications and further staff training. Such reviews may prevent similar problems occurring in future projects. The post-implementation review is an opportunity to ensure that the system is on course to meet the business case requirements (benefits outweighing costs) as well as the technical requirements of the system.
【structure & content of report】
post-implementation review
- Executive summary of findings
highlight problems e.g. Dec2004 case study: poorly designed report, absence of audit trail & archiving facility…
- A review of system performance and user satisfaction
by recording response time, down time, errors, questionnaires
comparing actual costs with actual benefits
- Recommendations for system modifications
end-project review
- Review of project initiation document
especially note the objectives from the project and check whether the objectives have been met…
a review of achievements vs. original objectives, provides a comment on the way that the objectives were achieved, e.g. lack of clarity in objectives
how efficient the project was in terms of budgets for resources and the actual resources used. Budget comparisons for cost of the project, no.of hours spent…
- Quality of the product and the process of the product itself
e.g. whether the testing design effective
【Procedure to effectively collect the metrics】
- carefully select the metrics that can measure significant aspects of the system (time, costs or quality focus)
- agree the data collection methods with users
- test the metrics in advance
- use the metrics consistently to ensure comparability
【metrics to measure the success of the system】
Metrics: quantified measurements used to measure system performance e.g. response time, down times per week
the most appropriate measures for IS system
1、agreement to original specification
(compare specification and the outcome, e.g. 80% agree)
2、time (compare estimated & actual time )
3、financial objectives (egg. costs, NPV, IRR)
4、less quantifiable measures (egg. user-friendliness, customer satisfaction, questionnaires, no. of complaints)
【IS automation system will lead to greater efficiency by】
1.Costs of computer system lower than manual system
(e.g. e-marking system, costs of courier from & to the markers saved)
2.Accuracy of data processing improved as avoid human errors
(e.g. e-marking system, the markers can mark scripts directly on the screen & the results sent to exam centre’s database directly, no need to key in manually, which may lead to type error)
3.Speed of processing increased
(e.g. e-marking system, the markers can mark directly on the screen & the result send to exam centre’s database directly, which reduce the lead time on the way)
|
|