Internal Controls Design website by Matthew Leitch (tutor, researcher, author, & consultant)
New website, new perspective: www.WorkingInUncertainty.co.uk - Related articles - All articles - The author - Services

Meltdown Graphic


Post-implementation project failure
Internal control weaknesses and project risk management

by Matthew Leitch; first appeared on www.irmi.com in April 2008




In March 2008 Heathrow Airport’s new Terminal 5 building went live after a huge and exceptionally well managed building project. Sadly, thanks to problems with baggage handling it has been a disaster for BAA, who own the airport, and British Airways, who are the sole airline using Terminal 5. What can we learn from this experience?

In a typical post-implementation melt down the high error rates and backlogs that often happen when a process or system is new overwhelm the fledgling control system in place, or nearly in place, to deal with them. This can happen even when people are aware that the initial months can be very challenging. The sequence of events usually goes something like this:

Stage 1: Good intentions

People on the project responsible for designing and implementing controls around the process or system think widely about what they need to do and write a long list of things to do. It may be a good list. They make plans. They know management reporting is needed.

Stage 2: First cracks appear

Once the project is underway it may be that things start to fall behind schedule and some strain is felt. Business analysts and process designers take all the time they are allowed and then a little bit more, leaving the controls team with very little time to respond to what is happening. At the same time, they gradually become aware that they are not as skilled or as productive at controls work as they had imagined.

Stage 3: Rising panic

As project health continues to decline, stress rises and people begin to revisit their original intentions and make cuts. It is justified as ‘focusing’ but in reality this is a kind of tunnel vision that gets progressively narrower. The controls team goes back to its original list of things to do and asks “What do we really, really need to do by go-live?” Systems people begin to regard controls work, and management reporting in particular, as “nice to haves” that they can leave until after going live. Some people can’t take the pressure and drop out of the project. Testing gets de-scoped and compressed.

As project health declines the likelihood of high error rates and backlogs on going live increases so controls development becomes more important and should be boosted. Instead, what usually happens is that it declines with everything else, or more so.

Stage 4: Champagne

It’s taken long shifts, working through weekends, and the project is a few weeks late, but it’s over. Hooray. Champagne is opened and everyone celebrates. It was a success. We’ve done it.

Stage 5: Emerging problems

Initially there is little or no evidence of things going wrong, but after a short while the first, feint indications of problems under the surface begin to emerge. As they are investigated more problems come to light and this eventually reveals a ghastly mess of faulty data, stuck transactions, or lost items. It’s too late to go back to backups. Thousands of incorrect cases already exist and the reason this wasn’t visible immediately is that not enough checks were being done. The controls weren’t in place. Worse still, now that there’s a lot of work to do the management information and supervisory control system needed to manage it is not in place either. These could have been developed and tested before going live as part of other testing, but that was de-scoped.

Stage 6: Long recovery

There’s nothing for it but to bring in temporary staff to cope with the extra work. It may take months to work through all the mistakes and correct them.

What about Terminal 5?

At this stage few details have emerged about what went wrong and some of these details are slightly different from a typical melt down. So far, what has been reported by journalists and the companies involved includes the following points.

Overall, a terrible period for everyone affected.

What lessons might be learned?

The most obvious lesson from the Terminal 5 baggage fiasco is that a live trial is still a trial. There’s nothing quite like live operation and while trialling can help a lot, it’s not enough on its own.

BA seems to have decided that the results of trialling were sufficient to justify starting at 70% of capacity on day one, when starting at 10% or less seems to have been a more reasonable approach. The background has not been made public but, typically, if you deliver incrementally it is possible to start delivering earlier than if you try to deliver everything (or nearly everything) on day one - and you can learn a lot this way.

After the trialling there would still have been uncertainties about the productivity of people involved in baggage handling and the reliability of the systems. These uncertainties should have been recognised, measured, and resolved through progressive increases in live operations.

As I have argued many times in previous articles for IRMI, our human tendency is to under-estimate uncertainties and, consequently, to do too little about them. Most likely, Terminal 5’s baggage handling is another example of this phenomenon.

BA seems to have been taken by surprise by events, as suggested by their sending of an illegal letter to customers and the inability to put extra people onto moving baggage as soon as a backlog started to develop on the first morning.

Unusually, there is no evidence at this stage of project health problems, with the exception of reports that baggage handling staff were demoralised and unimpressed by the training. It may be that the baggage system project had problems but the construction work had gone so well that senior people felt that the magic of their risk management approach would work once again.

Conclusion

Terminal 5 has hit the headlines but post-implementation meltdown is a common experience with causes that are easy to understand. It is essential to understand the high risk involved, to implement incrementally if at all possible, and to boost controls development if project health is ever in doubt.

Further reading

“Intelligent internal control and risk management” by Matthew Leitch, first published in 2008 by Gower Publications (www.gowerpub.com).



New website, new perspective: www.WorkingInUncertainty.co.uk - Related articles - All articles - The author - Services

If you found any of these points relevant to you or your organisation please feel free to contact me to talk about them, pass links or extracts on to colleagues, or just let me know what you think. I can sometimes respond immediately, but usually respond within a few days. Contact details

Matthew Leitch - Author

About the author: Matthew Leitch is a tutor, researcher, author, and independent consultant who helps people to a better understanding and use of integral management of risk within core management activities, such as planning and design. He is also the author of the new website, www.WorkingInUncertainty.co.uk, and has written two breakthrough books. Intelligent internal control and risk management is a powerful and original approach including 60 controls that most organizations should use more. A pocket guide to risk mathematics: Key concepts every auditor should know is the first to provide a strong conceptual understanding of mathematics to auditors who are not mathematicians, without the need to wade through mathematical symbols. Matthew is a Chartered Accountant with a degree in psychology whose past career includes software development, marketing, auditing, accounting, and consulting. He spent 7 years as a controls specialist with PricewaterhouseCoopers, where he pioneered new methods for designing internal control systems for large scale business and financial processes, through projects for internationally known clients. Today he is well known as an expert in uncertainty and how to deal with it, and an increasingly sought after tutor (i.e. one-to-one teacher). more

Please share:            Share on Tumblr