by Prof Barry Dwolatzky
Ninety thousand “new” World Cup ticket went on sale at 9:00am on Friday 28th May at FIFA ticketing centres around South Africa. Such is the passion and excitement around the upcoming World Cup that hundreds of people started forming queues on Thursday morning at the ticketing centres. There was a festive atmosphere as supporters braved winter weather spending the night in the queue as they waited for the centres to open.
By 9:30am the mood had changed to one of anger …. the IT systems supporting the sale of tickets had “crashed”. By late on Friday morning police had to be called to bring things under control. By 6pm on Friday many people, after queuing for nearly two days, had walked away with no tickets. FIFA Secretary General, Jérôme Valcke, apologised for the inconvenience. He blamed “technical problems”, promised to get a detailed report from FIFA’s “service provider”, and then went on to his next meeting.
Frankly I think that this is simply not acceptable!!
Let’s unpack what happened. More than 2 months ago FIFA announced that nearly half a million unsold tickets for the World Cup would be sold “over the counter”. On 15th April the first batch of these tickets went on sale at FIFA ticketing centres, some selected branches of Shoprite Checkers supermarkets and at branches of FNB. It was a disaster! The system “crashed” and – as we saw last Friday – people who had queued for hours had to endure frustration and chaos. Jérôme Valcke promised to sort things out.
How is it possible then that 6 weeks later the same thing happened? What are these “technical problems” and why weren’t they solved?
I’m willing to concede that the 15th April crash may have taken FIFA’s IT service provider by surprise. It was never envisaged that “over the counter” ticket sales would be provided for. This represented a new requirement and the system would have needed to be changed. In implementing these changes, any number of assumptions could have been incorrect. Server hardware, communications channels or transactional database systems may have been inadequately sized to cope with the volumes of traffic. There also is evidence that the systems were not tested properly.
But what about the “crash” on May 28th? I would expect that information collected from the 15th April would have been analysed and appropriate changes made to the system. There would also have been enough knowledge available to set up valid test cases. In software engineering terms I cannot accept that the system “crashed” on May 28th .
I have two theories that may explain this recent “crash”:
Theory 1 :FIFA’s IT Service Provider is incompetent
Who is this Service Provider? My answer to this question is based purely on a few hours of surfing the web. If I have my facts wrong maybe someone can correct me.
The first name that comes up is “MATCH Services AG”. It is a company based in Zurich Switzerland and is run by the FIFA President’s son-in-law. It provides FIFA with “ticketing, accommodation and event information technology services” [http://www.match-ag.com] . MATCH has a strategic partnership with the professional services company “Eurotech Global Sports AG”, also based in Switzerland.
It seems to me that Eurotech Global Sports [http://www.eurotech-gs.com] is the “Service Provider” ultimately responsible for the IT system that crashed on 15th April and again on 28th May. On the Eurotech GS website one reads that it’s “staff has event experience in 15 countries in the past 11 years”, and that it is “dedicated to providing high value-added planning, project management and operations support for the implementation and deployment of IT services in large-scale events.” We are told that Eurotech GS “specializes in assisting … international sports federations [amongst others] … with unique IT requirements”.
I’ve even been able to put some names to the key IT experts on the Eurotech Team. We have Jason Anderson [responsible for development and quality assurance when he worked for EDS], Tim Cromie [quality assurance and applications manager during the 2006 World Cup in Germany], Paul Leckie [ a “proven track record of success in delivering IT solutions in complex, high visibility, high risk environments”] and Dave Schoonaert [ with 13 years of “designing, developing and implementing scalable, flexible, and reusable systems”.]
So – do Jason, Tim, Paul and Dave have the experience and competence to spec, build and test a system that can cope with “over the counter ticket sales”? Based on the information I’ve found on each of them, I’m confident that they would be able to deal with the technical challenges quite easily.
I therefore don’t subscribe to Theory 1.
Theory 2: FIFA, or MATCH, are not willing to pay the cost of solving the problems
Assuming that there is a technical solution to the problem that caused the “crash” of 15th April, and assuming that the Eurotech GS Team of Jason, Tim, Paul and Dave, were able to design a fix to the problem, why wasn’t it implemented in time for the 28th May release of 90,000 additional tickets?
My theory is that the solution came with a price tag, and MATCH and/or FIFA looked at the price and decided it wasn’t worth fixing.
Why should they make such a decision? Well, firstly the tickets have still been sold. The hype and negative publicity surrounding some poor unfortunate soccer fanatics coming to blows at ticketing centres certainly hit the headlines around the world. The net result was that people went on-line and bought tickets.
Secondly, do FIFA really care about people queuing for tickets in South Africa? There is ample evidence that we South Africans are not all that important in FIFA’s global vision. Jérôme Valcke’s apologies and promises to sort things out cost FIFA nothing. Investing in technical solutions to solve the problems with the IT systems comes off someone’s bottom line.
“You must be crazy” I can hear some FIFA executive saying to the Eurotech GS team, “why should we spend a million dollars on a fix to the IT systems. When fights break out at the ticketing centres we’ll just call the cops and then roll out Jérôme Valcke to look concerned and apologetic. That’s a much more cost-effective solution.”
Am I being unfair to FIFA and MATCH. From an ICT point of view what do you think? Whatever it is, having a highly visible system crash so dramatically is bad news for software engineers and ICT professionals anywhere in the world.