{"id":175,"date":"2011-01-15T13:54:40","date_gmt":"2011-01-15T11:54:40","guid":{"rendered":"http:\/\/asymaps.wordpress.com\/?p=175"},"modified":"2011-01-15T13:54:40","modified_gmt":"2011-01-15T11:54:40","slug":"peugeots-black-swan-at-le-mans-2010","status":"publish","type":"post","link":"http:\/\/www.asym.dk\/index.php\/2011\/01\/15\/peugeots-black-swan-at-le-mans-2010\/","title":{"rendered":"Peugeot&#039;s Black Swan at Le Mans 2010"},"content":{"rendered":"<p>This blog post is\u00a0 about motorsport. What does motorsport have to do with software engineering, you ask? Read on!<br \/>\nI&#8217;m a big fan of motorsport and <a href=\"http:\/\/www.lemans.org\/\">Le Mans 24 hours<\/a> in particular.\u00a0 Le Mans is a 24 hours motor race with about 50 race cars of four different classes competing in the same race. Le Mans is also a legend, run first time in the 1920&#8217;s. To run a race over 24 hours is very challenging for teams and machinery. An F1 race is only 2 hours and cars are only a bit faster. We&#8217;re 240,000 spectators, and about 40,000 danes travel the 1500 km to get there \u2013 including me and two of my boys, so it&#8217;s also a big, great party.<br \/>\n<figure id=\"attachment_187\" aria-describedby=\"caption-attachment-187\" style=\"width: 500px\" class=\"wp-caption alignnone\"><a href=\"http:\/\/asymaps.files.wordpress.com\/2011\/01\/dsc_7546b.jpg\"><img loading=\"lazy\" class=\"size-full wp-image-187\" title=\"My son Aksel at Le Mans 2010\" src=\"http:\/\/asymaps.files.wordpress.com\/2011\/01\/dsc_7546b.jpg\" alt=\"My son Aksel at Le Mans 2010\" width=\"500\" height=\"313\" \/><\/a><figcaption id=\"caption-attachment-187\" class=\"wp-caption-text\">My son Aksel (very focused - and a bit tired from a long drive) at Le Mans 2010<\/figcaption><\/figure><br \/>\n\u00a0<br \/>\nBut to me as an engineer, Le Mans is also intellectually inspiring. Le Mans is a reminder that while we can do a lot with technology, there&#8217;s also a lot that we can&#8217;t do and that the laws of physics will always set a limit on the track. In order to try to win, race car manufacturers and teams will constantly try to push that limit, but it will always be there.<br \/>\nWhen cars are withdrawn from an F1 race, its typically because of an accident &#8211; drivers making mistakes. While driver mistakes are unavoidable over such a long race, withdrawals are actually more common due to technical reasons: The equipment breaking down, engines blowing up, or just electrical gremlins pulling the plug. The fascinating part is that it has been like this since the very beginning.<br \/>\nSo failures are more or less expected. 50 cars at the start line, and usually only some 25 at the finish. But Le Mans 2010 was a little different: It was Peugeots \u201dBlack Swan Year\u201d.<br \/>\nThe Peugeot 908&#8217;s were again\u00a0extremely fast, perfectly tuned, and ready to race. Audi had gone through a challenging development process with their new R15, which turned out to not be as fast as they had had hoped it would be in 2009, but was improved in 2010, so we all thought that 2010 was to be a year where Audi would be able to compete with Peugeot on speed. But Peugeot again set impressive lap times never before seen at Le Mans. Couple that with the fact that their team finally seemed to be a well working machine now (proved by the 2009 overall win), so it seemed that Audi could only hope for a podium.<br \/>\nUntil a <a href=\"http:\/\/en.wikipedia.org\/wiki\/Connecting_rod\">conrod<\/a> broke on the leadning Peugeot at Tertre Rouge on Sunday morning. I was there with my camera, enjoying the early morning and the race, but I left that area only 10 minutes before so I didn&#8217;t have a chance to catch the action (aren&#8217;t you always in the wrong place at the right time?).<br \/>\nIt came as a shock to everyone. I watched the TV pictures on the big screens around the track showing the team completely in shock about what had happened, and I looked down into the pit area where the Eurosport TV crew was trying to get comments from the team which seemed to be paralyzed. But it seemed to be a coincidence at the time. Until\u00a0a few hours later when\u00a0another Peugeot failed in a similar way. We started wondering what was going on?\u00a0And with only one hour remaining of the race, the customer entered Peugeot 908 failed and the race was lost. Audi won 1-2-3 with their three R15+ cars.<br \/>\nIt was devastating. The Peugeot Sport director was seen crying on TV. The french spectators and press went home early from the race. This was a nation loosing a battle with their negihbors.<br \/>\nOf course we didn&#8217;t know the technical reason why all Peugeots had failed at the race, but it seemed as if they had been &#8216;programmed&#8217; to fail. About a\u00a0month later, Peugeot released a statement that the three cars had suffered from the same failure and that the fourth car (which retired before the others due to a broken suspension) would have suffered the same problem if it had still been running during Sunday. Peugeot said that the breakdown came as a surprise. That they had tested the cars and engines and never expected this. I&#8217;m sure it was a surprise. I&#8217;m also sure their sports director didn&#8217;t expect this embarrasing disaster in front a whole nation of supporters. I&#8217;m sure they thought everything was <a href=\"http:\/\/investigatingsoftware.blogspot.com\/2011\/01\/hunky-dory-hypothesis.html\">Hunky-dory<\/a>.<br \/>\nBut at the same time, I&#8217;m not in doubt that the problem was <a href=\"http:\/\/en.wikipedia.org\/wiki\/Rogers_Commission_Report\">rooted in history<\/a>: That an engineer somewhere knew that there was a risk, but for reasons which are probably rooted in group thinking and organisational behaviour, kept the knowledge to himself &#8211; or simply chose to ignore it. Conrods have failed in cars since the first reciprocating engine was built, but engineers have learnt to handle this so today we have reliable engines that can easily do more than 300,000 km. When engineering has made something inherently unreliable reliable, people tend to forget about it. Management expect it to be under control.<br \/>\nThis is true even for competetion engines, even though they are of course pushed much more and designed to be minimal and as light as possible in order to promote power output: I&#8217;m sure Peugeot management thought the conrod supplier had everything under control, which they might have had &#8211; but they could have worked to meet the wrong specification. We won&#8217;t know the details, and it&#8217;s not important either.<br \/>\nTo win Le Mans you have to be running at the end. The Peugeots didn&#8217;t. They obviously forgot what it takes to make something inherently unreliable reliable: It takes focus on what can possibly go wrong. Software is not different: When software fails, it&#8217;s often also because someone forgot to raise and issue or because someone chose to ignore it. Many disasters in systems are rooted in history, which also means that they could have been\u00a0prevented.<br \/>\n\u00a0This is where <em>professional pessimists <\/em>on a team can help<em>. <\/em>Where testers&#8217; negative attitude can mean the difference between success and failure.<br \/>\nFor me, Peugeot&#8217;s black swan event at Le Mans 2010 is a reminder that we all have shared responsibility for seeking out and communicating these details. By testing, careful inspection, talking to developers and users, and by constantly focusing on problems. We&#8217;re on a mission to prevent disaster by making the risks known so managers can take informed descisions.<br \/>\nLe Mans 2011 will be interesting in a new way since the cars will be technologically different with hybrid engines. This is new technology, so we should probably expect it to fail more at random or just affect performance during the race: Longer pitstops and the like. But lets see, it&#8217;s a big and long race. Anything can happen! I&#8217;ve got our tickets booked, so let me know if you&#8217;ll be at Le Mans in June \u2013 and we can meet up and enjoy the cars. And perhaps discuss engineering and testing?<br \/>\n<figure id=\"attachment_176\" aria-describedby=\"caption-attachment-176\" style=\"width: 500px\" class=\"wp-caption alignnone\"><a href=\"http:\/\/asymaps.files.wordpress.com\/2011\/01\/dsc_9358b.jpg\"><img loading=\"lazy\" class=\"size-full wp-image-176\" title=\"Leading Peugeot 908 at Le Mans 2011\" src=\"http:\/\/asymaps.files.wordpress.com\/2011\/01\/dsc_9358b.jpg\" alt=\"Leading Peugeot 908 photographed at Tertre Rouge Sunday morning at Le Mans 24h 2010 - just prior to failing\" width=\"500\" height=\"333\" \/><\/a><figcaption id=\"caption-attachment-176\" class=\"wp-caption-text\">Leading Peugeot 908 caught by me and my Nikon on Sunday morning only about 30 minutes before it failed at the same location<\/figcaption><\/figure><\/p>\n","protected":false},"excerpt":{"rendered":"<p>This blog post is\u00a0 about motorsport. What does motorsport have to do with software engineering, you ask? Read on! I&#8217;m a big fan of motorsport and Le Mans 24 hours in particular.\u00a0 Le Mans is a 24 hours motor race with about 50 race cars of four different classes competing in the same race. Le [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[3],"tags":[15,68,89],"_links":{"self":[{"href":"http:\/\/www.asym.dk\/index.php\/wp-json\/wp\/v2\/posts\/175"}],"collection":[{"href":"http:\/\/www.asym.dk\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.asym.dk\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.asym.dk\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.asym.dk\/index.php\/wp-json\/wp\/v2\/comments?post=175"}],"version-history":[{"count":0,"href":"http:\/\/www.asym.dk\/index.php\/wp-json\/wp\/v2\/posts\/175\/revisions"}],"wp:attachment":[{"href":"http:\/\/www.asym.dk\/index.php\/wp-json\/wp\/v2\/media?parent=175"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.asym.dk\/index.php\/wp-json\/wp\/v2\/categories?post=175"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.asym.dk\/index.php\/wp-json\/wp\/v2\/tags?post=175"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}