www.bbc.com
Open in
urlscan Pro
151.101.128.81
Public Scan
URL:
https://www.bbc.com/future/article/20150820-the-bad-things-that-happen-when-algorithms-run-online-shops
Submission: On April 26 via manual from US — Scanned from DE
Submission: On April 26 via manual from US — Scanned from DE
Form analysis
0 forms found in the DOMText Content
WE'VE UPDATED OUR PRIVACY AND COOKIES POLICY We've made some important changes to our Privacy and Cookies Policy and we want you to know what this means for you and your data. * OK * Find out what's changed LET US KNOW YOU AGREE TO COOKIES LET US KNOW YOU AGREE TO COOKIES We use cookies to give you the best online experience. We use cookies to give you the best online experience. Please let us know if you agree to all of these cookies. Please let us know if you agree to all of these cookies. * Yes, I agree Yes, I agree * No, take me to settings No, take me to settings Homepage ACCESSIBILITY LINKS * Skip to content * Accessibility Help Sign in Notifications * Home * News * Sport * Weather * iPlayer * Sounds * Bitesize * CBeebies * CBBC * Food * Home * News * Sport * Reel * Worklife * Travel * Future * Culture * TV * Weather * Sounds More menu Search BBC Search BBC * Home * News * Sport * Weather * iPlayer * Sounds * Bitesize * CBeebies * CBBC * Food * Home * News * Sport * Reel * Worklife * Travel * Future * Culture * TV * Weather * Sounds Close menu What is BBC Future? Future Planet Lost Index Immune Response Family Tree Health Gap Towards Net Zero The Next Giant Leap Best of BBC Future Latest More Loading The Secret World Of... | Internet THE BAD THINGS THAT HAPPEN WHEN ALGORITHMS RUN ONLINE SHOPS Share using Email Share on Twitter Share on FacebookShare on Linkedin (Image credit: Getty Images) By Chris Baraniuk20th August 2015 Smart software controls the prices and products you see when you shop online – and sometimes it can go spectacularly wrong, from causing offence to destroying livelihoods. ALGO-SHOPPING INSIDE INTERNET RETAIL This is the second part in a two-part series about the algorithms in online shopping. Read part one, about the software that runs Amazon’s warehouses – and their workers. It was a warm, breezy Saturday morning in Melbourne, two years ago. Michael Fowler had just shut down his laptop after spending a few hours checking up on his business. He was the owner of a T-shirt company called Solid Gold Bomb, which sold a wide variety of garments online via, among other outlets, Amazon. Fowler was looking forward to getting back to his weekend, but then his phone buzzed. A notification from the company’s Facebook page. It buzzed again – and again. When he went to read the messages he saw a stream of abuse directed at his firm. The memory is still clear in his mind. “I knew instantly what had happened when I read what people were saying,” he says. “I couldn’t reply fast enough.” Fowler had set up an algorithm to upload thousands upon thousands of T-shirt designs to his online stores. The designs were based on the infamous “keep calm and carry on” catchphrase, a slogan which was originally dreamt up as a way of preserving morale in the event of a Nazi invasion of Britain. Fowler had decided to “parody” it by getting a computer programme to come up with random variations such as “keep calm and dance on” or “keep calm and play football”. > FOWLER’S EMPLOYEES WERE ALL OUT OF JOBS AND A ONCE THRIVING FIRM WAS GONE. ALL > BECAUSE OF A HORRIBLE T-SHIRT THAT NO-ONE WORE, NO-ONE BOUGHT, AND WHICH NEVER > MATERIALLY EXISTED. But the huge list of word choices that he fed in included less savoury options – which he says he had no knowledge of. In particular, a T-shirt emblazoned with the imperative “keep calm and rape a lot” had been published. No-one had bought it. In fact, it sat on the web for more than a year before anyone even noticed it. But eventually it was discovered – and the internet went crazy. Twitter was ablaze with condemnation. “Solid Gold Bomb is crouching behind its algorithmically generated excuse,” said Gizmodo. Others pointed out the stupidity of using an unexamined word list to automatically generate slogans for a commercial product. Software used to create T-shirt slogans similar to this one generated offensive results (Credit: Michal Huniewicz/Flickr/CC BY 2.0) Fowler admits he made a “big mistake” and within a couple of months, Solid Gold Bomb folded. His employees were all out of jobs and a once thriving firm was gone. All because of a horrible T-shirt that no-one wore, no-one bought, and which never materially existed. But that’s the trouble with algorithms. All sorts of unexpected results can occur. Sometimes these are costly, but in other cases they have benefited businesses to the tune of millions of pounds. What’s the real impact of the machinations of machines? And what else do they do? To really understand the sorry mess that ended things for Solid Gold Bomb, one has to consider the instant success that Fowler’s scripts and computer tricks had once brought him. Years before he ever experimented with the “keep calm and carry on” meme, he had devised an automated T-shirt design process which published over 22 million different versions of sports-related designs to a web store. These included icons and, crucially, people’s names. Finding the shirt with your name or your friend’s name on it made you much more likely to buy it, discovered Fowler. “It was about a 100-to-one ratio. For example, a picture of a car would sell once whereas a picture of a car with a name below it would sell a 100 times,” he says. > I’VE REALISED THAT YOU HAVE TO HAVE AN ELEMENT OF SCRUTINY – MICHAEL FOWLER, > ONLINE SELLER When Fowler first launched this technique in 2011 he received 800 orders over the first weekend. He was blown away and the effect on his business was profound. Soon he was processing thousands of orders a day. The problem was that a huge proportion of the designs weren’t vetted for suitability by human eyes before they went live on the web – an oversight that would lead to the problems two years later. “I’ve realised that you have to have an element of scrutiny,” he admits. Fowler has now returned to selling T-shirts – after a spell as a traffic warden and as a ranger catching stray dogs – but today he is more careful. His current company, Big Texas, also uses an algorithmic process to create designs for aprons, but he uses published lists of the 1,000 most common names, not random assortments of words. Algorithms play a role in much of the shopping you buy online (Credit: Getty Images) Errant algorithms can also cause human headaches when it comes to prices. The costs of products that appear on retail websites are constantly fluctuating thanks to software that sets them competitively. The frequency at which these changes happen is so great that dedicated websites have been set up to “watch” the pricing on websites like Amazon. Daniel Green has been running one of these sites for years. He explains that prices don’t just change daily – but sometimes several times in one day. > PRICES DON’T JUST CHANGE DAILY – BUT SOMETIMES SEVERAL TIMES IN ONE DAY “They will drop the price of a product every few days or every few hours until a product is purchased by someone and then the price goes back up,” he says. “We know that they keep prices low on a lot of their most popular products to give the impression that they have great deals and then for less active product categories or less popular products they may have a bit more of a profit margin there.” Sometimes this can produce amusing and unexpected results, however, in what Green calls a “race to the bottom”. Two retailers selling the same thing on Amazon’s marketplace will re-price their product against their competitor, but the re-pricing can occasionally continue unabated until absurdly low or high price points are reached. “It just goes back and forth,” says Green. A recent glitch briefly made prices on Amazon crash to a penny (Credit: Getty Images) In 2011 a blogger discovered that a biology textbook about flies was priced at the bewilderingly high price of over $23 million. Why? Two sellers, profnath and bordeebook, had set up algorithms which would watch each other’s prices and then reset their own. “The prices would remain close for several hours, until bordeebook ‘noticed’ profnath’s change and elevated their price,” explains Michael Eisen on his website. The pattern continued perfectly for the next week.” > ALGORITHMS WATCH OTHER’S PRICES AND RESET THEIR OWN Sometimes the most damaging prices are the lowest – as low as you can get, for example. This was what blighted the Christmas sales of a string of Amazon marketplace sellers in December last year, when automated re-pricing software RepricerExpress erroneously changed the price of thousands of items to as little as one penny or one cent. The glitch, which happened two weeks before Christmas, hit sellers running small retail businesses extremely hard. Businesses on tight margins have suffered when pricing software went wrong (Credit: Getty Images) Part of the trouble was that once orders had been placed, they were almost instantly processed by Amazon’s automated warehouse systems under the “Fulfilled by Amazon” (FBA) programme. Sellers asked the FBA team to stop sending these orders out but were told it wasn’t that simple. Amazon says that nothing about the operation of this system has changed since the December incident. > IT ALMOST FELT LIKE SOMEBODY BROKE INTO YOUR HOUSE - RICHARD BURRI, ON AN > ALGORITHMIC GLITCH “It almost felt like somebody broke into your house or your personal life and started to take things away from you,” says Richard Burri, whose office stationery store was affected by the error. He and his wife estimate that the various computer algorithms working together would have cost the business between $100,000 and $150,000. Fortunately, the majority of the firm’s human customers who had bought one penny items agreed to return them when contacted. The costs of products that appear on sites like Amazon are constantly fluctuating, thanks to software (Credit: Getty Images) Others found that buyers weren’t always so obliging. Shamir Patel sold pharmaceutical products via Amazon. He also asked customers to return one penny products, but he says about half of them refused to do so. The cost to his business, he calculates, was around £60,000. “You were a bit powerless to do anything about it,” he recalls. “You were literally just watching your money flush down the drain.” > IT’S MADE ME NOT REALLY WANT TO GO ON WITH THE BUSINESS – JUDITH BLACKFORD, > ONLINE SELLER Yet another seller, Judith Blackford, who marketed dolls and babies’ gifts, says she suffered sleepless nights and adds that she has been forced to close her business completely. “I’m selling off any stock that’s left now. Pretty much most of it is going out half price just to get rid of the stock,” she says. “It’s made me not really want to go on with the business.” RepricerExpress has apologised for what happened, though the firm has never explained exactly what went wrong. CEO Brendan Doherty declined to provide comment for this article. All of these stories demonstrate how acutely online retail is defined by the machinations of decision-making software hiding behind the scenes. For Michael Fowler, he learnt the hard way that algorithmically derived success can quickly turn into spectacular failure. “You can scale up and have hundreds of orders overnight. Hopefully you’ll have a process to know how to do that but I think that’s the biggest problem – you have to be ready for it and know how to handle it,” he says, reflecting on his experiences. “I don’t think it’s a long-term, sustainable solution unless it is really properly executed and done conservatively – with a lot of auditing in place. “If I wanted to I could scale my current business up tomorrow but I think I just have a more conservative approach now. I’m just trying to survive.” Follow us on Facebook, Twitter, Google+ and LinkedIn Share using Email Share on Twitter Share on FacebookShare on Linkedin Share RECOMMENDED ARTICLES * The Secret World Of...: HOW ALGORITHMS RULE AMAZON WORKERS * AI: The Ultimate Guide: THE ULTIMATE GUIDE TO AI * In Depth: THE MAN WHO CAN'T FEEL EMOTIONS * Last Place on Earth: WILL A MACHINE TAKE YOUR JOB? ; Around the BBC Culture THE NOVEL THAT TAUGHT TEENS ABOUT SEX Worklife WHY GEN Z ARE REJECTING 'PRESTIGE' JOBS travel THE FAMOUS SOUP THAT NEVER EXISTED EXPLORE THE BBC * Home * News * Sport * Weather * iPlayer * Sounds * Bitesize * CBeebies * CBBC * Food * Home * News * Sport * Reel * Worklife * Travel * Future * Culture * TV * Weather * Sounds * Terms of Use * About the BBC * Privacy Policy * Cookies * Accessibility Help * Parental Guidance * Contact the BBC * Make an editorial complaint * BBC emails for you * Advertise with us * Do not share or sell my info Copyright © 2023 BBC. The BBC is not responsible for the content of external sites. Read about our approach to external linking.