“It’s no exaggeration to say that minds can be changed. Behaviour can be predicted and controlled. I find it incredibly scary. I really do. Because nobody has really followed through on the possible consequences of all this. People don’t know it’s happening to them. Their attitudes are being changed behind their backs.”
Algorhythms. That might have been enough to tip the November elections to the most unlikely presidential candidate, Donald Trump. The Leave camp is convinced that was the decisive factor in winning the Brexit referendum. It's powerful. It's scary. It may be insurmountable.
I did a post on Sunday, "The Big Chill," on an Observer article about how American computer whiz billionaire and Trump backer, Robert Mercer, was behind an outfit, Cambridge Analytica, that data mined Americans' Facebook accounts to target them for political messaging.
In today's Globe and Mail, a report on a Victoria, B.C. company, AggregateIQ that did something quite similar to help swing the Brexit vote for the Leave campaign.
The scope of AggregateIQ's role emerged last week when Britain's Electoral Commission released the final tally of spending by the Vote Leave and Remain sides during last June's referendum on Britain's membership in the European Union. According to the figures, Vote Leave paid AggregateIQ £2.7-million ($4.4-million), out of its total budget of £6.8-million (the spending limit for the official Vote Leave and Remain campaigns was £7-million each). AggregateIQ got another £675,000 from a Vote Leave backer to target young voters.
"Without a doubt, the Vote Leave campaign owes a great deal of its success to the work of AggregateIQ. We couldn't have done it without them," Vote Leave's campaign director Dominic Cummings said in a glowing endorsement posted on the company's website.
[AggregateIQ's Zack Massingham said the] main tools are online messaging through social media outlets like Facebook, Twitter and YouTube. He prefers them to traditional media, such as broadcast or print, because the impact is easily measurable. "The tremendous opportunity you have with digital is that you are able to measure everything that much faster, even almost instantly. Print, it's just you fire it off into the ether and whoever ends up at your website ends up at your website. There's not attribution."
In this same context, today Scientific American asks, "Will Democracy Survive Big Data and Artificial Intelligence?"
...
One thing is clear: the way in which we organize the economy and society will change fundamentally. We are experiencing the largest transformation since the end of the Second World War; after the automation of production and the creation of self-driving cars the automation of society is next. With this, society is at a crossroads, which promises great opportunities, but also considerable risks. If we take the wrong decisions it could threaten our greatest historical achievements.
...
Some software platforms are moving towards “persuasive computing.” In the future, using sophisticated manipulation technologies, these platforms will be able to steer us through entire courses of action, be it for the execution of complex work processes or to generate free content for Internet platforms, from which corporations earn billions. The trend goes from programming computers to programming people.
These technologies are also becoming increasingly popular in the world of politics. Under the label of “nudging,” and on massive scale, governments are trying to steer citizens towards healthier or more environmentally friendly behaviour by means of a "nudge"—a modern form of paternalism. The new, caring government is not only interested in what we do, but also wants to make sure that we do the things that it considers to be right. The magic phrase is "big nudging", which is the combination of big data with nudging. To many, this appears to be a sort of digital scepter that allows one to govern the masses efficiently, without having to involve citizens in democratic processes.
...
Regardless of this, criminals, terrorists and extremists will try and manage to take control of the digital magic wand sooner or later—perhaps even without us noticing. Almost all companies and institutions have already been hacked, even the Pentagon, the White House, and the NSA.
A further problem arises when adequate transparency and democratic control are lacking: the erosion of the system from the inside. Search algorithms and recommendation systems can be influenced. Companies can bid on certain combinations of words to gain more favourable results. Governments are probably able to influence the outcomes too. During elections, they might nudge undecided voters towards supporting them—a manipulation that would be hard to detect. Therefore, whoever controls this technology can win elections—by nudging themselves to power.
Look, we've been warned. We have two fiascos, the Brexit referendum and the 2016 presidential election, as compelling evidence of widescale, mass electoral manipulation. It works. It will be used again. The popular will can be subverted, "nudged," for enough money. We, you and me, can be powerfully manipulated and the millions who couldn't care less will be.
“The danger of not having regulation around the sort of data you can get from Facebook and elsewhere is clear. With this, a computer can actually do psychology, it can predict and potentially control human behaviour. It’s what the scientologists try to do but much more powerful. It’s how you brainwash someone. It’s incredibly dangerous."
“The danger of not having regulation around the sort of data you can get from Facebook and elsewhere is clear. With this, a computer can actually do psychology, it can predict and potentially control human behaviour. It’s what the scientologists try to do but much more powerful. It’s how you brainwash someone. It’s incredibly dangerous."
We have to respond to this or succumb to it. Scientific American is right to question whether democracy can survive this.
Do we really want a future as digital North Koreans?