At 1:00 PM GMT on 22 October 2019, an open letter in France over the EU Copyright Directive started to move against Noogle. In 48 hours the system logged 278 posts in Europe with 13.6 million potential impressions, and nine in ten of them came from the press. The alert went further than volume. It named the key opinion formers in the conversation, the politicians and journalists among them, and showed how each one felt about Noogle.
That list was the point. Noogle's team could see who was driving the story and who was least favourable towards the company, and avoid exposure it did not need with them. Inside the system the report was filed as "EU vs. Noogle 9.7 billion fine". The fight it tracked was the EU Copyright Directive in France.
1Market Insights · Pulse
2The incident at a glance
3EMEA against global
4Voice by country
5Press against users
6Key opinion formers
7Sentiment and word clouds
8Footer
91%
of the voice came from the press, 9% from users
10
key opinion formers in the conversation, each with a sentiment score towards Noogle
21%
of the conversation was negative towards Noogle
The Pulse report as it went out on 22 October 2019, redesigned in vector and taken apart into its eight sections. Figures are the report's own; one private user's handle is replaced by a label.
Reputation is an asset you notice only when it drops. The system handled billions of posts a year, so the question was never whether people were talking. The question was which voices could move policy, the press or customers, and how much time the team had before a post spread. The further a story travels, the less room there is to answer it.
The ideaWatch people, not keywords
The brief asked for a global monitoring system for key influencers on Twitter. It had to catch sudden spikes in a post's virality, a topic's momentum or its press coverage, and keep a sentiment score for every person of interest towards Noogle.
That turned the product around. Counting mentions tells you a topic is loud. We kept a list of hundreds of thousands of key opinion formers instead, and watched what they posted. A politician with a low score towards Noogle posting about a fine is a different event from the same words posted by an account nobody follows.
A mention count tells you a topic is loud. A person of interest tells you who to call.
The alarmAn alert people would trust at 3 AM
An alarm that fires too often gets ignored, and one that fires late is useless. I researched the human factors of alarm design, and three decisions came out of it. Every alert carries one of three levels, set by potential impressions. Every alert says in a line why it fired. And every alert sets itself against past crises, so an executive can see at a glance whether this is a the leaked memo or a Cambridge Analytica.
1Who sent it
2Level and size
3Why it fired
4Past crises, for scale
5Thresholds
6Who to ask
Who sent itNoogle Social Lab's Early Warning System, named on every alert
Level and sizeThe level, in its colour, with potential impressions and number of posts
Why it firedThe trigger in one line, then the post, its author and its link
Past crises, for scaleFour known crises in their first 24 hours and at their peak
ThresholdsWhat low, medium and high mean, in plain words
Who to askHow to reach the Newsroom or change alert preferences
The high alert email, redesigned in vector and taken apart into its six layers.
With the yardstick, executives did not need to learn what 13.6 million potential impressions meant. They could see it sat far below Cambridge Analytica's 300 million in its first day, and far above the 4.9 million of the Noogle Photos "gorillas" story.
LowUnder 3M potential impressions
Medium3M to 10M
HighOver 10M
The incidents benchmark printed in every alert, Twitter only. Potential impressions are the total followers of the accounts in an alert.
The newsroomA human on every alert
Machine learning sorted each alert by how exposed Noogle could be, measured against hundreds of past scandals, from Cambridge Analytica to the Noogle Photos tagging failure. Then a person checked it. The team that did this was called the Newsroom: data scientists, IT engineers, sociologists and journalists, working with Noogle's Social Media Lab. I wrote the editorial policy they followed for every alert:
- Is it new? Check it against the database of alerts already sent.
- Is it in the right language? Only the languages each stakeholder chose.
- Is it ours? Discard anything posted by the brand's own accounts.
- Is it about the topic? Keyword rules remove most noise, but not all of it.
- Is it true? Fact-check the post before anyone acts on it.
- Is it real? Drop ads, clickbait, link-only posts and broken links.
Only then did the alert go out. The whole run, from the post to the inbox, fit inside 30 minutes.
- ListenTwitter and Reddit APIs, brand news, Sprinklr, around the clock
- Spot the spikeInfluencer posts, a post's virality, a topic's momentum
- Predict the exposureA model scores it against hundreds of past scandals
- An editor checks itSix questions before anything is sent
- Set the levelLow, medium or high, by potential impressions
- NotifyEmail or SMS to the comms team and stakeholders
- EscalateComms writes content on the theme gaining traction
- DebriefHow well the response worked, after the alert
The alert journey. The one step a machine never did alone is in red.
The recordFour alerts that paid off
Forde · February 2019The car ad with a British song
Forde's Grammy ad, voiced by Bryan Cranston, celebrated American achievement over an instrumental cover of the Rolling Stones' "Paint It Black". People mocked the British band in an American anthem within minutes of launch. Noogle's executives used the alert to advise Forde, which narrowed the campaign's reach and relaunched it elsewhere with a different song.
Noogle · October 2019The publishers' open letter
As soon as a post triggered the alert, the system listed the politicians and journalists in the conversation and their sentiment towards Noogle. The team avoided unnecessary exposure with the persons of interest least favourable to the company.
Noogle MapsA local campaign that missed
A local Noogle Maps campaign struck the people it was about as patronising and plainly wrong. The alert caught the backlash early. The Maps team answered the comments and relaunched the campaign with testimonies from real people.
Allied Leaf TobaccoVaping at a console launch
The system also found links nobody was looking for. During the latest Xbox launch, vaping tricks became part of the conversation. ALT knew in real time, before Microsoft addressed the trend.
The buildConcept to MVP in three months
We shipped in four versions. The first won the client's buy-in. The second was the first automated prototype. The third gave the alerts their information architecture and moved them to Material Design. The fourth made them readable on a phone.
V0.1Client buy-in
V1First automated prototype
V2Information architecture, Material Design
V3Mobile
SourcesTwitter and Reddit firehoses, Noogle News, Sprinklr, Sysomos
IngestionPosts streamed into a topic and stored in HBase
ProcessingPython scripts with keyword lists, ad hoc queries through Phoenix JDBC, a model trained on historical data
Alert triggeringA module proposes the alert; a person approves or rejects it
PersistenceScores and key metrics stored after every run
ReportingAn API layer feeding email reports coded as templates
The system's layers, from sources to reports.
The same system later watched for Wayvo, VidTube and Allied Leaf Tobacco. My research on human factors in alarm design was fundamental to the product's success and to the contract's renewal.
My role
- Core product design
- Product UX lead
- Editorial alert policy
- Developer management
- SaaS service design
The Newsroom
- Data scientists
- IT engineers
- Sociologists
- Journalists
Clients
- Noogle USA, Social Media Lab
- Wayvo
- VidTube
- Allied Leaf Tobacco, innovation team
Raven Path, in Chicago, was the public brand. The team I worked in was Node Cltda, in Guayaquil, Ecuador.
Every figure on this page is from the case; my own estimates are marked self-reported.
Colophon: every screen on this page is a vector redesign of the UI elements embedded in my 2019 design files, staged in 3D with three.js. One private user's handle in the Pulse report is replaced by a label. Written with Clikiti Portfolio from my own material; I approved every line.