海角大神

Modern field guide to security and privacy

Silicon Valley begins putting cyberbullies in the crosshairs

With the rate of digital bullying increasing, tech firms escalate efforts to build automated tools that can detect and flag online harassment. 

|
Baz Ratner/ Reuters/File
The Google logo is seen on a door at the company's office in Tel Aviv, Jan. 26, 2011.

Melissa Hourigan听knows first hand about the kind of online vitriol that kids encounter. She works in digital media and volunteers for a suicide prevention organization in Denver.听But even that didn't prepare her to respond when online bullies began targeting her 15-year-old daughter.

In January, a fellow student began tormenting Ms. Hourigan's daughter on Snapchat and Instagram.听But blocking the bully听didn't stop the problem. On Valentine's Day, classmates told the teenager that insulting messages popped up on ThisCrush.com,听a site that many young people link to their Instagram pages to send secret love notes. 听

Ever since, Ms. Hourigan's daughter has become unusually distant. A skilled drummer and bass player, she didn't audition for a new band.听She's ditched makeup and dresses for baggy clothes. The honors student's grades have even suffered.听

"It's been a disaster," Hourigan says. "She kind of became withdrawn, but the way that we've seen it materialize is the inability to focus at all. It's so drastic, she went from an A and B student to having four F's. We've had to get a tutor and counseling."

For victims of digital abuse, there are often few options to stop online bullying. Hourigan, a digital communications consultant, printed out the offensive messages and contacted the school's principal, the girl's parents, and local police.听The tormentor eventually got suspended from school.听

Yet after the ordeal stopped, ThisCrush administrators appeared to rebuff Hourigan听in a brusque exchange on Twitter, even听though the comments听appeared to violate the site's terms and conditions.

"You can call the police, which we did, and even they can just document it," Hourigan says. "But until something really happens, there isn't a lot to protect kids from things that happen on these sites, especially those that allow anonymous posting."听

ThisCrush did not respond to multiple requests for comment.

Concerned parents may not be able to convince developers of fringe apps听that quickly go in and out of favor to help thwart bullying. But听most established social media companies are beginning to take online harassment seriously.

In fact, many of听Silicon Valley's biggest tech companies appear to be making a concerted effort to crack down on听harassment on their platforms and news sites, a push that's motivated by the increasing prevalence of harassment.听According to a November survey from the New York-based research institute Data and Society,听听have experienced some form or online harassment.听

Last month, Jigsaw, a technology incubator first launched听by Google, announced the release of Perspective API, a beta version of a platform that could help news sites automatically听ferret out vulgar and disrespectful online comments.

To create the new filtering听software, Jigsaw hired a team of "human evaluators" to rate听comments from The New York Times, Wikipedia, and other sources for "toxicity" 鈥 one听. The Times, the Guardian, and the Economist, plan to test out the algorithm, which offers an easy-to-use interface for moderators. Type in any keyword or phrase, and Perspective will show you how many similar comments were marked abusive by internal judges.听

鈥淏ecause of harassment, many people give up on sharing their thoughts online or end up only talking to people who already agree with them,鈥 said CJ Adams, a product manager at Jigsaw. The goal of Perspective, he added, is "to help people stay online without having to read every bit of abuse hurled their way.鈥

And it's not just Google that's听deploying next-generation tools to deal with the issue.

罢飞颈迟迟别谤听is also rolling out new tools to combat the rise of onlinebullying.听In updates announced earlier this month, the company听听block specific accounts, keywords, and usernames from their timelines.听Facebook also offers a 听that provides tips to users hoping to thwart harassment.听

The issue is also getting more local and national attention. All 50 states have laws or policies .听The subject made national headlines last year when an 18-year-old Texas girl 听after being the target of online attacks. And it even became a focus for First Lady Melania Trump as she supported her husband on the campaign trail, "absolutely unacceptable when it is done by someone with no name hiding on the internet."

Yet even though social media platforms such as Google, Facebook, and Twitter have struggled to root out online abuse on their platform, some digital experts remain skeptical about using artificial intelligence to solve the problem.听

, machine learning designer Caroline Sinders criticized Jigsaw's new platform, showing that the algorithm proved more likely to mark a comment containing the word "Arabs" as abusive than one that said "I love Fuhrer," a term of endearment used for Hitler.

"This is a data set of agitation and anger, and perhaps, not really toxicity,"听Ms. Sinders wrote.

Google has said that it's still tweaking the Perspective algorithm.听

So far, Hourigan, the Denver mother, likes what she sees coming from Silicon Valley to combat bullying.听"I have been addicted to finding out what's possible," she says. "It鈥檚 a conversation that people [must] have."

But, she cautions that in a world where taunting can spread from social media platforms such as Facebook, Twitter, Instagram, and Snapchat to smaller apps and sites, the problem is becoming more challenging. "You can tell your kids to get off social media all you want, but it still gets to them."

You've read  of  free articles. Subscribe to continue.
Real news can be honest, hopeful, credible, constructive.
海角大神 was founded in 1908 to lift the standard of journalism and uplift humanity. We aim to 鈥渟peak the truth in love.鈥 Our goal is not to tell you what to think, but to give you the essential knowledge and understanding to come to your own intelligent conclusions. Join us in this mission by subscribing.
QR Code to Silicon Valley begins putting cyberbullies in the crosshairs
Read this article in
/World/Passcode/2017/0331/Silicon-Valley-begins-putting-cyberbullies-in-the-crosshairs
QR Code to Subscription page
Start your subscription today
/subscribe