Post Tagged with: "big data"

Some design fiction from Tim Maly, who wrote that thing about corporations being bad AI:

“…if a firm, partnership, company, or corporation owns real property within the municipality, the president, vice president, secretary, or other designee of the entity is eligible to vote in a municipal election…”
-Montana Bill Would Give Corporations The Right To Vote by Ian Millhiser for Thinkprogress

A broader version of this law passes, leading to an explosion of algorithmic corporations owning nominal fractions of land to meet the real property requirement.

Eventually, the corporate hordes overrun their human voter counterparts. A ballot measure is introduced allowing corporations to stand for election. It passes. Now, their dark work begins.

Full Story: Quiet Babylon: The Corporation Who Would be King

March 21, 2013 0 comments

Meteorologists: The Original Data Scientists?

Rock star data scientist Nate Silver wrote a long article on meteorology for the New York Times:

Why are weather forecasters succeeding when other predictors fail? It’s because long ago they came to accept the imperfections in their knowledge. That helped them understand that even the most sophisticated computers, combing through seemingly limitless data, are painfully ill equipped to predict something as dynamic as weather all by themselves. So as fields like economics began relying more on Big Data, meteorologists recognized that data on its own isn’t enough.

The New York Times: The Weatherman Is Not a Moron

(via Abe)

September 8, 2012 Comments are Disabled

DARPA Wants to Master the Neuroscience of Narrative

Once scientists have perfected the science of how stories affect our neurochemistry, they will develop tools to “detect narrative influence.” These tools will enable “prevention of negative behavioral outcomes … and generation of positive behavioral outcomes, such as building trust.” In other words, the tools will be used to detect who’s been controlled by subversive ideologies, better allowing the military to drown out that message and win people onto their side.

Danger Room: Darpa Wants to Master the Science of Propaganda

A couple years ago I would have dismissed this, but data scientists are getting closer to being able to pull this sort of thing off. I’d still say this is years off, but it’s edging closer to the realm of possibility.

Look, for instance, at how semantic analysis is affecting the legal profession and how many high-end, professional jobs are being replaced by robots.

See also:

The Rise of Predictive Policing

October 19, 2011 5 comments

The Rise of Predictive Policing: Police Using Statistics to Predict Crime

The Minority Report

The Department of Homeland security is field testing a system that will attempt to predict which passengers on an airline are planning terrorist activity, according to Nature. The system, called Future Attribute Screening Technology (FAST) looks at a number of factors, including your pulse, the steadiness of your gaze and the way you walk and calculates the probability that you’re planning to commit a crime. It’s a bit like a polygraph, but it doesn’t require subjects to be connecting to a polygraph.

DHS claims that the system is 70% effective in lab tests.

Nature: Terrorist ‘pre-crime’ detector field tested in United States

But DHS isn’t the only law enforcement agency looking to statistic modeling to predict crime. Earlier this year Slate ran a story on how police departments, including the LAPD and Chicago PD, are researching predictive policing. This projects aren’t about predicting the actions of one individual, Minority Report style, but instead are designed to help decide how best to allocate police resources.

Slate: Can police really predict crime before it happens?.

June 6, 2011 1 comment

Good News for Data Geeks, Bad News for Everyone Else

not hiring

I have a new piece on the dismal impact of information technology on the workforce at ReadWriteWeb:

Last week we told you that enterprises are investing more into business intelligence and analytics initiatives. This week there’s more good news for professionals in this area: according to KDNuggets, salaries are rising for analytics and data mining professionals.

Based on a poll with approximately 250 respondents, KDNuggets found that salaries are up from its 2010 poll in North America, Western Europe, Asia and Latin America. (There is no mention of Eastern Europe, Africa or Antarctica.)

It’s a good time to be a geek, particularly one with a background in statistics, analytics and data mining. But a bad time to be almost any other type of worker.

For example, The New York Times reported on software that can process legal documents at a fraction of the cost of hiring lawyers and paralegals:

“Some programs go beyond just finding documents with relevant terms at computer speeds. They can extract relevant concepts — like documents relevant to social protest in the Middle East — even in the absence of specific terms, and deduce patterns of behavior that would have eluded lawyers examining millions of documents.”

That’s good news for the people who develop that software. But for people in the legal profession? Not so much.

ReadWriteWeb: Good News for Data Geeks, Bad News for Everyone Else

Supplemental reading:

Paul Krugman: Degrees and Dollars

Paul Krugman: Autor! Autor!

Krugman, again, on the same issue back in 1996

And, less dreary but probably less realistic:

Jobs 2.0: Data-centric Jobs for Generation Y

Photo by Daniel Lobo

March 11, 2011 0 comments