Weapons of math destruction and the ethics of Big Data: "models and algorithms are not neutral, and come with important ethical considerations that we ... are often ill-equipped to see."

Trust at the individual level: People don't trust the data is truly anonymous.

An generic csv style form data can be anonymous in itself.

Say:

Id(hashed/marker),question,reply

Unless your web dev did something like:

Www.question.com/question/session=id?question=1...

You can't identify.

Unless you also have the web logs with external ip, you can't trace it's orgins.

Etc.

Unless marketing mix id and real id in some sql db.

There's laws regulating this.

I newer myself reply to web type questions forms.

Point is that you need full controll of the hole chain.

Nor do they trust that multiple sources of anonymous data won't be analyzed and combined with non-anonymous sources of data to derive behavior patterns. As an example, refer to angst regarding browser cookies and such.

Ah. Im glad your awake and get this.

Your 100% right.

Here some more fear for you.

You can find markers in time to.

I had an case where I traced an rouge miss config.

I did't have the usual log files, so I used time as an marker and suppressed various fields.

After an few hours I had 5 candidates.

I did an -3 month analyse and manged to suppress 2 more.

I suppressed some more towards time of day...

I did actualy manage to trace it after a few days.

While this was small data (a few gigs/day), it did scare me.

I just worked with this for a few years. Just imagine the bright people.

Imagine hypercube and more crazy consepts to seperate data in chaos...

Trust at the societal level: People don't trust that the data will be used for its intended purpose,

I live in an country where people thrust their goverment. We have to my knownlage the hardest privacy laws in the world.

So our pov might be different.

When in over at seminar in the states and share experience and stuff I go wtf several times.

There's no way I could do what they do, nither would I.

So different cultures/pov.

but be repurposed as a new tool for societal control.

Bigdata for me is just map reduce engine. It's an tool.

It's like nuclear power. Wonderful or terrible. Technology have no consept of intension.

Hypothetically, you may have a system that starts out monitoring for Islamic terrorist chatter

While im under nda, we all know most nations do this at various level/context.

I don't work in this area.

which gets repurposes to monitor trends of political discourse.

Very very easy to do.

I can come up with much much worse/bad ideas that are reactive.

Technology is not an issue.

You can also look into concerns about how governments both share and steal data from each other,

Not concerns. It's known by snowden and various leaks.

which limits the efficacy of privacy laws.

Nsa/4eyes kinda did what they wanted.

If your on their radar, you pretty fscked anyway.

Trust at the corporate level: Corporations work very hard and pay lots of money to governments to minimize their responsibilities

Lobby/corruption is illegal in my country, but im also happy to moved from .priv ->.gov.

with regard to privacy and security.

Yeah.

For example, every so often in the US, I periodically get notices from banks I do business with telling me that I have the option of continuing to allow them to distribute information about me to everybody, or limiting that distribution to close partners (which is probably the same as "everybody"). Who these third-parties are, and what they do with the aggregated data they receive is unknown to me.

My previous work was in banking/fraud.

We had very limited legal stuff and plenty compliance checks.

But I also managed the system that ships free credit card to people who had payment problems.

It was eating my soul.

In past, people who wanted privacy could do things like exclude their names from the phone book and set up a PO box. Even that limited type of anonymity is near impossible now.

Agree.

Past nsa revelations, I moved off facebook and is slowly moving off the rest.

At least get off facebook asap!

The average citizen cannot have a discrete, private and secure relationship with a government or corporation anymore.

Nope. Not even my cooworkers with passed time in <nda> orgs give me any comfort.

Your behavior, social circle, financial information and identity are all sold, traded and distributed without your consent or even awareness.

If not, 3 party will steal it or be breached.

I have tons of telemetric data on machines. I can tell you the lifestory about an fan, and drive or even an pid.

Now, replace that with an pcap from ypu interface, facebook, reddit etc and I will tell you stuff about yourself you did't know self.

Let's me top that off and run it thru my more experimental stuff...

Data processing at the warehouse (and beyond) level makes this kind of information commerce easier and profitable.

Yepp.

I newer work for them.

Disklaimer:

I don't work with personal data. I don't master the theory. I just have a few years experience.

/r/philosophy Thread Link - egtheory.wordpress.com