Parameters of Social Interaction

What does equality look like? How do we know if we are getting there?

This is the question I asked to open my talk at SHA 2017. It is also the question carried with me as I walked into CtK.Campfire. Both aimed to look at how to mitigate the polarization of human interaction in a digital age. The talk looked at the infrastructure of human interaction, and the retreat embodied some of the best ideals towards action. I’ve written two blog posts – one about each event – but they occurred temporally and intellectually adjacent. You can find the post about CtK.Campfire here.

The talk at SHA2017 (the Dutch hacker camp) was called “Weaponized Social.” WeapSoc is a project in which Meredith and I invested heavily through 2014 and 2015. She has gone on to write for Status451 on an extension of the topic area. I’ve continued to frame bits of my work in this context but have generally not kept up. It’s some of the most intellectually stimulating and emotionally draining work I’ve ever done, and that includes disaster response in the field.

A background assumption for this talk is that the effects of violence become less and less apparent to an observer of a single instance as we push the edges of “acceptable behavior” into being more aligned with human rights.

Violence is defined by the World Health Organization as “the intentional use of physical force or power, threatened or actual, against oneself, another person, or against a group or community, which either results in or has a high likelihood of resulting in injury, death, psychological harm, maldevelopment, or deprivation”, although the group acknowledges that the inclusion of “the use of power” in its definition expands on the conventional understanding of the word.

Example: seeing one person hit a non-consenting person is (pretty) easily defined as violence. Seeing one person say “your a dumb bitch” online to another non-consenting person isn’t as easily defined as violence (it’s often instead categorized as “conflict“). We have to zoom out to see that the receiver isn’t able to be online any longer due to thousands of similar messages in order to see it as the violence (in the form of depravation to opportunity or psychological harm) it is. Here’s just one example:


I don’t want to limit what this person says, but I also have a right not to experience him saying it, if it detracts from my ability to be online. As the quote says, “your right to swing your fist ends where my nose begins.” How can we bridge this sort of contention at scale?

To zoom out like this, and to take action at a systemic level, we luckily have Lessig’s four forces for social change. As the infosec crew which was the audience at SHA is largely skeptical of law (excepting the EFF), of social norms (“don’t tell me how to act”), and that I’m skeptical of markets being able to solve problems of inequality, we are left with architecture/code.

In the talk, I asked this question:

“Do we want to take a scientific approach to equality, where we tweak our infrastructure in explicit ways to see if it changes how people are interacting?”

We, as the creators and maintainers of online spaces have a responsibility to strive towards equality in the ways available to us. How can we do this without surveillance and control of speech? We change the architecture of the spaces. The crew of Weaponized Social (namely, TQ at the SF event in May 2015) started to lay out what the different parameters of social interaction are. Such as, how many people can one account be connected to, how far a message can travel (through timeouts or limits to re-broadcasts), of if an element of serendipity is introduced. These are toggles which can be changed, sliders which can be moved.

If we change these things, we can see how/if architecture changes the way we interact. The social sciences point to us being deeply (tho not solely) affected by our environments. By changing the architecture of online spaces, we could see how it changes how we interact. Who feels safe to speak by taking part in the act of speaking. We can then make better choices about our individual instances and realities based on those results. We now have one more set of tools by which to examine if we are progressing towards equality, without impinging on the individual right to speak. I hope you make use of these tools.

Cultivate the Karass

I came away from CtK.Campfire thinking about how anarchists might be aligned with Republicans in more ways than expected… and possibly more so than to Democrats.1

I was invited to Cultivate the Karass: Campfire based on two previous friendships and a workshop at Personal Democracy Forum. After seeing Lori talk at PDF about her son, Jake, and about carrying his work forward in cultivating relationships between “loyal antagonists,” I had to go to their workshop session later in the conference. One of the few truly interactive sessions (and that includes the one I was a part of called “Apocalyptic Civics”), I loved the use of spectrograms and deeper political discourse. Also, Seamus and Clarence were there! My friendship with both of them has been forged out of somewhat oppositional circumstances (one documented here). So when they suggested I attend the CtK.Campfire event, I listened.
5 people prioritize breakout session topics by applying stickers to post-it notes with topics listed.22 people – Republicans, Libertarians, Democrats, and one Anarchist (hey that’s me!) – gathered over three days to bond, to engage in facilitated civil discourse, and to learn to see each other as humans.

It worked.

After we had built trust over our life stories, and Not Talking About Politics, and some amount of beverages, we were able to move into more in-depth conversations. “Is our Democracy broken?” “Race relations and white people” “Equipping institutions for a VUCA world.” We did a spectrogram around whether or not statues of Confederate leaders should be removed. After much discussion, we came to a shared view – we should have to face our terrible history2, and that ideally some sort of process would be available to remove or relocate to museums the current glorification of those who wished to continue dehumanizing others. There was acknowledgement that democratic processes exist for this but has been ignored.

I want to tell you about one conversation in particular. Of all these conversations, the one that I both gave and received the most from was “What if it all goes wrong?” As in, what if we do put removal of statues to a vote, and the vote is to leave them where they are? What if Trump gets a second term? What if…

The conversation was posited by Cameron (Republican) and attended by Kyla (Democrat), Sarah (Republican), and me (Anarchist). We agreed that we shared a concern about a consolidation of power, and that respecting the systems we’ve built when power is imbalanced would lead to greater and greater oscillations of “now it’s my turn” from one party to the next. We agreed that a polarization in civil society could lead to increasing violences, and with diminishing ability to recover from imbalance. We had an interesting conversation around the vacuum of power currently occurring in leadership positions meaning a loss of infrastructure maintenance (let alone creation). We agreed government had been bulky, but that the current rate of displacement was dangerous.
7 people sit around a campfire in the sun. The image is taken through some trees from above.We even agreed about what “what if it all goes wrong?” might look like – our leaders becoming more radical, a continued shift in the Overton Window towards less and less civil/human-rights behavior, a validation of lack of leadership also leading to a lack of social cohesion, an increasing lack of faith in our electoral process and the census. I brought up that the world had already gone wrong for many people. I talked about cops not intervening in fights at protests in Berkeley. This was considered too specific by some folk in the group, but it did lead into a conversation about what “antifa” was.

“‘Antifa’ means ‘anti-fascist,’” I said. “I’m anti-fascist, but I don’t agree with destroying things.” “Ah. That is the ‘black bloc.’ They also identify as anti-fascist, but view meeting violence with violence and occasional destruction of property as a necessary component of fighting fascism. There was ‘civil discourse’ in pre-Nazi Germany, but the movement was still successful. As much as we’ve talked about how well Germany has done about monuments honoring the dead rather than the killers, there are still many Neo-Nazi groups there, which are often kept at bay by antifa/black bloc folk who are willing to literally fight them back. Some folk in the US think this is also necessary.” “So I’m antifa but not black bloc.”3

Then we got into problem solving. “Oh no,” I thought to myself, “this is where it will all go wrong.” But I was wrong. We agreed that America’s strength is in its plurality4. We agreed that Obama had normalized the use of executive orders which Trump is now running with even more. “Obama built the weapon that Trump is using,” as Cameron said. Since Republicans are invested in diminishing the size of big government, did they have a plan to reduce the run-away power of the executive branch that Democrats might be able to sign onto? Why yes, yes they do. It’s called the REINS Act and it limits what an executive order can do. It would be a huge step if Democrats were to pick this up (it’s already passed the House, but needs the Senate) as an act of good faith and self-awareness that it’s the amount of power someone has, not just how they use it which is at the core of the problem. Of course I need to read more – here’s a writeup from a “liberal” source, and one from a “conservative” source5.
We also talked about having open primaries, if the American people are smart enough to handle ranked voting (I think we are), and the problems of gerrymandering.
The Cultivate the Karass cohort stands and sits around a fire at night.But here’s what I walked away with: a new knowledge that my new conservative friends have been fighting for the same thing I’ve been fighting for as an anarchist in crisis response – getting more decision-making power into the hands of local populations. That although I align more with the rhetoric of liberals and radicals… the people doing the work within government to actually devolve power are those I never considered myself to be aligned with. I still think there are more responsible ways to care take the newest and most vulnerable in that process, but now I know I have some loyal antagonists with whom to debate the best path forward.

Footnotes

  1. *cough* Horseshoe Theory */cough*
  2. Facing History And Ourselves, anyone?
  3. I recognize I didn’t get into the more blurry lines of how Antifa is a movement which is often more comfortable with violence as a tool than explicitly nonviolent groups. But that was not the topic of the session, so I didn’t want to detract too much. For more information, start here.
  4. I’d of course argue that the human race’s strength is in its plurality, but America is currently considered a subset of that, so sure.
  5. Which has me thinking about anarchist reviews of policy as a useful project, as if I didn’t have enough projects on my plate…Anyone want to adopt this one?

Algorithms for Enforcement or for Data-Driven Introspection?

Many organizations (official or grassroots) have objectives which exceed their capacity, i.e., they have fewer resources than they think they need. In order to either better place limited resources, or to improve processes generally, some of these organizations have taken to collecting data about their objectives and use of resources. For a drought management agency in the Horn of Africa, this might have to do with the location of agripastoral communities and their access to water. For a school district in Michigan, this might be test scores or (better yet) teacher attendance. By documenting historical data and changes linked to actions taken, an understanding of whether or not a goal (equal representation, access to resources, etc) is being reached is more grounded in reality. Data, like all things, is political. What data is collected, how it is collected, where it is stored, to whom it is visible, and who gets to act on it can re-centralize power or become mechanisms of accountability and community empowerment.

This post explores how police departments have been collecting data about the location and types of arrests made as a way to track how much crime is happening in a certain place, as a way of placing their limited resources (cops and their weapons) more accurately (to their eyes). But of course their data has to do with arrests, not crime, and their definition of crime is still based on enforcement of law. This use of force, already untenable, can be seen by some as “unbiased” when based on data. Here we explore why this is not only inaccurate but will further embed systemic racial bias, while maintaining that data collection and subsequent action can be a useful thing when led by the communities themselves. Here, we specifically address questions of large sets of data against which algorithms can be run, and how we can make choices to maximize benefit and mitigate damage of these operations while transitioning from the world we’re in to the world we want.

I anticipate the audience for this blog is more acutely aware of things like state-sponsored surveillance, malware used by abusers to further control others, or circumvention tools than the usual crowd. But there is more to the technology and abilities of networks than just these components. Let’s talk about the data that networks generate, the algorithms by which that data is navigated, and how data is acted upon. One end of the arbitrary spectrum of action is enforcement – an external party exerting force in order to maintain the rule of law. The other end is data-driven introspection – an individual or group of people generating data for tracking changes within their own control. This article explores how to understand and increase the likelihood of just actions taken based on data and algorithms. Continue reading

So you want to build a tech tool which bridges political divides…

I reached out to friends at Center for Civic Media about how much I’ve been hearing lately about folk wanting to “pop communication bubbles.” A bunch of these (and Berkman) folk have been working on things like that for a long time, and have some excellent things to share in regards to our attempts, successes, failures. This is a near-exact transposition of their response to my prompt. Platforms which already try to bridge political (or other) differences:

A review of these systems is in

https://unfold.com/ breaks news into simple statements, lets users vote their opinion Things which indicate how great Amber is and that it should be used, but I bet were great when they led somewhere:

Remembering Normal

Most of my corners of the internet are currently filled with rage. One of the ongoing cries is “this is not normal.” It’s true, it’s not. So let’s take a moment to remember what normal has been for the past bit. This is to both balance out the past blog post, and in light of great blog posts like this one about mental health and long fights. Much of my “normal” has to do with where I live and what I look like. I still find it important to talk about them because these levels of freedom are something I actively fight to make available for others on a daily basis in my own flawed and insufficient ways.

  • Normal has been a high likelihood that overhead helicopters etc are for traffic reporting.
  • Normal has been walking in my neighborhood safely.
  • Normal has been making aggressively questioning remarks about government, governance, and other systems of power in public and having lively debate and no concern for my long-term well-being.
  • Normal has been visiting nearly every continent in 5 years and only getting heavy scrutiny thrice, including when soft-packing through TSA.
  • Normal has been asking friends to move to encrypted channels and no one being targeted for those moves.
  • Normal has been holding hands with a girlfriend and a boyfriend on a street corner and only getting occasional side-eye.
  • Normal has been openly attending talks from activists in other countries.
  • Normal has been experiencing shock when I see enforcement agents with semi-automatic weapons in other countries (because they don’t where I live).
  • Normal has been publishing under my own name.
  • Normal has been making an appointment for, and then getting, an IUD from my doctor, and it being covered by insurance.
  • Normal has been, and will always be, a slow fight towards more justice and more equality.

And so much more. Remember what is normal.

Same as it ever was

Hi, friends.

I’ve gotten into a few conversations recently with friends for whom this election has deeply shaken their world view. They wonder how — how — this could have happened. And how I can be so damn calm?! Instead of talking through this over and over again, I’m documenting it here.

I am not surprised by Trump winning the election.

A bee once flew into my motorcycle helmet while I was at speed on the highway and I was able to calmly and safely pull over and get it out without either of us losing our lives. My being calm and unsurprised is not an indicator of how terrified I am for my friends, for humanity, and for the planet in this slide towards fascism all over.

I know Trump supporters

People I have cared about for much of my life – and continue to care for – find promise in Trump. I think this is due to their feelings of disempowerment, but they have their own reasons as well. They are just as racist and sexist as anyone in a racist and sexist culture is. Which is to say, at least a little bit. They also, like most/all of my radical and liberal friends, feel disconnected from our governance systems. Sorry to go all Steven Universe on y’all, but I see these folk as potential allies in a very long fight, not as The Enemy. We’re all people, and anything I fight to achieve for my friends (legal recognition of love, freedom of speech, safety from harm) I also fight to achieve for these folk, because human rights apply to everyone.

Our systems are set up for this

Friends are under threat of violence. Our planet is under threat of no longer supporting human life. Friends of mine are under threat of funding being yanked, at an organizational or personal level. These are not new challenges, it is simply that we were mildly comfortable with who was at the helm in a haphazard and ineffective attempt to avoid these issues. Until a system can truly have any person in a role without the output of the system changing, it isn’t stable and maybe shouldn’t be relied upon. And unless a government is fulfilling its basic role to provide baseline human needs through collective action and resource management, it ain’t a government I’m much into. I say in a nominally self-aware way as a white lady in SF who has tons of privilege.

These are long standing issues

There are many social justice organizations which have been long working on problems of systemic violence such as racism and sexism through the means available to them. Those who understand the above point likely haven’t shifted what it is they’re up to all that much based on this election, although we may be working with more urgency than before.

What’s to be done?

When the Snowden revelations came out, some corners of the infosec community shrugged and said “yeah, and?” It was a huge lost opportunity. Suddenly, people care about your cause. This is, as they say, a “teachable moment.” Use this time to onboard people to your cause. Use it to teach and embrace and build solidarity.

Live your life

I don’t believe in needing the external morality of religion to guide my actions (though religion is just fine), and I don’t believe I need a government to tell me how to behave, either. I will continue looking out for my fellow humans, performing small acts of human decency, and wading into fights if needed. I hope you’ll do the same, or be even more present than you have been before. This everyday action thing is also the only way I’ve found to be sustainable in my long years of action.

Join the fight

We’re glad you’re here. Hello. Welcome. There are tons of groups already doing excellent work. Please find and contribute to one of them.

Step outside of your comfort zone

Try listening first, and then acting. Try understanding someone you dislike. Try seeing someone you’ve never looked at before. We’re in this together, regardless of how it shakes out.

And most of all: <3

Acting Together

Regardless of how or if you voted, if the past few days have inspired you to take action but aren’t sure how, here is a template to get started.


Not loading for you? It’s likely due to the chat on the riseup pad. Here‘s a direct link to the pad.

We’ll be hosting one this upcoming Tuesday evening in San Francisco. Let me know if you’d like to know details.

Forbidden Research liveblog: Sexual deviance: can technology protect our children?

liveblog by Alexis, Sam Klein, Natalie, and myself

Ethan Zuckerman, Director, MIT Center for Civic Media moderates.

Conducting research on adults who have sex with children is virtually impossible due to ethical and legal restrictions. The advancement of technologies like robots and virtual reality has opened the door to exploring questions that were previously not possible. But while a U.S. court case has held that virtual child pornography is legal, the law in this area is controversial and emotionally charged. Legal uncertainties and vast stigma make actual research difficult. At the same time, a better understanding of this deviant behavior has the potential to significantly change lives.

Lead to paraphilia. We’re not showing explicit imagery. It may be triggering. Going to try to deal with this very difficult topic. Lots of real world ramification. 1300 people are serving time for sex crimes just in MA. X are in indefinite civil confinement – finished sentence, but not released into the general public because of fear of recidivism. Research on the statistics. 10% to 50% which suggests that there isn’t a ton of research. We know very little indeed. Most people who are afflicted with pedophilia are actively trying to fight these urges. When talking with therapists, they’re trying very hard not to act on these urges they’re suffering from. There are some existing efforts to develop support programs. Whether there are ways of treating with VR, intimate robotics, etc.. It’s a challenging topic with a lovely set of folk willing to take it on.

Kate Darling, MIT Media Lab, IP Theory, Policy, and Robot Ethics, Fellow at Harvard Berkman Center is looking at the NOW of robot-human interaction. Leads us off. Human robot interaction, how we behave around robots. People treat them as though they’re alive. We know they’re just machines, but subconsciously when we interact, we treat them as if they’re alive. Not just about people getting used to a new technology but instead something which is biological. Our brains might project intent and life on moving things which seem autonomous. How strongly we respond to the cues these machines give us. Gives us a chance to study human psychology. People who have low empathic concern for others treat robots differently than those who have high empathetic concern —this is part of a research study Kate has been conducting with Palash Nandy, a researcher at the Media Lab in the Personal Robotics group. Those who treat robots like a living thing makes them a potentially great tool for

When child-size robots come to market, will they be used to address desires and protect children, or to normalize it and put more children at risk? There’s no way for us to know. These urges are not a moral failing, they are a psychological issue. Nearly impossible to self-report as you’ll get booked. If we really care about children, we might need to be preemptive about this.

Courts don’t know what to do with these robots, since no child has been harmed in making them.
While high quality sex robots are not coming as quickly as some might think (or like), but they are coming at a pace that’s faster than society is willing to talk about.

Child porn doesn’t exist for at least two reasons: because we think it’s not ok, but also because a child was harmed in its creation. 3D modeling etc would shift that. Do any international courts handle this differently? Need intent as well as harm to have broken a criminal law in the US. In the US in ’96 we had an act forbidding pornographic CGI depicting children. In ’02 the supreme court decided there was a free speech issue that overruled, and struck down parts of that act. Since then, a new act “Protect” has been passed, which prohibits “obscene” cartoons. They’ve shifted the child piece towards obscenity, which is not well defined and depends on community standards. Ex: some media showing young girls performing fellatio was targeted b/c it was aimed at an audience of young girls to teach them improper behavior, not because it included images of young girls.

Back to the question of legal status, but what is exploitative and what is put into legal frameworks because it is uncomfortable?

Ron Arkin, Roboethicist and Professor, School of Interactive Computing, Georgia Tech. Robots and robot ethics. Sex, laws, and violence. Robot deception, killer robots, but today we’re talking about sex.

There’s plenty of money to be made in lethal autonomous weapon systems. The USG doesn’t do? that, but some people do. And I do work in robot deception (how and when robots lie?) but that’s not what we’re discussing today. Outbranch from Genevive Bell. Intimate Robotics. Most concerned with lethal autonomous systems, but also concerned about something else that is happening now. I work with Sony, and the Aibo. we know how to make people fall in love with these things. What if we start crossing from teh social space into the sexual space? the questions we ask are around if human-robot intimacy is acceptable? Do you become a deviant if you have sex with a robot? [What about one indistinguishable from a human?]

Can [sex with a robot] it serve sort of like methadone for [sexual] deviants? These are research questions which need to be explored. Any time past offenders are released back into society, there will be more victims. [as there are already today] We need to be prepared for that.

Thank you for this forum for sharing this discussion with the audience and the public.
Uncanny valley has to do with behavior, temperature, texture, etc. Roxxxy, VR robot. How will the prostetution industry do in light of these dolls etc? Some see it as a way to free prostitutes to do other things (this is a rather paternalistic view). [Examples from non-sex robots, and sex robots, the former already well-funded by governments.]

Article from the Atlantic recently: “Can Child Dolls Keep Pedophiles from Offending?”
VICE: “Canada’s Child Sex Doll Trial Raises Uncomfortable Questions About Pedophilia and the Law” A man ordered one in Canada and gets arrested. Methadone is perscription, maybe we need to do the same here.

Protest: there’s a group called Campaign Against Sex Robots, viewed by the founder as “part of a cultural pattern to legitimate pedophilia more widely”. [This reminds me so much of some of the arguments against prostitutions, not seeing how sex is a basic human need ].

Study from Stanford University — touching a robot’s ‘intimate parts’ makes people uncomfortable. Published in an obscure journal, couldn’t find funding source listed. Study on body comfort zones: differences between Japanese and American adults re: where they normally touched close friends or sexual partners, and where they touched their parents, when they met. Dramatic differences in all cases; which one would take into consideration with any robot designs.

Wanting to establish a research agenda. Will sex robots increase or decrease urges? We have an ethical obligation to do this research.

Christina Couch, Journalist
Written on the question of computer imagery. How our feelings, thoughts, desires shape our our technology is designed.

Working on an article – therapeutic uses of VR : Treating PTSD, depression, phobias, addictions. Patrice Reneaud studying pedophiles right at the point of arousal. Having someone at that point requires a stimuli, which for pedophiles have super valid concerns attached to them.

Dr. Patrice Renaud – “assessing deviant preferences in sexual offenders” using virtual immersion.

Mostly audio, having a hard time getting data. His team published a paper that even when they KNOW a subject is a known pedophile, they couldn’t evoke a response just using audio files. When VR started working, they started building scenarios with [fewer] concerns. The differences are in motor and eye movement. The data we have on recidivism is nebulous because it’s really hard to study this group. Interested that VR is what opened up these possible studies.

Also a shift in how we view pedophiles. Virtuous Pedophiles is a support group of people trying to prevent acting on their impulses. Another group like them is called the Dukelfeld Project. Confidential treatment focused on preventing them from acting out. Accessibility to a population which has been traditionally hard to research PLUS new research tools usually means a huge amount of research coming out, but not so much for this case. Dukelfeld was able to get on their feet because there aren’t reporting issues, it might be covered by insurance.

In the US, Lupron (what people use to chemically castrate themselves) can be gotten under perscription as well. We’d first need a better idea of this as a psychological problem rather than a moral problem. How is the legal system changing? We used to think homosexuality was a moral failing, and then a disease, and is now accepted. How does that transition happen? Popular culture led. TV shows etc. The law came afterwards. Untouchable was a documentary on this. If you throw the word “pedophilia” into any legal debate, all the politicians jump in to vote for it. There’s no nuance. The topic (understandably) raises so many emotions for folk that it’s difficult to have a rational conversation about it. The YouTube videos for NYT articles are saying they need to be slaughtered for saying it might be an illness rather than a moral feeling. European culture just thinks about porn files as any other file. It allows them to approach all of this in different ways.

Q+A

So: you’re a robot ethicist. What’s stopping you from studying this? A: Funding. It can come most easily from foundations, but only a limited amount does. Most governments don’t support it [though as noted elsewhere: in Germany treatment for pedophilia is covered by insurance].

Can people get help with their urges? What are their motivations for doing this work? Is there a trend in what’s going on?
I don’t know that the landscape of research today is big enough to generalize. I know of only 2 researcher using VR for this. Maybe there’s more than that, but it is small.

Q: What are the key research questions in this space (intimate robotics)? As an experimentalist, are there things you’re thinking about studying that will help answer these Q’s?
A: (Kate):- how do our interactions with robots affect our interactions with humans? I think about harm: if our interactions with robots lead to harmful interactions with other humans, than that is a bad thing. But we don’t know if our interactions with robots will lead to any of these negative outcomes, so we have to do the research.
We currently know how to observe and measure behavior with robots, but we don’t know if this changes your behavior with people. That’s hard to study in any arena, and especially with intimate robots, I’m worried we won’t do it at all. If a big name in social robotics can’t get support for such work, how can anyone do that?

Q: In defense of continental Europe and its culture – I have experience with Quaker work in this field; they are some of the frist to visit prisoners, and they work with sex offenders. All these technologies seem to further sequester and isolate offenders from society. That seems to be something they’re trying hard to get over; they want to integrate with society. Do you think it is possible in the US to propose a system where groups voluntarily engage w/ pedophiles, on the basis that they are humans, and shouldn’t be treated even worse than violent criminals?
A: (Christina) A story just came out about a [NJ?] task force that is dedicated to that. I don’t have any way to answer, but people are starting to consider it.
A: (Ron) I don’t think this is a panacea for reintegration; but it should be considered as a possible positive force.
A: (Kate) People being visited are the small percentage who have been convicted of a crime. Most people affected have a hard time coming forward at all. I love that groups are forming to help (convicts), but we need legal changes and maybe tech changes as well if those can help people.

Q: (Willow) You’re talking about a lack of data and other things. This is the most academic panel we’ve had so far. I wonder if by opening up science to more citizen science approaches like other panels have, we might catch more data and discover more things. Are there possibilities to try citizen science approaches to sex studies?
A: (Ron) Yes, and I support anyone who wants to contribute to this, but: this does need strictly controlled science evaluation, with IRB and other controls, to get reliable data. We couldn’t even get accurate recidivism rates, and how hard could that be? Numbers were all over the place, because of the dearth of data. And we need to understand the tech coming down the pike. That might be easier to distribute, rather than the study of sexual deviance.
A: (Christina) VR is also bing used to study and treat victims of sexual trauma. This (type of tech) isn’t a one-way street. When we talk about amplifying research methods, it’s not just for offenders.

Q: You all seem to say that lack of funding and stigma are barriers. What would this look like if those didn’t exist? Get to Ethan’s initial questions: how does culture change, this medium change, over the long term? How does this change the future of dealing with taboo paraphilias?
A: (Ron) Human research interaction work has at present gone almost too far in requiring huge amounts of data. I think we can develop research with small focused sets of data. Then a series of progressive experiments could gather a larger body of data over time.

Q: There are studies that suggest porn has changed standards of sex. If these child robots are rolled out, who gets to decide if you can have such robots as therapy, or as entertainment?
A: (Kate) A lot of research here has been very [basic]. Many studies have questioned if violent/sexual games change behavior. Methods used in those cases can be applied to robotics. The increased realism may have more of an effect, but similar approaches may apply.
A: (Ron) To my mind, courts or physicians would say it is appropriate. But there would have to be quasi-controlled environments for this to work.

Q: (Victoria) I’m interested in areas where sex is considered? inappropriate such as w/disability. Looking at sexual deviance – how much correlation or research has been done to see whether pedophilia is different from other deviances? (anything considered unnatural by any society: bdsm, homosexuality, &c) If we’re talking about changing human behavior, can we cross-examine sth like violence, and the relevant effects of VR? [To inform these questions in a less taboo realm.]A: (Christina) I don’t know if any correlation like this has been done. In 20y of VR research, we find that yes it can influence RL behavior. PTSD can be reduced more quickly… unconscious racial bias can be reduced (in at least one study), though that’s incredibly difficult to break even temporarily. It’s not crazy to think this could influence behavior in pedophiles.
A: (Ron) Changing human behavior happens routinely, with or without robots – a change wrt. views on marriage, bestiality

Willow question: why can’t people consent to sexual research?
Question: how do advanced robots consent to sexual research?
Willow question: why are we talking about fully autonomous systems? Does the debate in self-driving cars and mixed-control systems apply here?

Forbidden Research liveblog: Disobedience: breaking the rules for social good

Many ideas and norms once considered unthinkable, like test tube babies and gay marriage, have now become everyday norms. It’s impossible to imagine life without them. For society to evolve, however, we must always be challenging our norms as well as the rules and laws that reflect them. Our institutions must lead in a way that harnesses this questioning into a driver for positive change. This session looks at how institutions can become “disobedience robust” — cultivating the ability to question themselves and accept questioning from others.

Moderated by Joi Ito, Director, MIT Media Lab with panelists
Liz George, MIT Alum Class of 2008
bunnie huang, Author, Hacking the Xbox: An Introduction to Reverse Engineering
Karrie Karahalios, Assistant Professor, Siebel Center for Computer Science, University of Illinois

All panelists are former MIT students (although Joi says he come in the backdoor:). Before this event, Joi interviewed lots of administrators at MIT including John DiFava. And everyone said that they had never met a student who was a bad person. And DiFava spent his career chasing bad guys with the MA State Police before coming to MIT.

Karrie remembers coming to MIT for rush week her first year. She took an “orange tour” and loved it, and it seemed like it was sanctioned by the university. Her House Master encouraged the students to win the East Campus lockpicking contest. And students were constantly hacking things in the dorms like phones and washing machines.

A discipline committee was set up around 2003. The police stopped arresting people at all, but started picking up more people and sending them to this discipline committee. So people who would have been let off altogether were getting in trouble.

The trouble now is that students have this fear of getting caught.
Should they not?
Then it’s hard to abide by that last point of the hacker ethic: avoid getting caught, but if you are, cooperate fully.
I find in some places if everything is legal, it’s not nearly as interesting. Is that a big part of it or not?
Sure it is. [but that doesn’t mean “risk of imprisonment”]“Just so you know, statue of limitations is 7 years.”

There’s a thing, ‘if you see something broken, report it to Physical Plant’, we would note these things if we were up on the roof and tell them. That almost helped build as sene of community across the groups. I did get caught at the ML, I was picking a lock here, I wanted access to one of the tool rooms? They described me as “tall kid, dark hair, asian” in an email to ML. I could have avoided fessing up, but I did tell someone in my lab. They got reasonably mad at me, saying just ask for permission, it’s not hard, and showing me how. That was a scolding, not disciplinary action. I’m a little cynical about MIT’s stance – Liz said MIT likes to own successes and disavow failures [JI – that’s broadly true you know, in the world] But a university is a good place to catch people when they stumble. Especially when they just did something unfortunate [not hurting others]

The ethics associated with hacking. Breaking the rules mindfully. MIT hacker secret sheet #forbiddenMLpic.twitter.com/V2ctRuvZiV

— andres lombana b. (@vVvA) July 21, 2016

Hacking the xbox led me to discover the problems with the DMCA which led me down this whole long path to where I am today [w today’s announcement]. My advisor Tom Knight introduced me to the general counsel, I was all excited; they met me with a sealed envelope on the table; they said I just want you to know we don’t want to touch this or have anything to do with it; you did this on your own time with your own funding, good luck.
I wanted to know, why is the institute disavowing me? I didn’t even disclose what was going on, I just wanted their help to do disclosure responsibly. They wouldn’t even hep with that. Fortunately Hal A and Tom K helped me find an amicable solution (via the EFF).

Joi: Ethan mentioned TidBit, where we had a student working on a project. It’s funny b/c MIT’s counsel represents MIT. There’s some things they can and can’t do. We ended up setting up a law clinic – I’ll give credit to the GC’s office and Provost for this fully-funded and pro-bono clinic at BU. So any problems a student has can go to a BU clinic; in your case they could have directed you to that. This is recent, within the last several months. One of the problems has been the liability concern that something happens and the inst. gets sued by the parents, and lawyers are lawyers. We’ve been trying to set up ways for people to talk to the admins. Legal support is key. Hoping that will help in the future.

There are certain things the institute should sanction, but there are certain things we can’t. On the research side, there are things that affect the whole institute. Some kids don’t know what the repercussions are. I went to a lot of cases I heard about to hear their side of the story. If some of these things came out, it would hurt privacy of the student. It can be better. But the trust gets developed when you have communication. Need informal communication because formal puts you at risk in other ways. Secret backchannel. So the hackers will often tell the police so they’re not caught off guard. No formal acknowledgement. People based and don’t persist over time. 4 year turnover. Met about what could be done. The policy in the handbook was drafted, students said “given all the things that have happened, you can’t ignore it.” You can’t say “look how amazing this place is” and then not support people when they get in trouble. People had to meet with a lot of people about what could be said legally. What was acceptable to write in there? The trust went up a lot after that.

What are the principals we put into a disobedience prize? Principles, playfulness, creativity, social benefit. Large scale collaboration. Swipe all cards in all doors as a way to add noise into a database. CSAIL and Media Lab run our own networks. Here we retain as little information as possible. No cameras here because it creeps us out, can be taken over. We have a lot of theft here, we know we wouldn’t catch the professionals anyway. Research in how we increase security without sacrificing privacy.
What aren’t you allowed to do? Purposefully destruct something for the sake of being destructive (if you’ve evaluated that it’s necessary, go for it).

Relationship between an institution and those performing civil disobedience is difficult. People who get attacked by people on the other side of the argument. Building an institution where disobedience doesn’t have grave consequences. It doesn’t have to be completely safe, but reasonably safe. Tenure, if you piss off the people in your department you don’t get it. How do you do things which speak truth to power while still being on people’s good side.
Tenure was put in place to allow people to be disobedient during McCarthyism. But maybe you’re past that phase in your life by then, you’re like 45. High school Japanese kids working in a lab, being picked on by grad students. Academia shouldn’t be about that, it should be the new people encouraged to question authority. “Does scientific research advance one funeral at a time?” – Max Planck Spoiler: yes [according to a recent MIT paper (PDF) which you should read].

These people learn most of their things on the internet; but without access to journals, they have a hard time applying it. We can go to first principles and questioning these things. That’s what I want to start with: questioning these things [publishing, bad laws]

Q+A

Q: do you think the administration today is too strict? A: when I was a student, yes. students aren’t doing this for the thrill of the illegal; but curiosity, exploring the inaccessible, doing a great piece of engaging engineering.

Maria Zuber: We now have a list of amazing, disobedient folk… a list we have to protect.
How is our Head of Research about this? I’m so glad we’re great at being self-reflexive. I think it went well. You’re listening to all this and some of it is shocking or discomforting, but the MIT administration talks about this stuff all the time. There’s a whole range of opinions. The administration gets a full spectrum of points of view. The ones we heard here [today] are not in the center of the bell curve on where the campus falls in a lot of matters. If there’s a question of how far we can push something, we can always have a conversation about it at least. Try to find the right balance. Try to explain why when we can’t do something.
One thing we are talking about is: is it OK to take an action that affects a broad population? IRB violations could shut down research across the institution. When things come to me, I have to think about the balance of people wanting to do something that moves their work in a positive direction (for them) but may affect others.
Can I ask a Q about that? ITAR rules for instance prvent you from bringing IR sensors into certain countries. Shoud an institution like MIT be pushing back against these rules with the govt? Saying these are rules that are iportant? MIT as an institution has a lot of clout.
A: on that particular issue, I have in fact been pushing back, personally. I’m a space scientist, so I care a lot also about thse cameras. We do that. but in the meantime we [may?] have to also obey the rules so people can continue to do their work.

Joi friend at Twitter and now White House. Would go to police events and just hand out his business card. So instead of busting things, we’d just have people calling him to fix it first. [This is so reminiscent of disaster response I can’t even]. When it happens in public there are egos on the line, too.
(Cory) The opposite of disobedience isn’t obedience, it’s compliance. it’s if you don’t immediately comply with an order, you risk summary execution.
Need to challenge laws in order to progress the nation.

(Sam) There are simple laws and painful laws. How do we make sure the institute isn’t standing in for excessive response, even when it happens outside that bubble?
(Joi) There are laws which are supported by commercial interests (DRM, CFAA, SoPA, PIPA). The Media Lab has made statements against those, and we have a lot of money from Hollywood (none of which went away). Courage to stand up to those that are backing you. We’re in a privildeged position to do that. Then there are laws that limit academic and scientific progress. There’s a way to try to talk to the authorities. There are broad thinkers there.
(Liz) those of us with power need to take those risks, support our folk when they cause problems.

(Kendra) Institutional trust and these back channels, I feel that insitutional trust is not something everyone has. What is MIT doing to help students know they have support? If you are a young black man, being arrested has different connotations.
(Joi) I’m thinking about this a lot lately, and it’s not just for us. I just try to talk with and connect with as many folk as possible
(Karrie) That you have this clinic is a huge signal that you want to support your students. I’d love a phone number for those students. I’d love to be able to promote this sort of structure at my university. We don’t have access to this sort of clinic.
(Joi) if we can figure it out, I hope others will also follow.

() This has been fantastic and it’s appreciated. What about research that would piss off your liberal collegues? It’s close to an ideological monoculture. Many of these entrenched things are not useful. Can we have another Forbidden Research conference which pokes holes in liberal assumptions?
(Joi) DARPA study on race and bias etc. The Uni had to be sued to release the study.

Steward Brand, claiming the final question
What’s most interest to me is the elegant hack, minmax, lazy hack. So fiendishly clever, subtle and undetectable. And yet has a great big effect. Do you have any examples of that?
(liz): The insription in Lobby 7 says what the institute was founded for: ‘for the furthering of science and technology and agriculture and commerce’ 20yrs ago some hackers made an incredible reproduction, but replaced the last two words with ‘entertainment and hacking’. Anyone passing by thought it was the original; and it was there for a really long time until a tour guide noticed it, and said “Here are the famous founding principals of MIT, and read it outloud.”
Joi: there’s a piece of artwork, metal and black, in front of the Green building. it’s a bunch of pieces of metal. some kids would leave pieces of metal, and people would think it was broken and weld it back on… it’s a good story, don’t know if it’s true.[Willow – I feel like it’s fine for institutions to move slowly. I feel like this whole thing is about an over extention and crimilization of otherwise inconsequential acts.]

Politics and Death

This was co-written with Fin

When Mihi died, we had some problems beyond just the holes in our chests and the salt in our eyes. 0) He was part of many communities – the medical community, the hacker community, the data journalism community, and many more. We wanted to create a site where these communities could come together, which was complicated as we are 1) activists of one flavor or another, and so most of us aren’t on facebook, 2) facebook memorial pages squick us the fuck out anyway1 2, and 3) there aren’t other accessible options out there for collaborative memorial pages3. Continue reading