Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Proposed Ethical Web Principle: Avoid enabling and amplifying dark patterns #25

Closed
tantek opened this issue Mar 6, 2020 · 12 comments
Closed
Assignees

Comments

@tantek
Copy link

@tantek tantek commented Mar 6, 2020

The W3C TAG Ethical Web Principles mentions enhancing individual control and power and recognizes a few misbehaviors, yet focuses on decentralization, minimizing single points of failure, and enabling individual & DIY developers. All of that is good, however there is the larger class of “dark pattern” harms to be named and explicitly avoided in specification and technology designs.

The Principles should explicitly note (either adding to or splitting off from “The web must enhance individuals' control and power”) the existence of “dark patterns” in web user interfaces (see WP: Dark pattern and darkpatterns.org for examples), with a statement similar to countering misinformation like:

We will avoid introducing technologies that create new or disproportionately enable, benefit, or amplify existing user interface dark patterns, such as confirmshaming, misdirection, friend spam, permissions pressuring or escalation, threat of data loss etc. We should also avoid new technologies that could be easily abused by existing dark patterns to more easily cause new or worse harms to users. We should design specifications that explicitly plan for and mitigate potential dark pattern abuses.

And cite either or both of those above two references. See also twitter.com/darkpatterns for many more real world web examples.

We obviously won’t be able to prevent all dark patterns and their harms, but we can at least reduce some of them by calling them out, and avoiding new technologies that would increase the chance of users being harmed by existing and new dark patterns.

(Originally published at: https://tantek.com/2020/066/b2/avoid-enabling-amplifying-dark-patterns)

@alice
Copy link
Contributor

@alice alice commented Mar 9, 2020

Could you give some examples of API design which explicitly encourages or mitigates against one or more of these patterns?

@mnot
Copy link
Member

@mnot mnot commented Mar 18, 2021

'The web must enhance individuals' control and power' addresses this somewhat, but then conflates it with centralisation-related issues.

I'd suggest that that item be broken into two -- one about dark patterns, and one about centralisation.

@masinter
Copy link

@masinter masinter commented Jun 8, 2021

I thought the considerations raised by Eliot Lear in https://mailarchive.ietf.org/arch/msg/ietf/k99uQa0Eyi3sueznaw9D7XChzF0/#
might find his issue 2 as a better formulation than "dark" (as compared to "light").

@torgo
Copy link
Member

@torgo torgo commented Aug 3, 2021

We discussed today. @rhiaro will work on some text on dark patterns for the intro. @mnot I don't agree that we are conflating two unrelated topics in "control and power." We're trying to make a statement that decentralised systems play a role in balancing individuals' control and power with that of large entities...? Should we try to make that more clear?

@mnot
Copy link
Member

@mnot mnot commented Aug 4, 2021

@torgo decentralisation is indeed about balancing individuals' control and power with that of large entities. I'm saying that it's worthy of separating that point from a discussion of dark patterns, because the latter aren't sensitive to the size of the entity abusing the user -- small web sites can use dark patterns too.

@LeaVerou
Copy link
Member

@LeaVerou LeaVerou commented Oct 1, 2021

Apparently "dark patterns" is considered inappropriate, as it associates color with malice. One politically correct term could be "manipulative design" [1]

@karger
Copy link

@karger karger commented Oct 1, 2021

Although a problem with "manipulative design" is that all designs manipulate (user attention, for example). The question is the whether the intent of the manipulation is to benefit or harm the user....

torgo pushed a commit that referenced this issue Oct 5, 2021
As agreed in breakout this morning.
@rhiaro
Copy link
Contributor

@rhiaro rhiaro commented Oct 5, 2021

Thanks @LeaVerou for mentioning that, I've done another PR to replace "dark" with "harmful" (but kept the wikipedia link the same) after also reading this

@tantek
Copy link
Author

@tantek tantek commented Oct 5, 2021

tl;dr: prefer using phrase “manipulative design” instead of “harmful patterns” as a replacement for “dark patterns”.

Also adding thanks to @LeaVerou, and agreed with the reasoning in https://www.ccianet.org/wp-content/uploads/2021/06/2021-05-28-CCIA-Comments-on-FTC-Dark-Patterns-Workshop.pdf (since this issue was filed!) particularly from an inclusiveness perspective, “[avoiding] connection of “dark-light dualism” to judgments about morality”.

And as @harrybr is quoted: “during the Workshop by Professor Harry Brignull, while the term “dark pattern” (originated and popularized in part by Brignull) has been useful for marketing and raising awareness, it would be both “vague and sloppy” if used as a legal term or standard.”

That being said, “harmful patterns” is vague and dilutes the intent of this issue.

It’s also not strictly accurate from the perspective of a company implementing such patterns, from their (typically attention/growth/profit-maximizing) perspective, such patterns are helpful to them personally, their shareholders/investors if any, and not harmful.

Such patterns are also too easy for such companies to hide behind a vague "intent" of supposedly "helping" people connect (quiet importing of contacts, suggesting joining radicalizing groups), or "helping" people get products they want/"need" (deceptive marketing, creating fear/insecurity in people’s minds then selling them a product to cope), etc.

More precise (and preserving of intent, meaning, and literal effect) would be the phrase “manipulative design”, also used & recommended by that ccianet workshop (same link): “Rather than employ the terminology of “dark patterns,” these comments will refer to “manipulative design” practices or interfaces”.

(Originally published at: https://tantek.com/2021/278/t2/manipulative-design-instead-of-dark-patterns)

@LeaVerou
Copy link
Member

@LeaVerou LeaVerou commented Oct 6, 2021

But what about @karger's point wrt the term "manipulative design"? A lot of UX is about manipulation for a good cause, the problem here is manipulation for a harmful cause.

@harrybr
Copy link

@harrybr harrybr commented Oct 6, 2021

@rhiaro
Copy link
Contributor

@rhiaro rhiaro commented Oct 6, 2021

It’s also not strictly accurate from the perspective of a company implementing such patterns

in that case, neither is "dark" where dark was used as a [flawed] metaphor for "bad".

In my work as an expert witness, I usually talk about manipulative and deceptive design practices.

Since the text already says "manipulate and deceive people", what if i just change the bit wrapped in the wikipedia link to "patterns" and leave it at that? The paragraph would be:

We recognize that web technologies can be used to manipulate and deceive people, complicate isolation, and encourage addictive behaviors. We seek to mitigate against these potential abuses and patterns when creating new technologies and platforms, and avoid introducing technologies that increase the chance of people being harmed in this way.

We're not coining a term here, just trying to set some pointers for further reading. Does that work?

rhiaro added a commit that referenced this issue Oct 6, 2021
@hober hober linked a pull request that will close this issue Oct 6, 2021
@hober hober linked a pull request that will close this issue Oct 6, 2021
@cynthia cynthia closed this in #55 Oct 6, 2021
cynthia pushed a commit that referenced this issue Oct 6, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

9 participants