What's happening
This bill prohibits interactive computer service providers from knowingly promoting or developing content that causes harm to targeted users in New York.
Why it matters
Targets Algorithmic Personalization. The bill specifically addresses content that is algorithmically targeted to users based on a wide range of personal data—including psychological profiles, relationship status, income, veteran status, and more—raising the bar for how platforms can use personal information in their recommendation systems.
Expands Platform Liability. By allowing civil lawsuits and penalties for “developing” or “promoting” harmful content, the bill could make platforms more directly responsible for the effects of their algorithms and content moderation decisions, potentially reshaping how social media and other internet services operate in New York.
Defines Harm Broadly. The types of harm covered—emotional, physical (including addiction-related injury), and financial—are broadly defined, which could open the door to a wide variety of claims against platforms if their targeted content is linked to negative outcomes.
Balances Against Free Speech and Some Use Cases. The bill includes carve-outs to avoid infringing on constitutional free speech rights and exempts liability for non-targeted content and for content promoted solely based on basic time/location data, signaling an attempt to limit the law’s reach to the most personalized and potentially harmful content.
Albany, before your first meeting.
Every bill that moved yesterday, summarized in a sentence and ranked by impact. The Albany Scorecard follows on Sundays.
Free. Unsubscribe in one click. Want alerts on specific bills? Create an account.
Headline styles
Ban Harmful Online Content
Plain English, a few words. Used as the page title.
Sponsors
No co-sponsors yet.
History
- Referred to internet and technology
Companion bill
The same bill in the other chamber. A bill becomes law when one version passes both houses and the governor signs it, so either number can carry it.
Ban Harmful Online Content
In Assembly Committee · Consumer Affairs And Protection · Sponsor Clyde Vanel
Full text
3 pagesUnderlined is new[Struck] is removedOfficial text on nysenate.gov ↗
STATE OF NEW YORK
8300
IN SENATE
February 10, 2022
Introduced by Sen. PARKER -- read twice and ordered printed, and when printed to be committed to the Committee on Internet and Technology
AN ACT to amend the general business law, in relation to prohibiting interactive computer service providers from knowingly developing or promoting content that is dangerous or injurious
The People of the State of New York, represented in Senate and Assembly, do enact as follows:
Section 1. The general business law is amended by adding a new section 394-ccc to read as follows:
§ 394-ccc. Interactive computer service; developing injurious content. 1. As used in this section, the following terms shall have the following meanings:
(a) "Interactive computer service" means a service provider, which, for profit-making purposes operates an internet platform that is designed to disseminate public content generated by a third-party;
(b) "Content" means the textual, visual or aural information that is generated by a third-party or the interactive computer service provider;
(c) "Promote" means to present or otherwise convey third-party-generated or interactive computer service provider-generated content to a target user;
(d) "User" means any person who is located in the state who utilizes an interactive computer service provider's platform;
(e) "Platform" means an application or website developed by an interactive computer service provider that acts as an intermediary between users and a third-party to disseminate content;
(f) "Target user" means a person who uses an interactive computer service and whom the interactive computer service provider targets for the purpose of sending a developed message; and
(g) "Target, targets, targeted, or targeting" means conveying content to a target user solely on the basis of their personal data which includes, but is not limited, to a target user's:
(i) location data, whether general or precise, including: (A) the time of day in the user's current or predicted future location; (B) the weather in the user's current or predicted future location; (C) the
EXPLANATION--Matter in italics (underscored) is new; matter in brackets
[ ] is old law to be omitted.
LBD13403-03-1
local businesses in the user's current or future predicted location; (D) the natural, artificial, or planned events in the user's current or future predicted location; (E) political preferences in the user's current or future predicted location; and/or (F) landmarks in the user's current or future predicted location;
(ii) income related activities, including the user's: (A) income level; (B) profession; (C) employment status; (D) source of income; and/or (E) investments;
(iii) relationship status, including whether the user is: (A) single; (B) married; (C) divorced; (D) engaging in an affair; (E) in a domestic partnership; (F) engaged; (G) in a romantic or intimate social relationship; and/or (H) contemplating or is in the process of terminating a relationship;
(iv) social status, including whether the user: (A) is a public official; (B) is a public figure; (C) is a limited purpose public figure; (D) is involuntarily thrust into the public domain; (E) receives a significant amount of engagements on the interactive computer service provider's platform; and/or (F) receives an insignificant amount of engagements or is within a specific threshold of engagements on the interactive computer service provider's platform;
(v) psychological profile, whether generated based on psychological conditions set by the interactive computer service provider, or unique or generally accepted psychological conditions;
(vi) veteran status, including whether the user: (A) has served in the armed forces of the United States or another country; (B) is currently serving in the armed forces of the United States or another country; (C) has been discharged, whether honorably, for medical reasons or otherwise; and/or (D) is not a veteran nor a member of the armed forces of the United States or another country;
(vii) medical condition or status, including the user's: (A) mental state; (B) physical state; (C) emotional state; and/or (D) frequency of their receipt of medical care;
(viii) sex;
(ix) gender;
(x) national origin;
(xi) age;
(xii) race;
(xiii) religion; and/or
(ix) familial demographics, including: (A) whether the user is pregnant or expecting a child; (B) the demographic makeup of the user's family; (C) the number of people in the user's family; (D) the emotional relationship between family members; and/or (E) an immediate or distant relative's social status, veteran status, medical status or psychological profile, relationship status, income related activities, income level, location data, age, sex, gender, race, national origin, religion, or familial status as described in this paragraph;
(h) "Developed" or "Developing" shall mean:
(i) the interactive computer service provider generating or altering visible portions of content or a group of content; or
(ii) the interactive computer service provider sufficiently altering the meaning of content or a group of content generated by third parties through the calculated targeting of the specific person such that a new message is deemed to be created by the interactive computer service provider.
2. An interactive computer service provider that conducts business in this state shall not knowingly:
(a) promote any content to a targeted user; and
(b) with the intention of developing the content, cause: (i) extreme emotional harm; (ii) physical injury, including self-inflicted injury or injury resulting from addiction whereby the content being promoted created the addiction or encouraged such user to indulge in their addiction; (iii) financial injury, including self-inflicted financial injury and financial injury resulting from addiction whereby the content being promoted created the addiction or encouraged such user to indulge in their addiction; or (iv) any other severe, cognizable injury that the interactive computer service provider could reasonably foresee would occur as a result of them promoting the developed message.
3. Any interactive computer service provider who willfully violates any provision of this section shall be liable in a civil action to a target user for any actual, physical or emotional harm incurred from such violation and incur a civil penalty of up to ten thousand dollars for each offense. In making a determination of any violation pursuant to this section, the attorney general may take and make a determination on the relevant facts, and issue subpoenas in accordance with the civil practice law and rules.
4. Nothing in this section shall be construed as: (a) an obligation imposed on an interactive computer service provider that adversely affects the rights or freedoms of any persons including exercising the right of free speech granted by the New York state constitution or the United States Constitution; (b) creating any liability for an interactive computer service provider for promoting content to non-target users based solely on their location and/or time data; (c) creating any liability for an interactive computer service provider for promoting content that is not sufficiently developed to be deemed a violation of the provisions of subdivision two of this section; or (d) creating any liability for an interactive computer service provider for promoting injurious developed content in another state.
§ 2. This act shall take effect on the one hundred eightieth day after it shall have become a law.
Reflowed for reading: line numbers and page breaks removed. Cite the official text.
Sponsor's memo
Title of bill
An act to amend the general business law, in relation to prohibiting interactive computer service providers from knowingly developing or promoting content that is dangerous or injurious
Purpose or general idea of bill
Provides remedies for any person when an interactive computer service provider causes extreme emotional harm, physical injury, financial inju- ry, or another type of foreseeable, severe, cognizable injury.
Summary of specific provisions
Section 1 provides important definitions that are critical in determin- ing whether content is sufficiently developed, namely, what "targeting" is, what "promoting" is, and what a "developed messages" is. It also provides the elements for determining interactive computers service provider liability and the type of liability they will incur if they violate the act.
Read the full memo (1,007 words)
Justification
Interactive computer service providers wield immeasurable power in our society. They are free to act in a variety of unethical and unlawful ways that are at odds with our modern society's principles. Interactive computer service providers are protected under law from being considered as the publisher or speaker of content generated by their users under 42 U.S.C. Section 230. As a result, they are not accountable for any user- generated content hosted on their websites. However, when they "devel- op, in whole or in part," content, they lose their protection under Section 230. This bill aims to hold interactive computer service provid- ers civilly liable for damages resulting from content they develop in accordance with Section 230.
The content that an interactive computer service provider directly alters or creates is referred to as developed content. However, when particular user-generated content is targeted towards a specific indi- vidual, based on their specific characteristics, and in specified ways such as time, location, and placement of content on a page - it can be considered developed content. When a message is promoted in such a calculated manner, the intended message is no longer the message that the targeted user sees in the user-generated material. Instead, the message becomes the underlying message that the interactive computer service provider is aiming to communicate to a user. This is because targeting specific people with specific content necessitates sending a specialized, targeted message that, while comparable to the information being delivered, is uniquely crafted for the targeted user. For example, if a social media platform promotes third-party generated content that encourages eating disorders to a targeted user the third-party generated content may expressly state a message encouraging such a disorder, but if that message, along with many others, is delivered to a figure-cons- cious person around dinner time (which the interactive computer service provider knows about because they determined their individual character- istics, location, and other factors), then that message is evidently
intended to be developed into "This large group of reputable people do not want you to eat dinner tonight."
The purpose of this act is to hold interactive computer service provid- ers responsible exclusively for generating messages that cause the kind of injuries specified by the act. The act is not intended to hold inter- active computer service providers responsible for targeting users with content based only on their location and/or time data, because such information cannot, without more, be employed in any exploitative or inflammatory way. Furthermore, because the risk of harm is so minimal in these instances, this exception balances the benefits of promoting local businesses to users in a specific region with the harms of advertising harmful content to user.
Prominent examples of injury are covered by this act. These include content which causes extreme emotional harm, physical harm, financial harm, and other foreseeable, severe, and cognizable harms.
Extreme emotional harm varies from person to person; nevertheless, as previously indicated, an interactive computer service provider knows who they are targeting and sends specific messages to specific people for specific reasons. As a result, the interactive computer service provider will inevitably know exactly who they are targeting and will be able to anticipate that person's unique triggers. As a result, they can antic- ipate the sort of reaction that the promoted material would elicit with near certainty using their large collection of unique identifiers and statistical data.
This act also covers physical injury, whether self-inflicted or other- wise. This would make an interactive computer service provider liable for any harm caused by the content shown to the user, such as content that the interactive computer service provider knows will cause severe fright in a person or exacerbate a known condition - such as seizures and self-inflicted injury caused by the aforementioned severe emotional harm. Additionally, it covers an interactive computer service provider both causing and exacerbating addiction, such as with alcohol, drugs, products, services, and other types of addictions that can harm a person.
This act also covers financial harm, whether self-inflicted or other- wise, in the same manner as it covers physical injury. This would include gambling addictions, addictions to risking one's finances in speculative assets like stocks, cryptocurrency, and other forms of investment, promoting scams and other predatory businesses like high-in- terest-rate lenders and get-rich quick schemes and courses that they know the targeted user is likely to spend their money on, and any other type of financial injury that is foreseeable based upon the interactive computer service provider's known characteristics and the targeting of the user.
Finally, the last part addresses any type of foreseeable, severe, and cognizable harm resulting from the promotion of a developed message. These types of injuries are not considered emotional, physical, or financial injuries, and should be assessed on a case-by-case basis based on how foreseeable, severe, and cognizable the harm was. An interactive computer service provider inciting someone to commit acts of political violence against others, for example, might be considered an injury
under the act in both the victim and the perpetrator of the crime in some circumstances, while in others it might not.
Prior legislative history
New bill
Fiscal implications
TBD
Effective date
This act shall take effect on the one hundred eightieth day after it shall have become a law.
Summaries, headlines and scores are AI-generated from the official bill text. How we score bills. Source: NYS Open Legislation.