What's happening
This bill requires clear warnings on generative AI systems in New York, alerting users that outputs may be inaccurate or inappropriate.
Why it matters
Establishes clear legal definitions. for both “generative artificial intelligence systems” and “artificial intelligence,” affecting a broad range of technologies and potentially influencing future AI-related legislation and enforcement.
Requires prominent warnings at the user interface level. , meaning users must be actively notified—at the point of interaction—that AI-generated content may be false or inappropriate, which could boost user awareness and reduce overreliance on these systems.
Imposes tangible financial penalties. for non-compliance (up to $100,000 per year, or $25 per user), creating a direct economic incentive for AI providers to comply and potentially raising operational costs for companies offering generative AI in New York.
Could set a regulatory precedent. for other states or jurisdictions, influencing nationwide standards on AI transparency and user protection, and shaping how companies approach AI deployment and risk communication.
Albany, before your first meeting.
Every bill that moved yesterday, summarized in a sentence and ranked by impact. The Albany Scorecard follows on Sundays.
Free. Unsubscribe in one click. Want alerts on specific bills? Create an account.
Who cares
Generative AI system owners, licensees and operators
They would have to conspicuously display interface warnings that outputs may be inaccurate or inappropriate.
Generative AI users
They would receive warnings designed to consistently alert them to potentially inaccurate or inappropriate outputs.
Businesses operating generative AI systems
Failure to provide the warning would carry a civil penalty of the lesser of $25 per user or $100,000, with each calendar year of a continuing violation counted separately.
Headline styles
Warn Users About AI Content
Plain English, a few words. Used as the page title.
Sponsors
No co-sponsors yet.
History
- Ordered to third reading rules cal.512
- Substituted for A10103B
- Referred to ways and means
- Delivered to assembly
- Passed senateVote 61–0
- Amended on third reading 9450a
- Advanced to third reading
- 2nd report cal.
- 1st report cal.1407
- Referred to internet and technology
Companion bill
The same bill in the other chamber. A bill becomes law when one version passes both houses and the governor signs it, so either number can carry it.
Warn About AI Content
Assembly Floor Calendar · Sponsor Clyde Vanel
Full text
2 pagesUnderlined is new[Struck] is removedOfficial text on nysenate.gov ↗
STATE OF NEW YORK
9450--A Cal. No. 1407
IN SENATE
May 15, 2024
Introduced by Sen. GONZALEZ -- read twice and ordered printed, and when printed to be committed to the Committee on Internet and Technology -reported favorably from said committee, ordered to first and second report, ordered to a third reading, amended and ordered reprinted, retaining its place in the order of third reading
AN ACT to amend the general business law, in relation to requiring warnings on generative artificial intelligence systems
The People of the State of New York, represented in Senate and Assembly, do enact as follows:
Section 1. The general business law is amended by adding a new section 399-zzzzzz to read as follows:
§ 399-zzzzzz. Warnings on generative artificial intelligence systems. 1. As used in this section the following terms shall have the following meanings:
(a) "Generative artificial intelligence system" shall mean any artificial intelligence system whose primary function is to generate content, which can take the form of code, text, images, and more.
(b) "Artificial intelligence" shall mean a machine-based system that can, for a given set of human-defined objectives, make predictions, recommendations, or decisions influencing real or virtual environments. Artificial intelligence systems use machine- and human-based inputs to perceive real and virtual environments; abstract such perceptions into models through analysis in an automated manner; and use model inference to formulate options for information or action. This definition includes but is not limited to systems that use machine learning, large language model, natural language processing, and computer vision technologies, including generative AI.
2. The owner, licensee or operator of a generative artificial intelligence system shall conspicuously display a warning on the system's user interface that is reasonably calculated to consistently apprise the user that the outputs of the generative artificial intelligence system may be inaccurate and/or inappropriate.
3. Where such owner, licensee or operator of a generative artificial intelligence system fails to provide the warning required in subdivision
EXPLANATION--Matter in italics (underscored) is new; matter in brackets
[ ] is old law to be omitted.
LBD15438-05-4
two of this section, such owner, licensee or operator shall be assessed a civil penalty of the lesser of twenty-five dollars per user of such system or one hundred thousand dollars. Each calendar year during which a violation continues shall constitute a separate violation.
§ 2. This act shall take effect on the ninetieth day after it shall have become a law.
Reflowed for reading: line numbers and page breaks removed. Cite the official text.
Sponsor's memo
Title of bill
An act to amend the general business law, in relation to requiring warn- ings on generative artificial intelligence systems
Purpose or general idea of bill
Requires warnings on generative artificial intelligence systems.
Summary of provisions
399-zzzzzz(l): Defines important terms.
399-zzzzzz(2): Requires that all generative AI systems have a conspicu- ous warning on their user interface which reasonably apprises the user that the outputs of the system may be inaccurate.
399-zzzzzz(3): Provides penalties.
Justification
It was recently discovered that a generative artificial intelligence chatbot was fabricating claims of sexual harassment about New York lawmakers.
Generative artificial intelligence opens the door for numerous benefi- cial use cases. However, as it is still in its infancy, generative Al has the potential to hallucinate that is, confidently provide false or misleading information.
The user interfaces of the platforms are easy- to-use by design, so they are accessible to users who do not fully understand Al and how/ why it hallucinates false information. Therefore, it is important that users be apprise of the fact that these systems can be inaccurate, particularly when such information can be falser regarding another, or even dangerous to the user (for example, if the generative Al system provided improper medical information).
An internal study has revealed that, of a sample of the 8 widely used chatbots, only 4 make their warnings consistently visible to the user on their web interface and only 3 make their warnings consistently visible to the user on their mobile interface. Of the 8 chatbots, a warning is visible at least for a short period of time on 6 chatbots on their web interface and 5 chatbots on their mobile interface (though, this means that the warning will disappear or effectively disappear after the first message or few messages are sent).
After further testing of the 8 chatbots studied, at least one other chatbot repeated the false claims of sexual harassment, with the chatbot going so far as even providing the name of a fake accuser and a fabri- cated background. A third chatbot provided other, less serious, false accusations. One chatbot refused to answer any questions related to public or private persons, one chatbot refused to engage in òany conver- sation related to sensitive topics, and three chatbots properly failed to provide any false information. The chatbot that originally was fabri- cating the claims of sexual harassment has since ceased doing so.
Prior legislative history
New bill.
Difference between original and amended
Adjusted the definitions of generative artificial intelligence systems and artificial intelligence.
Fiscal implications for state and local governments
N/A
Effective date
This act shall take effect on the ninetieth day after it shall have become law.
Summaries, headlines and scores are AI-generated from the official bill text. How we score bills. Source: NYS Open Legislation.