Skip to content
S9450Senate2023-2024 SessionSame asA10103

Warn Users About AI Content

Official title

“Requires warnings on generative artificial intelligence systems”

Sponsor Kristen GonzalezSD-59Affects Finance
Status
Assembly Floor Calendar
Impact
6/10
Moderate
Passage
0%

Bill progress

Step 5 of 7

In Assembly · Ways And Means

What's happening

This bill requires clear warnings on generative AI systems in New York, alerting users that outputs may be inaccurate or inappropriate.

Why it matters

  1. Establishes clear legal definitions. for both “generative artificial intelligence systems” and “artificial intelligence,” affecting a broad range of technologies and potentially influencing future AI-related legislation and enforcement.

  2. Requires prominent warnings at the user interface level. , meaning users must be actively notified—at the point of interaction—that AI-generated content may be false or inappropriate, which could boost user awareness and reduce overreliance on these systems.

  3. Imposes tangible financial penalties. for non-compliance (up to $100,000 per year, or $25 per user), creating a direct economic incentive for AI providers to comply and potentially raising operational costs for companies offering generative AI in New York.

  4. Could set a regulatory precedent. for other states or jurisdictions, influencing nationwide standards on AI transparency and user protection, and shaping how companies approach AI deployment and risk communication.

The daily · weekday mornings

Albany, before your first meeting.

Every bill that moved yesterday, summarized in a sentence and ranked by impact. The Albany Scorecard follows on Sundays.

Free. Unsubscribe in one click. Want alerts on specific bills? Create an account.

Who cares

  • Generative AI system owners, licensees and operators

    They would have to conspicuously display interface warnings that outputs may be inaccurate or inappropriate.

  • Generative AI users

    They would receive warnings designed to consistently alert them to potentially inaccurate or inappropriate outputs.

  • Businesses operating generative AI systems

    Failure to provide the warning would carry a civil penalty of the lesser of $25 per user or $100,000, with each calendar year of a continuing violation counted separately.

Headline styles

Warn Users About AI Content

Plain English, a few words. Used as the page title.

Sponsors

Primary sponsor
Kristen Gonzalez

Senator · Senate District 59

Chair, Internet And Technology

No co-sponsors yet.

History

  1. Ordered to third reading rules cal.512
  2. Substituted for A10103B
  3. Referred to ways and means
  4. Delivered to assembly
  5. Passed senateVote 61–0
  6. Amended on third reading 9450a
  7. Advanced to third reading
  8. 2nd report cal.
  9. 1st report cal.1407
  10. Referred to internet and technology

Companion bill

The same bill in the other chamber. A bill becomes law when one version passes both houses and the governor signs it, so either number can carry it.

A10103Assembly

Warn About AI Content

Assembly Floor Calendar · Sponsor Clyde Vanel

Impact 6 · Moderate0% to pass

Full text

2 pagesUnderlined is new[Struck] is removedOfficial text on nysenate.gov ↗

STATE OF NEW YORK

9450--A Cal. No. 1407

IN SENATE

May 15, 2024

Introduced by Sen. GONZALEZ -- read twice and ordered printed, and when printed to be committed to the Committee on Internet and Technology -reported favorably from said committee, ordered to first and second report, ordered to a third reading, amended and ordered reprinted, retaining its place in the order of third reading

AN ACT to amend the general business law, in relation to requiring warnings on generative artificial intelligence systems

The People of the State of New York, represented in Senate and Assembly, do enact as follows:

Section 1. The general business law is amended by adding a new section 399-zzzzzz to read as follows:

§ 399-zzzzzz. Warnings on generative artificial intelligence systems. 1. As used in this section the following terms shall have the following meanings:

(a) "Generative artificial intelligence system" shall mean any artificial intelligence system whose primary function is to generate content, which can take the form of code, text, images, and more.

(b) "Artificial intelligence" shall mean a machine-based system that can, for a given set of human-defined objectives, make predictions, recommendations, or decisions influencing real or virtual environments. Artificial intelligence systems use machine- and human-based inputs to perceive real and virtual environments; abstract such perceptions into models through analysis in an automated manner; and use model inference to formulate options for information or action. This definition includes but is not limited to systems that use machine learning, large language model, natural language processing, and computer vision technologies, including generative AI.

2. The owner, licensee or operator of a generative artificial intelligence system shall conspicuously display a warning on the system's user interface that is reasonably calculated to consistently apprise the user that the outputs of the generative artificial intelligence system may be inaccurate and/or inappropriate.

3. Where such owner, licensee or operator of a generative artificial intelligence system fails to provide the warning required in subdivision

EXPLANATION--Matter in italics (underscored) is new; matter in brackets

[ ] is old law to be omitted.

LBD15438-05-4

two of this section, such owner, licensee or operator shall be assessed a civil penalty of the lesser of twenty-five dollars per user of such system or one hundred thousand dollars. Each calendar year during which a violation continues shall constitute a separate violation.

§ 2. This act shall take effect on the ninetieth day after it shall have become a law.

Reflowed for reading: line numbers and page breaks removed. Cite the official text.

Sponsor's memo

Title of bill

An act to amend the general business law, in relation to requiring warn- ings on generative artificial intelligence systems

Purpose or general idea of bill

Requires warnings on generative artificial intelligence systems.

Summary of provisions

399-zzzzzz(l): Defines important terms.

399-zzzzzz(2): Requires that all generative AI systems have a conspicu- ous warning on their user interface which reasonably apprises the user that the outputs of the system may be inaccurate.

399-zzzzzz(3): Provides penalties.

Justification

It was recently discovered that a generative artificial intelligence chatbot was fabricating claims of sexual harassment about New York lawmakers.

Generative artificial intelligence opens the door for numerous benefi- cial use cases. However, as it is still in its infancy, generative Al has the potential to hallucinate that is, confidently provide false or misleading information.

The user interfaces of the platforms are easy- to-use by design, so they are accessible to users who do not fully understand Al and how/ why it hallucinates false information. Therefore, it is important that users be apprise of the fact that these systems can be inaccurate, particularly when such information can be falser regarding another, or even dangerous to the user (for example, if the generative Al system provided improper medical information).

An internal study has revealed that, of a sample of the 8 widely used chatbots, only 4 make their warnings consistently visible to the user on their web interface and only 3 make their warnings consistently visible to the user on their mobile interface. Of the 8 chatbots, a warning is visible at least for a short period of time on 6 chatbots on their web interface and 5 chatbots on their mobile interface (though, this means that the warning will disappear or effectively disappear after the first message or few messages are sent).

After further testing of the 8 chatbots studied, at least one other chatbot repeated the false claims of sexual harassment, with the chatbot going so far as even providing the name of a fake accuser and a fabri- cated background. A third chatbot provided other, less serious, false accusations. One chatbot refused to answer any questions related to public or private persons, one chatbot refused to engage in òany conver- sation related to sensitive topics, and three chatbots properly failed to provide any false information. The chatbot that originally was fabri- cating the claims of sexual harassment has since ceased doing so.

Prior legislative history

New bill.

Difference between original and amended

Adjusted the definitions of generative artificial intelligence systems and artificial intelligence.

Fiscal implications for state and local governments

N/A

Effective date

This act shall take effect on the ninetieth day after it shall have become law.

Summaries, headlines and scores are AI-generated from the official bill text. How we score bills. Source: NYS Open Legislation.