Skip to content
S9640Senate2023-2024 Session

Disclose AI Use in Court

Official title

“Relates to requiring disclosure of use of generative artificial intelligence in a civil action”

Sponsor Brad Hoylman-SigalSD-47Affects Legal
Status
In Senate Committee
Judiciary
Impact
6/10
Moderate
Passage
0%

Bill progress

Step 2 of 7

In committee · Judiciary

What's happening

This bill requires disclosure and certification when generative artificial intelligence is used to draft filings in civil court actions.

Why it matters

  1. Increases transparency and accountability. By mandating disclosure and human certification when generative AI is used in civil court filings, the bill aims to ensure that judges and opposing parties are aware when technology, rather than a human, has contributed to legal documents. This could help maintain trust in court proceedings.

  2. Promotes accuracy and reduces risk of misinformation. The requirement that a human review and verify all AI-generated content is intended to prevent the unintentional filing of incorrect or fabricated information—an issue that has arisen in high-profile cases involving AI-drafted legal briefs.

  3. Establishes a clear legal definition of generative AI. The bill lays out a broad and detailed definition of generative artificial intelligence, potentially setting a standard for future regulation and clarifying the scope of technologies that must be disclosed in legal filings.

  4. Impacts legal practice and innovation. Lawyers and law firms using AI tools will need to adjust their workflows to comply with new affidavit and certification requirements, which may influence the adoption and oversight of AI within the legal profession.

The daily · weekday mornings

Albany, before your first meeting.

Every bill that moved yesterday, summarized in a sentence and ranked by impact. The Albany Scorecard follows on Sundays.

Free. Unsubscribe in one click. Want alerts on specific bills? Create an account.

Who cares

  • Civil litigation attorneys and law firms

    They would need to attach a separate affidavit to papers drafted with generative AI assistance, disclosing its use and certifying human review of source material and verification of accuracy.

  • Self-represented civil litigants

    They would face the same disclosure and verification requirements when using generative AI to draft papers, while papers drafted without it would require no disclosure.

  • Appellate attorneys and appellants

    Appellants’ briefs would need to include AI-use disclosure and human-review certification when required by the new rule.

  • Civil court judges and opposing litigants

    They would receive disclosures identifying AI-assisted papers and certifications that a human reviewed the sources and verified the generated content’s accuracy.

Headline styles

Disclose AI Use in Court

Plain English, a few words. Used as the page title.

Sponsors

Primary sponsor
Brad Hoylman-Sigal

Senator · Senate District 47

Chair, Judiciary

No co-sponsors yet.

History

  1. Referred to judiciary

Full text

2 pagesUnderlined is new[Struck] is removedOfficial text on nysenate.gov ↗

STATE OF NEW YORK

9640

IN SENATE

May 16, 2024

Introduced by Sen. HOYLMAN-SIGAL -- read twice and ordered printed, and when printed to be committed to the Committee on Judiciary

AN ACT to amend the civil practice law and rules, in relation to requiring disclosure of use of generative artificial intelligence in a civil action

The People of the State of New York, represented in Senate and Assembly, do enact as follows:

Section 1. The civil practice law and rules is amended by adding a new rule 2107 to read as follows:

Rule 2107. (a) Certification of filings produced using generative artificial intelligence. Any paper or file served that was drafted with the assistance of generative artificial intelligence must attach to the filing a separate affidavit disclosing such use and certifying that a human being has reviewed the source material and verified that the artificially generated content is accurate.

(b) For the purposes of this section, "generative artificial intelligence" shall mean the use of machine learning technology, software, automation, and algorithms to perform tasks, to make rules and/or predictions based on existing data sets and instructions, including, but not limited to:

1. any artificial system that performs tasks under varying and unpredictable circumstances without significant human oversight, or that can learn from experience and improve performance when exposed to data sets;

2. an artificial system developed in computer software, physical hardware, or other context that solves tasks requiring human-like perception, cognition, planning, learning, communication, or physical action;

3. an artificial system designed to think or act like a human, including cognitive architectures and neural networks;

4. a set of techniques, including machine learning, that is designed to approximate a cognitive task; and/or

5. an artificial system designed to act rationally, including an intelligent software agent or embodied robot that achieves goals using perception, planning, reasoning, learning, communicating, decision making, and acting.

EXPLANATION--Matter in italics (underscored) is new; matter in brackets

[ ] is old law to be omitted.

LBD15648-01-4

(c) Where no generative artificial intelligence was used in the drafting of a paper or file, no disclosure is required under this rule.

§ 2. Paragraphs 4 and 5 of subdivision (a) of rule 5528 of the civil practice law and rules, paragraph 5 as amended by chapter 730 of the laws of 1963, are amended and a new paragraph 6 is added to read as follows:

4. the argument for the appellant, which shall be divided into points by appropriate headings distinctively printed; [and]

5. an appendix, which may be bound separately, containing only such parts of the record on appeal as are necessary to consider the questions involved, including those parts the appellant reasonably assumes will be relied upon by the respondent; provided, however, that the appellate division in each department may by rule applicable in the department authorize an appellant at [his] the appellant's election to proceed upon a record on appeal printed or reproduced in like manner as an appendix, and in the event of such election an appendix shall not be required[.]; and

6. if required by rule 2107, a disclosure of the use of generative artificial intelligence in the drafting of the brief and certification that the content therein was reviewed and verified by a human.

§ 3. This act shall take effect on the ninetieth day after it shall have become a law.

Reflowed for reading: line numbers and page breaks removed. Cite the official text.

Sponsor's memo

Title of bill

An act to amend the civil practice law and rules, in relation to requir- ing disclosure of use of generative artificial intelligence in a civil action

Purpose

To require litigants to disclose use of generative artificial intelli- gence in court filings and to attest to the accuracy of such papers

Summary of provisions

Section 1 of the bill amends the civil practice law and rules to add a new rule 2107 requiring certification of filings produced using genera- tive artificial intelligence, and provides a definition of generative artificial intelligence.

Section 2 of the bill amends rule 5528 of the civil practice law and rules to clarify that filings in appellate courts are also subject to the disclosure requirements of new rule 2107 of the civil practice law and rules.

Justification

The rise of generative artificial intelligence (GenAI) tools that are capable of drafting, editing, or creating citations for legal documents poses risks and opportunities to the legal profession. While this tech- nology has the potential to advance legal productivity and broaden access to justice for underserved populations, the use of GenAI by lawyers to produce court filings raises serious professional, ethical, and policy concerns around the accuracy and quality of briefings in New York courts.

GenAI tools are already at work in the legal profession. In June 2023, a federal judge in the Southern District of New York sanctioned two attor- neys who had used ChatGPT to write a brief they had submitted to the court. The brief referenced non-existent cases and included totally fabricated quotations from false opinions. Another attorney was sanc- tioned by the Second Circuit in January 2024 (see Park v. Kim, 22-2057 (2d Cir. Jan. 30, 2024)) for not double-checking a brief drafted with the help of GenAI that contained similar errors.

This trend has prompted judges across the country to establish policies around the use of GenAI in legal filings. According to Law360, about 16% of more than 1,600 U.S. district and magistrate judges had issued 23 standing orders on AI as of February 2024. As of May 2024, Ropes and Gray LLP, which tracks such standing orders, has identified 36 standing orders from state and federal judges across 13 states requiring attor- neys to disclose and/or verify briefings filed with the court that were drafted with the assistance of GenAI. Six such orders were in courtrooms in New York.

This bill would codify such requirements in the civil practice law and rules. It would require any attorney who used GenAI to draft legal docu- ments to disclosure the use of such tools when the document is filed with the court, and to certify that a human reviewed the filing before it was submitted.

Legislative history

This is a new bill.

Fiscal implications

None.

Effective date

Takes effect on the ninetieth day after it shall have become law.

Summaries, headlines and scores are AI-generated from the official bill text. How we score bills. Source: NYS Open Legislation.