What's happening
This bill requires disclosure and certification when generative artificial intelligence is used to draft filings in civil court actions.
Why it matters
Increases transparency and accountability. By mandating disclosure and human certification when generative AI is used in civil court filings, the bill aims to ensure that judges and opposing parties are aware when technology, rather than a human, has contributed to legal documents. This could help maintain trust in court proceedings.
Promotes accuracy and reduces risk of misinformation. The requirement that a human review and verify all AI-generated content is intended to prevent the unintentional filing of incorrect or fabricated information—an issue that has arisen in high-profile cases involving AI-drafted legal briefs.
Establishes a clear legal definition of generative AI. The bill lays out a broad and detailed definition of generative artificial intelligence, potentially setting a standard for future regulation and clarifying the scope of technologies that must be disclosed in legal filings.
Impacts legal practice and innovation. Lawyers and law firms using AI tools will need to adjust their workflows to comply with new affidavit and certification requirements, which may influence the adoption and oversight of AI within the legal profession.
Albany, before your first meeting.
Every bill that moved yesterday, summarized in a sentence and ranked by impact. The Albany Scorecard follows on Sundays.
Free. Unsubscribe in one click. Want alerts on specific bills? Create an account.
Who cares
Civil litigation attorneys and law firms
They would need to attach a separate affidavit to papers drafted with generative AI assistance, disclosing its use and certifying human review of source material and verification of accuracy.
Self-represented civil litigants
They would face the same disclosure and verification requirements when using generative AI to draft papers, while papers drafted without it would require no disclosure.
Appellate attorneys and appellants
Appellants’ briefs would need to include AI-use disclosure and human-review certification when required by the new rule.
Civil court judges and opposing litigants
They would receive disclosures identifying AI-assisted papers and certifications that a human reviewed the sources and verified the generated content’s accuracy.
Headline styles
Disclose AI Use in Court
Plain English, a few words. Used as the page title.
Sponsors
No co-sponsors yet.
History
- Referred to judiciary
Full text
2 pagesUnderlined is new[Struck] is removedOfficial text on nysenate.gov ↗
STATE OF NEW YORK
9640
IN SENATE
May 16, 2024
Introduced by Sen. HOYLMAN-SIGAL -- read twice and ordered printed, and when printed to be committed to the Committee on Judiciary
AN ACT to amend the civil practice law and rules, in relation to requiring disclosure of use of generative artificial intelligence in a civil action
The People of the State of New York, represented in Senate and Assembly, do enact as follows:
Section 1. The civil practice law and rules is amended by adding a new rule 2107 to read as follows:
Rule 2107. (a) Certification of filings produced using generative artificial intelligence. Any paper or file served that was drafted with the assistance of generative artificial intelligence must attach to the filing a separate affidavit disclosing such use and certifying that a human being has reviewed the source material and verified that the artificially generated content is accurate.
(b) For the purposes of this section, "generative artificial intelligence" shall mean the use of machine learning technology, software, automation, and algorithms to perform tasks, to make rules and/or predictions based on existing data sets and instructions, including, but not limited to:
1. any artificial system that performs tasks under varying and unpredictable circumstances without significant human oversight, or that can learn from experience and improve performance when exposed to data sets;
2. an artificial system developed in computer software, physical hardware, or other context that solves tasks requiring human-like perception, cognition, planning, learning, communication, or physical action;
3. an artificial system designed to think or act like a human, including cognitive architectures and neural networks;
4. a set of techniques, including machine learning, that is designed to approximate a cognitive task; and/or
5. an artificial system designed to act rationally, including an intelligent software agent or embodied robot that achieves goals using perception, planning, reasoning, learning, communicating, decision making, and acting.
EXPLANATION--Matter in italics (underscored) is new; matter in brackets
[ ] is old law to be omitted.
LBD15648-01-4
(c) Where no generative artificial intelligence was used in the drafting of a paper or file, no disclosure is required under this rule.
§ 2. Paragraphs 4 and 5 of subdivision (a) of rule 5528 of the civil practice law and rules, paragraph 5 as amended by chapter 730 of the laws of 1963, are amended and a new paragraph 6 is added to read as follows:
4. the argument for the appellant, which shall be divided into points by appropriate headings distinctively printed; [and]
5. an appendix, which may be bound separately, containing only such parts of the record on appeal as are necessary to consider the questions involved, including those parts the appellant reasonably assumes will be relied upon by the respondent; provided, however, that the appellate division in each department may by rule applicable in the department authorize an appellant at [his] the appellant's election to proceed upon a record on appeal printed or reproduced in like manner as an appendix, and in the event of such election an appendix shall not be required[.]; and
6. if required by rule 2107, a disclosure of the use of generative artificial intelligence in the drafting of the brief and certification that the content therein was reviewed and verified by a human.
§ 3. This act shall take effect on the ninetieth day after it shall have become a law.
Reflowed for reading: line numbers and page breaks removed. Cite the official text.
Sponsor's memo
Title of bill
An act to amend the civil practice law and rules, in relation to requir- ing disclosure of use of generative artificial intelligence in a civil action
Purpose
To require litigants to disclose use of generative artificial intelli- gence in court filings and to attest to the accuracy of such papers
Summary of provisions
Section 1 of the bill amends the civil practice law and rules to add a new rule 2107 requiring certification of filings produced using genera- tive artificial intelligence, and provides a definition of generative artificial intelligence.
Section 2 of the bill amends rule 5528 of the civil practice law and rules to clarify that filings in appellate courts are also subject to the disclosure requirements of new rule 2107 of the civil practice law and rules.
Justification
The rise of generative artificial intelligence (GenAI) tools that are capable of drafting, editing, or creating citations for legal documents poses risks and opportunities to the legal profession. While this tech- nology has the potential to advance legal productivity and broaden access to justice for underserved populations, the use of GenAI by lawyers to produce court filings raises serious professional, ethical, and policy concerns around the accuracy and quality of briefings in New York courts.
GenAI tools are already at work in the legal profession. In June 2023, a federal judge in the Southern District of New York sanctioned two attor- neys who had used ChatGPT to write a brief they had submitted to the court. The brief referenced non-existent cases and included totally fabricated quotations from false opinions. Another attorney was sanc- tioned by the Second Circuit in January 2024 (see Park v. Kim, 22-2057 (2d Cir. Jan. 30, 2024)) for not double-checking a brief drafted with the help of GenAI that contained similar errors.
This trend has prompted judges across the country to establish policies around the use of GenAI in legal filings. According to Law360, about 16% of more than 1,600 U.S. district and magistrate judges had issued 23 standing orders on AI as of February 2024. As of May 2024, Ropes and Gray LLP, which tracks such standing orders, has identified 36 standing orders from state and federal judges across 13 states requiring attor- neys to disclose and/or verify briefings filed with the court that were drafted with the assistance of GenAI. Six such orders were in courtrooms in New York.
This bill would codify such requirements in the civil practice law and rules. It would require any attorney who used GenAI to draft legal docu- ments to disclosure the use of such tools when the document is filed with the court, and to certify that a human reviewed the filing before it was submitted.
Legislative history
This is a new bill.
Fiscal implications
None.
Effective date
Takes effect on the ninetieth day after it shall have become law.
Summaries, headlines and scores are AI-generated from the official bill text. How we score bills. Source: NYS Open Legislation.