Skip to content
S8390Senate2023-2024 SessionSame asA8110

Limit AI Evidence in Court

Official title

“Relates to the admissibility of evidence created or processed by artificial intelligence”

Sponsor Jeremy CooneySD-56Affects Legal
Status
In Senate Committee
Codes
Impact
8/10
Significant
Passage
0%

Bill progress

Step 2 of 7

In committee · Codes

What's happening

This bill sets strict standards for admitting evidence created or processed by artificial intelligence in New York criminal and civil proceedings, requiring independent corroboration and expert validation of AI reliability and accuracy.

Why it matters

  1. Raises the bar for AI-generated or AI-processed evidence. The bill requires independent, admissible evidence to corroborate any evidence created or processed by AI, reducing the risk that unreliable or poorly-understood AI outputs will influence the outcome of legal cases.

  2. Mandates expert scrutiny of AI systems. Before AI-related evidence is admitted, a qualified expert must testify to the system’s reliability and accuracy, and courts must be satisfied that the particular use of AI in the case has been rigorously validated through scientific or technical testing.

  3. Clarifies what counts as “AI-created” or “AI-processed” evidence. The bill precisely defines when information is considered to be created or processed by AI, focusing on situations where the AI generates new conclusions or transforms information in a way that isn’t straightforwardly deducible by humans.

  4. Balances transparency with protection of sensitive information. While requiring expert explanations for AI evidence, the bill allows courts to protect trade secrets, law enforcement techniques, and privileged information from public disclosure, in order to enable expert testimony without compromising security or proprietary interests.

The daily · weekday mornings

Albany, before your first meeting.

Every bill that moved yesterday, summarized in a sentence and ranked by impact. The Albany Scorecard follows on Sundays.

Free. Unsubscribe in one click. Want alerts on specific bills? Create an account.

Headline styles

Limit AI Evidence in Court

Plain English, a few words. Used as the page title.

Sponsors

Primary sponsor
Jeremy Cooney

Senator · Senate District 56

Chair, Procurement And ContractsChair, Transportation

No co-sponsors yet.

History

  1. Referred to codes

Companion bill

The same bill in the other chamber. A bill becomes law when one version passes both houses and the governor signs it, so either number can carry it.

A8110Assembly

Limit AI Evidence in Court

In Assembly Committee · Codes · Sponsor Clyde Vanel

Impact 8 · Significant0% to pass

Full text

3 pagesUnderlined is new[Struck] is removedOfficial text on nysenate.gov ↗

STATE OF NEW YORK

8390

IN SENATE

January 26, 2024

Introduced by Sen. COONEY -- read twice and ordered printed, and when printed to be committed to the Committee on Codes

AN ACT to amend the criminal procedure law and the civil practice law and rules, in relation to the admissibility of evidence created or processed by artificial intelligence

The People of the State of New York, represented in Senate and Assembly, do enact as follows:

Section 1. The criminal procedure law is amended by adding a new section 60.80 to read as follows: § 60.80 Rules of evidence; admissibility of evidence created or proc-

essed by artificial intelligence.

1. Evidence created, in whole or in part, by artificial intelligence shall not be received into evidence in a criminal proceeding unless the evidence is substantially supported by independent and admissible evidence and the proponent of the evidence establishes the reliability and accuracy of the specific use of the artificial intelligence in creating the evidence.

2. Evidence processed, in whole or in part, by artificial intelligence shall not be received into evidence in a criminal proceeding unless the proponent of the evidence establishes the reliability and accuracy of the specific use of the artificial intelligence in processing the evidence.

3. Evidence is created, in whole or in part, by artificial intelligence where the artificial intelligence produces new information from existing information not present in or reasonably deducible from the existing information.

4. Evidence is processed, in whole or in part, by artificial intelligence where the artificial intelligence produces a conclusion based off of its analysis, interpretation, or transformation of existing information where such conclusion is not reasonably deducible from the existing information.

5. Evidence is not reasonably deducible from the existing information where the reliability or accuracy of the information created or conclusion drawn from the existing information would be substantially compro-

EXPLANATION--Matter in italics (underscored) is new; matter in brackets

[ ] is old law to be omitted.

LBD13089-01-3

mised without the use of artificial intelligence as a result of the complexity, uncertainty, or subtlety of the information.

6. Evidence is substantially supported by independent and admissible evidence where:

(a) The independent evidence is separate from, and not derived from, the artificial intelligence that generated the artificially created evidence;

(b) The independent evidence is admissible under the existing rules of evidence;

(c) The independent evidence bears a close and significant relationship to the artificially created evidence in such a manner that it reinforces or corroborates the information created from the artificially created evidence.

7. The reliability and accuracy of the specific use of the artificial intelligence in creating or processing the evidence is sufficient where the proponent of the evidence has a qualified expert testify and such testimony is sufficient to prove that:

(a) The specific use of the artificial intelligence has been validated through rigorous scientific or technical testing, demonstrating that it consistently produces accurate and reliable results in varied environments;

(b) The artificial intelligence has been subjected to testing or application in environments that are similar or analogous to the specific context in which it is being used in the proceeding and such testing or application produced accurate and reliable results;

(c) The artificial intelligence has not been subjected to any variables that, based on scientific or technical testing of the system, have a substantial probability of causing a materially inaccurate or unreliable result. In assessing the probability, the court shall consider the weight of the artificially created evidence relative to other admitted evidence.

8. Where expert testimony would include trade secrets, privileged government information, or information about law enforcement techniques that, if disclosed, would unduly compromise their ability to effectively use their systems for their intended purpose, the court, in its discretion, may impose appropriate measures to protect such information.

§ 2. The civil practice law and rules is amended by adding a new section 4551 to read as follows:

§ 4551. Rules of evidence; admissibility of evidence created or processed by artificial intelligence. (a) Evidence created, in whole or in part, by artificial intelligence may not be received into evidence in a civil proceeding unless the evidence is substantially supported by independent and admissible evidence and the proponent of the evidence establishes the reliability and accuracy of the specific use of the artificial intelligence in creating the evidence.

(b) Evidence processed, in whole or in part, by artificial intelligence may not be received into evidence in a civil proceeding unless the proponent of the evidence establishes the reliability and accuracy of the specific use of the artificial intelligence in processing the evidence.

(c) Evidence is created, in whole or in part, by artificial intelligence where the artificial intelligence produces new information from existing information not present in or reasonably deducible from the existing information.

(d) Evidence is processed, in whole or in part, by artificial intelligence where the artificial intelligence produces a conclusion based off of its analysis, interpretation, or transformation of existing information where such conclusion is not reasonably deducible from the existing information.

(e) Evidence is not reasonably deducible from the existing information where the reliability or accuracy of the information created or conclusion drawn from the existing information would be substantially compromised without the use of artificial intelligence as a result of the complexity, uncertainty, or subtlety of the information.

(f) Evidence is substantially supported by independent and admissible evidence where:

1. The independent evidence is separate from, and not derived from, the artificial intelligence that generated the artificially created evidence;

2. The independent evidence is admissible under the existing rules of evidence;

3. The independent evidence bears a close and significant relationship to the artificially created evidence in such a manner that it reinforces or corroborates the information created from the artificially created evidence.

(g) The reliability and accuracy of the specific use of the artificial intelligence in creating or processing the evidence is sufficient where the proponent of the evidence has a qualified expert testify and such testimony is sufficient to prove that:

1. The specific use of the artificial intelligence has been validated through rigorous scientific or technical testing, demonstrating that it consistently produces accurate and reliable results in varied environments;

2. The artificial intelligence has been subjected to testing or application in environments that are similar or analogous to the specific context in which it is being used in the proceeding and such testing or application produced accurate and reliable results;

3. The artificial intelligence has not been subjected to any variables that, based on scientific or technical testing of the system, have a substantial probability of causing a materially inaccurate or unreliable result. In assessing the probability, the court shall consider the weight of the artificially created evidence relative to other admitted evidence.

(h) Where expert testimony would include trade secrets, privileged government information, or information about law enforcement techniques that, if disclosed, would unduly compromise their ability to effectively use their systems for their intended purpose, the court, in its discretion, may impose appropriate measures to protect such information.

§ 3. This act shall take effect on the first of January next succeeding the date on which it shall have become a law.

Reflowed for reading: line numbers and page breaks removed. Cite the official text.

Sponsor's memo

Title of bill

An act to amend the criminal procedure law and the civil practice law and rules, in relation to the admissibility of evidence created or proc- essed by artificial intelligence

Purpose or general idea of bill

Relates to the admissibility of evidence created or processed by artifi- cial intelligence.

Summary of specific provisions

60.80 (1),(2),(3),(4): Evidence 'created' versus 'processed' -- The primary distinction between evidence that was created or processed is the result of the system. If "new information" is generated from the AI, then it was "created." If a "conclusion" was generated from the AI, then it was "processed." "New information" is information that did not exist prior to the Al's intervention, while a "conclusion" is an interpreta- tion of the information that did exist.

Read the full memo (981 words)

60.80(5): "Reasonably deducible" -- There currently exist many forms of evidence analysis which use AI systems, but only as a means to achieve its ends more quickly. These would not fall under the standard set forth in this bill because the accuracy and reliability of the conclusions drawn, or information created by them, would not be substantially compromised if AI was not used. Instead, the AI simply makes the work more efficient.

60.80(6)(a): "The evidence is separate from, and not derived from, the artificially created evidence." - The evidence must be supported by something other than the artificially created evidence.

60.80(6) (b): The independent evidence must be admissible under the existing rules of evidence.

60.80(6)(c): "The independent evidence bears a close and significant relationship to the artificially created evidence in such a manner that it reinforces or corroborates the information created from the arti- ficially created evidence. -- Courts should only accept such evidence which corroborates the evidence or reinforces information. This inquiry is highly fact specific and can vary depending on other evidence presented.

60.80(7)(a): "The specific use case of the AI system must also be vali- dated through rigorous scientific or technical testing, demonstrating that it consistently produces accurate and reliable results in varied environments." -- The accuracy and reliability of the specific use case of the AI that is used in the case at hand can be determined by looking at prior testing of the AI system. This testing should be done in varied environments to ensure the highest probability of an accurate result regardless of the environment. The level of accuracy should be deter- mined on a case-by-case basis. Courts should not get caught up on the question of whether AI generated evidence should be admitted where the evidence has little weight considering the weight of other evidence.

60.80(7)(b): "The AI has been subjected to testing or application in environments that are similar or analogous to the specific context in which it is being used in the proceeding and such testing or application produced accurate and reliable results." - Courts must ask whether the AI has been used in the way that it is being used in a similar or analo- gous situation to the situation at hand. The "context" to which this part refers is the domain or set of circumstances in which the AI system is operating.

60.80(7)(c): "The AI has not been subjected to any variables that, based on scientific or technical testing of the system, have a substantial probability of causing a materially inaccurate or unreliable result. In assessing the probability, the court shall consider the weight of the artificially created evidence relative to other admitted evidence." -This is similar to the previous element, but with a minor but important difference. This element states that if we have knowledge of the fact that the AI system produces inaccurate or unreliable results when subjected to a certain variable, then the evidence should not be used. So, even if the AI is generally accurate, and even if it has been tested to be accurate in the given context, was a variable introduced that would cause an inaccuracy?

60.80(8): Permits the courts to limit the disclosure of certain informa- tion.

4551 - The same as the foregoing but as applied in the civil context.

Justification

Artificial intelligence (AI) systems are sophisticated technologies that can independently analyze data to generate novel conclusions and new information. As these technologies continue to advance in accuracy and capability, their use cases also expand. One crucial aspect that society must examine is Al's ability to create and process evidence for use in criminal and civil court proceedings.

A common challenge in many AI systems is known as the "black box" prob- lem. This complexity arises from the nature of Al's operation, partic- ularly within neural networks. These networks function as a series of interconnected processing units guiding the AI's operations and, in turn, undertake a process to generate an output or prediction based on given data.

The crux of the black box problem is that no one, not even the AI's programmers, can precisely understand how the AI reaches its conclusions from the data. This ambiguity introduces an issue with evidence created or processed entirely or partially by AI; we cannot discern how the AI arrived at a specific conclusion. However, through rigorous testing, we can Verify whether those conclusions are accurate and reliable.

This unique challenge posed by AI necessitates a reevaluation of how we approach evidence, particularly when we can't be certain of the steps involved in its creation or processing.

Therefore, this bill outlines the essential steps that must be undertak- en to ensure that no individual is unjustly penalized in a criminal or civil proceeding due to evidence created or processed by AI. It strives

to set a legal framework that both recognizes the potential of AI and safeguards the principles of justice.

Prior legislative history

New bill

Fiscal implications

TBD

Effective date

This act shall take effect on the first of January next succeeding the date on which it shall have become law.

Summaries, headlines and scores are AI-generated from the official bill text. How we score bills. Source: NYS Open Legislation.