What's happening
The bill requires New York state agencies to ensure human oversight, conduct impact assessments, and disclose use of automated decision-making systems affecting public rights or benefits.
Why it matters
Ensures human accountability. By requiring "meaningful human review" of any automated decision-making system (ADS) used in significant government functions, the bill aims to prevent unchecked algorithmic decisions, helping maintain transparency and public trust in state actions that affect individual rights or public benefits.
Protects against algorithmic discrimination. The bill mandates impact assessments that specifically test for accuracy, fairness, bias, and discrimination in automated systems. If any system is found to produce discriminatory or biased outcomes, agencies must immediately stop using it, directly confronting risks of technological bias in public services.
Safeguards worker rights. The legislation prohibits using automated systems to replace or displace existing state employees, or to transfer their duties to machines, thereby protecting jobs, collective bargaining rights, and employment conditions from being eroded by automation.
Mandates public disclosure and oversight. Agencies must submit detailed impact assessments to both state leadership and the public (with limited redactions for safety/privacy reasons), improving transparency around how and why these systems are used, what data they operate on, and what safeguards are in place to protect New Yorkers' rights.
Albany, before your first meeting.
Every bill that moved yesterday, summarized in a sentence and ranked by impact. The Albany Scorecard follows on Sundays.
Free. Unsubscribe in one click. Want alerts on specific bills? Create an account.
Who cares
State agencies and public authorities
They would face human-review requirements for covered automated decisions, recurring impact assessments and disclosure of existing systems to the legislature.
State employees and their unions
The bill would bar automated systems from displacing workers, reducing their hours or benefits, taking over their duties or impairing collective bargaining protections.
Recipients of state public assistance benefits
Automated decisions involving covered benefits would require ongoing review by trained people authorized to approve, deny or modify those decisions.
Civil rights and privacy advocates
Agencies would have to assess systems for discrimination and privacy risks, publish assessments subject to permitted redactions, and stop using systems found to produce biased or discriminatory outcomes.
Headline styles
Limit AI in Government
Plain English, a few words. Used as the page title.
Sponsors
History
- Approval memo.97
- Signed chap.674
- Delivered to governor
- Returned to senate
- Passed assembly
- Ordered to third reading rules cal.459
- Substituted for A9430B
- Referred to science and technology
- Delivered to assembly
- Passed senateVote 61–0
- Amended on third reading 7543b
- Advanced to third reading
Show 6 earlier actions
- 2nd report cal.
- 1st report cal.403
- Print number 7543a
- Amend and recommit to internet and technology
- Referred to internet and technology
- Referred to rules
Companion bill
The same bill in the other chamber. A bill becomes law when one version passes both houses and the governor signs it, so either number can carry it.
Monitor Government AI Decisions
Assembly Floor Calendar · Sponsor Steven Otis
Full text
4 pagesUnderlined is new[Struck] is removedOfficial text on nysenate.gov ↗
STATE OF NEW YORK
7543--B Cal. No. 403
2023-2024 Regular Sessions
IN SENATE
June 5, 2023
Introduced by Sens. GONZALEZ, BRISPORT, COMRIE, COONEY, GOUNARDES, HARCKHAM, JACKSON, KRUEGER, LIU, MYRIE, PARKER, SALAZAR, SCARCELLA-SPANTON, SEPULVEDA, THOMAS -- read twice and ordered printed, and when printed to be committed to the Committee on Rules… Show allHide
Introduced by Sens. GONZALEZ, BRISPORT, COMRIE, COONEY, GOUNARDES, HARCKHAM, JACKSON, KRUEGER, LIU, MYRIE, PARKER, SALAZAR, SCARCELLA-SPANTON, SEPULVEDA, THOMAS -- read twice and ordered printed, and when printed to be committed to the Committee on Rules -recommitted to the Committee on Internet and Technology in accordance with Senate Rule 6, sec. 8 -- committee discharged, bill amended, ordered reprinted as amended and recommitted to said committee -reported favorably from said committee, ordered to first and second report, ordered to a third reading, amended and ordered reprinted, retaining its place in the order of third reading
AN ACT to amend the state technology law, in relation to automated decision-making by state agencies
The People of the State of New York, represented in Senate and Assembly, do enact as follows:
Section 1. Short title. This act shall be known and may be cited as the "legislative oversight of automated decision-making in government act (LOADinG Act)".
§ 2. The state technology law is amended by adding a new article 4 to read as follows:
ARTICLE IV
AUTOMATED DECISION-MAKING IN STATE GOVERNMENT Section 401. Definitions.
402. Use of automated decision-making systems by agencies.
403. Impact assessments.
404. Submission to the governor and legislature.
§ 401. Definitions. For the purpose of this article:
1. "Automated decision-making system" shall mean any software that uses algorithms, computational models, or artificial intelligence techniques, or a combination thereof, to automate, support, or replace human decision-making and shall include, without limitation, systems that process data, and apply predefined rules or machine learning algorithms
EXPLANATION--Matter in italics (underscored) is new; matter in brackets
[ ] is old law to be omitted.
LBD11734-11-4
to analyze such data, and generate conclusions, recommendations, outcomes, assumptions, projections, or predictions without meaningful human discretion. "Automated decision-making system" shall not include any software used primarily for basic computerized processes, such as calculators, spellcheck tools, autocorrect functions, spreadsheets, electronic communications, or any tool that relates only to internal management affairs such as ordering office supplies or processing payments, and that do not materially affect the rights, liberties, benefits, safety or welfare of any individual within the state.
2. "Meaningful human review" means review, oversight and control of the automated decision-making process by one or more individuals who understand the risks, limitations, and functionality of, and are trained to use, the automated decision-making system and who have the authority to intervene or alter the decision under review, including but not limited to the ability to approve, deny, or modify any decision recommended or made by the automated system.
3. "State agency" shall mean any department, public authority, board, bureau, commission, division, office, council, committee or officer of the state. Such terms shall not include the legislature or judiciary.
4. "Public assistance benefit" shall mean any service or program within the control of the state, or benefit provided by the state to individuals or households, including but not limited to public assistance, cash assistance, grants, child care assistance, housing assistance, unemployment benefits, transportation benefits, education assistance, domestic violence services, and any other assistance or benefit within the authority of the state to grant to individuals within the state. This shall not include any federal program that is administered by the federal government or the state.
§ 402. Use of automated decision-making systems by agencies. 1. No state agency, or any entity acting on behalf of such agency, which utilizes or applies any automated decision-making system, directly or indirectly, in performing any function that: (a) is related to the delivery of any public assistance benefit; (b) will have a material impact on the rights, civil liberties, safety or welfare of any individual within the state; or (c) affects any statutorily or constitutionally provided right of an individual, shall utilize such automated decisionmaking system, unless such automated decision-making system is subject to continued and operational meaningful human review.
2. No state agency shall authorize any procurement, purchase or acquisition of any service or system utilizing, or relying on, automated decision-making systems in performing any function that is: (a) related to the delivery of any public assistance benefit; (b) will have a material impact on the rights, civil liberties, safety or welfare of any individual within the state; or (c) affects any statutorily or constitutionally provided right of an individual unless such automated decision-making system is subject to continued and operational meaningful human review.
3. The use of an automated decision-making system shall not affect (a) the existing rights of employees pursuant to an existing collective bargaining agreement, or (b) the existing representational relationships among employee organizations or the bargaining relationships between the employer and an employee organization. The use of an automated decision-making system shall not result in the: (1) discharge, displacement or loss of position, including partial displacement such as a reduction in the hours of non-overtime work, wages, or employment benefits, or result in the impairment of existing collective bargaining agreements; (2) transfer of existing duties and functions currently performed by employees of the state or any agency or public authority thereof to an automated decision-making system; or (3) transfer of future duties and functions ordinarily performed by employees of the state or any agency or public authority. The use of an automated decision-making system shall not alter the rights or benefits, and privileges, including but not limited to terms and conditions of employment, civil service status, and collective bargaining unit membership status of all existing employees of the state or any agency or public authority thereof shall be preserved and protected.
§ 403. Impact assessments. 1. State agencies seeking to utilize or apply an automated decision-making system permitted under section four hundred two of this article with continued and operational meaningful human review shall conduct or have conducted an impact assessment substantially completed and bearing the signature of one or more individuals responsible for meaningful human review for the lawful application and use of such automated decision-making system. Following the first impact assessment, an impact assessment shall be conducted in accordance with this section at least once every two years. An impact assessment shall be conducted prior to any material change to the automated decision-making system that may change the outcome or effect of such system. Such impact assessments shall include:
(a) a description of the objectives of the automated decision-making system;
(b) an evaluation of the ability of the automated decision-making system to achieve its stated objectives;
(c) a description and evaluation of the objectives and development of the automated decision-making including:
(i) a summary of the underlying algorithms, computational modes, and artificial intelligence tools that are used within the automated decision-making system; and
(ii) the design and training data used to develop the automated decision-making system process;
(d) testing for:
(i) accuracy, fairness, bias and discrimination, and an assessment of whether the use of the automated decision-making system produces discriminatory results on the basis of a consumer's or a class of consumers' actual or perceived race, color, ethnicity, religion, national origin, sex, gender, gender identity, sexual orientation, familial status, biometric information, lawful source of income, or disability and outlines mitigations for any identified performance differences in outcomes across relevant groups impacted by such use;
(ii) any cybersecurity vulnerabilities and privacy risks resulting from the deployment and use of the automated decision-making system, and the development or existence of safeguards to mitigate the risks;
(iii) any public health or safety risks resulting from the deployment and use of the automated decision-making system;
(iv) any reasonably foreseeable misuse of the automated decision-making system and the development or existence of safeguards against such misuse;
(e) the extent to which the deployment and use of the automated decision-making system requires input of sensitive and personal data, how that data is used and stored, and any control users may have over their data; and
(f) the notification mechanism or procedure, if any, by which individuals impacted by the utilization of the automated decision-making system may be notified of the use of such automated decision-making system and of the individual's personal data, and informed of their rights and options relating to such use.
2. Notwithstanding the provisions of this article or any other law, if an impact assessment finds that the automated decision-making system produces discriminatory or biased outcomes, the state agency shall cease any utilization, application, or function of such automated decisionmaking system, and of any information produced using such system.
§ 404. Submission to the governor and legislature. 1. Each impact assessment conducted pursuant to this article shall be submitted to the governor, the temporary president of the senate, and the speaker of the assembly at least thirty days prior to the implementation of the automated decision-making system that is the subject of such assessment.
2. (a) The impact assessment of an automated decision-making system shall be published on the website of the relevant state agency.
(b) If the state agency makes a determination that the disclosure of any information required in the impact assessment would result in a substantial negative impact on health or safety of the public, infringe upon the privacy rights of individuals, or significantly impair the state agency's ability to protect its information technology or operational assets, such state agency may redact such information, provided that an explanatory statement on the process by which the state agency made such determination is published along with the redacted impact assessment.
(c) If the impact assessment covers any automated decision-making system that includes technology that is used to prevent, detect, protect against or respond to security incidents, identity theft, fraud, harassment, malicious or deceptive activities or other illegal activity, preserve the integrity or security of systems, or to investigate, report or prosecute those responsible for any such malicious or deceptive action, such state agency may redact such information for the purposes of this subdivision, provided that an explanatory statement on the process by which the state agency made such determination is published along with the redacted impact assessment.
§ 3. Disclosure of existing automated decision-making systems. Any state agency, that directly or indirectly, utilizes an automated decision-making system, as defined in section 401 of the state technology law, shall submit to the legislature a disclosure on the use of such system, no later than one year after the effective date of this section. Such disclosure shall include:
(a) a description of the automated decision-making system utilized by such agency;
(b) a list of any software vendors related to such automated decision-making system;
(c) the date that the use of such system began;
(d) a summary of the purpose and use of such system, including a description of human decision-making and discretion supported or replaced by the automated decision-making system;
(e) whether any impact assessments for the automated decision-making system were conducted and the dates and summaries of the results of such assessments where applicable; and
(f) any other information deemed relevant by the agency.
§ 4. This act shall take effect immediately, provided that section two of this act shall take effect one year after it shall have become a law.
Reflowed for reading: line numbers and page breaks removed. Cite the official text.
Sponsor's memo
Title of bill
An act to amend the state technology law, in relation to automated deci- sion-making by state agencies
Purpose
This bill would require the disclosure of automated decision-making systems already in use, prohibit the unauthorized use of automated deci- sion-making systems by state agencies or entities on behalf of an agency without meaningful human review and, when authorized, require the publi- cation of an impact assessment.
Summary of provisions
Section 1. Provides the title, which is the "legislative oversight of automated decision-making in government act (LOADinG Act)."
Read the full memo (641 words)
Section 2. Adds new article 4 to the technology law to prohibit any state agency or entity acting on behalf of any agency from directly or indirectly using automated decision-making systems in relation to the delivery of any public assistance benefit or in circumstances that impact the rights, civil liberties, safety, or welfare of an individual unless such system is subject to meaningful human review. Further prohibits the procurement or acquisition of any service or system rely- ing on automated decision-making systems without meaningful human review. If authorized, the agency is required to complete an impact assessment once every two years that includes a description of the objectives and the development of the technology and testing of its accuracy, fairness, and possible biases that could lead to discriminato- ry outcomes. If such impact assessment finds that the automated deci- sion-making system produces discriminatory or biased outcomes, the agen- cy shall not use the system. The impact assessment would be made public on the agency website and sent to the governor, the temporary president of the senate, and the speaker of the assembly at least 30 days prior to any use or implementation. Allows agencies to redact information in certain cases when publishing publicly.
Section 3. Requires disclosure of certain information about automated decision-making systems already in use by any state agency, including a description of the system, software vendors related to the system, the date use began, the purpose and use of the system, whether any impact assessments have been carried out, and any other information that the agency deems necessary.
Section 4. Effective date.
Justification
In New York State and worldwide, artificial intelligence, algorithms, and computational modeling services have recently exploded onto the market and have become fully-integrated tools for many individuals and companies alike, often automating certain historically human-conducted decision-making tasks and functions to boost productivity. However, these systems come with significant risks to security and privacy, unknown malfunctions, and the demonstrated potential for discrimination to occur due to biases in their development and operation. As these technologies continue to mature, more use cases evolve, and direct costs of use diminish, it is paramount that the duties of the state to the public are reaffirmed, especially when individuals' constitutional and statutory rights are involved.
This legislation sets a necessary prohibition on the unauthorized use of these services by state agencies, and, when authorized, requires the publication of an impact assessment detailing the development of the service and requires thorough testing of its biases and discrimination against actual or perceived race, color, ethnicity, religion, national origin, sex, gender, gender identity, sexual orientation, familial status, biometric information, lawful source of income, or disability. Finally, the bill prohibits the state from using discriminatory auto- mated decision-making systems.
To minimize disruption of state operations that already rely on these technologies, existing automated decision-making systems must be disclosed to the legislature within one year. After one year, existing uses will be subject to the same requirements as any new automated deci- sion-making system.
Legislative history
2024: S7543 - Referred to Internet &Technology
2023: S7543 - Referred to Rules
Fiscal implications
To be determined.
Effective date
This act shall take effect immediately, provided that section two of this act shall take effect one year after it shall have become a law.
Summaries, headlines and scores are AI-generated from the official bill text. How we score bills. Source: NYS Open Legislation.