What's happening
The Stop Deepfakes Act requires AI content creators to include provenance data on synthetic digital content and mandates preservation of this data on social media, with enforcement by the Attorney General.
Why it matters
Enhances transparency and trust in digital media. By mandating the inclusion and preservation of provenance data on AI-generated or altered content, the bill helps users distinguish between authentic and synthetic media, potentially reducing the spread of misinformation and deepfakes.
Creates accountability for AI and social media companies. Synthetic content creation system providers and hosting platforms must comply with technical standards for tagging and tracking synthetic content, shifting some responsibility for content authenticity onto technology providers rather than solely end users.
Empowers law enforcement to take proactive action. The Attorney General is authorized to seek injunctions and impose significant civil penalties for violations, allowing for swift intervention to halt the distribution of unlabeled or deceptive synthetic content.
Sets a precedent for public sector transparency. By requiring New York state agencies to label and disclose the use of AI in their digital output, the law could set a model for government accountability and inform future policy on AI transparency nationwide.
Albany, before your first meeting.
Every bill that moved yesterday, summarized in a sentence and ranked by impact. The Albany Scorecard follows on Sundays.
Free. Unsubscribe in one click. Want alerts on specific bills? Create an account.
Who cares
Developers and Providers of Synthetic Content Creation Systems
Companies and individuals who build or distribute generative AI models that create images, audio, video, or other digital content must implement provenance data standards and ensure compliance with new labeling and tracking requirements.
Social Media Platforms
Platforms operating in New York must preserve provenance data on user-uploaded content, adapt their systems to avoid stripping such data, and ensure compliance with content authenticity regulations.
State Agencies
Government departments and agencies in New York are required to attach and maintain provenance data on all electronically published or distributed audiovisual materials, affecting their workflows and technology procurement.
New York Residents and Digital Content Consumers
Individuals who use or are exposed to synthetic media will benefit from enhanced transparency about the origins and authenticity of digital content, which could help combat misinformation and deepfakes.
Headline styles
Require AI Content Labels
Plain English, a few words. Used as the page title.
Sponsors
1 Co-sponsor
History
- Returned to senate
- Passed assembly
- Ordered to third reading cal.163
- Substituted for A6540E
- Referred to codes
- Delivered to assembly
- Passed senateVote 60–1
- Amended on third reading 6954b
- Advanced to third reading
- 2nd report cal.
- 1st report cal.432
- Referred to internet and technology
Show 12 earlier actions
- Returned to senate
- Died in assembly
- Ordered to third reading rules cal.900
- Substituted for A6540C
- Referred to codes
- Delivered to assembly
- Passed senateVote 58–1
- Amended on third reading (t) 6954a
- Advanced to third reading
- 2nd report cal.
- 1st report cal.1509
- Referred to internet and technology
Companion bill
The same bill in the other chamber. A bill becomes law when one version passes both houses and the governor signs it, so either number can carry it.
Require AI Content Labels
Assembly Floor Calendar · Sponsor Alex Bores
Full text
5 pagesUnderlined is new[Struck] is removedOfficial text on nysenate.gov ↗
STATE OF NEW YORK
6954--B Cal. No. 432
2025-2026 Regular Sessions
IN SENATE
March 27, 2025
Introduced by Sen. GOUNARDES -- read twice and ordered printed, and when printed to be committed to the Committee on Internet and Technology -reported favorably from said committee, ordered to first and second report, ordered to a third reading, amended and… Show allHide
Introduced by Sen. GOUNARDES -- read twice and ordered printed, and when printed to be committed to the Committee on Internet and Technology -reported favorably from said committee, ordered to first and second report, ordered to a third reading, amended and ordered reprinted, retaining its place in the order of third reading -- recommitted to the Committee on Internet and Technology in accordance with Senate Rule 6, sec. 8 -- reported favorably from said committee, ordered to first and second report, ordered to a third reading, amended and ordered reprinted, retaining its place in the order of third reading
AN ACT to amend the general business law, in relation to requiring synthetic content creations system providers to include provenance data on synthetic content produced or modified by a synthetic content creations system that the synthetic content creations system provider makes available
The People of the State of New York, represented in Senate and Assembly, do enact as follows:
Section 1. This act shall be known and may be cited as the "stop deepfakes act".
§ 2. The general business law is amended by adding a new article 45-C to read as follows:
ARTICLE 45-C
STOP DEEPFAKES ACT Section 1550. Definitions.
1551. Synthetic content creations system.
1552. Content provenance preservation.
1553. Provenance data requirements.
1554. Enforcement by attorney general.
§ 1550. Definitions. For the purposes of this article:
1. "Provenance data" means data that records the origin or history of digital content and is communicated as a content credential or via another substantially similar method, pursuant to either the Technical
EXPLANATION--Matter in italics (underscored) is new; matter in brackets
[ ] is old law to be omitted.
LBD07930-27-6
Specification for Content Credentials published by the Coalition for Content Provenance and Authenticity, or pursuant to relevant standards, guidelines or specifications which adopt generally accepted security best practices and are published by an established standards setting body. Such data must at a minimum communicate: (a) information about the origin or creation of the content; (b) subsequent editing or modification to the content or its metadata; and (c) use of a synthetic content creations system in generating or modifying the content. Such data shall be cryptographically bound to the underlying file and use signing credentials whenever the medium of the synthetic content permits such binding credentials. "Provenance data" shall not include personal information as defined in subdivision five of section two hundred two of the state technology law, or unique device, system, or service information that is reasonably capable of being associated with a particular user, including but not limited to an internet protocol address, unless a user chooses to include such personal information in such data described in paragraph (a), (b), or (c) of this subdivision.
2. "Generative artificial intelligence system" means a class of artificial intelligence system that is self-supervised and emulates the structure and characteristics of input data to generate derived synthetic content, including, but not limited to, images, videos, audio, text, and other digital content.
3. "Synthetic content" means audio or visual content that has been generated or materially modified by a synthetic content creations system.
4. "State agency" has the same meaning as defined in subdivision six of section two hundred two of the state technology law.
5. "Synthetic content creations system provider" means an organization or individual that creates, codes, substantially modifies, or otherwise produces a synthetic content creations system that is made publicly available for use by a New York resident, regardless of whether the terms of such use include compensation.
6. "Synthetic content creations system hosting platform" means an online repository or other website, other than the synthetic content creations system provider, that makes a synthetic content creations system available for use by a New York resident, regardless of whether the terms of such use include compensation. Synthetic content creations system hosting platform does not include a cloud computing platform or other service insofar as such cloud computing platform or other service makes synthetic content creations systems available for use by a New York state resident solely at the direction of others.
7. "Social media platform" shall have the same meaning as in section eleven hundred of this chapter.
8. "Artificial intelligence" or "artificial intelligence technology" means a machine-based system that can, for a given set of human-defined objectives, make predictions, recommendations, or decisions influencing real or virtual environments, and that uses machine- and human-based inputs to perceive real and virtual environments, abstract such perceptions into models through analysis in an automated manner, and use model inference to formulate options for information or action.
9. "Synthetic content creations system" means a class of generative artificial intelligence system capable of generating wholly synthetic content.
10. "File-sharing platform" means an online service for which a primary function is to enable users to upload files and make such files available for access, discovery, or download by users who did not create or collaborate in creating the content, including through public links, browsing interfaces, or similar distribution features.
11. "Mass messaging platform" means a public-facing direct messaging platform that allows users to distribute content to more than one hundred users simultaneously.
12. "Large online platform" means a social media platform, file-sharing platform, mass messaging platform, or stand-alone search engine that distributes content to users who did not create or collaborate in creating the content. A "large online platform" does not include:
(a) broadband, broadband service or broadband internet, as defined in paragraph (b) of subdivision two of section sixteen-gg of the New York state urban development corporation act, as added by section two of part MMM of chapter fifty-eight of the laws of two thousand twenty-two; or
(b) a telecommunications service, as defined in section 153 of title 47 of the United States code.
(c) Any infrastructure as a service or platform as a service, as those terms are defined in the National Institute of Standards and Technology's Special Publication 800-145, and any subsequent version of such publication.
§ 1551. Synthetic content creations system. 1. A synthetic content creations system provider shall apply provenance data, either directly or through the use of third-party technology, to synthetic content produced or modified by a synthetic content creations system that the synthetic content creations system provider makes available; provided, however, that this obligation shall not apply to the extent the synthetic content creations system performs an assistive function for standard editing or does not substantially alter the input data provided by the deployer or the semantics thereof.
2. The application of provenance data to synthetic content, as required by this section, shall, at a minimum, identify the digital content as synthetic and communicate the following provenance data:
(a) that the content was created or edited using artificial intelligence;
(b) the name of the synthetic content creations system provider;
(c) the time and date the provenance data was applied;
(d) to the extent technically feasible, the specific portions of the content that the synthetic content creations system generated; and
(e) the type of device, system, or service that was used to generate the image, audio, or video.
3. Synthetic content creations system hosting platforms shall not make available a synthetic content creations system where the hosting platform knows that the synthetic content creations system provider for such system does not apply provenance data to content created or substantially modified by the artificial intelligence system in a manner consistent with specifications set forth in this section, nor shall a synthetic content creations system hosting platform deliberately prevent a synthetic content creations system provider from applying provenance data to content created or substantially modified by a synthetic content creations system in a manner consistent with the specifications set forth above.
4. The provisions of this section shall only apply to synthetic content creations systems that were created or modified after the effective date of this article.
§ 1552. Content provenance preservation. 1. A large online platform shall not delete, disassociate, or degrade, in whole or in part, provenance data from or associated with content uploaded to the large online platform, unless and until such content is permanently deleted or removed from the large online platform or the deletion, disassociation, or degradation of such content is required by law. Nothing in this article shall be construed as prohibiting users from choosing to include personal information in provenance data from or associated with such uploaded content.
2. (a) A large online platform shall be required to surface latent provenance data with either content that is an image, video, or audio, or content that is any combination thereof, that is:
(i) Clear, conspicuous, appropriate for the medium of the content and understandable to a reasonable natural person; and
(ii) Permanent or extraordinarily difficult to remove or modify.
(b) Such surfacing of latent provenance data shall include, to the extent such information is available and reliable in conformance with security best practices via the provenance data, the following information:
(i) Whether or not the content was created or modified using a synthetic content creations system;
(ii) The name of the synthetic content creations system provider used, if any;
(iii) The time and date the provenance data was applied;
(iv) The type of device, system, or service that was used to generate the image, audio, or video;
(v) The name of the tool used to apply the provenance data; and
(vi) The specific portions of the content that the synthetic content creations system generated, if any.
(c) This subdivision shall not apply to file sharing platforms that are designed primarily for file storage or collaboration within a defined organization, workspace, or group of users in which access to files is limited through permission-based or invitation-only controls, or where content is not routinely surfaced or distributed to the general public, nor shall this subdivision apply to mass messaging platforms that are designed primarily for communication within a defined organization, workspace, or group where participation is limited through permission-based or invitation-only controls and where messages on such platform are not routinely distributed or surfaced to the general public.
§ 1553. Provenance data requirements. 1. A state agency shall ensure, to the extent practicable either through direct application or through the use of third-party technology, that all audio, images and videos published or distributed electronically by the state agency carry provenance data.
2. The application of provenance data to audio, images and videos, as required by this article, shall, at a minimum, communicate the following provenance data:
(a) The type of device, system, or service that was used to generate the audio, image or video, to the extent the device, system, or service has the technical capability to do so;
(b) The specific portions of the content that the synthetic content creations system used by the state agency generated, if any;
(c) Whether the content was created or edited using artificial intelligence;
(d) The name of the synthetic content creations system provider used to generate the synthetic content, if any; and
(e) The time and date any of the provenance data delineated in this section was applied.
§ 1554. Enforcement by attorney general. In addition to the other remedies provided, whenever there shall be a violation of this article, application may be made by the attorney general in the name of the people of the state of New York to a court or justice having jurisdiction by a special proceeding to issue an injunction, and upon notice to the defendant of not less than five days, to enjoin and restrain the continuance of such violations; and if it shall appear to the satisfaction of the court or justice that the defendant has, in fact, violated this article, an injunction may be issued by such court or justice, enjoining and restraining any further violation, without requiring proof that any person has, in fact, been injured or damaged thereby. In any such proceeding, the court may make allowances to the attorney general as provided in paragraph six of subdivision (a) of section eighty-three hundred three of the civil practice law and rules. Whenever the court shall determine that a violation of this article has occurred, the court may impose a civil penalty of not more than twenty-five thousand dollars for each violation.
§ 3. This act shall take effect on the one hundred eightieth day after it shall have become a law.
Reflowed for reading: line numbers and page breaks removed. Cite the official text.
Sponsor's memo
Title of bill
An act to amend the general business law, in relation to requiring synthetic content creations system providers to include provenance data on synthetic content produced or modified by a synthetic content creations system that the synthetic content creations system provider makes available
Purpose or general idea of bill
To require synthetic content creation system providers to apply prove- nance data to synthetic content produced by their systems
Summary of provisions
Section one of this bill names it the Stop Deepfakes Act
Section two of the bill adds a new Article 45-B to General Business Law (GBL) to establish the Stop Deepfakes Act.
Section 1540 of Article 45-B provides definitions.
Section 1541 of Article 45-B implements requirements for synthetic content creation providers and requires the attachment of metadata consistent with the standards set by the Coalition for Content Prove- nance and Authenticity or an equivalent standard.
Section 1542 of Article 45-B establishes that large online platforms may not remove metadata attached to uploaded content and must prominently surface latent provenance data where it is detected.
Section 1543 of Article 45-B implements requirements for state agencies to adopt metadata attachment mechanisms to the extent practicable.
Section 1544 establishes enforcement by the NYS Attorney General.
Section three of this bill sets the effective date.
Justification
This legislation seeks to ensure transparency and accountability in the use of generative artificial intelligence (AI) by requiring the attach- ment and preservation of metadata by synthetic content creation systems, large public-facing platforms, and state agencies. The rapid advancement of AI technologies has made it increasingly difficult for consumers to distinguish between human-created and AI-generated content, raising concerns about misinformation, manipulation, and the erosion of trust in digital media. By mandating that AI providers include clear provenance data, this bill will enable the public to identify the origins and alterations of AI-generated content. The bill would only impose obli- gations on companies that provide users synthetic content and would not impose obligations on companies that merely make available model weights or source code. Companies would also not have to attach this kind of data to types of files which cannot support it.
In line with current industry best practices, this light-touch bill would help establish clear demarcations between what is real and fake online. The data attached would be embedded within the content itself, allowing for an icon, tag, or other visible manifestation of detected provenance data that would, by default, come with all AI-generated or -modified content. The Stop Deepfakes Act imposes three requirements synthetic content creation providers have to attach metadata, large online platforms have to preserve metadata, and state agencies have to attach the data to the extent practicable.
This kind of data is attached to images, videos, and audio all the time, and thus it is a relatively small burden to add a bit more data to ensure that AI-generated content is clearly indicated.
Prior legislative history
2025: Passed Senate, ordered to Third Reading in Assembly
Fiscal implications
TBD
Effective date
This act shall take effect on the one hundred eightieth day after it shall have become a law.
Summaries, headlines and scores are AI-generated from the official bill text. How we score bills. Source: NYS Open Legislation.