Government Tightens Grip: New IT Rules To Regulate AI‑Generated Content On Social Media

Introduction

In February 2026, the Government of India, through the Ministry of Electronics and Information Technology (MeitY), officially notified amendments to the Information Technology (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021. These amendments target the rising challenge of AI‑generated content and synthetic media — especially deepfakes — on social media platforms. The updated framework brings rigorous compliance requirements for platforms like Facebook, Instagram, YouTube, X, WhatsApp, and others.

AI‑generated content refers to any audio, visual, or audiovisual information created, modified or altered using artificial intelligence technologies that appear real, authentic, or indistinguishable from genuine content. Under the new rules, platforms must adopt rapid takedowns, mandatory labeling, and transparency mechanisms.

Definition and Scope of AI‑Generated Content

One of the most significant shifts in the amendments is the clear legal definition of AI‑generated content (also called synthetically generated information). According to the notification, this includes any content — video, audio, image, or mixed media — that is artificially created or altered using computer resources in a way that it appears real or authentic.

This means that deepfake videos, AI‑manipulated images, voice‑cloned audio, and other synthetic media fall under the regulatory ambit. Routine edits like color correction, filtering, formatting, or accessibility improvements are excluded, provided they do not materially distort the original content.

By expanding the definition of AI‑generated content, the government ensures all such material is treated with the same level of regulation as other online information.

Mandatory AI Labels and Transparency

Under the new IT Rules, digital platforms are now obliged to clearly label AI‑generated content. This includes photos, videos, and audio files that have been synthesized or manipulated with AI.

Key labeling requirements include:

Labels or audio disclosures must be prominent and visible so users can easily distinguish AI‑generated content from real content.
Metadata or unique identifiers should be embedded in the file to preserve the provenance and traceability of the AI‑generated content.
Platforms cannot remove or suppress AI labels or metadata once applied.
Users who upload content must declare whether the content is AI‑generated, and platforms must implement automated tools to verify these declarations where technically feasible.

These measures aim to enhance user awareness and reduce misinformation arising from undisclosed AI content.

Three‑Hour Takedown Rule

Arguably the most stringent compliance requirement in the updated IT Rules is the three‑hour takedown timeline for harmful AI‑generated content. Under the amendments:

Platforms must remove or disable access to flagged unlawful synthetic content, including deepfakes, within three hours of receiving a government or court order.
This replaces the previous 36‑hour period, drastically shortening the window available to intermediaries for compliance.

The intent is to prevent the viral spread of misinformation or unlawful material across social networks, but critics argue that such strict timelines may not always be feasible, especially at scale.

User Rights, Obligations, and Penalties

The amended rules clearly outline rights and obligations for social media users and platforms, including:

Mandatory user declarations: Users must confirm whether uploaded content is AI‑generated. Platforms may verify this using technical tools.
Periodic warnings: Platforms must notify users — at least every three months — about consequences of violating terms or sharing unlawful content, including AI‑generated content.
Penalties for non‑compliance: Failure to comply with these obligations can lead to loss of safe harbour protection, civil penalties, ethical liability, or even criminal sanctions under applicable laws.

Such provisions ensure platforms take proactive steps, rather than wait passively for government or user flags.

The updated IT Rules represent a major increase in regulatory pressure on significant social media intermediaries (SSMIs) — those with over 5 million users.

Reported impacts include:

Higher compliance costs: Platforms must invest in AI moderation tools, rapid response workflows, and metadata systems.
Operational challenges: Meeting three‑hour takedown timelines at scale poses infrastructure and logistical issues.
Greater legal risk: Loss of safe harbour protections means platforms may now be legally liable for hosting undisclosed AI‑generated content.

Industry stakeholders have urged the government to reconsider some obligations, citing feasibility and the potential for over‑enforcement.

Also Read: Airtel Deploys Advanced AI to Prevent OTP Fraud During Suspicious Calls

Balancing Regulation and Innovation

While the government’s goal is to curb harmful synthetically generated material and misinformation, questions remain about how these rules will affect AI innovation, free expression, and platform dynamics.

Supporters argue that the rules will:

Enhance digital transparency and trust.
Protect users from deception, identity misuse, and fraudulent deepfakes.

Critics, however, caution that:

Strict obligations may lead to over‑censorship or blanket removals.
Automated detection systems still struggle with accuracy, potentially mislabeling benign content.
Short compliance windows could strain smaller platforms.

The balance between curbing harmful synthetic content and preserving an open digital ecosystem will be closely watched in the coming months.

Conclusion

The Indian government’s decision to tighten regulation around AI‑generated content marks a major shift in content governance. By defining synthetic media clearly, mandating labeling and metadata, shortening takedown timelines, and imposing accountability on platforms, the amended IT Rules seek to reduce misinformation and protect users.

However, the new framework also raises challenges for implementation, innovation, and free speech — especially as AI continues to evolve quickly. Whether these rules will effectively curb harmful AI content without stifling digital creativity remains a key question for policymakers, platforms, and users alike.