FTFuture Technology
AI

Instagram Is Cracking Down on Undisclosed AI Profiles

· 2 min read · By Nath Connell

Key takeaways

  • Instagram is restricting undisclosed AI profiles from direct messaging non-followers, running certain ads, and appearing in recommendations without labels
  • Account-level AI labels will now persist on profiles, not just individual posts
  • Enforcement will combine automated detection with user reporting, meaning the platform is partly using AI to catch AI accounts

Instagram has announced new restrictions on AI-generated profiles that don't clearly disclose their artificial nature. The platform is rolling out updated rules that limit what undisclosed AI accounts can do, a move that comes after months of growing pressure from regulators, creators, and users who have found themselves interacting with bots they believed were real people.

This matters because the problem has become genuinely significant. AI-generated social media accounts have exploded in sophistication over the past two years. Where early AI bots produced obviously stilted text and stock photos, modern AI profiles can maintain coherent personas across months of posting, respond contextually to comments, generate photorealistic images of non-existent people, and build follower counts that look legitimate to casual inspection.

What the New Rules Actually Do

Instagram's new limits reportedly restrict undisclosed AI profiles from direct messaging users who don't follow them, from running certain types of advertising, and from appearing in recommended content feeds without a clear disclosure label. The platform is also expanding its AI-content labelling system to cover accounts rather than just individual posts, meaning an account that is primarily AI-operated will carry a persistent label visible to anyone who visits its profile.

The enforcement mechanism is where things get interesting. Instagram says it will use a combination of automated detection and user reporting to identify accounts that are operating without proper disclosure. That's a meaningful admission that the platform knows it cannot manually review the sheer volume of new accounts being created, and that it is relying partly on its own AI to catch AI.

For creators who have been using AI tools to assist with content production, these rules create some grey areas. A human creator who uses AI to generate images or draft captions but who is genuinely the creative and strategic force behind an account is in a very different category from a fully automated profile with no human involvement. Instagram will need to draw that line clearly, and quickly.

The future, in 3 minutes a day. The biggest tech story explained every morning, free. Get the briefing →

Why Now?

The timing here is not accidental. The European Union's Digital Services Act has been pushing platforms to be more transparent about automated accounts since 2024. In the United States, several states have introduced or passed bills requiring disclosure of AI-generated content, particularly in advertising and political communications. Meta, Instagram's parent company, has been navigating this regulatory patchwork while trying not to restrict the AI creator tools that are genuinely popular with its user base.

There's also a trust issue that Meta clearly wants to get ahead of. Research published earlier this year found that a significant portion of users who had interacted with AI profiles on major social platforms did not know the account was artificial. That kind of erosion of trust is bad for engagement metrics long-term, even if individual AI accounts drive short-term interaction.

What This Means for Creators and Brands

If you manage a brand account on Instagram and you use AI tools as part of your workflow, now is the time to audit how you're disclosing that. The rules are shifting in a direction that will only get stricter, not looser. Voluntary early compliance is almost always cheaper than being caught out and facing platform penalties later.

For regular users, the changes should mean fewer surprise encounters with accounts that turn out to be automated. Whether Instagram's enforcement will be robust enough to actually deliver that remains to be seen, but the direction of travel is right. Social media platforms hosting large populations of undisclosed AI personas is a genuinely weird situation that most users never signed up for.

Sources

Get the briefing, free

The biggest tech story, explained in 3 minutes every weekday. Choose your briefings →

Free. No spam. Unsubscribe in one click.