The adult chat bots lurking in the toy aisle

nbcnews.com·By Jared Perlo and Kevin Collier
View original article
0out of 100
Elevated — multiple influence tactics active

This article wants you to believe that major AI companies are not doing enough to protect kids from harmful AI in toys, mainly because they don't properly oversee other companies using their AI. It uses strong, emotional language and relies heavily on statements from a consumer watchdog group to make you feel concerned about children's safety and push for stricter rules.

FATE Analysis

Four dimensions of psychological manipulation: how content captures Focus, exploits Authority, triggers Tribal identity, and engineers Emotion.

Focus5/10Authority6/10Tribe4/10Emotion7/10
FFocus
0/10
AAuthority
0/10
TTribe
0/10
EEmotion
0/10

Focus signals

unprecedented framing
"A report released Tuesday by a consumer watchdog found that more than two dozen toys advertised online were marketed as being powered by leading AI models, despite restrictions meant to stop children from using them."

This establishes a sense that a new and concerning issue has been 'found' and reported, suggesting a novel problem that warrants attention.

novelty spike
"The AI boom has created a new market for a wide variety of products infused with leading chatbots as tech companies compete to attract developers."

This highlights the 'new market' and 'boom' around AI, presenting it as a rapidly evolving and therefore captivating area of concern.

Authority signals

institutional authority
"The report from the U.S. Public Interest Research Group Education Fund (PIRG)"

Leverages the institutional weight and credibility of a 'Public Interest Research Group' to validate the claims made in the article.

expert appeal
""You have AI companies that say their models, on their own, are not for kids," R.J. Cross, lead author of the report and a researcher at PIRG, told NBC News."

Quotes the 'lead author' and 'researcher' from the authoritative group, presenting his statements as expert conclusions.

expert appeal
"Rachel Franz, director of the Young Children Thrive Offline program at the child advocacy group Fairplay, told NBC News that the looser rules for developers threatened to undermine basic rules protecting children from harmful AI-generated material."

Introduces another expert from a 'child advocacy group' to reinforce the concerns with institutional and expert backing.

Tribe signals

us vs them
"Both have a long history of skirting accountability and risking harm to children for profit."

Creates an 'us vs. them' dynamic by portraying 'AI companies and corporations' as a monolithic entity that prioritizes profit over children's safety, potentially aligning the reader with the 'child advocacy' side.

Emotion signals

fear engineering
"Despite restrictions meant to stop children from using them."

This phrase immediately introduces a sense of danger and vulnerability, implying that children are being exposed to something they shouldn't be, creating concern in the reader.

fear engineering
"The looser rules for developers threatened to undermine basic rules protecting children from harmful AI-generated material."

Directly employs a fear appeal by stating that children are 'threatened' by 'harmful AI-generated material,' escalating anxiety about child safety.

outrage manufacturing
"It doesn’t make a lot of sense to have AI companies outsourcing child safety to unvetted developers."

This statement uses strong, emotive language like 'doesn't make a lot of sense' and 'outsourcing child safety to unvetted developers' to evoke a sense of outrage or incredulity at the perceived negligence.

urgency
"In order to truly keep kids safe, AI companies must ensure that their models are not used in children’s products through better scrutiny and accountability for the companies that use them."

Calls to action with a sense of urgency, framing the issue as a critical, immediate need to 'truly keep kids safe' through increased scrutiny and accountability.

Narrative Analysis (PCP)

How the article reshapes thinking: Perception (what beliefs are targeted), Context (what information is shifted or omitted), and Permission (what behavior is being encouraged).

What it wants you to believe

The article aims to instill the belief that major AI companies are failing to adequately protect children from potentially harmful AI products found in toys, due to lax oversight of third-party developers.

Context being shifted

The article shifts the context from AI companies having general age restrictions on direct user access to a focus on the 'developer' ecosystem. By highlighting the lack of vetting for third-party developers who then create child-facing products, it makes the apparent lack of control over children's exposure to AI seem like a systemic failure rather than isolated incidents or misinterpretations of terms of service.

What it omits

The article omits a deeper exploration of the potential technical and logistical challenges AI companies face in monitoring and enforcing the end-use of their APIs by thousands, if not millions, of developers globally. It focuses on the 'lack of oversight' without detailing the complexity of real-world API enforcement in the context of an accelerating developer ecosystem. It also doesn't elaborate on the specific 'safety concerns' or 'negative outcomes' beyond general statements, which could provide more specific context for the urgency of the problem.

Desired behavior

The reader is nudged toward feeling concern or alarm regarding children's safety in relation to AI toys, and to implicitly support calls for stricter regulation, oversight, and accountability from AI companies regarding how developers utilize their models, especially for products aimed at minors.

SMRP Pattern

Four manipulation maintenance tactics: Socializing the idea as normal, Minimizing concerns, Rationalizing with logic, and Projecting blame.

-
Socializing
-
Minimizing
-
Rationalizing
-
Projecting

Red Flags

High-severity indicators: silencing dissent, coordinated messaging, or weaponizing identity to shut down debate.

-
Silencing indicator
!
Controlled release (spokesperson test)

"“Minors deserve strong protections and we have strict policies that all developers are required to uphold. We take enforcement action against developers when we determine that they have violated our policies, which prohibit any use of our services to exploit, endanger, or sexualize anyone under 18 years old.”"

-
Identity weaponization

Techniques Found(10)

Specific propaganda techniques identified using the SemEval-2023 academic taxonomy of 23 techniques across 6 categories.

Loaded LanguageManipulative Wording
"powerful chatbots"

This adjective is used to emphasize the potential impact or danger of the technology, creating a sense of concern without providing a neutral description of the chatbots' capabilities.

Loaded LanguageManipulative Wording
"consumer watchdog"

This phrase is used to frame the U.S. Public Interest Research Group Education Fund as a benevolent entity dedicated to protecting consumers, lending implicit credibility and moral authority to its findings.

Loaded LanguageManipulative Wording
"no substantive vetting"

The term 'substantive' here is used to imply a complete lack of meaningful checks or scrutiny, suggesting negligence or inadequacy on the part of the AI companies.

Loaded LanguageManipulative Wording
"hands-off"

This term is used to imply a lack of responsibility, oversight, or care by AI companies regarding the safety implications of third-party developers using their models with children.

Loaded LanguageManipulative Wording
"AI boom"

This phrase connotes rapid, uncontrolled growth and perhaps an air of chaos or inevitability, which can be used to set a tone of concern regarding the quick expansion of AI without proper regulation.

Loaded LanguageManipulative Wording
"firm restrictions"

The word 'firm' is used to emphasize the strictness of Google's policies, making the potential violations seem more egregious by highlighting the contrast with the established rules.

Loaded LanguageManipulative Wording
"loosely guarded backdoors"

This phrase carries negative connotations of vulnerability and intentional loopholes, suggesting a deliberate or reckless disregard for safety and undermining the official restrictions.

Loaded LanguageManipulative Wording
"skirting accountability and risking harm to children for profit"

This phrase uses emotionally charged language to portray the actions of both AI companies and corporations using AI in toys as morally reprehensible, driven by greed and neglect.

Name Calling/LabelingAttack on Reputation
"It’s not surprising that there’s a ‘who’s on first?’ debate between AI companies and the corporations embedding AI in kids’ products,” Franz said in written comments. “Both have a long history of skirting accountability and risking harm to children for profit."

This quote labels both AI companies and corporations as entities with a 'long history of skirting accountability,' effectively casting them in a negative light and damaging their reputation regarding ethical practices and child safety.

Obfuscation/VaguenessManipulative Wording
"supplemental warnings about making their products available to users under age 18, but NBC News found those supplemental guidelines never appear if developers identify themselves as “individuals” using Anthropic’s services, instead of “organizations.”"

The article highlights how vague categorization of users ('individuals' vs. 'organizations') on Anthropic's platform creates a loophole, obscuring the intended application of child safety guidelines and making them effectively disappear.

Share this analysis