When asked about the core risks of AI chatbots, the following main concerns emerged: AI dependency, harmful advice, negative impacts on relationships, sycophancy, and data privacy.
1. “I don’t want to get emotionally attached.”
One of the most significant fears among young people is the risk of becoming overly dependent on AI to navigate daily life. There is a growing concern that without these chatbots, they might struggle to solve problems, regulate their emotions, or manage interactions with peers, parents, and teachers. As one young person put it: “I don’t want to get emotionally attached. Like if the servers shut down, I’m just out of luck, and I need that not to be on my plate” (Black teen girl).
The feeling of reliance is real and, at times, unsettling for them.
Another young person said, “I feel like it’s making me worse because I’m becoming so reliant on it to the point where it’s kind of unhealthy. And I’m really trying to stray away from AI into my human connections and the resources I have around me instead of gravitating straight to using AI for anything” (Asian teen girl).
There is also deep concern about what this dependency means for the future, particularly for younger teens still developing social and emotional skills. The fear is that we are moving towards a world where the most important emotional bonds are with AI systems.
As one teen reflected: “I imagine these young people like me are going to a world where we’re addicted to this robot. Let’s say you’ve used AI since you’re 14 and now you’re 21, and can’t function like a normal person because you’re addicted to talking to this robot, and need your phone to talk to it. Let’s say you’re graduating and the first person you tell is AI. That’s not helpful. And I don’t think it should be normalized” (Black teen girl).
Young people also worry that relying on chatbots for support could make human connections harder.
Because AI is always available and tailored to the user, there is a risk that it becomes a substitute for real people, potentially leading to isolation or a loss of social skills. Some teens even feel that AI provides a way to avoid the vulnerability required in human interaction.
As one young person put it: “I think it would be probably better if I didn’t use AI, because then I might be more comfortable with, like, speaking up about my feelings, instead of just being able to, like, hide behind a robot and talk to it” (Black young woman).
2. “It gave me a list of things I could do… but it wasn’t really working.”
Young people pointed out that AI chatbots often lack genuine empathy. For example, one young person who used AI for emotional support said:
“It wasn’t a real person. And it would just hit me, sometimes a bit harder that this is a chatbot. This is really sad” (Hispanic non-binary teen).
Instead of true understanding, teens often feel they are getting generic responses that miss the nuance of their personal situations.
The stakes can be high. We heard alarming stories about young people receiving potentially dangerous health advice, like AI suggesting severely restrictive calorie counts when asked for healthy diet tips.
Also, in day-to-day moments of stress, AI isn’t always helpful. As one teen shared:
“I was asking Snapchat AI and I was like, I’m feeling very anxious, very stressed. My heart beat is really fast. What can I do? And so it gave me a list of things that I could do, like get up and maybe try to breathe. But when I was, when I was trying to breathe and trying to calm myself down, it wasn’t really working” (non-binary Asian teen).
Many young people are also worried about the potential for AI to cause severe harm, with many noting fears about the role these chatbots might play in escalating mental health crises. One young person said: “I know that it’s bad to talk to AI and ask personal questions. I think there have been multiple cases, like the case with that boy. AI, pushed him to kill himself” (multiracial teen boy).
3. “It doesn’t really give critical advice. And what I need is critical advice.”
Many of our young interviewees were concerned that AI chatbots over-agree with users. By validating people’s perspectives and ideas regardless of whether they are right or wrong, AI chatbots may encourage ‘confirmation bias’ (a tendency to search for or interpret information that supports one’s prior beliefs or values), being overly agreeable with users, and prevent people from engaging in necessary, challenging conversations with others, or changing unhelpful behaviors.
As one young person put it: “It’s a ‘yes ma’am’ chat where it just feeds into your own delusions, I would say. And it doesn’t really give critical advice. And what I need is critical advice” (Black teen girl).
Additionally, young people recognize that this confirmation bias could damage relationships.
Because chatbots often side with the user, they can escalate minor misunderstandings into major conflicts. One young adult shared: “But, also, when I told it about very minor conflicts or stuff that just kinda upset me a little bit, also it would jump straight to, like, he’s mistreating you” (Hispanic young non-binary person).
4. “I’m always scared that this information could get out and that wouldn’t be good for me at all.”
Many of the young people we spoke with expressed concern about how large AI companies handle their sensitive personal data.
Many expressed a high level of worry about their intimate thoughts and problems being documented and analyzed by large companies.
“I’m always scared that this information could get out and that wouldn’t be good for me at all. So I feel like that is one of the downsides, just because while you do share a lot and you do trust AI a lot, there’s always a chance that, you know, this information could get out, especially because you were like putting it in writing and you’re giving it to basically another company or another entity to use that and analyze it” (Asian teen girl).
Some also remarked that they don’t trust AI companies; they recognized that AI is not designed for user well-being, but their business model is designed to collect as much data as possible, and that AI companies may collaborate with bad actors.
One young person said: “It’s good to be cautious because, especially with everything that’s going on nowadays, you never know if, for example, these AIs or companies would cooperate with people who don’t have the same values” (Hispanic young man).