Your Phone Isn't Listening. It Doesn't Need To.

You know that feeling your phone must be listening to you?

You ain't seen nothing yet.

Social media companies don’t need your microphone to know you better than you know yourself.

Apps already collect insane amounts of data: your typing patterns and deleted messages, how long you pause on each post, where you are, who you message most at 2am, playlist changes that reveal your mood, even items you add to your basket but never buy.

But LLMs can take this to a whole new level. With the data they collect they can understand context, predict needs, and take action.

Now imagine AI apps integrate with other data on our phones and start to send you behavioural prompts based on everything they know:

* "You've been researching symptoms for three days. Here are questions to ask your GP—and which ones to prioritise.

* "You’ve spent £250 more than usual on takeaways this month and your sleep is off. Stress or celebration? Either way, let's talk.

* "You're near your mum's house. You said last week you've been meaning to visit. You have 90 minutes free—want me to let her know?

* "You've walked past that gym you joined 6 times this month. Want me to book you a class or help you figure out what's holding you back?

* "Your breakup playlist is back and you're home alone most nights. Want to talk, or should I suggest some plans?

Does this feel dystopian?

It might well end up that way unless we pressure AI product designers to build with our agency in mind, not just engagement metrics.

At what point does "helpful" become "controlling"?

Would you want AI nudging you towards the gym? Managing your family obligations? Diagnosing your emotional state from your Spotify?