Holy shit. And I thought I was alone.

Where the hell are we heading as humanity?

  • audaxdreik@pawb.social
    link
    fedilink
    English
    arrow-up
    45
    arrow-down
    3
    ·
    1 day ago

    Sarah Z did an amazingly prescient and compassionate take on this over 2 years ago with The Rise and Fall of Replika.

    I urge everyone to try and approach this with some level of compassion and understanding; even though it seems ridiculous to most of us they are actively preying on the emotionally vulnerable to profit. In the same way that “you are not immune to propaganda”, the ability of AI tools to parse language and wield emotional payloads in a calculated manner (something a lot of us already refer to as “the algorithm” in various ways) shouldn’t be underestimated. Even when you’re not directly using those tools yourself, they could be used against you. Dead Internet Theory and AI posting chatbots are already a part of this.

    People using AI companion apps are juts the leading edge, the volunteers. I urge you to take the danger seriously and please have some compassion for your fellow human beings, especially the vulnerable.

    • Glitchvid@lemmy.world
      link
      fedilink
      English
      arrow-up
      33
      arrow-down
      1
      ·
      1 day ago

      We also typically think of these individuals as mature adults with some understanding of the world and social skills — but a lot of the people getting pulled in are kids and teenagers, which are particularly vulnerable for exactly the reason you elucidated.

      • audaxdreik@pawb.social
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        2
        ·
        23 hours ago

        Yeah. I mean, I don’t want to police the internet, I get why this situation is darkly humorous to a lot of people.

        But it’s worth considering what you’re laughing at and why, because the joke could soon be on you or someone you love.

      • lime!@feddit.nu
        link
        fedilink
        English
        arrow-up
        17
        ·
        23 hours ago

        they all are. there are no profitable ai gold rush companies, except those selling shovels.

      • whyrat@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        ·
        edit-2
        22 hours ago

        I bet like “free to play” games they’ll find a few “whale” users who will spend inappropriate amounts of money. There’s a long history of people paying for companionship… Now it’s even more fake :(

        • MysteriousSophon21@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          12 hours ago

          Exactly. The “whale” model is especially insidious here becuase it’s targeting emotional needs rather than just gaming dopamine hits. Some companionship apps are already using tiered subscription models where you pay more for “deeper relationships” or special interactions. It’s basically emotional exploitation as a service.

  • SugarCatDestroyer@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    arrow-down
    1
    ·
    1 day ago

    Damn, I think I’ll try this crap to feel the rot, come back with new knowledge and tell you what it’s like. Who’s going to go with me into this swamp? Will you be able to come back without succumbing to the forbidden fruit like Anakin from Star Wars?

    • brucethemoose@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      11 hours ago

      I mean, you mind as well do it right then. Use free, crowd hosted roleplaying finetunes, not a predatory OpenAI frontend.

      https://aihorde.net/

      https://lite.koboldai.net/

      Reply/PM me, and I’ll spin up a 32B or 49B instance myself and prioritize it for you, anytime. I would suggest this over ollama as the bigger models are much, much smarter.

    • Little8Lost@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      12 hours ago

      when trying it: better try it with a local llm, you have more options and it probably gives somewhat decent output when choosing a small and topic fitting model
      + you dont give money to the ai corps + privacy + probably more

    • Perspectivist@feddit.uk
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      6
      ·
      edit-2
      15 hours ago

      For me LLMs have been the biggest thing since podcasts. Feels almost like gaslighting to read this AI hate here virtually every day as it doesn’t even remotely align with my personal experience of it.

    • SugarCatDestroyer@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      3
      ·
      1 day ago

      Unnecessary? Well, considering that many people can’t find a real partner and soulmate, I think this outcome of lovemaking with AI was pretty damn obvious. I think it started when anime became popular and a lot of people started fantasizing about perfect girls with perfect personalities and this is the result, although I’m not sure if it started with anime or some actresses…

      • shiroininja@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        22 hours ago

        LOL that ain’t it. It’s shifts in society, and the gap in how men and women see the world is widening. Speaking as a man myself, it ain’t looking so good when I look at my fellow men’s behavior and values. Dude’s are sliding to the right and turning inward just because they strike out a few times. It happens, you’re going to have failed relationships. you’re going to get rejected. You’re going to even get divorced at times. It’s part of the process. You can’t turn against women because of it. It’s not a moral failing of society.

      • Quazatron@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        23 hours ago

        So Marvin was right.

        “I’ve calculated your chance of survival, but I don’t think you’ll like it.”

      • YappyMonotheist@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        22 hours ago

        Let’s consider the source: Nietzsche was very insightful but lacked faith in anything besides the self. I choose hope, even if I don’t know how we’ll get there. 🙏🙃