Small rant : Basically, the title. Instead of answering every question, if it instead said it doesn’t know the answer, it would have been trustworthy.

  • AceBonobo@lemmy.world
    21·
    3 days ago

    What’s absolutely crazy about that is:

    Prompt: write code that checks how many r’s are in the word strawberry

    Response:

    using System;

class Program
{
    static void Main()
    {
        string word = "strawberry";
        char targetChar = 'r';
        int count = 0;

        foreach (char c in word)
        {
            if (c == targetChar)
                count++;
        }

        Console.WriteLine($"The letter '{targetChar}' appears {count} times in the word \"{word}\".");
    }
}
    • drislands@lemmy.world
      8·
      3 days ago

      My first thought is that you could write a program that does something like this:

      • Receive prompt “how many times does R appear in the word ‘strawberry’”
      • Run the prompt through LLM saying “reword the following into a command to generate code that will answer the question” or something like that
      • Run the results through LLM
      • Compile and run the results
      • Provide the output to the user

      Of course, the biggest problem with this system is that a person could fool it into generating malicious code.

      • AeroLemming@lemm.eeEnglish
        3·
        3 days ago

        That could work in that specific case, but telling the LLM to write code to answer random questions probably wouldn’t work very well in general.

    • folkrav@lemmy.ca
      1·
      2 days ago

      The code does look like code that counts Rs. The training data probably included tons of code that “counts character X in string Y”, so ChatGPT “knows” what code that counts characters in a string looks like. It similarly “knows” what a string looks like in the language, and what an application entry point looks like, etc. I’m not so familiar with C# that I’d know if it compiles or not. ChatGPT doesn’t either, but it has the advantage of having seen a whole freaking lot of C# code before.