• Tavi@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    9
    ·
    5 months ago

    Gemma2, the new state of the art, still can get above 45% correct in basic addition, and also can’t do better than a two or three basic Google searches. GPT is a NLP tool, and using it to do math would be like using a F-35 to weave lace.

    • I'm Hiding 🇦🇺@aussie.zone
      link
      fedilink
      arrow-up
      2
      ·
      5 months ago

      That’s true, but usually they get their method right (or close to it) but fail on the simple addition. If you use it to help figure out what steps you need to take, you can then run through substituting the correct numbers in and make some real progress.

      I just completed a class on hydrology and water engineering with this method. Got a HD. That either says something about the school or something about GPT. Not sure which.

      It certainly says something about my willingness to complete water engineering coursework, I’ll admit that.