Actions
Forum Thread Details
  • Replies 19 replies
  • Subscribers 44 subscribers
  • Views 1186 views
  • Users 0 members are here
Related

AI induced errors in your code

michaelkellett

There's an interesting article here:

https://www.eenewseurope.com/en/llms-used-to-code-can-introduce-serious-errors/?hash=93e5355d8bf7ef1fe62975a87f9d012aac4b4f7c7d1099e932443336d0aa983e

The key point of the article is:

"discovered that 440,445 out of 2.23 million code samples generated in Python and JavaScript using LLM models referenced hallucinated packages"

Bad actors can identify popular hallucinations and make real malware packages which will then be loaded into your code.

So unless you have a bomb proof way of checking that any packages referenced in AI generated code you may have serious problems.

Worth thinking about !

MK

Parents

  • Ai is making a lot of incompetent people think they're competent. I'm not a fan of it at all.

    I remember someone asking on a StreamDeck forum where to download the Python SDK. When I pointed out that there wasn't one I was told "ChatGPT says there is. Where is it?" When I pointed out that ChatGT was wrong I was told that I clearly didn't know what I was talking about and AI would take the jobs of dinosaurs like me.

    The best fit I've seen for AI is generating background scenery in Unreal. I feel that if you're making something that doesn't need to be right and that "good enough" will do, then maybe AI can help. If it needs to be exactly right, or you need to be able to understand why it came up with what it did and make fine adjustments then it's not much use.

Reply

  • Ai is making a lot of incompetent people think they're competent. I'm not a fan of it at all.

    I remember someone asking on a StreamDeck forum where to download the Python SDK. When I pointed out that there wasn't one I was told "ChatGPT says there is. Where is it?" When I pointed out that ChatGT was wrong I was told that I clearly didn't know what I was talking about and AI would take the jobs of dinosaurs like me.

    The best fit I've seen for AI is generating background scenery in Unreal. I feel that if you're making something that doesn't need to be right and that "good enough" will do, then maybe AI can help. If it needs to be exactly right, or you need to be able to understand why it came up with what it did and make fine adjustments then it's not much use.

Children