您现在的位置是：Microsoft's ChatGPT >>正文

Microsoft's ChatGPT

后花园论坛社区|2024夜上海论坛网|爱上海419论坛 -- Back garden8人已围观

简介Patrick Daxenbichler/Getty ImagesMicrosoft's new ChatGPT-powered Bing Chat is still in a limited pre...

Patrick Daxenbichler/Getty Images

Microsoft's new ChatGPT-powered Bing Chat is still in a limited preview, but those with access have already prompted it to reveal its codename, the rules governing its responses -- and apparently witnessed it denying that it was vulnerable to a method that caused it to reveal its codename in the first place.

Also:Why ChatGPT won't discuss politics or respond to these 20 controversial questions

Users with access to Bing Chat have over the past week demonstrated that it is vulnerable to so-called 'prompt injection' attacks. As Ars Technica's AI reporter Benj Edwards explains, prompt injection attacks allow the user to bypass previous instructions in a language model prompt and substitute it with a new one. Edwards detailed the attack in an earlier story.

Featured

Garmin wins big at CES, launches new products and updates Garmin Connect
From indoor solar to light-based internet, photonics offers a brighter future
I saw Samsung and LG's new transparent TVs at CES, and there's a clear winner
Have 10 hours? IBM will train you in AI fundamentals - for free

Bing Chat has even claimed that reports about its vulnerability to prompt injection attacks are incorrect, and argued with testers over minor details of history telling one journalist "You are only making yourself look foolish and stubborn."

Kevin Liu, a Stanford University student, last Thursday used the style of prompt to get Bing Chat to reveal its codename at Microsoft is Sydney, as well as many of the rules its responses are governed by.