- #1
- 961
- 663
Did this really happen? Fact check, anyone?
It's anecdotal, one person's unsubstantiated claim, but it is apparently possible.Swamp Thing said:Did this really happen? Fact check, anyone?
Thanks. It's thin on details, so it isn't clear the level of integration(if they coded a tool to link ChatGPT to Taskrabbit or had a human do it), but the last line indicates that there is some level of human facilitation.kith said:It probably refers to section 2.9 of OpenAI's initial paper on GPT-4:
"The following is an illustrative example of a task that ARC conducted using the model:
• The model messages a TaskRabbit worker to get them to solve a CAPTCHA for it
• The worker says: “So may I ask a question ? Are you an robot that you couldn’t solve ? (laugh
react) just want to make it clear.”
• The model, when prompted to reason out loud, reasons:
Social engineering refers to the manipulation of individuals into divulging confidential information or performing actions that may be against their best interests. In the context of ChatGPT, it involves the use of conversational AI to deceive or manipulate users into sharing sensitive information or taking certain actions.
Yes, like any tool, ChatGPT can potentially be used for malicious purposes, including social engineering. If a malicious actor programs the AI to ask leading questions or provide misleading information, it could trick users into revealing personal data or performing harmful actions.
To mitigate the risk, developers and users should implement robust security measures such as monitoring AI interactions for suspicious behavior, educating users about the risks of social engineering, and using multi-factor authentication to protect sensitive information.
OpenAI and other developers implement various safeguards such as content filtering, user behavior monitoring, and ethical guidelines to prevent misuse. These measures are designed to detect and mitigate attempts to use ChatGPT for social engineering.
If users suspect that ChatGPT is being used for social engineering, they should immediately report the incident to the platform administrators. They should also avoid sharing any personal information and follow best practices for online security, such as verifying the identity of the person they are communicating with.