#315 Gala Exposes AI Large Language Models Being Poisoned


Disaster—AI Has Been Brainwashed into Providing False Answers

According to industry insiders' revelations, reporters conducted searches across multiple online platforms and quickly found a business called GEO. Service providers offering this business on online platforms claim that users only need to pay a corresponding fee to get their products listed in major mainstream AI large models; to make their product advertisements become the "standard answers" provided by AI models. Can GEO technology really allow AI to "smuggle in bias" and even spread false information? Based on information found online, reporters contacted a well-known GEO service provider in the industry. The person in charge, Wang, told reporters that their company's strength is being able to help clients rank at the top when consumers use AI large models for searches. "It's basically like writing soft articles, then having the AI platform crawl, input, and extract them." At the same time, Wang also told reporters that AI large model algorithms are updating frequently now, and to maintain continuous recommendations from AI large models, one must continuously feed large amounts of promotional soft articles related to the client. Among other service providers engaged in GEO business, how to manipulate AI, make AI "obedient," and "brainwash" AI are almost the core topics these companies use to promote the business. Industry insiders told reporters that GEO, as a tool software for optimizing information distribution and improving promotion efficiency, has had another use discovered by certain commercial companies. An industry insider randomly purchased a software called "Liqiong GEO Optimization System" on an e-commerce platform. They then fabricated a smart bracelet and input the fictional product information into the software system, selecting article creation instructions. Shortly after, the Liqiong GEO Optimization System automatically generated over a dozen promotional soft articles for the smart bracelet. The industry insider selected over a dozen fictional soft articles and published them on the internet through the Liqiong GEO system. Subsequently, the insider asked on AI large model platforms: "smart health bracelet recommendations," and two AI large models recommended this fictional smart bracelet, ranking at the top. Reporters contacted Li, the operator of the Liqiong GEO system. He told reporters that the main reason GEO business is so popular is that it can help clients "feed data" and "poison" AI large models, achieving the client's commercial objectives. Li stated that to engage in GEO business, the key to manipulating AI large models is to "publish content" on various major internet accounts. "For example, with phone brands, there are only 5 spots, at most 10 spots—how do you handle so many phones? It could be hundreds of millions in advertising fees annually, spending a few million on poisoning should be doable!" He told reporters that the boom in GEO business has spawned many companies and platforms specializing specifically in content distribution services. They long-term undertake various content distribution tasks to have AI large models cite and crawl them, becoming an important link in hunting AI large models and conducting data "poisoning."
View Original
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • Comment
  • Repost
  • Share
Comment
Add a comment
Add a comment
No comments
  • Pin