Salesforce CEO Urges AI Developers to Prioritize Safety

Salesforce CEO Marc Benioff has joined a growing group of technology leaders urging the artificial intelligence industry to act with greater caution. Speaking at his company’s annual Dreamforce event in San Francisco, he emphasized that developers must consider the broader social consequences of their creations. His remarks align with recent calls from other executives to prioritize safety over speed.

The warning comes as powerful AI models become more widely integrated into business operations. Benioff drew a direct parallel to the social media era, noting that previous generations of technology caused significant harm to individuals and society. He argued that the AI sector has a duty to ensure these new tools are used responsibly and ethically, rather than rushing to market without adequate safeguards.

Avoiding past social media mistakes

Benioff has long been a critic of how social media platforms have impacted society, famously comparing Facebook to cigarettes in 2018. He stated that many companies and individuals were hurt by that technology. His current message is a plea for the AI industry not to repeat those errors, emphasizing that the core of ethics is responsibility toward communities and the world.

This stance is particularly notable given Salesforce’s close ties to leading AI firms. The company recently unveiled a product called Claudeforce, which allows customers to use Anthropic’s Claude model to interact with their own data. This integration highlights the complex relationship between major software providers and the AI developers they rely on for core functionality.

Market reaction to slowing calls

The debate over AI safety has gained momentum recently, fueled by comments from Anthropic CEO Dario Amodei. Amodei published an essay arguing that frontier AI labs should slow down model development to allow safety measures to catch up. This perspective has resonated with some investors, contributing to a recent rebound in enterprise software stocks that had previously fallen on fears of AI disruption.

Despite the positive sentiment in some market segments, Salesforce shares gave back some of their gains on Tuesday. The stock had risen significantly from its low point in late June as Wall Street warmed to the idea that AI will not replace all human roles. However, the broader market remains cautious about the long-term implications of rapid technological change.

Balancing innovation with responsibility

Benioff stopped short of demanding a halt to AI development or criticizing specific companies. Instead, he framed the issue as a matter of professional duty. He urged his peers to view their work through the lens of ethical stewardship, suggesting that true leadership in tech involves setting examples for responsible behavior. This approach reflects a broader shift in the industry toward acknowledging the societal weight of their innovations.

As reported by GN technics/ai (en-US), the conversation highlights a critical trade-off in the tech sector. Companies must balance the drive for innovation and competitive advantage with the need for public trust and safety. The outcome of this debate will likely shape regulatory landscapes and corporate strategies in the coming years.