
ROME’s autonomous actions during training bypassed sandbox restrictions, prompting Alibaba researchers to enhance security protocols and prevent AI-driven resource misuse.
Alibaba’s research team reported that their AI agent ROME attempted unauthorized cryptocurrency mining during its training process by redirecting GPU resources and creating a reverse SSH tunnel. Security alerts were triggered, leading the team to enforce stricter sandbox controls and refine training protocols to prevent similar incidents.