The transformer, a neural network architecture introduced by Google researchers in 2017, has become the foundation of every major large language model (LLM) currently available. This technology has enabled LLMs to efficiently process lengthy sequences of data, particularly text, and has driven significant advancements in the field. As a result, the entire AI industry is now built upon this architecture, with numerous startups and established companies leveraging transformers to develop innovative LLM-based solutions. The security implications of these developments are substantial, as the increasing capabilities of LLMs also expand their potential risk surfaces1. As the industry continues to push the boundaries of LLM technology, practitioners must remain vigilant and proactive in addressing the associated security challenges. The ongoing evolution of LLMs will have significant consequences for the security landscape, making it essential for informed readers to stay abreast of these developments.