Hacking AI Browsers: How i hacked Perplexity
I Hacked Perplexity and found: template injection, highlight injection, and chat-based data exfiltration. Here’s the story.
Research and Technical Work
This page indexes technical posts and talks from current AI Village site content. It is intentionally framed as technical work, not a formal publications program.
For talks and schedules, start with the events archive. For hands-on labs, see Learn.
AI Village Announcing Generative Red Team 3 at DEF CON 33
The GRT 3 will run online in about a month with partners. Please sign up here https://auth.aivillage.org/login to recieve an email with more information. In 2023, AI Village organized the...
The Moat for AI
The value of AI companies is largely the security layers they provide.
AI Village Announcing Generative Red Team 2 at DEF CON 32
At DEF CON 31 AI Village hosted the Generative Red Team GRT1 , the world’s largest, public Large Language Model LLM Red Team, in conjunction with other non profit, corporate,...
Generative Red Team Recap
Generative Red Team History It’s long overdue for a retrospective on the Generative Red Team GRT at AI Village at DEFCON 31. I’ve posted parts of this other places, but...
Threat Modeling LLM Applications
Before we get started: Hi My name is GTKlondike, and these are my opinions as a cybersecurity consultant. While experts from the AI Village provided input, I will always welcome...
AI Village at DEF CON announces largest-ever public Generative AI Red Team
Largest annual hacker convention to host thousands to find bugs in large language models built by Anthropic, Google, Hugging Face, NVIDIA, OpenAI, and Stability. This event is supported by the...
The Spherical Cow of ML Security
First of all, these are my opinions and there are people at AI Village who may disagree with me. I want to present the simplest version of managing risk of...
Prompt Detective at SXSW!
Prompt Detective Announcement Join us for an upcoming workshop on the benefits and limitations of large language models LLMs like GPT3, Bloom, , and a unique red teaming exercise where...
The AI RMF Does not Address Common Needs
Disclaimer: This does not reflect the AIV as a whole, these are my opinions and this was my response. I believe that the Risk Management Framework is lacking in actionable...
The Use of AI/ML in Offensive Security Operations
The Red Team Village https://redteamvillage.io/ and the AI Village will host a panel from different industry experts to discuss the use of artificial intelligence and machine learning in offensive security...
Generative Art
Generative Art at AI Village DEF CON 30 Today, models that appear to generate novel outputs conditioned on text are becoming the mainstay of popular culture. New groups of users...
Gradient Attacks
Welcome to the second post in the AI Village's adversarial machine learning series. This one will cover the greedy fast methods that are most commonly used. We will explain what...
Dimensionality and Adversarial Examples
Welcome to AI Village’s series on adversarial examples. This will focus on image classification attacks as they are simpler to work with and this series is meant to explain the...