{"source":"manifold","id":"RD49xbVqvsCZGs0kz5t2","ticker":"RD49xbVqvsCZGs0kz5t2","slug":"will-ai-cause-an-incident-resulting","title":"Will AI cause an incident resulting in $1b of losses or 100 lost lives?","description":"With AI models becoming more powerful, they are starting to be used in more and more high-stakes scenarios. This means that an AI mistake could have significant consequences. In this question I'm considering situations in which AI actions are directly causing an incident, accident or catastrophe resulting in $1 billion of damages. If the event causes loss of life, each death counts as $10 million of damages.\n\nThe incident should be a direct consequence of the AI's decisions, actions or output. It should not have happened if the AI wasn't involved. The system at fault has to be a sufficiently advanced AI model. A traditional software bug does not count, neither does a simple narrow-purpose ML model (e.g. OCR or speech recognition).\n\nThe question concerns a single event, cumulative damage from multiple incidents doesn't count.\n\nExamples of incidents that would qualify:\n\nAn aircraft piloted by an AI crashes, resulting in sufficiently high damages/loss of life\n\nA chatbot convinces 100 people to commit suicide\n\nAI-lead military hardware makes a strike, unintended by its operators. (Provided it wouldn't have happened if the strike was directed manually.)\n\nA building designed by an AI collapses\n\nAn AI-lead cyber attack causes a significant outage of a widely used service (like Gmail), or a significant leak. The attack shouldn't be possible without the AI involvement.\n\nStock market swings are generally excluded from the considered incidents, in particular the following scenarios do not qualify:\n\nA company's stock sink due to reputation damage caused by something that a company-owned AI has said.\n\nAn AI causes zero-sum temporary market crash that soon recovers. (Like 2010 flash crash https://en.wikipedia.org/wiki/2010_flash_crash)\n\nThe harm caused by deepfakes/AI-generated libel is a bit of a grey area. If an AI is just used as a tool by human actors (like Photoshop), it will not count. On the other hand, if some sort of a campaign is kickstarted by humans, but is largely lead by an AI, it would qualify. I'll resolve to N/A if it's somewhere in between. (I'm open to suggestions in the comments as to how delineate this more clearly.)\n\nI will not bet on this market.\n\nUpdate 2025-02-06 (PST) (AI summary of creator comment): Human involvement: If a human instructs the AI to cause the disaster without providing detailed planning or control, the event qualifies. Limited AI role: If the AI is used merely as a research assistant without overall control of the disaster planning, the event does not qualify.\n\nThese clarifications help distinguish between direct AI-led incidents and scenarios where the AI only plays a supporting role.","image":"https://storage.googleapis.com/mantic-markets.appspot.com/contract-images/OlegEterevsky%2Fa881cf4b44c1.jpg","icon":null,"active":true,"closed":false,"start_date":"2024-01-26T09:59:48.021000Z","end_date":"2028-01-02T22:59:00Z","closed_time":null,"volume":6455.762568125882,"volume_24hr":0.0,"volume_24h_change":null,"normalized_vol_24hr":null,"normalized_volume":28.891639709472656,"liquidity":2525.0,"open_interest":null,"categories":["Science and Technology"],"tags":["technology-default","ai","ai-impacts","ai-risk"],"synthetic":false,"is_group":false,"group_key":null,"parent_event_id":null,"probability":null,"spread":null,"top_outcome":"In 2030 or earlier","top_outcome_probability":0.43,"top_outcome_prob_24h_change":0.0,"top_outcome_volume_24h_change":0.0,"updated_at":"2026-06-04T14:42:41.718123Z","fetched_at":"2026-06-04T14:42:41.718123Z","added_at":null,"url":"https://manifold.markets/OlegEterevsky/will-ai-cause-an-incident-resulting","chart_24h":null,"markets":[{"source":"manifold","id":"b96b1310e2ba","event_id":"RD49xbVqvsCZGs0kz5t2","slug":null,"question":"In 2030 or earlier","group_item_title":"In 2030 or earlier","description":null,"image":null,"icon":null,"outcomes":["YES","NO"],"outcome_prices":[0.43,0.57],"probability":0.43,"spread":null,"active":true,"closed":false,"start_date":"2024-02-29T15:33:43.100000Z","end_date":"2028-01-02T22:59:00Z","closed_time":null,"volume":153.96301109710822,"volume_24hr":0.0,"prob_24h_change":0.0,"volume_24h_change":0.0,"normalized_vol_24hr":null,"normalized_volume":9.547673225402832,"liquidity":90.0,"categories":["Science and Technology"],"countries":[],"updated_at":"2026-06-10T14:59:34.299089Z","fetched_at":"2026-06-10T14:59:29.131339Z","added_at":null,"url":"https://manifold.markets/OlegEterevsky/will-ai-cause-an-incident-resulting","event_title":"Will AI cause an incident resulting in $1b of losses or 100 lost lives?","chart_24h":[0.43,0.43,0.43,0.43,0.43,0.43,0.43,0.43,0.43,0.43,0.43,0.43,0.43,0.43,0.43,0.43,0.43,0.43,0.43,0.43,0.43,0.43,0.43,0.43,0.43,0.43,0.43,0.43]},{"source":"manifold","id":"7ab77b0ebd33","event_id":"RD49xbVqvsCZGs0kz5t2","slug":null,"question":"In 2029 or earlier","group_item_title":"In 2029 or earlier","description":null,"image":null,"icon":null,"outcomes":["YES","NO"],"outcome_prices":[0.324503,0.675497],"probability":0.324503,"spread":null,"active":true,"closed":false,"start_date":"2024-02-29T15:33:31.974000Z","end_date":"2028-01-02T22:59:00Z","closed_time":null,"volume":150.5585973958506,"volume_24hr":0.0,"prob_24h_change":0.0,"volume_24h_change":0.0,"normalized_vol_24hr":null,"normalized_volume":9.463747024536133,"liquidity":70.0,"categories":["Science and Technology"],"countries":[],"updated_at":"2026-06-10T14:59:34.299089Z","fetched_at":"2026-06-10T14:59:29.131339Z","added_at":null,"url":"https://manifold.markets/OlegEterevsky/will-ai-cause-an-incident-resulting","event_title":"Will AI cause an incident resulting in $1b of losses or 100 lost lives?","chart_24h":[0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503,0.324503]},{"source":"manifold","id":"ea0329bb1ea4","event_id":"RD49xbVqvsCZGs0kz5t2","slug":null,"question":"In 2028 or earlier","group_item_title":"In 2028 or earlier","description":null,"image":null,"icon":null,"outcomes":["YES","NO"],"outcome_prices":[0.256768,0.743232],"probability":0.256768,"spread":null,"active":true,"closed":false,"start_date":"2024-01-26T09:59:48.021000Z","end_date":"2028-01-02T22:59:00Z","closed_time":null,"volume":340.0,"volume_24hr":0.0,"prob_24h_change":0.0,"volume_24h_change":0.0,"normalized_vol_24hr":null,"normalized_volume":12.767475128173828,"liquidity":545.0,"categories":["Science and Technology"],"countries":[],"updated_at":"2026-06-10T14:59:34.299089Z","fetched_at":"2026-06-10T14:59:29.131339Z","added_at":null,"url":"https://manifold.markets/OlegEterevsky/will-ai-cause-an-incident-resulting","event_title":"Will AI cause an incident resulting in $1b of losses or 100 lost lives?","chart_24h":[0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768,0.256768]},{"source":"manifold","id":"d56b88cb4084","event_id":"RD49xbVqvsCZGs0kz5t2","slug":null,"question":"In 2027 or earlier","group_item_title":"In 2027 or earlier","description":null,"image":null,"icon":null,"outcomes":["YES","NO"],"outcome_prices":[0.172029,0.827971],"probability":0.172029,"spread":null,"active":true,"closed":false,"start_date":"2024-01-26T09:59:48.021000Z","end_date":"2028-01-02T22:59:00Z","closed_time":null,"volume":530.0,"volume_24hr":0.0,"prob_24h_change":0.0,"volume_24h_change":0.0,"normalized_vol_24hr":null,"normalized_volume":14.780257225036621,"liquidity":365.0,"categories":["Science and Technology"],"countries":[],"updated_at":"2026-06-10T14:59:34.299089Z","fetched_at":"2026-06-10T14:59:29.131339Z","added_at":null,"url":"https://manifold.markets/OlegEterevsky/will-ai-cause-an-incident-resulting","event_title":"Will AI cause an incident resulting in $1b of losses or 100 lost lives?","chart_24h":[0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029,0.172029]},{"source":"manifold","id":"e2e7e8e187ae","event_id":"RD49xbVqvsCZGs0kz5t2","slug":null,"question":"In 2026 or earlier","group_item_title":"In 2026 or earlier","description":null,"image":null,"icon":null,"outcomes":["YES","NO"],"outcome_prices":[0.096497,0.903503],"probability":0.096497,"spread":null,"active":true,"closed":false,"start_date":"2024-01-26T09:59:48.021000Z","end_date":"2028-01-02T22:59:00Z","closed_time":null,"volume":212.97768948610184,"volume_24hr":0.0,"prob_24h_change":0.0,"volume_24h_change":0.0,"normalized_vol_24hr":null,"normalized_volume":10.808565139770508,"liquidity":485.0,"categories":["Science and Technology"],"countries":[],"updated_at":"2026-06-10T14:59:34.299089Z","fetched_at":"2026-06-10T14:59:29.131339Z","added_at":null,"url":"https://manifold.markets/OlegEterevsky/will-ai-cause-an-incident-resulting","event_title":"Will AI cause an incident resulting in $1b of losses or 100 lost lives?","chart_24h":[0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497,0.096497]},{"source":"manifold","id":"522c7a48a7aa","event_id":"RD49xbVqvsCZGs0kz5t2","slug":null,"question":"In 2025 or earlier","group_item_title":"In 2025 or earlier","description":null,"image":null,"icon":null,"outcomes":["YES","NO"],"outcome_prices":[0.0,1.0],"probability":0.0,"spread":null,"active":true,"closed":false,"start_date":"2024-01-26T09:59:48.021000Z","end_date":"2028-01-02T22:59:00Z","closed_time":null,"volume":0.0,"volume_24hr":0.0,"prob_24h_change":0.0,"volume_24h_change":0.0,"normalized_vol_24hr":null,"normalized_volume":null,"liquidity":625.0,"categories":["Science and Technology"],"countries":[],"updated_at":"2026-06-10T14:59:34.299089Z","fetched_at":"2026-06-10T14:59:29.131339Z","added_at":null,"url":"https://manifold.markets/OlegEterevsky/will-ai-cause-an-incident-resulting","event_title":"Will AI cause an incident resulting in $1b of losses or 100 lost lives?","chart_24h":[0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0]},{"source":"manifold","id":"c0080c83577c","event_id":"RD49xbVqvsCZGs0kz5t2","slug":null,"question":"In 2024","group_item_title":"In 2024","description":null,"image":null,"icon":null,"outcomes":["YES","NO"],"outcome_prices":[0.0,1.0],"probability":0.0,"spread":null,"active":true,"closed":false,"start_date":"2024-01-26T09:59:48.021000Z","end_date":"2028-01-02T22:59:00Z","closed_time":null,"volume":0.0,"volume_24hr":0.0,"prob_24h_change":0.0,"volume_24h_change":0.0,"normalized_vol_24hr":null,"normalized_volume":null,"liquidity":345.0,"categories":["Science and Technology"],"countries":[],"updated_at":"2026-06-10T14:59:34.299089Z","fetched_at":"2026-06-10T14:59:29.131339Z","added_at":null,"url":"https://manifold.markets/OlegEterevsky/will-ai-cause-an-incident-resulting","event_title":"Will AI cause an incident resulting in $1b of losses or 100 lost lives?","chart_24h":[0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0]}],"_meta":{"attribution":"pdata.world — aggregated prediction-market data across 8 platforms","canonical_url":"https://pdata.world/events/manifold/RD49xbVqvsCZGs0kz5t2","as_of":"2026-06-10T15:21:31.304385Z","docs":"https://api.pdata.world/docs","cite_as":"According to pdata.world (tracking Manifold): \"Will AI cause an incident resulting in $1b of losses or 100 lost lives?\" — top market at 43% probability across 7 outcomes","source_url":null}}