If your org’s using any virtual assistants with AI capabilities, are you concerned about indirect prompt injection attacks?

Machine Learning (ML)Artificial Intelligence (AI)

Extremely concerned — it’s a major risk19%

Somewhat concerned — it's a potential risk66%

Mildly concerned — it’s on my radar13%

Not particularly concerned — I doubt we’ll be impacted2%

344 PARTICIPANTS

3.7k views2 Comments

Sort by:

Chief Data Scientist in IT Servicesa year ago

This has been a risk for as long as IT systems have been around. I feel like were using the word prompt to talk about Generative AI solutions, but there is alot of solutions that based on Conversational AI. But any solutions that has access to your back end and integration is a risk of attack.

Board Member, Advisor, Executive Coach in Software2 years ago

What many dont realize is that AI or more accurately ML models themselves are not protected - whether it be a model used as a virtual assistant or an ML model used in a trading platform in the financial industry or an ML model embedded in an application like a CRM or even your security tools. So we should be asking a a much broader question on the risks any ML model poses to our organizations and our customers

Content you might like

When it comes to generative AI threats, what weighs most on your mind?

Lack of security18%

Inaccuracy36%

Bias22%

Job losses5%

Negative cultural impact6%

Lack of IP protection5%

Widespread knowledge gaps5%

Economic volatility

Another threat

View Results

Anomaly Detection / Mindbridge: We’re exploring tools that support continuous monitoring of financial transactions (e.g., inventory adjustments, journal entries, credit memos, disbursements) to help us identify anomalies earlier than our traditional periodic audits allow. We are a $20B company with 50+ different ERP systems globally (some data is mastered). Our goal is to enhance fraud detection and internal controls using modern, AI/ML analytics tools. We've started a vendor assessment process and MindBridge seems to be the only vendor that fairly fits the bill. I'd appreciate if someone can share any feedback/experience on the solution/vendor.

How have you calculated ROI of AI solutions (including agents) that you've rolled out at your firm? Are there specific KPI's that you've focused on and how have you measured (and validated) the value?

Which of the following AI technologies will have the greatest impact on the global technology market in the next 2 years?

Composite AI6%

AI governance34%

AI orchestration and automation platform26%

Generative AI18%

Human-centered AI10%

Synthetic data3%

Other (Comment below)