How do you approach evaluating vendor claims about integrating generative AI into their products?

Machine Learning (ML)Artificial Intelligence (AI)

Technical assessments of generative AI algorithms and techniques38%

Use case analysis for generative AI integration62%

Data privacy and security evaluation52%

Compatibility and scalability assessment26%

Vendor's future roadmap for generative AI integration11%

101 PARTICIPANTS
798 viewscircle icon1 Comment
Sort by:
IT Manager in Construction2 years ago

To be clear, the vendor must be complaint with the regulations (AI Act, GDPR, OSS, OCSE, ...) without any further assessment by our side.

Content you might like

What are some less obvious or downstream opportunity costs you’ve encountered with AI implementation?

What is the one business pain point / challenge that you regularly face, that you wish AI had solved it? The problem could be a time consuming, routine task that is frustrating to handle. It may happen daily / weekly / monthly, and you may lose many hours on it which results in delays / added cost.

Read More Comments

What is the biggest factor that will determine successful adoption of Agentic AI?

Strategic Alignment: ensuring AI projects directly support mission outcomes and priorities.32%

Governance & Oversight: establishing clear policies, risk management, and accountability frameworks.46%

Workforce Readiness: building AI literacy, confidence, and trust across roles.20%

Technical Infrastructure: ensuring secure, accessible data and platforms to support AI.2%

View Results

We are in the process of implementing a chatbot for our local government site with intentions to deploy for internal use only for testing.  We are having problems quantifying is the cost around token consumption.  I know that cost varies depending on the model used, but does anyone have any useful estimators.  Consumption calculators I have found don't seem particularly useful.  What methods for estimating cost did you use?  Did you use number of searches against the site?

What's the most important friction in deploying Robotic Process Automation (RPA) in your company?

Cost of RPA products25%

Lack of developers who can code RPA applications43%

Amount of customization needed to automate business processes27%

Lack of RPA code maintenance resources4%

View Results