Which option would you prefer to work with in your org: a domain-specific small language model or an LLM?

Machine Learning (ML)Artificial Intelligence (AI)

Small LM25%

LLM50%

It depends25%

Not sure

107 PARTICIPANTS
1.1k viewscircle icon1 Comment
Sort by:
IT Manager in Constructiona year ago

SLM all the way. As you can see market trends is moving fast to 3/7b parameters LM.

Content you might like

Does your organization have an AI CoE?

Yes43%

No, but we plan to35%

No, and we don't have plans to21%

View Results

I am interested in people who have tried generative AI coding projects.  In your experience, are there project attributes that make generative AI coding capabilities a "good fit"?  Are there project attributes that are likely indicators that generative AI will not result in something useful?  I would think complexity of requirements is a big factor.  If the complexity of the project or its requirements is low - I assume genAI coding can get you within the ballpark.  For instance, logic stores: if your project has critical business logic spread out all over the place and not centralized I think that generative AI would not be able to make sufficient sense of that.

How are you addressing technical debt risk resulting from AI coding tools? Have you established specific processes to manage vulnerabilities in AI-generated code, and are you collaborating with software engineering or other teams using these tools?

How likely are you to use the new Azure OpenAI service?

We already have plans to use it8%

Very likely30%

Likely24%

Somewhat likely23%

Somewhat unlikely3%

Unlikely3%

Very unlikely

Unsure4%

View Results

We are in the process of implementing a chatbot for our local government site with intentions to deploy for internal use only for testing.  We are having problems quantifying is the cost around token consumption.  I know that cost varies depending on the model used, but does anyone have any useful estimators.  Consumption calculators I have found don't seem particularly useful.  What methods for estimating cost did you use?  Did you use number of searches against the site?