What’s the biggest gap you see right now in generative AI tools? What type of tool do you wish was on the market?
Sort by:
Tools to agnostically evaluate, privacy, transparency, bias and model energy consumption. A sort of Nielsen rating for retail but for LLMs.
It's a combination of prompt engineering and trustworthy outputs.
Prompt engineering is a skill all employees should be building, but there is an appetite to push it towards a dedicated role, which is a very short sighted as it will lead to bias (both concious and unconcious)
Trustworthy outputs falls at the other end of the spectrum and is simply that we can't take anything that Generative AI delivers at face value. It needs to be valdiated and checked.
Having inbuilt adequate Security controls which can protect the information from misuse and breach . Have not seen much information or commitment from vendors in securing this part. From the output perspective they give generic results for most of the queries and it does not give the exact results which business teams need. Lot of information need to be fed in for tool to understand the requirement and before it can be use for production. Integration with in-house developed applications I see a challenge.
The biggest gap isn't so much in the technology, but not being able to trust it. In my personal experience, there are way too many hallucinations that occur to make it trustworthy for anything more than general admin type of functions.
That said, I do think there is a place for it to help in the SOAR front and for finding connections in threats that a human wouldn't see. In addition, it should also be able to help find ways to remediate and clean up inefficient implementations of products like firewalls, etc.
The biggest gap in generative AI tools is controllable creativity. We need AI tools that can produce highly creative content while allowing precise control over output specifics like style, tone, or context, bridging the gap between innovation and customization, also These tools should also prioritize ethical AI by providing built-in mechanisms to detect and mitigate biases, ensuring responsible and fair AI-generated content across various domains and applications.