nasscom Design & Engineering Summit 2024

What can Large Language Models do, and can't do? In this talk, we delve into the technology of LLMs and explore their hoary past and what they can and can't be expected to do and why. We go over techniques for evaluating their ability to deliver ROI in any proposed automated solution. Finally, we revisit engineering techniques that have been used to manage and mitigate the shortcomings of AI in production for decades past and see how they apply to the brave new world of LLMs.