Integrating AI Services into Semantic Kernel: A Case Study on Enhancing Functionality with Google PaLM and Large Language Models

Abstract

Microsoft's Semantic Kernel is a software development kit (SDK) designed for C# and Python developers to integrate AI large language models (LLM) such as Chat-GPT into their existing applications. The Semantic Kernel leverages AI services like OpenAI, Azure OpenAI, and Hugging Face via their respective APIs. This SDK simplifies the utilization of AI technology for developers by enabling the orchestration of AI plugins.

To become acquainted with the Semantic Kernel project, the team selected a 'good first issue' to address collaboratively. This issue involved modifying the API calls to include a parameter known as logit-bias, which allows developers to influence the probability of certain words appearing in responses from OpenAI models. Logit-bias is a dictionary that maps words to integer values, with -100 completely banning a word and 100 exclusively favoring a word, with varying degrees in between.