QUESTION-ANSWER SYSTEM ON MEDICAL DOMAIN WITH LLMS USING VARIOUS FINE-TUNING METHODS

The challenge of developing artificial intelligence (AI) with the ability to comprehendand produce human language has persisted since the 1950s, when the TuringTest was first proposed. Language modelling techniques have advanced fromstatistical to neural models, recently focusing on pre-trained language models(PLMs) utilizing Transformer architecture. These PLMs, trained on vast datasets,excel in various natural language processing (NLP) tasks. Researchers have discoveredthat increasing the size of these models enhances their capabilities andeven imparts unique abilities like in-context learning and the ability to think likehuman brains. These more significant variants are referred to as large languagemodels (LLMs). This report examines recent LLM advances, encompassing pretraining,adaptation tuning, utilization, and capacity evaluation on specificallymedical domains with not-so-large language models. Also, work with the PEFTLibraries like the LoRa and QLora techniques to accommodate LLMs on a singleGPU. Index Terms Pre-trained language models(PLMs), ChatGPT, Large languagemodels(LLMs), Finetuning, Promt engineering, Reinforcement learning withhuman feedback, Chain-Of-Thoughts.