How LLMs like Chat GPT and Gemini are hitting dead-end? Find the Reason
In the realm of artificial intelligence , Large Language Models (LLMs) such as Chat GPT and Gemini have captivated the imagination of researchers and enthusiasts alike. These models represent the pinnacle of contemporary natural language processing , capable of generating human-like text and engaging in meaningful conversations. However, behind the facade of innovation lies a sobering reality: the looming dead-end of traditional computing. The sheer computational power required to train and deploy LLMs is staggering, with training often necessitating expensive GPUs and TPUs . Despite the substantial investment of resources, the journey does not end once the model is trained. Inference, the phase where the model performs tasks related to artificial general intelligence (AGI) , demands ongoing computational power, further exacerbating the financial burden. Compounding this issue is the approaching limit imposed by Moore's Law, which dictates that the number of transistors on a mic...