@bala gaaru, you are 100% correct. LLMs have 100+ Billion parameters. Who knows which small subset of parameters are important? Does an LLM get better if one increases the numer of parameters by an order of magnitude? By two orders of magnitude? Asymptotcially to approach the number of neurons in a brain of a chimp, a human? Quantity may not equal quality unless one knows why.
Statistics: Posted by Vayutuvan — 07 Mar 2024 08:45