Related Posts
Tata Consultancy I am a manager in Capgemini... have an offer frm TCS. the designation being offered is Assistant Consultant.. 9.8 years experience( 5 yrs with Cap) Even though I am getting a package of 25Lakhs.. it seems like a demotion in designation.. Cg has offered to match upto 23.5 lakhs.. Is it worth moving to TCS on this grade? My primary reason for moving out of Cg is i m bored of beauocracy and WLB at current project. Is it a good idea to still switch with the counter offer from Cg Capgemini Tata Consu
More Posts
Any CDD / M&A Strategy fish willing to chat?
New to Fishbowl?
unlock all discussions on Fishbowl.



If you think of deployment, the options are either calling a hosted llm through an api like replicate, groq, or save your downloaded llm to a gpu instance of aws and use the same. Unless your prod computer is gpu rich
Yes
There are only few companies in the world which are ready to build thier own LLMs, because this is damm expensive, as it involves high hardware configuration and good data, and best architecture.
Atleast 98% to 99% of the companies either use the existing LLM(openai, gemini, claude etc).
And all thier products are powered by these LLM.
There are open source llms ( available in huggingFace) but which are not up to mark as of open LLMs available.And thier parameters size significantly less.
When you say deploy llms, you finetune these open source llms with peft-lora techniques and deploy on cloud or on-prem vms.
I need your guidance. How to connect with you?
Hiii, I think I can guide and help you well in this.
Can we connect?
I'm looking to invest in a new laptop primarily for coding, with a strong emphasis on being able to run and experiment with Large Language Models (LLMs) locally. I need a machine with sufficient power to handle demanding tasks Like Successfully running LLMs like Llama 2, or similar
Specific hardware recommendations. I'm looking for guidance on: CPU GPU RAM anylaptop models that have worked well for you.