Hello Fishes,
I was just wondering how you guys
implement LLM model in your
project.
Technology, framework?
If you can provide me some resources
on building and deploying LLM models, I will be glad.

like
Posting as :
works at
You are currently posting as works at

If you think of deployment, the options are either calling a hosted llm through an api like replicate, groq, or save your downloaded llm to a gpu instance of aws and use the same. Unless your prod computer is gpu rich

Yes

There are only few companies in the world which are ready to build thier own LLMs, because this is damm expensive, as it involves high hardware configuration and good data, and best architecture.


Atleast 98% to 99% of the companies either use the existing LLM(openai, gemini, claude etc).
And all thier products are powered by these LLM.


There are open source llms ( available in huggingFace) but which are not up to mark as of open LLMs available.And thier parameters size significantly less.


When you say deploy llms, you finetune these open source llms with peft-lora techniques and deploy on cloud or on-prem vms.

I need your guidance. How to connect with you?

Hiii, I think I can guide and help you well in this.

Can we connect?

I'm looking to invest in a new laptop primarily for coding, with a strong emphasis on being able to run and experiment with Large Language Models (LLMs) locally. I need a machine with sufficient power to handle demanding tasks Like Successfully running LLMs like Llama 2, or similar
Specific hardware recommendations. I'm looking for guidance on: CPU GPU RAM anylaptop models that have worked well for you.

Related Posts

I have a dumb question... I have my first jury trial coming up in a few months. It's a 3-day auto accident trial. I'm the plaintiff attorney. My question is, should I have my client present the entire three days, or am I okay to tell them that they're fine to leave after they testify?

like

My yearly appraisal in on the way. I worked for the same client for the last year but in 3 different projects. I received client appreciations in all 3 projects and in addition I also helped my account in creating proposals, etc. What should I expect in terms of rating and monitory appraisal. Would be thankful to any genuine advice.

like

I've a question on what sections to put on a regular resume. I see some people are using consulting style resume for outside companies as well. Do you think it's a good idea to devide work experience by projets? Or is it better to have "projects highlights" separate from work experience.. something like: intro>functional expertise> project highlights>work experience>education?

like

I’m a former educator that has transitioned to working for a SaaS company. I have been hired under one role but have been managing projects in design UX/UI, content management (auditing and process development), and governance (currently working on a bot project). I certified as a scrum master but I’m having a hard time finding a Scrum position. In transparency I have been in the field about 2 years. Any and all suggestions are welcome and encouraged.

like

Can we change project in Capgemini?

Just FYI, if you ever miss an issue in an agreement that you don’t catch until late in the deal process, don’t try to blame it on the other side to your client. You’ll get caught.

likehelpful

Tata Consultancy I am a manager in Capgemini... have an offer frm TCS. the designation being offered is Assistant Consultant.. 9.8 years experience( 5 yrs with Cap) Even though I am getting a package of 25Lakhs.. it seems like a demotion in designation.. Cg has offered to match upto 23.5 lakhs.. Is it worth moving to TCS on this grade? My primary reason for moving out of Cg is i m bored of beauocracy and WLB at current project. Is it a good idea to still switch with the counter offer from Cg Capgemini Tata Consu

like

Currently a manager in a Big4 & have an offer for Sr. Consulting project mgr in Oracle with 15% rise in salary. Worth the move?

like

For startup founders/people with a successful side project: How did you get the idea/inspiration for your business? I’m currently working at a Series B startup and my end goal has always been to found my own startup, but I graduated from college 2.5 years ago and I still have not had any great ideas cross my mind. I do spend a fair amount of time brainstorming. I don’t want to continue working here forever, but I’m struggling to generate that “this is it” idea to build a company for. Any advice?

like

Anyone know of any headhunter/recruitment firms for client-side marketing roles? (Nyc)

like

How many years of experience did you have before you went client-side?

like

Hi Fishes,

I got offer from 
Visa Consulting and Analytics with CTC around 34LPA. But I will be working from client location. So how will my work life balance be affected? I am in a big dilemma because of this.

Any help would be greatly appreciated.

like

Any one getting hired for city bank project in Wipro . How the the city bank unit in Wipro

like

How do you find test subjects for your research project? What kind of incentives do you like to offer?

likesmarthelpful

Guys, I am looking for a project in RPA technology. I have basic knowledge in Uipath and Automation Anywhere. Any leads please DM me.

like

Seeking for tips/advise to break into equity research (ER) - with my profile:

Relevant to ER: 6 month IB internship @ small sized Los Angeles Merchant bank; CFA Level 2 cleared; Master of Science in Finance - SUNY Buffalo - Extra-curricular work relating to ER - university competition - case & research work, academic project w Co., custom electives; 1 year – wealth management – client acquisitions exp.

Additional Experience: 1.5 yr Product Control Analyst @ Citi & 1.5 year Loan Operations

I’ve very fortunate to have a new job. I wanted WFH, but I guess it wasn’t in the cards. Do you think people who work from home are that much happier?

likesmarthelpfulupliftingfunny

I have a governmental entity client in Texas that wants to offer 6 weeks of paid parental leave for all employees, even those who aren’t eligible for FMLA. After the paid 6 weeks, the employee can choose to continue paid leave using any accrued personal leave.

Texas does not have a paid parental leave statute.

If paid leave above what is required is offered for parents, do we also have to provide the same benefit to other employees that are eligible for unpaid leave?

like

How is being on the bench differ across firms? For us, it often is working similar to project hours (late night) on short fuse pitches

like

More Posts

Hello all,

I have started my career as manual tester and have 1YOE. Im thinking to move on automation testing and I'm learning automation using tools such as katalon studio and functionize.
Can you please suggest me to whether I need to continue my learning based on tools or selenium would be better?

Thanks in advance

Have a spider mite infestation on a lemon tree I brought indoors for the winter. Anyone have any ideas for how to kill them? I looked online and have tried neem oil, but it doesn’t seem to be working too well. Help!

like

I was recently (in April) fired from a good nursing position that I was at for 5 years. I reached out to my old ADON to get some information on where we had our vaccinations from and she told me that I should come back and the administrator that I had issues with is gone. Is this something I should even consider? I miss my patients and some of my coworkers and the pay is better, but I don't feel like I would really be welcome to come back.

like

How to know company is given medicine facilities to employee and his family, is it mentioned on the offer letter?

How to avail mediclaim?

like

Any CDD / M&A Strategy fish willing to chat?

like

Job Titles-Levels: what are typical career levels within M&A practices at your respective companies? For example, EY-Parthenon recently rebranded the following levels. Curious if this is industry norm. Manager became “Director” and Senior Manager became “Senior Director”

like

Hey everybody, I work in Healthcare Consulting (9m of prior M&A experience) and have an upcoming PwC Deals Contracts Analytics associate interview next week, any PwC D&T/M&A folks willing to connect, share their experience and provide any insights for nailing the interview?

like

I’m curious about the enlisted versus officer ratio as well...here’s a way to better survey the group. “Like” your respective group below.

Is it possible to exit to LS VC from a boutique firm? What type of experience do they typically look for?

like

What are some of the must read books in Management Consulting?

likefunny

Hey all, having issues with interviewing this year. I’ve been passed over every opportunity I really want and I’m unsure how to regroup and move forward. I’m really trying to break into method development roles and I haven’t had the opportunity to do so with my analytical experience. A lot of my HPLC and LCMS experience is with already established methods. Any tips?

like

Looking to move out in about 1-1.5 years.. any thoughts on where to park a large sum of cash for the time being? I feel like just having it sit in regular savings is a waste, but putting it anywhere even if it’s not known for being risky still rubs me the wrong way! 1st time home buyer, thanks!l!

like

Cognizant Senior Associate or Sunlife Financials same fixed CTC but 2 lac variable more in Sunlife . 10 YOE looking for job security and WLF.
Will project be allocated in CTS when I join and what is role of Senior Associate projects.

like
like

Currently working as an in-house SEO for a big ecommerce company (fortune 500). Currently earning 65K CAD. Contemplating a position for SEO manager on another company, SaaS B2B, very small office (<50people), pay around 80-100K. It's not a startup.

Did anyone made a move like this? From a big company (SEO team has 5+ people) to a very small company? I'm worried about job security and how stressful this new position would be, considering I'll be the only SEO professional there.

like

Amex rewards is not as well as cards like Marriott or Citi AAdvantage. Isn't it better sometimes to use your card for expenses, but report it correctly and be reimbursed?

like

So here in CA there is a lot of talk about certain jurisdictions doing virtual jury trials. As a firm we won’t agree to it and if push comes to shove we’ll take it up on. Writ. What is everyone else’s opinion?

like

Does any one knows public sapient interview process?
I have completed one MCQ round and one technical round (2 hrs).

like

Hi All

Received offer from HCL for 19LPA
YOE 7.1
Band E3
Associate Consultant
Domain Network Security

CCTC 14LPA
I asked 20LPA.

Is 19 LPA good package for the E3 band?

like

What is the Senior Associate comp at PwC Consulting? Not too sure about the cohort system. Thanks PwC

like

New to Fishbowl?

Download the Fishbowl app to
unlock all discussions on Fishbowl.
That was just a preview…
Sign Up to see all discussions
  • Discover what it’s like to work at companies from real professionals
  • Get candid advice from people in your field in a safe space
  • Chat and network with other professionals in your field
Sign up in seconds to unlock all discussions on Fishbowl.

Already a user?
Login here

Share

Embed this post

Copy and paste embed code on your site

Preview

Download the
Fishbowl app

See what’s happening in your industry
from the palm of your hand.

A phone with Fishbowl app

Scan your QR code to download
Fishbowl app on your mobile

Download app

Sign up for free to view this conversation on Fishbowl

By continuing you agree to Terms of Use and Privacy Policy

Already have an account? Log in

Sign up for free to continue using Fishbowl

By continuing you agree to Terms of Use(New) and Privacy Policy(New)
Messaging rates may apply

Already have an account? Log in

For account settings, visit Fishbowl on Desktop Browser or

General

Legal