Question for experienced Machine Learning Engineers & Data Scientists. 1. How to identify perfect model for data. Either ML or DL model. If it is DL with custom layers how you decide the architecture and identify this is the perfect one ? 2. Till now I do random trials and finalise the model with high accuracy as best model. But how you decide based on understanding your input data ? I’m asking these questions in research perspective.

like
Posting as :
works at
You are currently posting as works at

My approach is to start with simple Architecture and check if there any better model or architecture available for problem statement we are solving and Experiment by adding each layer or additional layers and Logging these Model Evaluation Metrics and whichever gives u the best Results that's the best Model.

Accuracy is not the best Metric always,it depends on what type of Problem statement you are solving.
Let's say we are doing Health Disease classification and In which I want the model to predict all the cases of the Disease ie, Recall should be Higher because even though model Classified Normal instance as Disease instance ,those patients can check again or do precautions tests to confirm again but if u left any classify any diseased patients as Normal that's gonna create chaos.

Normally researchers prefer F1 score as metric and also do cross Validation to check Model Accurate Results.

And Plot different Metrics plots like Roc ,Prc curve those Will give u some extra idea about which model u should choose.

I think u should record whatever custom layers u are adding and the Parameters of it and results of it and combinations of it for logging ,this way u can easily find out which method or combination is giving u best results.

likehelpful

A lot depends on your input data type, structure and size. If data is all binary then a tree based model might be a bad choice and if it is an image then a CNN/Transformer based model should be chosen. Also, depending on the number of data points you have for training one might decide if a particular architecture is chosen, will it even converge to a local minima.

To start with, these pointers help. Once you have finalized on the model types, I guess then its all about experimenting with readily available models. If you see an opportunity to further improve the model metrics then you can go ahead with a custom model architecture.

Last but not the least, the gpu compute available at your hand must be considered before you select a specific architecture. Experimentation time drastically changes based on your architecture selection.

Hope this helps!

Related Posts

Anyone working towards early retirement? Whats your target $, age and location?

likehelpful

Does anyone know if the 10% penalty and if taxes are waived on a death of a beneficiary? A friend of mine’s 17 year old pass away. I was wondering due to the circumstance, is there any way he can get around paying extra money by doing a 1035 exchange, rollover, withdrawal. Anything out there? Suggestion are welcome.

Hey guys I’m trying to figure out the market rate for a staff tax accounting position as I am new to the industry. I am looking in Long Island New York any help would be great. Looking to start at a mid sized firm.

like

What are the exit opportunities for digital consulting if product management recruiting doesnt go well?

like

Hi, I am looking to be referred into some top consulting firms. I am a Project Coordinator at Nielsen with 1 YOE. I have applied thru various job portals but the application does not seem to be viewed or going forward. Would be really helpful if my fellow fishes can refer me. I will be happy to discuss further on this and share my CV. Have a good day!

like

5 years of experience, Digital Media Supervisor is the next title for me Associate Media Director?

Does Walmart uses dell boomi

like

Hi folks,
I have recently joined capgemini.
Is it worth opting for bus pass if we're working in hybrid mode? Bcoz i think any way if we opt for, the company will deduct whole month specific amount under conveyance allowance.

like
like

Where to order Ethics CPA study course so I can get reimbursed by PwC? I took Roger instead of Becker and I am not reimbursed so im asking.

like

Hi guys

I require one clarity, if my application is under process in one department for a role and i have applied in another role in different department suitable to my profile in same organisation will they consider the application or not ????

-especially Deloitte
Please guide

like

What does it mean if there’s a NEP at the firm who’s been there for a long time (20+ years), but never got promoted to EP? Never held leadership roles too. Does it usually mean EPs does not like the NEP enough to get promoted?

The NEP has a book of business, though no idea how much it brings in.

like

Gorgeous night, 36/m, anyone want to meet for a drink?

like

Any Valee, Megan Thee Stallion, Gunna, Zack Fox, Brandon Wardell, Deftones, Anand Giridhradas fans out here?

like
like

Hello,

Received an verbal offer from
Amazon for Data Engineer position (Luxembourg).
I have no idea regarding pay bands for Amazon Luxembourg.
Wanted to check if there is any room for improvement with respect to proposed offer.

Base : 85k €
Bonus : 1st year: 14k and 2nd year : 12k €
RSU : 24 Units

YoE : 4
TC : 42 LPA

Amazon

like

Anyone got salary today??

like

Is it possible to get a convenient location transfer in LTIMindtree? Or it can be decided only after the project allocation?

like

Is it true that UAE public entities are the best among ME public sector clients? If yes, why?

like

9th September onwards, so called the grand programme for the next 3 Fridays for completion of 150 years!
Question to Leadership!
1. You are calling all the employees in the office & just providing lunch? That's all for completing 150 years?
2. You would ask questions, and whoever is able to answer it, you will give some merchandise only to them?, And the other people are not your employees?
Why are you even organizing it? You think people would come from far places just for lunch?

likeuplifting

Additional Posts in Data Science and Machine Learning

i am looking for data scientist role, i have done only email spam and phishing detection project , i have done PGP course in same ,i joined one of the service company 3 months back , still project not assigned yet , kindly refer for suitable product company, DM me to share resume

like

Hi fishes
I am very intrested in data science career plz someone suggest me from where/how I can start

like

Hi everyone, I will be highly obliged if someone can share the interview questions for data scientist/decision consultant role in fractal

like

Hello fishes,
Can u pls name a few reputed MNCs in Pune location working in Data Science domain like TCS, Accenture, Capgemini?

like

Hi, what salary can be negotiated for 6+ overall experience & 4.5yrs of experience in DS role. Education is BE, MBA. Current CTC is 9.9L. Thanks in advance.

like

Hello fishes,
Does anybody know how much it takes to receive Revised Offer letter from Mindtree ?
I had a discussion with the recruiter on 6th May and he agreed to send the revised offer letter, but I am still awaiting it. The recruiter is not receiving my calls, not replying to my sms and emails as well.
Not sure what to do in this scenario.

like

Hello fishes


Want to start my career in data science
I am 2021 mechanical engineering graduate having one year of experience in cognizant in support.
!!!!!! Help please

Thank you in advance

like

Hey Folks,

Help me to unlock DM!

Thanks.

like

Hello folks!
Wondering what is the ideal package for a 5+ years exp with AI and Deep learning skillset?

like

Hey All, which is better Fractal or Happiest Minds for Data Scientist ? Both are offering same CTC. Got to decide soon as my joining date is next week. Thanks.
YOE : 7 years.

like

Hey fishes
Need your help

I am from non tech background and planning to shift my career. Currently I have 2 options for a career change.
1. Data science.
2. Cloud computing and devops.

I have zero coding experience..
Request please help me choose the best for my career .

Thank you.

like

Hi All,
Need some suggestions!!! Please help

I have two offer , one offer is from Infosys and package is 16 + 1.25(JB) and role is lead data analyst - data science (Bangalore location) and other offer is from Latent view and package is 18 and role assistant manager and location is Chennai.

Which one should I choose?

like

What skills are going to be on top in coming years into data engineering.
Currently spark is mandatory for data engineers.
How's the scope of Snowflake in future.

like

Hello. Is the Nvidia stack (deepstream sdk, tensorRT, Gstreamer, CUDA, etc.) widely used? Are the skills transferrable and worth learning?

like

I am currently working as a delivery manager for a data science project where I manage both ML and DE teams. I am not sure what career path should I follow.

Should I move into either a core technical data science/data engineering role or move into a techno-managerial role like a program or project manager? What role would be best in terms of money, growth, and job security?

like
like
like
like

Hi everyone! How are you all doing?
I am looking for a switch to a Data Science/ ML role.
As of now, I am working as a Data Associate and my tech stack is: Python, SQL, Aws, kubernetes, docker. I have worked on creation of Novel scripts to parse medical data and optimization of existing data parsing scripts, ETL pipelines and Data Migration. YOE: 1year 2months.
Thanks.

like

New to Fishbowl?

Download the Fishbowl app to
unlock all discussions on Fishbowl.
That was just a preview…
Sign Up to see all discussions
  • Discover what it’s like to work at companies from real professionals
  • Get candid advice from people in your field in a safe space
  • Chat and network with other professionals in your field
Sign up in seconds to unlock all discussions on Fishbowl.

Already a user?
Login here

Share

Embed this post

Copy and paste embed code on your site

Preview

Download the
Fishbowl app

See what’s happening in your industry
from the palm of your hand.

A phone with Fishbowl app

Scan your QR code to download
Fishbowl app on your mobile

Download app

Sign up for free to view this conversation on Fishbowl

By continuing you agree to Terms of Use and Privacy Policy

Already have an account? Log in

Sign up for free to continue using Fishbowl

By continuing you agree to Terms of Use(New) and Privacy Policy(New)
Messaging rates may apply

Already have an account? Log in

For account settings, visit Fishbowl on Desktop Browser or

General

Legal