I want to have insight of Data engineering industry as of now.

What are you doing in term of AI/ML in data engineering domain. I'm curious more on ETL/ELT side instead of analytics.

I'm little worried about my career path as all companies enforcing AI everywhere and not sure if that is really meaningful or what is actual scope in industry as of now?

like
Posting as :
works at
You are currently posting as works at

In future ETL and ELT both will be automated 60-70%.. pipeline creation is already getting automated in databricks and snowflake...now coming ai ml ,not much work is there and industry doesnt need many people...i m currently doing mtech in ai m from iisc bangalore online which our company is sponsoring amd what i found out is that its better to go in research field where u will hv meaningful work else many projects code is already lying in github...amd being a end user of ai ml tool one is highly replaceable with some less experienced or cheap resources...stanford graduates are struggling to get job read about IIM students not getting placed...

like

As more and more AI has been adopted, there is an increase in demand for data engineers as AI are data hungry.
Companies need people who can handle infrastructure and provide clean data.
For your future growth , you can help AI such as rag pipelines, vector databases, AI warehouses etc.
You have a great scope, but just don't stick to ETL or ELT. Think it from the architectural level.

U guys are the reason why institute earns and students suffer..yesterday i attended AI conclave in accenture and accneture in collaboration with databricks and snowflake has made a tool called CoCo builder ...it needs business requiremnt document as input and it will design ,transform and report the data and they clearly told no human or engineer needed in loop...now if this guy does the course also were he will get job and also do u know nowadays companies dont pay by head count to service providers it is outcome based i m a manager myself ..so service providers has to do same work with less head count...IT is not a career anymore..i m being told that i hv 2 years of job before i will be kicked out....whole india wants to come to IT let them come....its tougher than cracking govt job now...days of survivors or average engineers gone...koi bhi course karke IT mei job lena woh din gaye....kuch aur karlo nhi toh 5 mahine baad data engineering padhne k baad yahi miloge tum ki mai kya karu

Related Posts

Does your firm give you credit for hours that were written off? Sometimes I feel if you don’t lose anything for hours cut from the bill, you have incentives not to be 100% honest w/ your timesheet.

like

Good resources to find industry metrics? Interested to see how carriers rank up by product type in direct written premium, new business, combined ratios, etc.

like

Best place for some authentic Indian food?

like

Gratitude thread: what are the top three to five things you’re grateful for as you reflect on the last two weeks?

likeuplifting

Has anyone moved from antitrust private practice to a non-antitrust in-house role? If so, what kind of role?

like
like
like

Anyone know what happened to the Indian food truck outside of jpms building, use to be in the south west corner of 47 and park? Recently moved to new office in midtown and trying to find my old favs from like 4/5 years ago

like

Trying to buy a 20*15.4*9.6 carry on. Can it fit in the overhead bin on an Embraer 175? Delta website says 22*14*9. Thank you!

like

Any thoughts on Metyis as a strategy consultancy? They were previously known as YGroup and have recently rebranded.
Would love to hear from anyone that knows them or has worked for them in the past.

I have my final round of interview with Bain Netherlands. I am bit nervous and want some heads-up before the round. Any advice?

like

Hi fishes,
I have a written case interview with EY Parthenon in Amsterdam. Can someone help with the structure and expectations?
Have never done a written case and don't know what to expect. Where can I practice from?
Thanks in advance.

like

People in cognizant consulting or ex-employees, how is the culture? It is a good place to switch?

Hi, I am currently a Sr. Radiation Therapist experiencing burnout. I am currently looking into other positions within healthcare that does not involve direct patient care. Any suggestions of routes I should take?

like

Has anyone transferred to FDD in late manger years (M2/M3) from audit or accounting advisory? Has the transition been hard? Any advise would be appreciated!

like

I'm starting a home health agency and I'm having second thoughts because of how saturated the market is. Anyone have any experience working at a home health care agency that can share some insight into the industry?

Anyone stuck in an unhappy marriage? How do you deal with loneliness of this profession and complicated family life

Which m7s are known for consulting and/or tech as exit opps?

like

I have ~4ys industry experience, considering Slalom in the Cloud/DevOps space. LCOL area, what type of TC could I expect? What do promotions look like from C to SC? Anyone here have experience going from industry to Slalom in the tech field? Curious on your decisioning and if you were happy about it.

like

30M, Nordics. Anyone up for a chat in Europe?

like

Additional Posts in Data Engineering

Hi,
I am working as Data Analyst. Now, I seen my interest towards Data Engineering.

Please help me to decide, Should I go with
Azure Data Engineer
Or
with Big Data Technology like Spark, Kafka, Hadoop, Sqoop, Airflow.

Suggest me some good course to start.

Thanks 😊

like

I have 2 offers one from my Current company and one from Cisco my current company is giving 10 percent more than cisco Where should I go should I join cisco or stay in my current company( a small stablished startup )Considering my final goal as FAANG (similar) and I come from a Small College Cisco Amazon Uber Walmart

like
like

Nagarro OR Deloitte which firm is good for interesting big data products? And which firm has better work life balance?

like

Guys pls reply…
How is Impetus Leaplogic project for a data engineer ? In terms of technology used and WLB?

like
like

Hi folks, i am looking for a job change i have 2.6 yoe in data engineering with tech stack - hive, hadoop, pyspark, sql, python , aws. These days i am not getting much calls. I worked for x company for 2 yrs and switched to y company in feb 2022. But recently i faced a situation. I cleared all rounds and send my docs to sunlife financial but now when i am trying to connect with them they are saying your candidature is on hold. I alao resigned from my current company. What should i do?

like

American Express Hey Guys,Can anyone who is a Data Engineer and working with Big Tech Companies share some light on how you guys are preparing for interviews?How are you learning so fast/so much?Can you please share some plan or guide me on what resources you are following?There are too many things. And in my current organization I am not able to learn those.I want to learn fast and more.I see profiles on LinkedIn that are filled with big data techstack.Please guide. Adobe Amazon Walmart Expedia, Inc. American E

like

Epam system(not epam anywhere) or Impetus technologies?

Tech stack- data engineer - spark, hive, hadoop, java
YOE- 8.5 years
Both providing long term wfh option
Ctc almost same

Which would be better to join for long term settlement and growth perspective irrespective of ctc offered?

Please suggest.

like

What does col a /=/ ‘ONE’ :: “VARCHAR” do in Netezza. Join or checks for null or match to ONE ?

How can I use the same in Oracle database? Any suggestions

like

Hi Fish,

I am currently working in non tech as an analyst. I have learnt SQL AND Data warehousing concepts. I am thinking of switching to any data related role Data Analyst/Data engineer. Appreciate your views/thoughts on this.
Should I have to learn some more to switch or should take up any real time projects to start a career in the above mentioned fields.
Overall experience: 3y
CCTC: 4.2 LPA

THANK YOU

like

How is Tavant technologies for Data Engineer?

like

I got an offer for 36 in Citi , have another offer from a SBC for 39.5 , do you think Citi can match that offer? I’m willing to join Citi only. Please help.
C12 position offered , 9 YOE.

like

I have been working as an Azure data engineer for the last 3 years and am currently looking for a job change.

Please let me know if you have some referrals for similar roles.

I'm currently serving a notice period and will join within 15-20 days.

like

Hi fishes,I have around 5.2 yrs of hands on exp in data engg. and able to clear service based companies interviews easily.Now I want to switch to product based companies as I am looking for some good work,good salary but I am not really strong in dsa as it's not part of my daily work.I don't really use trees and graphs as part of my daily work.
How shall I switch to product based companies considering DSA is their 1st round itself.what level of DSA can I expect from companies for data engineer position?

like

What is the average salary for a data engineer with 5.5 YoE?
Skillset: Spark and Hadoop with hybrid cloud.
CCTC 13.5 fixed

Which companies offer good salaries for data engineers?

Why Data Modeler role is on high demand these days?

Hi All,

I'm looking for referral in data engineering.
I'm having 2 year of relevant experience in data engineering.

like

Hi fishes,
Hope you are doing well. I am looking for a job having 3+ years of experience in Data Engineer domain/ Python Development. If your organization is recruiting for this position. Then let me know or forward my profile to your connections.
YOE - 3+ yrs
NP - 30 days
Skills - Python, SQL, AWS, Pyspark, Jenkins
Thanks a lot in advance!

like

Hi people,Does anyone have given visa hackerrank interview recently? May I know the kind of questions being asked and their level?

New to Fishbowl?

Download the Fishbowl app to
unlock all discussions on Fishbowl.
That was just a preview…
Sign Up to see all discussions
  • Discover what it’s like to work at companies from real professionals
  • Get candid advice from people in your field in a safe space
  • Chat and network with other professionals in your field
Sign up in seconds to unlock all discussions on Fishbowl.

Already a user?
Login here

Share

Embed this post

Copy and paste embed code on your site

Preview

Download the
Fishbowl app

See what’s happening in your industry
from the palm of your hand.

A phone with Fishbowl app

Scan your QR code to download
Fishbowl app on your mobile

Download app

Sign up for free to view this conversation on Fishbowl

By continuing you agree to Terms of Use and Privacy Policy

Already have an account? Log in

Sign up for free to continue using Fishbowl

By continuing you agree to Terms of Use(New) and Privacy Policy(New)
Messaging rates may apply

Already have an account? Log in

For account settings, visit Fishbowl on Desktop Browser or

General

Legal