I’m thinking on shifting my career into Data Engineering. I’m a data scientist (statistician), but I’m kind of interested in being more of the builder rather than the analyst.

How does the career path and outlook for DE compare to DS?

Also, how hard of a transition would this shift be? I have python, R, and SQL expertise (also lower level languages from undergrad). I have ML and CS minors, but no engineering experience. I know cloud fundamentals, but also no experience.

like
Posting as :
works at
You are currently posting as works at

The skills you mentioned are essential for becoming a DE. You may be lacking the data pipeline building skills so just upskill by building a data pipeline as a minor project. Many YouTube videos out there.

Python, Airflow, Aws glue/step or Azure data factory are hot and required for the DE roles

likehelpful

You’re definitely qualified to shift into DE from DS, but I’d recommend you brush up on your Spark and cloud experience (specifically data pipelines)

helpful

Look into Applied Scientist jobs. These have been my last few jobs, though all labeled DS. I don't really touch testing, and often feel like all I do is build... Think kind of like internal ML consulting, but you're the project execution guy and your management are the folks who sell

If you’ve a solid DS experience, I would recommend pursuing MLE role, it’s essentially DS + DE,

You’ve to up skill on DE and SWE type skills.
Recommend you to do a boot camp, focus on landing entry level role by practicing leet code, etc

Related Posts

Recently received a PM offer with the option of Mountain View or NYC location. Would need to move to either city but have a preference for NYC. Are there any trade offs (network / career opportunities / projects etc) to starting in NYC over the Bay Area?

like

Is it worth it to go back to school for a better track to a FAANG company? The division I’m currently in seems like there are no good opportunities, and I have the funds available to finish my undergraduate full time (Canada). I applied to Amazon before for a highly senior position and made it to final interview so I think I would have a better chance for a new grad type role.

like

Hi all,
Can someone from BCN give me some insights on the culture, growth opportunity and hike scenario.
How is the movement frequency from BCN to Bain India?
Current offer at BCN is 19.65 LPA
Also I havevanother offer from a unicorn, (19+2 JB + 4 ESOP) LPA
Help me make an informed decision.

I'm a 2022 MBA pass out from one of the second gen IIMs

People who have made it to the perceived “top/best” place in their career field/education (MBB, FAANG, top PE fund, HSW, etc): do you feel satisfied? Have you had to recalibrate your goals? If so, what are those goals?

like
like

I got an offer from Natwest. My current company is accenture and they are offering me to promote as an assoc manager if i take my resignation back. Shall i consider it? What whould i prefer Nat west or promotion in Accenture. How much hike accenture gives while promoting? Any inputs?

likehelpful

Have others found it hard to transition from Audit to Financial Analyst? All the recruiters I’m meeting with are telling me I probably won’t get an interview since they’re looking for someone who’s ready to hit the ground running.
It’s discouraging because I’m a fast learner, and from talking to my friends who are Financial Analysts, it doesn’t seem like what we do is so dissimilar.

likesmart

Hi, I have more then 2 years experience in Excel all the advance formulas and stuff as Jr. Analyst & Data entry Operator, Currently working as Customer Service associate in Amazon (2.8 LPA). Recently I have learnt basic SQL, R & Tableau through Google Data Analytics Certificate. Can I switch whith these skil sets or I have to complete some projects or Lear python for that?

smart

Anyone have a CFE designation and taken the test recently? Debating about getting it wasn’t sure if it’s worth it.

like

HSBC I have an offer for Consultant Specialist GCB5. Not sure what the role is..is it a team lead role or is it a junior role? I have 10 yoe .. is it apt? Pls help Thanks

HSBC India

like

After you are stealth laid off, other than job search, what do you do? I assume they won’t give you work and even if they do, you can politely decline? How do you feel about you are not progressing anymore and seeing other people progressing in their career? I have no intention to make partner, but still feel a bit stuck not doing that much.

like

I'm a typical Java Developer. I want to widen my stack as a Backend Dev. Should I learn Node.js?

like

Persistent Systems Limited Hello fishes, Please suggest which one is best in terms of WLB, Job security and carrier growth. 1. Hitachi Vantara 2. Rakuten India 3. Persistent systems limited 4.Neudesic LLC 5. Thoughtworks
6.Publicis Sapient

Not received offer so far. All the above in pipeline please suggest me how much can expect.

Tech stack: Dot. Net Full stack developer, 7+ exp Please provide some insight about the company suggest by you.

CTC: 15 LPA fixed

like

How do PE exits look like for emerging market funds in Middle East (e.g Abraaj group type firms)

How much time should I expect between starting a UX design boot camp, doing a job placement program with portfolio building to landing my first gig? I hope to be able to work quickly because I’ll have 15-20/week devoted to learning.

Think it’s possible to do it all under 6 months? I have 10 years of graphic design experiments 6 with a large entertainment company. I’ve saved money and I’m ready for the switch!

like

Currently in consulting where I get to do data visualizations sometimes but not always, have an opportunity to shift to a data analytics focused role. Struggling to decide as I am not fully sure if I would be competent in/happy with daily data work. Advice, thoughts? 😣 I just never find what I like…

like

Does anybody here do any side work for extra income using their data expertise? I would love ideas that I could do from ~5-15 hours a week. Tutoring is the only thing that comes to mind immediately. Thanks in advance!

helpful

Currently a Wealth Advisor for Citi but I honestly hate it here with a passion it’s the worst company I’ve ever worked for in my life and I’ve been in Wealth Management in the banking channel for over a decade. Series 7, Series 63, Life, CFP, ChFC, and soon to have my MBA with a focus in Mergers & Acquisitions. I’m look to enter another area of Finance at this point instead of starting over somewhere else from scratch, but not sure what direction to go. Interested in Investment Banking or M&A.

Trying to get an investment job in Toronto as a new immigrant. I have 4 yoe in consulting, investor searching and financial service (risk). Currently working at call center to get local experience (bilingual), opportunities for internal transfer, while preparing for CFA 3 next Feb. Any ideas what to prepare in extra?

like

What are some great paying fields/position that are lesser known in the world of finance and are not crazy hard to lateral into? With around a year of experience in asset management/operations, I always try to think about what my career path will be and so far it has been ever changing.

like

More Posts

Anyone else here looking to make a switch into healthcare (physician, nurse, etc)?

like

Currently a new S1 thinking about taking a FP&A role. Is going from Senior to Analyst not Senior analyst a bad move? Mediocre raise in salary (3k) but well known company with a flat structure

like

Hello

I've been interviewed by @Amazon on 8th July and even after multiple follow up emails, there's no update. Any suggestions?

like

Hi Fishes, If I join Bank of America (BA Continuum) on October 1st, will I be eligible for hike in coming appraisal. Bank of America BA Continuum India Pvt. Ltd.

like

I am a mechanical engineer having 10 years of experience in wind and automotive domain. Is it possible to switch to IT domain. Please suggest some course without or with basic codeing to get some IT jobs.

like

Hi, can anyone tell me what will monthly in-hand salary for this one.
PwC Deloitte

Post Photo
like

just got a full time graphic design job. is there any reason why using the work-provided adobe creative cloud account for personal use is a bad idea? like privacy or something? i’m thinking of canceling my personal subscription and saving some money.

like

My last therapist keeps coming up in my mind. I left her when I moved to a new area before COVID dug in and frankly it felt like leaving a girlfriend. She also disclosed in the final session that she was a member of AA and knew several of the people I occasionally discussed from the rooms. Her knowledge of the program certainly built trust with me early on, but it has been two years. I discussed it with my current therapist but she’s still in there. Any advice?

like

Hey y’all! Anybody willing to provide a reference for Global Endowment Management? Would love to connect.

like

Anyone in the market for bags? Looking to sell a Celine Luggage, Celine Belt Bag, Givenchy Antigona and an LV Neverfull. All great for work!

like

New to insurance, please can someone explain what "capacity" means in the context of a managing general agent or coverholder in the insurance world? E.g. "An MGA securing more capacity to write D&O lines"

like

Salary aane ka bhi koi deadline hai?

How much should a senior email designer/developer make? I make 77k USD and feel like I’m underpaid. 😕

like

Who all are coming to Sunburn this year?

like

Currently I have 6.5 years of experience, completed 2 years in current organisation and I got very good hike also (after hike CTC is 24 LPA )
And my manager got changed also but I am frustrated with my new Manager.
should i start preparing for next/better Company like Amazon, Microsoft ?

like

How do you know that you want to spend the rest of your life with one person?

likefunny
like

For those who have asked to switch clients, does it make a drastic difference? Currently so bored with my main client but not sure if grass is always greener. Thanks.

likesmart

Additional Posts in Data & Analytics Consultants

What are some of the best online resources to learn Power BI?

like

Would you give a referral to someone you haven't talked to in years and don't know much about their ability?

like

This might be a long shot ... but I have a Statistics assignment due for tonight in a few hours

Does anyone know how to do Linear Discriminant Analysis with more than one predictor - by hand? I know how to compute in R but my professor wants it done by hand .... fml

likefunny

Currently in consulting where I get to do data visualizations sometimes but not always, have an opportunity to shift to a data analytics focused role. Struggling to decide as I am not fully sure if I would be competent in/happy with daily data work. Advice, thoughts? 😣 I just never find what I like…

like

Hello, Anyone here from Deloitte Omnia AI who could refer me for an open opportunity.

like

Meeting with a recruiter at one of the FAANG companies. I won’t be able to move jobs because of H1b /GC at least for the next year. Any idea if I should start off with that or should I just try to understand the work that they have been doing?

like

Anyone have any tips or material on effective storytelling to leadership? I have to present an analysis and recommendation to a VP and really need to put together a good story. Thanks!

like

Hiring for data scientists and BI analysts across a couple levels, DM me if interested!!

like

from God import pandemic
From China import coronavirus, mortality_rate

covid_19 = pandemic.coronavirus.set_mortality(mortality = 1.)

like

I'm planning to transition to Data Science. What should be the key technologies that i need to learn and add to my resume to make this work?

Thanks for your suggestions.

like

What do you think when associates/senior associates misspeak on a concept during a meeting or interview?

I’ve learned something new on each project, and I’m afraid of coming off as an idiot so I rarely contribute to conversations; only after I have done research on the topic and have prepared do I speak/give ideas

like

How hard is it to get an interview for SWE at FAANG outside of on campus recruiting? I’m in GT’s OMSCS program right now, hoping to take advantage of career fairs this fall, but I don’t know if I’ll have enough time to prepare for the technical interviews before then. I’m worried about missing out on the recruiting opportunity and having to resort to applying online/LinkedIn afterwards. Any insights into this?

like

What’s the best/simplest way to understand Sets vs Groups in tableau?

like

What are some interesting non-tech/insurance/advertising/consulting careers where data science is applied? Thinking of epidemiology and economics

like

Partner: Let’s take the data in the spreadsheet and put it in PowerBI so we can cut it up.

Me: What? It’s already cut up in the spreadsheet. I don’t get it.

Also me: Yeah! Analytics!

likefunny

Quick survey: Do you guys think having a template package to envelope an ML model as an application would be helpful. The package could contain boiler plate template for unit test, docker image, CI/CD, database connectors etc and act as a starting point for doing that. Tech firms usually have that internally but limited options in open source.

like

Hi! Does anyone know what kind of knowledge is needed to crack the Data Scientist interview at Google?

I'm currently working in Marketing Analytics (primarily using SQL and a bit of pyspark). Apart from mastering SQL, I wanted to know from people working at Google what does it take to get there as a Data Scientist? (I'm very interested in Strategy Ops)

I plan to another 6-8 months in preparation and upskilling myself before I even apply.
Any help and guidance is appreciated! Thanks :)

like

Could anyone recommend a set of indices that are publicly available and is a good predictor for consumer spend in home renovations ?

like

What is it about D&A that most clients (or even partners) don't appreciate? Thinking about the painpoints or opportunities that are unseen at the top or require lateral thinking

like

What’s so good about the Georgia Tech OMSC and OMSA? Is it just the cost? Seems to be recommended by most of reddit

likehelpful

New to Fishbowl?

Download the Fishbowl app to
unlock all discussions on Fishbowl.
That was just a preview…
Sign Up to see all discussions
  • Discover what it’s like to work at companies from real professionals
  • Get candid advice from people in your field in a safe space
  • Chat and network with other professionals in your field
Sign up in seconds to unlock all discussions on Fishbowl.

Already a user?
Login here

Share

Embed this post

Copy and paste embed code on your site

Preview

Download the
Fishbowl app

See what’s happening in your industry
from the palm of your hand.

A phone with Fishbowl app

Scan your QR code to download
Fishbowl app on your mobile

Download app

Sign up for free to view this conversation on Fishbowl

By continuing you agree to Terms of Use and Privacy Policy

Already have an account? Log in

Sign up for free to continue using Fishbowl

By continuing you agree to Terms of Use(New) and Privacy Policy(New)
Messaging rates may apply

Already have an account? Log in

For account settings, visit Fishbowl on Desktop Browser or

General

Legal