Analytics background wanting to switch to data engineer. What would be the best way to do it? What skills should I focus on?

like
Posting as :
works at
You are currently posting as works at

Data pipelining is a must ie. ability to
Write scalable, fault tolerant scripts to move data from one place to another.

like

Misread your question OP, best way would be either use python or/and SQL. A lot of the time is spent on performance tuning your script, handling very large dataset, using techniques like partitioning, parallel processing etc.

Any data engineering boot camp would be a good start or working on a project by yourself.

helpful

Pick a platform. Pick up pipelining. Pick up a framework. Get some experience with airflow... Learn cluster configuration and cost management in your preferred environment... know how to dig through a DAG.

like

ETL/ELT, data modeling, good to understand/know one of the cloud platforms(gcp, aws, azure), data warehousing, SQL, Python, big data tools/technologies.

like

Related Posts

Anyone here from Health Industry Group (HIG) that want to share some insights on the type of work, growth etc

like

Any realistic exit options from Cognizant? I’m not having luck switching firms.

Hello fishes,
Please help me choose.
Walmart or Paypal for around the same salary.
Which is better in terms of learning, job security and work life balance?
Thanks in advance for you valuable inputs.

like

Hi folks,

I have been offered a position on Senior Consultant/ Deputy Manager at Deloitte India for 4.5 years of exp.

Is this position/role normal for years of experience I hold?

like

So l just started a new job (I work in
higher Ed) but I would like another
stream of income. I am interested in
adjunct faculty but I find it so hard to
get into and I think it's because of
experience teaching. Can anyone be if
help with landing an online adjunct
position for teaching college
readiness or success? I think to start
my teaching journey that type of
course would be best.

Anyone currently in People Advisory services at EY? Left a banking job at Chase to go into Resource Management at EY. Considering looking in to the Talent/Learning side of PAS? Hours, lifestyle, pay?

Can someone give insights about yearly hikes please. I'm joining this month but not sure about growth perspective. 9 YOE , Hyderabad

like

Which one to choose
1 Mercedes-Benz, banglore, 28lpa
2 Impetus ,pune 26 lpa
Yoe 10
Skill sql, plsql
Help me to decide which one is best in terms of learning and growth.

like

Recently got my CPA license in August & considering leaving public accounting for Industry. Should I expect my new role to pay for my CPA license renewals/AICPA membership/CPE classes? These things add up &I feel like should be considered when transitioning. Thoughts?

like

I want to learn SQL with free certificate. Any one can suggest where ca in find it free. You response can change my life

like

Would you ever mentor a junior accountant at your firm? Do they reach out to you? I really would like to help more younger people get into the industry.

like

I got 50% hike in Infosys however in accenture, I got 20% mid year hike and 30% hike promise in Dec'22 to match Infosys. Should i stay in Accenture or move to Infy? which company is better?

like

Hi guys, a plea for help here 🙏🏻 have any founders here gotten an O-1 visa or an H1B transfer into their startup? Would greatly appreciate hearing your advice / experience over DM

like

Hello Friends, Please help me out which paid online platform is best for java full stack developer. I have 7 years of experience in java and want to enhance my skills more. There are many in markets like:- upgrade, great learning, scaler, simplilearn and many more. Please suggest which one is best. Or anyone here joining any of these platforms yet?

Hello all, I am a production manager for a sign design and manufacturing company. I have been with the company for six years now starting as lead graphic designer working my way to the production manager. since becoming the production manager two years ago I am responsible for 4 large format printers and 1 vinyl plotter. I’m wearing too many hats but I love what I do. I would love to be a remote graphic designer but I don’t know where to start. Any suggestions?

I already am a CFP, now thinking about getting the RICP. Who has it? What's the study time required?

like

Looking to take a break from the advertising agency world (honestly pretty burnt out on ad land) Thoughts on working at an agency who may be more focused on branding or content creation. Anyone made the jump?

like

Can anyone guide me how to switch from Microsoft to Google.
MS tech stack : M365 ( Intune , Defender)
Google tech stack interestes in : Google workspace.

like

Making a career change from mechanical engineering to software engineer. Got an offer today. Pretty nervous and I already feel like an imposter. I am almost entirely self taught, they know this, and they know I have no software engineering experience. Any advice?

like

Hi Guys,

I appreciate your views on Scaler Academy data science course. The course fees is around 3 lakhs and duration of this course is 12 months. I belongs to Non IT field, is it possible to become a Data Scientist for the one who having non IT background?



Thanks!

like

More Posts

Hi 👋 I’m new to the LA area and looking for good networking events. Any places I should look into? Thank you in advanced!

like

Accenture India Employees - (1) How much does job location matter in getting good projects for a fresher(ASE- Lvl 12) ?

I am currently in Entry Level Pool-Bangalore and will be 'Soft Locked' to Bench in a month's time. I wish to change my job location to either Indore in MP(top priority) or to Pune(MH).

(2) Should I wait till I get a project in Bangalore and then change location only if WFH gets over (if that is possible) or change it right now ?
(3) Any idea till when WFH will last? Thanks 🙏

Post Photo
helpful

A client (in the banking industry) is looking for what they’re calling a software/dev ops attorney to report directly to the GC. Thinking 6th year+. Would need to be based in the south. Can provide more details if you dm me.

like

What is the HRA policy in Accenture? I got to know that i can't claim HRa if my base location is city A and living in a rental accommodation in City B?
Is that true?

like

Hi, I need some advice
How to crack Google or Microsoft data engineer interviews, what are the rounds and what will be the key skills I should focus on
My current skills are
Azure cloud and gcp cloud data platform services
Pypsark
Python
SQL
Data modelling

like

How is the new Partner promotion list looking like for PwC India ? Heard that their overall compensation has been slightly reduced. Is this true ?

like

You are currently posting as works at Software Engineer
Anyone here from NatWest group Bangalore ? Need some advice before joining. Please let me know in comments so that I can DM you.

Anyone starting at Deloitte Jan 11?!

funnylike

How can I get involved with staffing events like CES, Davos, SXSW?

All tips welcome.

Pizza on deck

Post Photo
like

Best restaurants in Miami for a nice dinner? Company paying up to $300 per person. It will be a small group of 6 to 8 people.

like

What should I start watching next: Tiger King or Ozarks Season 3?

likehelpful

Anyone know anything about street legal electric go-carts? Think less $$ Vanderhall alternatives. Suggestions welcome.

like

How stressful is it to work in a call center? It seems to me that the supervisors would be the micromanaging sort

like

Is Infosys still looks for percentage in X, XII and Graduation for experienced? What percentage they look for?

For 10 years experience in Qa with Automation.
Salary 22lpa fixed.

Is this correct pay ?

like

Looking to take a break from the advertising agency world (honestly pretty burnt out on ad land) Thoughts on working at an agency who may be more focused on branding or content creation. Anyone made the jump?

like

Band 7
CBD Grad (no mba)
DC

Is 96k under market value ? If so, what is the best approach/conversation to have with SAM HR?

like

Can anyone guide me how to switch from Microsoft to Google.
MS tech stack : M365 ( Intune , Defender)
Google tech stack interestes in : Google workspace.

like

Additional Posts in Data & Analytics Consultants

Heya, are there any data migration experts about, who wouldn’t mind answering some questions I have about dashboard migration (Palantir Foundry)

like

Has anyone else begun to resent data science?

like

Just curious?

How many people have actually built a rigorous Model for clients? In this consulting/analytics consulting settings, do clients actually trust us as a modeling expert?

🤯🤯

I have created Algorithmic Product/System for the client to take out inventory not-in-demand for long time to save storage expense and also provide an approach to prioritize Work Orders based on Market Demand. It’s more like an Manufacturing Plan. I want to get into Product Analyst/Lead role. What approach I should take? Any books to start with? Any events to attend? Any groups to join?

like

I am seeking a technical co-founder for our b2b saas-based startup. We are a team alignment, communication, and performance reporting platform that makes it easier and more effective for teams to capture, organize, and disseminate updates.

About Me: I am a serial entrepreneur who has launched several successful companies. Please DM me if you or anyone in your network may be interested in this opportunity.

Post Photo
likefunny

The longer I do this job, the more I want to accept a tech job... no travel, same / better pay, no annoying clients...

like

What do you folks think about a monthly show and tell of anything data-related?
Open forum where anything relating to data & its applications would be fair game. E.g.:

-a visualization you made and/or like
-data pipelines for a personal website
-market analysis
-relevant memes
-scientific article
-data news
-what you'd like to see data driven but isn't

In a nutshell, a conversational experience. Introduce and discuss ideas. BYOB and at least 1 talking point, or if you really want a full deck

likehelpfulupliftingsmart

What are some of the best online resources to learn Power BI?

like

Have you ever failed to deliver? What was it and why?

like

Do I need to learn SQL when I only use Tableau (and their built in database UI)?

like

So engineers can now automate the writing of basic code, and potentially more complex tasks, by using GPT-3.

For those who are technical: If machines can write code, how are you going to upskill? And what are the best ways make yourself indispensable?

I am not embracing the notion that you shouldn't have to code to do data science. However, I think coding may soon be much less of a competitive advantage.

like

Asking for a friend:
What’s the interview process for a FSO Manager in EY joining the DnA BI team like? Has anyone been through the process recently? Thanks

like

Single book recommendation for user research?

Goal is interview prep. Ideally focused on applications in tech.

like

EY is hiring for various senior level positions in Data & Analytics practice. (Staff-2, Senior, Manager etc). Please DM me in case you have any questions and I’ll be happy to refer in case you have a relevant experience.

like

Is it realistic to join KPMG Lighthouse or Gamma without a Masters degree but with previous experience as a data scientist at a big data startup?

Learning cloud architecture right now so apologies if these are obvious questions: Best ways to store video metadata to perform analysis on it? I'm looking at AWS and GCP. Saw that Cassandra would be good for it, but not sure what the GCP equivalent is? But also I'm a bit confused on if Cassandra is just a DB and storage would need to be elsewhere? All help is welcome! I've been spinning my wheels on Google trying to understand

like

I'm interested in data analyst remote positions.
Any suggestions on companies to apply to ?

like

In the most unnecessarily complicated phrasing worthy a dissertation, what are you working on this week?

like

How hard is it to get an interview for SWE at FAANG outside of on campus recruiting? I’m in GT’s OMSCS program right now, hoping to take advantage of career fairs this fall, but I don’t know if I’ll have enough time to prepare for the technical interviews before then. I’m worried about missing out on the recruiting opportunity and having to resort to applying online/LinkedIn afterwards. Any insights into this?

like

New to Fishbowl?

Download the Fishbowl app to
unlock all discussions on Fishbowl.
That was just a preview…
Sign Up to see all discussions
  • Discover what it’s like to work at companies from real professionals
  • Get candid advice from people in your field in a safe space
  • Chat and network with other professionals in your field
Sign up in seconds to unlock all discussions on Fishbowl.

Already a user?
Login here

Share

Embed this post

Copy and paste embed code on your site

Preview

Download the
Fishbowl app

See what’s happening in your industry
from the palm of your hand.

A phone with Fishbowl app

Scan your QR code to download
Fishbowl app on your mobile

Download app

Sign up for free to view this conversation on Fishbowl

By continuing you agree to Terms of Use and Privacy Policy

Already have an account? Log in

Sign up for free to continue using Fishbowl

By continuing you agree to Terms of Use(New) and Privacy Policy(New)
Messaging rates may apply

Already have an account? Log in

For account settings, visit Fishbowl on Desktop Browser or

General

Legal