Getting into data engineering from cloud/ DevOps. What are the top 5 skills/tooling experience you would look for in a data engineer ? I assume SQL +Python+???+???+???

like
Posting as :
works at
You are currently posting as works at

ETL

like

I would recommend picking an ETL tool first, then doing training for that tool. If you’re not sure what ETL tool to learn you may want to pick a company that you aspire to work for, look at the data engineer job description for that company, and focus on learning the ETL tools listed in the job description.

Some ETL tool examples at SAP Data Services, Apache Airflow, Microsoft SSIS, and AWS Glue.

Pick a cloud provider and learn about their data ingestion,storage, processing offerings. For ex: if AWS make yourself aware of Kinesis, Glue, S3, EMR,Redshift etc. Knowing Spark in and out will be really beneficial.

If I can ask, Why do you want to move from cloud & DevOps to data engineering? Any specific reasons

like

Thank you. Just to learn something new and add new skills :)

Related Posts

Hi All, just sharing what on mind to vent it out from my system. Maybe with this I could gain some insights and inspiration.
I have been working as a data scientist since 2018 & have been the bread winner. I have neither been under a proper mentor nor with a team of peers from my field to help me out. I was alone and confused. I have never really got the chance to prove myself which makes me all the more depressed. I'm not sure what to do with my future, indecisive and low on confidence.

like

Has anyone taken the below course for learning Microservices with Java, Spring Boot, Docker and Kubernetes?

Post Photo
like
like
likehelpful

Exit opportunities for a non technical Project Manager? Looking to do something new but stay in consulting. Lately been feeling like a Jack of all trades, master of none...

like

For remote folks: am I more likely to find a remote role that allows me to move around multiple times during my tenure at a big FAANG-like company, or a startup? what are things I should look out for in my search?

like

What can I do outside the office to boost my resume and be a substantially more attractive candidate for top consulting firms in ~12 months time. Working in disputes and valuation role but want to go into management consulting next year (post MBA role). I feel like my job isn’t enough because skills aren’t considered as transferable outside this field.

like

Add a comment with the designation levels in your bank.

like

Hello Friends, Please help me out which paid online platform is best for java full stack developer. I have 7 years of experience in java and want to enhance my skills more. There are many in markets like:- upgrade, great learning, scaler, simplilearn and many more. Please suggest which one is best. Or anyone here joining any of these platforms yet?

Partners with kids and a working spouse, how do you manage? Is it realistic for both people in the relationship to work full time long term? How do you keep marriage going and career progressing?

likesmart

Folks applying for Data and Analytics roles in the industry at M, SM, D Levels, what technical/functional topics do you prepare for on the Analytics side?

like
like

What does an exit from Salesforce consulting look like? I’m in a technical role leading a small team so my understanding is a technical/solution architect or a development team lead at either Salesforce or an end user like Amazon/Amex.

I have bounced around a couple consulting companies so would prefer not to do it again. Total 4 YOE.

I don’t think I have enough YOE to go for a program architect role at SF otherwise I’d be interested.

like

Marketing leaders at startups: at what point did you make your first dedicated product marketing hire? What lessons did you learn? Did you do it too early? Too late? Didn’t hire senior enough?

like

Hey sharks,
How to get into freshers data science role as a non-tech professional?

like

What do you guys think about a career in investor relations / capital formation for a decent size PE. I think principals get carry.

like

Hello Mastercard employees. I have been trying to break into MC for long now.

I have 2 yrs workex post MBA. I have experience in data analysis and consulting. But I don't want to get into consulting anymore. I am looking for analytics roles. Anyone here would be able to DM and guide me on the available options at Mastercard?
Location: Gurgaon

like

Hello Fishes!

I am a Mechanical Engineer with around 5YOE in FEA in automotive sector.
I am finding it very difficult to get a FEA job in Mumbai (moving out from Pune). Do you think not many FEA jobs are there in Mumbai? Should start developing myself for another role which will bag me a job?

TIA

like

Thoughts on a PM going into new business? Challenges? Similarities?

like

Looking for advice! I was approved to work remotely but my salary will decrease 10%. I received two raises so the decrease brings me down to my previous salary. I was told that it’s due to the cost of labor in the area.

I’ve been with my company for 8+ yrs, I love my manager and the work I do (engagement, recognition, & wellness programs) but I feel like I’m limiting myself since I have the experience, an HRM degree, and SHRM-CP credentials.

Should I apply for roles outside the company?

like

More Posts

One of the worst parental insurance plans. 30% co-pay and that too on such high premium.

like

What’s your favorite WFH footwear? Any recommended brands for a chilly home office?

like

Is your firm hiring for remote advisory positions? What service line? What does the work look like?

My Accounting background is:

3 years GT Audit - manage small team, manage engagements, audit etc

2 years Industry Accounting - manage small team, improve monthly processes, month-end close, reconciliations, generate financial reports, generate budget and forecasts

Referrals welcome.

like

So, the CDC removed the Covid guidelines. I’ve never had Covid. I’m afraid people will come into work not wearing a mask and be inconsiderate… ughhh so distracting and disgusting. I’m also at risk to develop complications. Not sure if I should talk to HR. Not even sure if I should ask for accommodations to continue being able to wfh at least most days of the week to reduce risk. Idkkkk 😩This is so unprecedented. I always wear my mask at work. I’m getting pressured to attend firm events as well

Is it me or the wifi in hotels is too bad to play online games? How do you people manage gaming while traveling?

TC New grad Software Engineer
Base: $110k
Sign-On: $35k
RSU: $120k/3years
Relocation: $20k

Starting fresh with virtually $0 savings and $0 worth of financial literacy, whats the best course of action? any advice is greatly appreciated!

like

Accenture Hello, this past December I applied to a Devops role at Accenture. I didn’t get the position but I looked on their website and noticed they have an software engineer apprenticeship. I emailed the recruiter about the apprenticeship but she didn’t get back to be. But after telling me I didn’t get the position she did say to wait six months to apply for another position. I really think I would be a good fit for the apprenticeship. What can anyone recommend? Can I possibly get a referral.

like

I have an offer for Consultant Specialist GCB5. Not sure what the role is..is it a team lead role or is it a junior role? I have 10 yoe .. is it apt? Pls help Thanks

Hi Guys,

Can I get some refferal for Cloud Automation fields : VCenter, Powershell, Azure...
Application Development : .net , C#, javascript, html, css...

Currently I am on notice period. With total experience of 3 years 10 months.

Also please give some idea of what CTC should I expect....

like

Got offer from JPMorgan Chase , but variable pay percent was not mentioned in it. HR told it will be around 10-12% . Is it true? It's for VP/602/Commercial Banking? How much we variable pay will get annually? Can someone help as based on this only in have to decide whether, I can go with counter offer or not?

First 2 years for CSR is about to be over, and I’m looking at the value of the card against the annual fee. Combined with my other cards (Chase Freedom Unlimited & Flex) and deducting the $300 travel fee, the net benefit is $76. Is that enough to justify keeping the card? The lounge access at airports were a nice benefit, never got to use it since my client travel was through Amtrak.

like

I’ve been working in finance strategy / transformation consulting for the last two years and would like to pivot into construction project management. Looking to get some insights of if something like this is even feasible or if anyone else has done something similar.

like

Maybe stupid question....With global slowdown, does JPMC fire any new hires?

like

Looking to join Holcim a cement company as an Electrical Engineer I in Alabama.
What is a fair pay with roughly 2 years experience and an EIT license.

Is $80,000 fair to both me and the company. Since I'm really on the cusp of being an Electrical Engineer II?

like

I’m still in the entry levels of digital marketing and I’m looking to expand my skills. What would you suggest to get certified in or skills / programs to learn.

What should I put in e signature tab in Barclays onboarding portal for accepting the offer? I'm getting validation error - personal data e-signature has failed.

like

Is anyone hiring anyone over 50?

likefunnyuplifting

Hi, I got selected in S&P. Hr gave me an link to apply for some position but I am not able to do login to that link

Facing issue like user name doesn't exist in tenant s&p global.

Did anyone face the same, if yes could you please help me on that.

Does anyone work at Rocket 55 in Minneapolis that could give me a referral for the web project manager position? I have over 5 years collective experience in Project management, digital marketing and design.

Additional Posts in Data & Analytics Consultants

KPMG folks, thoughts about Lighthouse relative to other big 4s? About to start the interview process. Coming from EY FSO DDnA

like

This might be a long shot ... but I have a Statistics assignment due for tonight in a few hours

Does anyone know how to do Linear Discriminant Analysis with more than one predictor - by hand? I know how to compute in R but my professor wants it done by hand .... fml

likefunny

Mεntal mαth in iηtervieωs. Thoughts, tips, rants, grievances?

like

How hard is it to get an interview for SWE at FAANG outside of on campus recruiting? I’m in GT’s OMSCS program right now, hoping to take advantage of career fairs this fall, but I don’t know if I’ll have enough time to prepare for the technical interviews before then. I’m worried about missing out on the recruiting opportunity and having to resort to applying online/LinkedIn afterwards. Any insights into this?

like

Is anyone working with Elastic at DoD?

1) Hypothetically if you were looking to sabotage a colleague, can you code an excel document to throw off their numbers or calculations, (if you send them that document and they download it for use)?

like

In the most unnecessarily complicated phrasing worthy a dissertation, what are you working on this week?

like

today I choose violence

Post Photo
funnylikesmartuplifting

How does everyone in this bowl feel towards master’s degrees in data science/analytics? I didn’t study this in undergrad so I’m looking to get an analytics degree but I’ve heard mixed reviews.

like

Anyone in the KPMG Lighthouse practice that would be willing to take a look at my husband’s resume and put in a referral? He’s interested in the Associate, Data Scientist position.

Can anyone at Ford Motor Company tell me more about the “Learning Analytics and Engagement Specialist” remote position? Very curious and would love a referral!

like
like

Could anyone recommend a set of indices that are publicly available and is a good predictor for consumer spend in home renovations ?

like

Noob question - I want to consolidate the dates into a single dates column. Would numpy or pandas help me reorganize this dataset effectively or should I do it within excel?

Post Photo
like

Docket + R - I have an container running a rocker image and I’m trying to launch a bash terminal and the RStudio server (/init) at the same time. Is this possible? I tried adding CMD [“/init”] too.

like

If you were to hang your own shingle as a consultant what BI tool would you use to deliver dashboarding to clients?

Assume that you aren’t plugging in to source systems as I primarily work in CDD.

like

What’s so good about the Georgia Tech OMSC and OMSA? Is it just the cost? Seems to be recommended by most of reddit

likehelpful

Have you ever failed to deliver? What was it and why?

like

What is Accenture’s data scientist interview process like?

like

New to Fishbowl?

Download the Fishbowl app to
unlock all discussions on Fishbowl.
That was just a preview…
Sign Up to see all discussions
  • Discover what it’s like to work at companies from real professionals
  • Get candid advice from people in your field in a safe space
  • Chat and network with other professionals in your field
Sign up in seconds to unlock all discussions on Fishbowl.

Already a user?
Login here

Share

Embed this post

Copy and paste embed code on your site

Preview

Download the
Fishbowl app

See what’s happening in your industry
from the palm of your hand.

A phone with Fishbowl app

Scan your QR code to download
Fishbowl app on your mobile

Download app

Sign up for free to view this conversation on Fishbowl

By continuing you agree to Terms of Use and Privacy Policy

Already have an account? Log in

Sign up for free to continue using Fishbowl

By continuing you agree to Terms of Use(New) and Privacy Policy(New)
Messaging rates may apply

Already have an account? Log in

For account settings, visit Fishbowl on Desktop Browser or

General

Legal