Getting into data engineering from cloud/ DevOps. What are the top 5 skills/tooling experience you would look for in a data engineer ? I assume SQL +Python+???+???+???

like
Posting as :
works at
You are currently posting as works at

ETL

like

I would recommend picking an ETL tool first, then doing training for that tool. If you’re not sure what ETL tool to learn you may want to pick a company that you aspire to work for, look at the data engineer job description for that company, and focus on learning the ETL tools listed in the job description.

Some ETL tool examples at SAP Data Services, Apache Airflow, Microsoft SSIS, and AWS Glue.

Pick a cloud provider and learn about their data ingestion,storage, processing offerings. For ex: if AWS make yourself aware of Kinesis, Glue, S3, EMR,Redshift etc. Knowing Spark in and out will be really beneficial.

If I can ask, Why do you want to move from cloud & DevOps to data engineering? Any specific reasons

like

Thank you. Just to learn something new and add new skills :)

Related Posts

Does promotion happen while you're on bench in IT companies?
Hi All, I've completed two years in my current company and I was recently released from my project and my manager is trying to assign me to a new project hopefully.
My question is, will my promotion happen as I was eligible for the same and I was released to the bench as I'll be moving on to another project soon. Can someone enlighten me on this?

like

I want to get out of warehouse work. What's a good-paying job where I don't need a lot of schooling?

like

I’m a designer in the planning/landscape architecture dept. of a CE firm. Extremely frustrated that after 4+ years and multiple asks, I’m not getting the in-field construction experience I’ve asked for. I know that my designs could be better if I could see how things are actually built but I get slapped in the face with “I need you in the office designing/drafting” or “there’s no budget to have you go out” and then sends an intern to inspect instead. I’m 5 yrs out of college. Any advice?

like

I had recently attended the interview at IQVIA for sql developer position, but when I received the offer letter the designation mentioned there is "Software engineer- technical operations 130'.

Just wanted to know if this is some kind of a production support role.

Can anyone please help me understand this?

TIA !

like

When’s the best time to go client side? Wait till I get a promotion or try to switch sooner rather than later?

like

Getting ready to study for the CAMS exam. Do I need anything extra besides just studying the study guide and practice exam over and over. I’ve read online about people using AML assassin; is it worth it?

like

Hello ,
I am btech fresher recently got placement but i got a domain where no coding is required and more of functional work is there . So i want to switch to JAVA . Can you please tell me how should i proceed , in what order and what should i learn and any resources?? I have good knowledge of Core Java and DSA.

Laid off, 10 years exp, tired of acct management. Feel so lost. Don't want to go back to agency side. What should I do? I feel like 💩

like

I want to switch.

CCTC: 18 LPA (its been 9 months in the company)
YOE: 4 yrs 9 months
Tech: ReactJS, JavaScript etc.

Haven't put down the paper yet (notice period will be 2 months)

What can the expected CTC for a 5 YOE? I want good WLB and growth in a product based company.

Preferred location: Bengaluru (India)

like

I'm thinking about starting something, but I want to be well versed in entrepreneurship before I do. Any recommended resources (websites, podcasts, books, etc.)? Thanks!

like

Currently pursuing a MBA, and am deciding which focus areas to take.
I am trying to pivot from UX design to product in tech.
Ideal sector: FinTech
Current sector: Mobile Gaming
Related sectors: Entertainment, Edutainment, e-Commerce, Social

Aiming at head of product or head of design as long term goal.

If only 2 focuses, would you pick Business Analytics, Digital Marketing, Entrepreneurship and Strategic Innovation, or Global Challenges in Business?
Advice appreciated!

like

Hello! I noticed some similar questions to the one I am about to ask and I apologize if I am being repetitive but I didn’t see this specifically (I am new so sorry if I am missing it). I am a RN and have been for 15 years. I was looking to transition into health tech but has been a bit more challenging than I expected. So, I have been working on trying to get in as a SDR but I am also taking a course for my PMP certification. Is this of value or should I focus on something else?

like

Can someone pls explain the current designation hierarchy in mastercard like level 5,6,7 etc?

like

Rescheduled my Level 1 exam from December to February. I’m worried that changing the date will means I need to buy new study materials, but how much of the curriculum could actually change? It seems like it should be the same.

like

What are some boutique firms in London who specialize in the Retail industry? Have a friend with industry experience looking to move into consulting but big firm life would not be a fit for her. TIA!

like

From a career advancement perspective. Would it be better for me to move into project management or to move to the change management practice?

like

Any recommendations on prep courses for CFP exam? Taking the exam in March

like

Worried because of my salary at my current company I am pricing myself out of opportunities to move into a rep agency that could eventually give me the opportunity to buy into it. I’m currently almost topping out on my salary at current company with no opportunity to progress. Can make good money for a while here, but new challenge is interesting to me. Struggling accepting I may have to cut my salary 10k-20k in order to do that…

like

If you are leaving your firm and putting in your two weeks notice, what should be on your checklist to make sure your transition is the smoothest, both for you and for the firm you’re leaving?

like

Does VP or SVP really mean anything in Talent or Business Affairs? Does it actually bump salary up significantly or does it just mean a free parking space that no one is using since we’re WFH? Genuinely curious as I see some people with VP or SVP that have less experience than many with just a Sr title.

like

More Posts

Are there any disadvantages of joining a C2H role purely on the basis of high CTC even though it is for a big client of the contractor company?

like

Salary idea for Deloitte ARA senior assistant(A2)? West Coast

Thank you! Deloitte

like

💠SAP Mega Drive 12th Nov'22 💠
LTI - India

Interested can Dm with job roles and email id to apply

Post Photo
like

Need a referral for a Software Engineering position for AWS!

like

Any insight into Quintairos, Prieto, Wood, & Boyer, P.A.? Curious if they have billables, what the pay structure is like etc. Thanks!

like

I have applied for Wells Fargo for more than 15 positions I'm not even getting the status of those applied positions. All are in review stage.How will be the hiring process in Wells Fargo?Wells Fargo

like

Hi All

Need your help in making a decision.

My friend has 4+yoe and holds two offer. One is from Hashedin ( senior product specialist) and other is from Netomi ( product owner)
Both have same compensation.

Please suggest and share insights about these two organization.

like

I’ve officially made the switch from BIG4 tax to FDD. So stoked; beyond ready for a career pivot

likefunny

How much are Senior Associates/Principals making at small PE shops?

like

How often do you all review your rates? I’m 6 months into partnership and my rate is the same as it was two years ago when I started at this firm as a 4th year (currently had a license just over 6 years and the 5.5 I’ve been in practice are all domestic relations)

like

Has anyone worked directly with an Instagram type Content Creator to shoot and edit OLVs? I have a job coming up where the target market is teens and they want to connect in an authentic way. Plus as always they are saying no $$$. A friend did this happily in Europe. Would love any tips or suggestions from this group. Thanks!

like

Considering a Product Owner role. Any best practices of what questions to ask during an interview? First phase deals with a virtual Teams interview with the recruiter and her manager on Tuesday. Excited since this is a hop from a Product Analyst role and entails an offer of over $30,000 from what I'm getting now! This would be a permanent full-time compared to my current contractor role that ends in March.

like

Anyone know of a good cross-border US/UK financial fiduciary?

like

Anyone know a Connecticut or 2nd circuit case for this rule? I can’t find one to save my life. A defendant generally is liable for all harmful results that are the normal incidents of and within the increased risk caused by their negligent acts. If a defendant's negligence was a substantial factor in producing the plaintiff's injuries, the element of proximate cause has been satisfied and the defendant would not be relieved from liability for those injuries even though another force concurred..

like

So, here it is. I was having joining on last week October as a senior analyst data science in Tiger Analytics. Today I got an call from HR that due to economic recession we are going to delay your date of joining by 2 months. My notice period was of 3 months. So total duration would be 5 months. Infact even after that too they didn't send me revised offer letter. There is something wrong with this company.
Fuck them

like

What biotech stocks are yall trading right now?

GILD, INO, MRNA

like

This might be a long shot ... but I have a Statistics assignment due for tonight in a few hours

Does anyone know how to do Linear Discriminant Analysis with more than one predictor - by hand? I know how to compute in R but my professor wants it done by hand .... fml

likefunny

I'm looking for referrals for SAP BASIS. 3 YoE and serving notice period.

Please DM. Thanks in advance.

like

What has been your greatest challenge this year and how have you overcome?

like

Additional Posts in Data & Analytics Consultants

Could anyone recommend a set of indices that are publicly available and is a good predictor for consumer spend in home renovations ?

like

Quick survey: Do you guys think having a template package to envelope an ML model as an application would be helpful. The package could contain boiler plate template for unit test, docker image, CI/CD, database connectors etc and act as a starting point for doing that. Tech firms usually have that internally but limited options in open source.

like

Hello, Anyone here from Deloitte Omnia AI who could refer me for an open opportunity.

like
like

What is Accenture’s data scientist interview process like?

like

McKinsey & Company Does somebody have experience regarding
compensation differences between
QuantumBlack & McKinsey? I am in the process at
QB and disappointed with the salary that's
proposed. (New grad Data science from top
university applying for London) McKinsey & Company QuantumBlack

like

Is anyone working with Elastic at DoD?

Any conda users in here have to install a binary and use conda forge? Need some help installing pdftotext. Throwing a weird message saying “Found conflicts!” Any and all help would be appreciated.

like

Hiring for data scientists and BI analysts across a couple levels, DM me if interested!!

like

In the most unnecessarily complicated phrasing worthy a dissertation, what are you working on this week?

like

Docket + R - I have an container running a rocker image and I’m trying to launch a bash terminal and the RStudio server (/init) at the same time. Is this possible? I tried adding CMD [“/init”] too.

like

Looking for an entry-level data analyst position in the DC area. Have a BA in economics & certification in Computer Science. Also 3 years of professional work experience as a full time marketing manager which I performed while attending school full time. I’m a self-starter and extremely driven. I also have a passion for data and statistics, and plan on pursuing my MS in data science within the next year. Please let me know if you know of any positions! Thank you.

like

Is 128k a fair base salary for Consultant in Deloitte Analytics & Cognitive. MS CS and about 3 yrs experience. In one of the fastest growing but midtier tech cities in the US.

like

Does anyone work at EY in their Decision Modeling team? Not asking for answers, but just wondering if someone is able to share what concepts I should be familiar with when prepping for the case study (i.e. do I need to know how to run an LBO or is a DCF sufficient)?



like

Anyone have a ballpark range on dataiku price per seat or however they price? It looks like an interesting product.

My manager continues to ask me to help other teams and do work on other billable projects. I’m sick of it .. and I’m going to explicitly say that no I can’t do it because my hours are taken by the existing project we are doing. Is this appropriate?

like

Anyone in the KPMG Lighthouse practice that would be willing to take a look at my husband’s resume and put in a referral? He’s interested in the Associate, Data Scientist position.

Has anyone else begun to resent data science?

like

What is a data lake in basic terms?

like

1) Hypothetically if you were looking to sabotage a colleague, can you code an excel document to throw off their numbers or calculations, (if you send them that document and they download it for use)?

like

New to Fishbowl?

Download the Fishbowl app to
unlock all discussions on Fishbowl.
That was just a preview…
Sign Up to see all discussions
  • Discover what it’s like to work at companies from real professionals
  • Get candid advice from people in your field in a safe space
  • Chat and network with other professionals in your field
Sign up in seconds to unlock all discussions on Fishbowl.

Already a user?
Login here

Share

Embed this post

Copy and paste embed code on your site

Preview

Download the
Fishbowl app

See what’s happening in your industry
from the palm of your hand.

A phone with Fishbowl app

Scan your QR code to download
Fishbowl app on your mobile

Download app

Sign up for free to view this conversation on Fishbowl

By continuing you agree to Terms of Use and Privacy Policy

Already have an account? Log in

Sign up for free to continue using Fishbowl

By continuing you agree to Terms of Use(New) and Privacy Policy(New)
Messaging rates may apply

Already have an account? Log in

For account settings, visit Fishbowl on Desktop Browser or

General

Legal