My target is to work as a Data Engineer. How much proficient I need to be in Python? I do have knowledge about programming but not pro level. I can say average. I can write code but need help from google. Which other field I need? I do have good knowledge in SQL. I know tableau and power bi. What else? Do I need any other skills?

like
Posting as :
works at
You are currently posting as works at

Apache Spark, Delta Lake

likehelpful

I’m just proficient in Python. Learned on the job. In our shop we mostly use it for data ingest and then put the script into an SSIS package to be placed on a schedule. Most transformations take place inside the database.

like

You can use (spark) sql for most data engineering tasks on DBX. Python comes in handy when automating resources, making api requests, accessing underlying infrastructure, or anything ml related.

like

Related Posts

Tips to build my brand and network as a junior practitioner navigates their career to the next level at the firm?

like

I’m seriously contemplating taking a software development boot camp. For those who hire new software developers, does it make you stand out if you get your certificate from a university instead of a coding academy (like coding dojo or something)? I noticed the universities are a bit more expensive but is it worth the price to have a university on your resume or does it not really matter?

like

What are the best exits from risk assurance? Is it possible to lateral into tech or no?

like

I have a low GPA because an abusive relationship during my schooling that kept me from focusing. I’m clear of that now, but I don’t know how to explain my low GPA going forward.

like

Thinking about getting the AWS Cloud Practitioner certification. Does EY have any amazon resources or training materials that they provide? Any advise from people who have taken it before? Thanks!

like

Can someone explain to me what law clerks are in private practice? I'm based internationally but deal with our NY office a lot, and I can not figure out what the title actually means/where it sits.

like

I had recently attended the interview at IQVIA for sql developer position, but when I received the offer letter the designation mentioned there is "Software engineer- technical operations 130'.

Just wanted to know if this is some kind of a production support role.

Can anyone please help me understand this?

TIA !

like

Top companies or types of companies for consumer insights/analytics? E.g. in terms of opportunities to learn, general progression, salary, etc

like

Hi!! I’m an HR Coordinator currently (about two years of experience) but my job has so many responsibilities and tasks I’m beyond burnt out. It’s truly impossible to focus on one task because things are constantly being thrown my way. I’ve heard whisperings of a promotion or raise, but my workload is already too much, I don’t know if I’d want to accept more responsibility. Is it normal to feel like you have just as many responsibilities as your superiors who make 30k+ more than you?

like

What are your favourite free SEO (technical and/onpage) courses or certificates?

like
like

Hi everyone

Can someone please help me understand hierarchy at BNY Perishing. Where does a Grade J stands?

like

Young professional with 3 years of retail banking experience, 1 year of claims experience, and now roughly 6 months into insurance sales. Between selling in retail banking environment and every month of insurance sales regularly pacing 200% or over to goal. Loving comp but not loving the call center environment and hoping to move to another lucrative sales position with less non stop calls. Any suggestions?

like

Hey everyone. I found out we are expecting our first child and I’m really nervous. I got into consulting one year ago and I’m up for promotion this year. With timing of our performance conversations I would have to inform I’m pregnant before outcomes - then shortly after the promotion effective date I would go on a leave for due date. I’ve worked really hard and I’m worried our wonderful news will throw chances with this :(- also if I don’t get promoted pretty sure it’s up or out. Any advice?

like

What is it about D&A that most clients (or even partners) don't appreciate? Thinking about the painpoints or opportunities that are unseen at the top or require lateral thinking

like

Do you think consulting is not the right path for core technical people ?

like

I am new to EY. How to check one's exact designation in the system (I am a senior, but want to know whether it's SCon1/2/3?

like

I feel bad for the people who got into supply chain management and are burned out. I feel like they get the short end of the stick, and it truly is not a bad career at all, I think maybe some of them just aren't cut for it.

like

Why too many people leaving FIS ?

like

Any paralegals ever switch to a legal tech company? How did you like it?

like

More Posts

How soon do most companies let you know if you're not proceeding to the next round of interviews? Do they let you know within the day, a day after, or a week usually?

like

When you hear the title “consumer product manager” vs “product marketing manager”what job responsibilities do you assume each person has? Or do they seem the same? There has been some confusion internally for a new team/role and wanted to get a check from all of you on perception!

like

How much is the notice period in KPMG india?

Recently i joined cgi but the project does not ses much good as per tech stack.Is there anything I can do in this case.I am tagged to this assignment but project has not yet started.Please help me with issues?

Let’s say you’re the main character of some action movie. Think military / Jason Bourne / Ethan Hunt type of guy. You’re only bringing one watch with you on your mission across the world. Streets of Paris, African jungles, Southeast Asia, and wherever else the mission takes you. What watch you wearing?

like

Anyone have a Baume & Mercier Classima? How do you like it? Thinking about purchasing one to get up the list w an AD for a Rolex OP

like

Does project have any role to play in the hike % in Cognizant ? As in if my engagement is doing well financially for the organization will I get a better hike than others with the same rating as me but in other engagements that are not doing so well. I am in Cognizant Consulting.

like

I am in the market for a Rolex, budget is 5k. Any recommendations pls

funnylike

Who here has any advice on how to get into marketing at age 40?

like

Does anyone have any good Russian contacts to get the lowdown on these Iowa caucus results?

funnylike

I have ADD and occasionally make small mistakes in my work, like leaving a word missing when editing sentences, small formatting errors or leaving an internal comment in drafts sent to clients. All partners have been very understanding and care about the quality of my work, and no client has ever complained. Partners and clients praise my work.

But now, one partner has become super mad and when I explained ADD, he said:

likefunny
like

What are some high paying companies for Data Science roles?

Yoe - 4 yes
Offer in hand 16 lpa
1 month notice period is left

Hi, can someone help me understand what's the salary range for a UiPath business/process analyst with 5 yrs of experience in UiPath and overall 10 years of experience in Toronto, Ontario?

like

Can I negotiate my level with Booz? Not getting the salary I want for an SC

like

What’s a good Marriott Bonvoy points vs $ conversion to make decisions on using points or $?
I’m contemplating 40k points vs $168 including taxes at a category 4 location

If I have to fly next week for business, do I have to remove mask/face shield for security check?

helpfullike

Bachelor party in vegas in september. Estimated 10 attendees. I’m not a groomsman so i’ve been held out of planning but im more of the well traveled attendees so trying to help. Any rec’s on suites/lodging in general for a group this size? Never traveled with such a big group and prices on the strip are insane rn

like

I can pay my rent in new building through Zelle, Venmo or PayPal. Any way to hack this to earn Credit card points without any extra fees to me?

Additional Posts in Data & Analytics Consultants

How does everyone in this bowl feel towards master’s degrees in data science/analytics? I didn’t study this in undergrad so I’m looking to get an analytics degree but I’ve heard mixed reviews.

like

What’s so good about the Georgia Tech OMSC and OMSA? Is it just the cost? Seems to be recommended by most of reddit

likehelpful

Noob question - I want to consolidate the dates into a single dates column. Would numpy or pandas help me reorganize this dataset effectively or should I do it within excel?

Post Photo
like

today I choose violence

Post Photo
funnylikesmartuplifting

Anyone who has done masters in business analytics Singapore? Could you help on courses, Scholarships and careers and jobs. Looking for help.

like

What are some interesting non-tech/insurance/advertising/consulting careers where data science is applied? Thinking of epidemiology and economics

like

Anyone have any suggestions for front end guis for users to run python code? I’ve created a few tools for webscraping data, automation, and modeling but non technical users freak out when they try to run the code themselves. Any suggestions? (Have tried Juypter Notebooks and a few other IDEs)

like

I need to do a timeline with lots of information over a long period of time. I wanted to that in Tableau, but partner will not pay license and data is sensitive so I cannot use Tableau public.
Do you have suggestions?
The requirements are the following:
- No online input data upload (so local editing)
- The produced output file must be local and easily exportable and readable
-timeline must be interactive (filter/click/zoom in/out/view detals etc.)
- free

Any kind of help is really appreciated

like

Single book recommendation for user research?

Goal is interview prep. Ideally focused on applications in tech.

like

Any cyber security folks here? or those interested in systems engineering? Potential role with TC 120-180, awesome team and wlb, at least compared to consulting.

like

Quick survey: Do you guys think having a template package to envelope an ML model as an application would be helpful. The package could contain boiler plate template for unit test, docker image, CI/CD, database connectors etc and act as a starting point for doing that. Tech firms usually have that internally but limited options in open source.

like

I was hired a few months ago by D to do data science. I am not doing data science currently, is there a way I can switch roles internally? Should I talk to my coach? Or should I just start looking for a new job. I’m starting to feel that the field is so hot rn my small stint at D won’t be a big deal to other firms.

like

Is 128k a fair base salary for Consultant in Deloitte Analytics & Cognitive. MS CS and about 3 yrs experience. In one of the fastest growing but midtier tech cities in the US.

like

What do you think when associates/senior associates misspeak on a concept during a meeting or interview?

I’ve learned something new on each project, and I’m afraid of coming off as an idiot so I rarely contribute to conversations; only after I have done research on the topic and have prepared do I speak/give ideas

like

It’s been ages since I’ve taken college statistics. Can anyone recommend an online course where I can review and brush up?

like

Does your company split data science roles into different practices like data & analytics and software engineering? Does this inhibit collaboration & Where does a data engineer fall?

like

Coming to the realization that consulting is not for me (tech person) feeling angry that salaries at D will never be on pair with FANG and that leadership is not tech focused. For example you could be a soul contributor at fang making 240k and people at Deloitte wait 10+ years to earn that as Senior Managers because they need to climb the corporate ladder. It seems super clear cut to me now, if you want to make money in tech don’t join consulting firms. Am I wrong?

like

New to Fishbowl?

Download the Fishbowl app to
unlock all discussions on Fishbowl.
That was just a preview…
Sign Up to see all discussions
  • Discover what it’s like to work at companies from real professionals
  • Get candid advice from people in your field in a safe space
  • Chat and network with other professionals in your field
Sign up in seconds to unlock all discussions on Fishbowl.

Already a user?
Login here

Share

Embed this post

Copy and paste embed code on your site

Preview

Download the
Fishbowl app

See what’s happening in your industry
from the palm of your hand.

A phone with Fishbowl app

Scan your QR code to download
Fishbowl app on your mobile

Download app

Sign up for free to view this conversation on Fishbowl

By continuing you agree to Terms of Use and Privacy Policy

Already have an account? Log in

Sign up for free to continue using Fishbowl

By continuing you agree to Terms of Use(New) and Privacy Policy(New)
Messaging rates may apply

Already have an account? Log in

For account settings, visit Fishbowl on Desktop Browser or

General

Legal