how would you answer the “how do you deal with big data” interview question?

like
Posting as :
works at
You are currently posting as works at

It depends where you’re working. At Facebook, say you’d sell it to anyone that’s willing to pay.

funnylike

“With big hands”

likefunnysmart

Depends on who's asking. In reality and when speaking to a data person, I've worked on "medium data" that's a bit too large for a laptop but not big enough to warrant the latest greatest big data tools (leveraged the data warehouse hardware and minimal cloud). But to recruiters and execs who don't touch infrastructure, it's definitely "big data" since you'd have a bad time with it in an Excel sheet 🤷‍♂️

like

1) The tools I use, like Spark.
2) The methods that I build in, like there's a pipeline I built which does diagnostics and logging so I can tell if it's working, and then can pick up where it left off if it breaks.
3) A bit about how big data doesn't mean good data or useful data.

like

I always lie. I’m in a similar position as DS1 with data too big for my laptop but nothing bigger than a few gigs. Interviewers tend not to understand that medium-ish data exists, so I always am just like, “Yeah, I work with terabyte-size data tables using X, Y, and Z (fill in the variables with the job description’s tech stack)”

like

I recommend searching “the data engineers guide to Apache spark” by databricks. It’s free. Knowing how spark works and the motivation behind it will provide you with a nice detailed answer to that one

Related Posts

Hello Fishes,
I am currently interviewing at EY GDS and HR discussion is done.
But the HR is saying they can offer only 36% hike.
YOE: 6
CCTC : 12 LPA fixed.

How should I proceed with this.

like

I made it through the first 2 interviews and I think it went well. How long does it usually take to find out if you move on to the final interview round?

like

I have gotten a verbal offer from Facebook, but I just had my phone screen interview with the hiring manager at Amazon yesterday. I want to reach out to the recruiter at Amazon and let them know what the timeline looks like. I would much rather have the Amazon job over the Facebook one. But I’m afraid if I decline Facebook then Amazon won’t happen. I’m just completely lost.

like

Hey all!
Any insights you can share on work simulation assessment for PgM?

Thanks

like

What kind of questions does a role alignment interview for a Finance+Ops role at tech company entail ? Is it just a fancy name for evaluating prior experience and the behavioral stuff ? Or is there some framework being tested?

like

I am finishing up a project and I’m trying to document what I’ve done for my resume. What are some good metrics for someone who mainly created user stories, created dashboards, interacted with the client and developed statistical models? One of my dashboards got deployed to production but it’s to early to see the impact. My other dashboards are almost done but I’m moving on to something else.

like

I’m curious - let’s say you have a role to fill but they are targeting only female candidates to balance out the team. What recruiting strategies can i implement to meet those needs?

like

Hello Everyone!
Hope you all are doing great.
Can you please guide me how to prepare for @Google's interview?
Role: Administrative Business Partner

like

Do we know who the new BBDO recruiter is? Thanks Chicago fish!

like

Is it normal to be ghosted after interviews? I’ve had three recently and not one callback.

like

Hey Amazon employees,
I need your help!
I have successfully passed the online assessment for Cloud Support Engineer and my initial phone screen is tomorrow evening.
What should I expect? How should I prepare?
Thanks In advance!

like

How much of the buyside recruiting process is dependent on your school? Like if you went to a non targ but were top bucket, will you still lose out on interviews to Ivy League grads?

like

Pwc AC Hi All, What is Product innovation practise in PWC AC Bangalore? I was interviewed for AWS Data Engineer profile.Pwc AC PwC

Had a couple interviews today for a position - what is the etiquette on follow-up thank-you / emails? I kind of feel like they're outdated. Contd...

like

I’m a foreign qualified lawyer who passed the NY Bar Exam recently. I’m looking to apply to law firms along the East Coast. How do I get in touch with a recruiter to help me with my job search?

like

No one answers anything in the bowl lol. this would be a good interview topic for Fishbowls PM roles. How would you drive engagement in the PM bowl? 😂

like

Hi fish - I have a referral for bcg - do I ask the colleague to send in the referral before or after submitting my application?

Hey fishes, completed 3 tech rounds at Bosch.
Last tech + managerial round was on 10th Nov. Got HR call on 17th Nov. Told my expected package and she didn't seem to have any issue. On 22nd Nov, got a call from the consultant at taggd who has been arranging all my interviews. Told my expected CTC and she seemed a bit surprised but didn't negotiate and asked if I have any other offers? I asked when can I expected the OL, she said within a week but didn't take any documents. Can I expect the OL?

like

If you are working in IC ( incentive compensation of Salesforce) Need your help on giving an overview of the work to my friend who have an interview in Novartis, JD had keywords like sale force, incentive optimization, javelin etc.

like

Private Equity groups at Oliver Wyman, S&, and EY Parthenon have all invited me to interview. Alix Partners has reached out to build out the Galt Co acquisition. 1. Anyone else who is considering a move to private equity consulting, are you concerned with joining at what could be the peak of M&A? Are these companies being rational in such a hot market when it comes to hiring? 2. Any thoughts on the quality of these teams relative to one another?

likesmart

More Posts

Any BCG consultants or knowledge experts willing to chat? Super interested in the space and role but unsure what the best fit would be. Have 2 YOE in sustainability.

like

Any dermatology research opportunities?

like

Thought this could be a really great opportunity for some folks out here 🙏🏻

Post Photo
like

Anyone in printers row know of good gyms around ~$50? Looking to avoid LA Fitness at SouthGate or XSport (reviews seem to agree - they are a mess). FFC is just not in the cards rn.

How is Accenture Research vs EY vs PwC vs KPMG

like

Things to consider before going Indy? Feel like I have enough in my book to go on my own but I'm not sure...

like

My s/o and I were in a very long relationship that just ended. We have so much financial ties that I feel we need a separation agreement to resolve these issues. Has anyone heard of a non married separation agreement?

like

I have 9 years of overall experience and past 2 years with Oracle, I am in SAAS based apps, Recently I got 5 rating in the appraisal and Manager asked what is the number you are expecting ?
Any idea what to quote either percentage / LPA ?

like

If you and your girlfriend went to law school together, were you together the night the bar results came back? What if one of you doesn’t pass / and the other feels like they can’t celebrate?

like

Let’s make this Soho House, a Soho Home.

Post Photo
like

Can anyone please give the salary range for a consultant with 5 years in Belgium?

like
like

Why do holidays when you can extend your impact

Post Photo
like

When you’re no longer a rising star on this bowl

Post Photo
likefunny

Where’s the best place to watch sunset around downtown Chicago?

like

What is it like to work in a core immigration role at infosys Bpm.

like

How is service line consulting in Deloitte India (not USI), is it only applicable for Indian clients? Has anyone joined recently? Faced any issue with Work life balance ?
Deloitte Deloitte India Deloitte USI PwC EY

In today's scenario what is the average pay for a senior software developer with yoe 6-8?? (Do not include companies like maang and similar companies). I want to know if I am in average salary slab or not. TIA.

Hi Fishes,
I am an Senior iOS developer. YOE is 8.5. Currently getting 13 LPA. Getting promotion in a month with 25 to 30 percent hike which comes nearly 16.8 LPA. I cannot able to relocate now due to family dependency reasons. I heard iOS developer salary market is good. I am having a very good work life balance in the current company. I am in a confusion. Should I look for opportunities with PWFM or stay in current company? Am I making low pay as per market trends?

like

I found a place with great reviews to be diagnosed for ADHD, but it’s through virtual appointments, is this a normal thing?

like

Additional Posts in Data & Analytics Consultants

In the most unnecessarily complicated phrasing worthy a dissertation, what are you working on this week?

like

Could anyone recommend a set of indices that are publicly available and is a good predictor for consumer spend in home renovations ?

like
like

I am currently working mostly in Data Analytics, but I want to transition into Data Engineering. I've applied to a couple Data engineer positions but it seems I don't have the qualifications for them. Should I maybe look for Jr. Data Engineer positions to get experience and try to move up from there? If so anybody know of any Jr. Data Engineer positions available?

like

What are the top sales & marketing metrics that tech companies track? I have an interview for a Data architect role and the data aspect is my strength but need to brush up on the business insight part

like

I am finishing up a project and I’m trying to document what I’ve done for my resume. What are some good metrics for someone who mainly created user stories, created dashboards, interacted with the client and developed statistical models? One of my dashboards got deployed to production but it’s to early to see the impact. My other dashboards are almost done but I’m moving on to something else.

like

Is 128k a fair base salary for Consultant in Deloitte Analytics & Cognitive. MS CS and about 3 yrs experience. In one of the fastest growing but midtier tech cities in the US.

like

What’s the best/simplest way to understand Sets vs Groups in tableau?

like

It’s been ages since I’ve taken college statistics. Can anyone recommend an online course where I can review and brush up?

like

Single book recommendation for user research?

Goal is interview prep. Ideally focused on applications in tech.

like

Have you ever failed to deliver? What was it and why?

like

Is it worth it to do a PhD in Statistics or Epidemiology or Health Informatics if I am interested in being a data science director in Pharma or a Health system? I am working remotely a a data scientist right now. I am plan on learning more ML models for now. However, is there a certain point where it makes sense to get a PhD? I want to stay in the healthcare space but not sure what I should do next besides taking coursera classes.

likeuplifting

Anyone have recommendations on the best app/site to learn Python? 🐍
I’m a complete beginner.

like

I was hired a few months ago by D to do data science. I am not doing data science currently, is there a way I can switch roles internally? Should I talk to my coach? Or should I just start looking for a new job. I’m starting to feel that the field is so hot rn my small stint at D won’t be a big deal to other firms.

like

Coming to the realization that consulting is not for me (tech person) feeling angry that salaries at D will never be on pair with FANG and that leadership is not tech focused. For example you could be a soul contributor at fang making 240k and people at Deloitte wait 10+ years to earn that as Senior Managers because they need to climb the corporate ladder. It seems super clear cut to me now, if you want to make money in tech don’t join consulting firms. Am I wrong?

like

I'm non US citizen and thinking of moving back to EU. My plan is getting remote opportunities across the world and work as a freelancer. My speciality is Data analytics and BI (Qlikview, Tableau). 1) How likely I can get a gig from the US? 2) if a job looking for a remote 2-3 months contract do they care what country I'm in? 3) how can I compete Indian rates as I'm in Europe 60-70$ per hour as a BI consultant is a good rate but I see online rates as low 10$😫?

like

New data offering: name.co, or namesoftware.com for the main domain? I’m leaning toward name.co, but I worry about not having the .com.

like

What are some interesting non-tech/insurance/advertising/consulting careers where data science is applied? Thinking of epidemiology and economics

like

New to Fishbowl?

Download the Fishbowl app to
unlock all discussions on Fishbowl.
That was just a preview…
Sign Up to see all discussions
  • Discover what it’s like to work at companies from real professionals
  • Get candid advice from people in your field in a safe space
  • Chat and network with other professionals in your field
Sign up in seconds to unlock all discussions on Fishbowl.

Already a user?
Login here

Share

Embed this post

Copy and paste embed code on your site

Preview

Download the
Fishbowl app

See what’s happening in your industry
from the palm of your hand.

A phone with Fishbowl app

Scan your QR code to download
Fishbowl app on your mobile

Download app

Sign up for free to view this conversation on Fishbowl

By continuing you agree to Terms of Use and Privacy Policy

Already have an account? Log in

Sign up for free to continue using Fishbowl

By continuing you agree to Terms of Use(New) and Privacy Policy(New)
Messaging rates may apply

Already have an account? Log in

For account settings, visit Fishbowl on Desktop Browser or

General

Legal