Related Posts
What should I ask for in my exit interview?
Additional Posts
Post new user
new test post
Top top post!
Testing a new post at 12:06PT 5.12
CRJ regional jets are terrible
New to Fishbowl?
Download the Fishbowl app to
unlock all discussions on Fishbowl.
unlock all discussions on Fishbowl.
It depends where you’re working. At Facebook, say you’d sell it to anyone that’s willing to pay.
“With big hands”
Depends on who's asking. In reality and when speaking to a data person, I've worked on "medium data" that's a bit too large for a laptop but not big enough to warrant the latest greatest big data tools (leveraged the data warehouse hardware and minimal cloud). But to recruiters and execs who don't touch infrastructure, it's definitely "big data" since you'd have a bad time with it in an Excel sheet 🤷♂️
1) The tools I use, like Spark. 2) The methods that I build in, like there's a pipeline I built which does diagnostics and logging so I can tell if it's working, and then can pick up where it left off if it breaks. 3) A bit about how big data doesn't mean good data or useful data.
I always lie. I’m in a similar position as DS1 with data too big for my laptop but nothing bigger than a few gigs. Interviewers tend not to understand that medium-ish data exists, so I always am just like, “Yeah, I work with terabyte-size data tables using X, Y, and Z (fill in the variables with the job description’s tech stack)”
I recommend searching “the data engineers guide to Apache spark” by databricks. It’s free. Knowing how spark works and the motivation behind it will provide you with a nice detailed answer to that one