Databricks vs. Snowflake? Which one do you feel like will last longer and why?

like
Posting as :
works at
You are currently posting as works at

We use both of them in our environment. I feel Snowflake has been overselling their data engineering capabilities. At the end of the day, it’s just a data warehouse with some great features such as Cloud storage access, zero copy clones and secure data sharing. However, their suggested way of doing hardcore data engineering through SQL statements is just bonkers. Very hard to maintain and debug deep nested sql statements. That’s where customers suddenly feel a need to buy extra tooling like dbt. We do most of our DE through Databricks and use Snowflake just as a DWH. Lately, I have been comparing Delta lake with Snowflake. DL is a very promising ‘dwh’ and may start eating Snowflake’s lunch soon.

like

Databricks

like

Robust, versatile, based on open source

like

Both products at the moment are not able to replace each other fully. They are proposed together to build more comprehensive solutions. Somewhat MECE

like

Databricks.

Spark isn't going anywhere anytime soon and it is by far the best implementation.

like

Opinion on Cloudera?

It is on a slow death bed .. was big until 2019-ish .. don’t expend your time and energy on it ..

Related Posts

Can anyone refer me in PWC India.
I am having 5.5 years of experience unto java development.
My LWD:14th September

like

Started eating healthy and going to the gym two days ago and already lost 5 lbs. was this the secret to being skinny all along?

like

Operations Supported in Business Configuration UI

#SAP #SuccessFactors #BCUI #HXM #HRIS

Post Photo

What are the hours like for a program manager in the Bay Area?

like

Im joining Accenture Uk on 19th Aug 2021. Anybody else starting on this date? When does one usually receive the Teams invite / joining instructions for the first day orientation & induction?

like

What is pilot roleout program in Capgemini, I received for B2 consultant.
It consists of assessment and learning of different topics.

What is it's significance and what impact does it have if you have cleared or failedCapgemini

When Parents want you to see Baghban with them, show them chhichhore instead 😁. #mondayblues

like

What’s making those of you who want to go back to India want to go? I hear the work culture and bureaucracy there are the main reasons people come to the US.

like

Idli Sambar with a twist of mutton 😁

Post Photo
likeuplifting

Looking for help/advice for case study interview in consulting firm in Canada. It’s a role in supply chain/retail vertical- I come from a merchandising background in retail

like

Hello everyone,
I would like to know if gst is applicable on notice period buyout?

My company is charging gst on notice period buyout..I have never heard of it.

funnylike

I'm a depressed 32 yrs old single with 8 YOE. Last drawn CTC was 5 LPA even after switching 5 companies.
When I see Ppl with 18LPA or 23LPA with 4 or 5 YOR, I really feel my gut wrench with sadness wishing I had that CTC.
I need to put up things right to rebuild my life all over again. What do I do?

likehelpful

Hi Guys ,
I had my capgemini hr round cleared on 7th October , and on 8th October , she said she has sent mail for business approval ?
Job grade B2
YOE - 4.1
CTC offered - 14 Lac ( fixed )
Current CTC - 5 6 LAC
Skill - AWS Cloud + Python + Devops

My question is how many days does it takes to release offer letter ?
Is the salary offered good or should I try for more negotiation ?

Note :- LWD in my current company is 1ST Nov

like

Anyone at Salesforce know how to lookup the level-grade of a specific person from the org chart?

like

Hi fishes,
It's it possible to move from EY India to EY GDS?
What are your thoughts?

like

Guys I have a offer for Penetration Testing Engineer L4 position, London location what should be the salary ?

Years of experience- 2 years

NWA❗️

Got the call for this piece yesterday.

Post Photo
likeuplifting

Approached by Amazon recruiter to interview for an entry level role. Is it worth it? Recruiter said the hiring manager likes my profile but I lack some “product/industry” knowledge and she can’t match my YOE. I’m at 190 (210 TC).

like

Winter can be exhausting 😴❄️

Post Photo
like

Looking to exit into industry as a PM. I’m currently a product owner at a client but did not build the products, I inherited them and mostly do support and minor enhancements. Any advice?

like

Additional Posts in Data & Analytics Consultants

How’s EY’s hiring/interview process structured for data and analytics roles?

like

Looking for senior Data Analytics Associate. Role pays 110K for fully remote role for non profit in NYC. Let me know if interested.

Minimum Requirements placed below

like
like

What’s so good about the Georgia Tech OMSC and OMSA? Is it just the cost? Seems to be recommended by most of reddit

likehelpful

Can anyone at Ford Motor Company tell me more about the “Learning Analytics and Engagement Specialist” remote position? Very curious and would love a referral!

like

Bowl show and tell this Saturday at 12-1 EST! Put it on your calendar so you remember us brainy people 📆
Zoom details will be posted on this thread, FB team is working provide an account.

Bring a talking point: anything data or analytics related, from memes to case studies of your side hustle to firm stuff we should know about to anonimized work projects. This is DaTa bOwL LiVe!! I can't promise we'll get through everyone, but we'll see. We can go overtime if y'all are enjoying 🍿🦁🎪🤡

like

I'm non US citizen and thinking of moving back to EU. My plan is getting remote opportunities across the world and work as a freelancer. My speciality is Data analytics and BI (Qlikview, Tableau). 1) How likely I can get a gig from the US? 2) if a job looking for a remote 2-3 months contract do they care what country I'm in? 3) how can I compete Indian rates as I'm in Europe 60-70$ per hour as a BI consultant is a good rate but I see online rates as low 10$😫?

like

Interview for a Data Analytics consultant role and have been told there will be white-boarding exercises. How would you prepare for this? I’m guessing it will mostly be SQL but don’t want to assume.

like

I have created Algorithmic Product/System for the client to take out inventory not-in-demand for long time to save storage expense and also provide an approach to prioritize Work Orders based on Market Demand. It’s more like an Manufacturing Plan. I want to get into Product Analyst/Lead role. What approach I should take? Any books to start with? Any events to attend? Any groups to join?

like

Is it realistic to join KPMG Lighthouse or Gamma without a Masters degree but with previous experience as a data scientist at a big data startup?

Can anyone from Blackstone share some insight about the Data Science Management Program? Looks like a fantastic opportunity!

like

Anyone at Google willing to refer? I want to apply to a role I’m interested in. Thanks in advance! 🙏🏽 Google

like

I was hired a few months ago by D to do data science. I am not doing data science currently, is there a way I can switch roles internally? Should I talk to my coach? Or should I just start looking for a new job. I’m starting to feel that the field is so hot rn my small stint at D won’t be a big deal to other firms.

like

How is the Deep Learning specialization on Coursera?

So engineers can now automate the writing of basic code, and potentially more complex tasks, by using GPT-3.

For those who are technical: If machines can write code, how are you going to upskill? And what are the best ways make yourself indispensable?

I am not embracing the notion that you shouldn't have to code to do data science. However, I think coding may soon be much less of a competitive advantage.

like

Heya, are there any data migration experts about, who wouldn’t mind answering some questions I have about dashboard migration (Palantir Foundry)

like
like

Folks applying for Data and Analytics roles in the industry at M, SM, D Levels, what technical/functional topics do you prepare for on the Analytics side?

like

Docket + R - I have an container running a rocker image and I’m trying to launch a bash terminal and the RStudio server (/init) at the same time. Is this possible? I tried adding CMD [“/init”] too.

like

Looking at a job in Kobo (Rakuten) for Data Analyst, any insights as in the technical portion of the interview ? Also, any recommendations regarding the company? Thank you!

like

New to Fishbowl?

Download the Fishbowl app to
unlock all discussions on Fishbowl.
That was just a preview…
Sign Up to see all discussions
  • Discover what it’s like to work at companies from real professionals
  • Get candid advice from people in your field in a safe space
  • Chat and network with other professionals in your field
Sign up in seconds to unlock all discussions on Fishbowl.

Already a user?
Login here

Share

Embed this post

Copy and paste embed code on your site

Preview

Download the
Fishbowl app

See what’s happening in your industry
from the palm of your hand.

A phone with Fishbowl app

Scan your QR code to download
Fishbowl app on your mobile

Download app

Sign up for free to view this conversation on Fishbowl

By continuing you agree to Terms of Use and Privacy Policy

Already have an account? Log in

Sign up for free to continue using Fishbowl

By continuing you agree to Terms of Use(New) and Privacy Policy(New)
Messaging rates may apply

Already have an account? Log in

For account settings, visit Fishbowl on Desktop Browser or

General

Legal