Related Posts
AMC to the moon baby
Anyone from Capgemini Engineering Hamburg??
Need 11 likes to start DM
How many pages is your resume/CV?
$BABA got murdered today. Buy, hold, or sell?
Any CDD / M&A Strategy fish willing to chat?
Any mass hiring happening for freshers??????
Additional Posts in Data & Analytics Consultants
What is a data lake in basic terms?
New to Fishbowl?
unlock all discussions on Fishbowl.



To add… I know that it is typical for analytics teams to be bad at query optimization. This is somewhere that I’m sure my team could improve but I have people with query runtimes of 10+ hours on decently written queries but the source tables are so large (50B+ rows) that processing spills to remote disks no matter what given our limited warehouse sizing.
If you are moving to the cloud to save costs, do not move to the cloud. The goal should be to break even and maintain. The cloud requires a lot of work in the standardization of reporting data and pipelining appropriately for cost savings. Governance has to extend out of the IT level and become a partnership with the business. Otherwise, there are 60 slight variations on a single calculation that result in 60 different Snowflake charges. Repeat that over so so so many dashboards and it becomes a comedy of self-inflicted wounds.
Precalculate, provide a dictionary, review and standardize definitions, and allow smaller space and throttled access for true sandbox testing and definition challenging.
Uptime, reliability, increase of complexity of calculations, the ability to share and acquire 3rd party data, and scalability should be more of the reasoning for going to the cloud.