Related Posts
31 F based in Chicago. Does anyone want to talk?
Siemens technology is product based company?
Who is hiring?
Additional Posts in Data & Analytics Consultants
New to Fishbowl?
Download the Fishbowl app to
unlock all discussions on Fishbowl.
unlock all discussions on Fishbowl.







It really depends upon the process details and the teams that interact with the specific data pipelines. Some questions to consider could be:
1) Is it possible to shift the large processing time from business hours to non-business hours (with the help of schedulers)?
2) Can you cache intermediate results? This would require a review but could pay off massively.
3) Are several long running queries doing the same intermediate calculations? This may involve refactoring queries.
4) How is the delivery of results affected from long processing times?
5) Does your current setup hinder teams from developing future use cases?
Use a hashmap bruh