Related Posts
What is the TC for a partner at PWC?
Is it SAFE joining Wipro as technical lead (B3) with 37LPA? Knowing that package is pretty high as compared to collogues in same band. HR is not ready to give project manager(C1) position.
Appreciate your suggestions/input.
Would there be any scope of increment going forward?
YOE 8.7
Tech SF DevOps
Wipro Infosys HCL Technologies Tata Consultancy Cognizant
Additional Posts in Data & Analytics Consultants
Has anyone else begun to resent data science?
New to Fishbowl?
unlock all discussions on Fishbowl.





Subject Expert
These are very valid questions. If you are trying to migrate database records as batch process, you generally would need to stage in cloud buckets and then update your database tables. These might differ across cloud vendor.
However, assuming once it’s setup, you should be able to query and update the database directly using an endpoint. There is no need to first load the data to storage and subsequent update to database. You could maintain replicas and cache as well as perform snapshots for faster reads and reliability.
This brings us to the question as how many hits one can make to the database per second and associated scalability constraints. For small and moderate scale workloads, sql are more than fine if you have a defined schema and query patterns do not include network like joins.
Not a database design expert but just my two cents on the topic.
Well metadata of media files. Media files would be stored in an S3 bucket, but trying to understand best way to store and analyze the metadata of those media files
Bowl Leader
Listing three to five words that describe your requirements may help you organize. Try picking from the below list, and then look up tools based on your priorities:
https://en.m.wikipedia.org/wiki/List_of_system_quality_attributes
Subject Expert
Is the metadata schema enforced or could contain free fields?
Yes user info would be a separate DB - assuming something like AWS RDS or Google cloud SQL. I guess my confusion lies on whether that data needs to first be stored somewhere like an S3 bucket beforehand? And if this is ideally real time info, would it make sense to have things cached after/if being stored before querying info from a DB. Again apologies if I'm just totally off here, just started looking at cloud architecture and really trying to learn some different scenarios
Use cloud data store aka fire store to store metadata