Could the fishes here please suggest some good resources to understand data pipeline designs and best practices for the same?

like
Posting as :
works at
You are currently posting as works at

Hey! Not sure what level of pipeline your asking about (specifically in terms of data size and currency), but, since you’re asking here, you might mean reporting oriented data pipelines, Guy In A Cube on YouTube is a great resource for all things Power BI related and they have a pretty good collection of videos on ETL topics involving configuring presentation data layers. Even if you’re not using Power BI you might find some of their content helpful.

Thank you. I actually meant designing data/etl pipelines in the cloud such as aws/gcp using devops.

Gotcha, can’t say I have recommendation here, but I’m interested too!

like

Related Posts

What laptop is given in CGI for Associate Consultant level? Could someone help here please?

#CGI

like

Anyone volunteered with Techbridge before? I have some questions

like

My first jr ad interview is coming up. What can I expect? What kind of questions will I be asked? Any device would be lovely.

like

I recently left EXL Services in July month. It has been more than 60 days but i haven't received my relieving letter from EXL. They are still saying that it can take 15 days more. What could be done in this case?

like

Does anyone know the salary of a beginner para planner at Ameriprise or any other broker-dealer?

Is 80k cash + 20k company share a good deal for a junior dev role in the bay area?🙏

like

Idk, maybe it’s time we bring these engineers and techs down. If my 🧠 links to a 💻 , all of my non-billable work will come to light. 😤

Post Photo
like

The World's 100 best companies

Post Photo
smart

Hi
Can someone refer me in Citi
If there is an opening for analytics position

Skills: Python,SQL,excel,sas

Yoe: 2.3

like
funny

What kind of sectors does Accenture S&C deals into How is customer service and sales strategy team within Accenture s&c

like

PSA: A shirt with a buttoned collar is not a dress shirt, please stop

like

Trying to understand risk of loss and title better. When does it make sense for title to transfer upon receipt of payment? Why would title and risk transfer separately?

like

Anybody who got laid off in the current wave and looking for a referral in Zalando in Germany, feel free to DM me. Happy to help.

like

I would really appreciate any feedback on Manhattan Associates PSO OMNI.
I have offer from MA PSO OMNI.
Shall I consider it?

like

I passed out in 2013 and started job in 2015 on contractual basis till mid 2017 and during this Many payroll companies changed for that particular contract and in this duration my PF, tax didn't deduct and no record in PF portal. Then joined Infosys in mid 2017. So now wanted to know can I show my experience from 2017 to apply in companies as for bgv many companies ask for PF statement or form 16 for all previous companies. How should I deal for 4 years gap if i show exp. from 2017 ?

like

Hello all, I have received an offer from tiger Analytics for Data Scientist role. Kindly suggest if I should join the company in the recent events of layoffs and recession?

like
likefunny

What is salary range and/or total comp for a SM/D entering into big 4? Obviously I’m talking about D and p dubs, respectively. Have 2.5 years consulting experience. 16.5 years industry exp. Ty

like

$210k TC in Bay Area (Consulting) or new offer: $220k TC in Austin (FAANG)?

like

Additional Posts in Data & Analytics Consultants

Learning cloud architecture right now so apologies if these are obvious questions: Best ways to store video metadata to perform analysis on it? I'm looking at AWS and GCP. Saw that Cassandra would be good for it, but not sure what the GCP equivalent is? But also I'm a bit confused on if Cassandra is just a DB and storage would need to be elsewhere? All help is welcome! I've been spinning my wheels on Google trying to understand

like
like

Anyone here work or has interviewed for a data science role at DataRobot? Would love to get some insight. Third interview coming up.

like

Anyone in the KPMG Lighthouse practice that would be willing to take a look at my husband’s resume and put in a referral? He’s interested in the Associate, Data Scientist position.

1) Hypothetically if you were looking to sabotage a colleague, can you code an excel document to throw off their numbers or calculations, (if you send them that document and they download it for use)?

like

I have been working in healthcare clinics and health techs for a few years now. I’m an independent consultant. Bust, a friend of mine referred me to a big bank job. The role is of data governance manager. What should I know for the interview, or how can I prepare for it? Any thoughts? They told me I don’t need financial background. Data is data, but they wanted to know metadata management and how do I build frameworks/implement enterprise systems.

like

What is a data lake in basic terms?

like

I was hired a few months ago by D to do data science. I am not doing data science currently, is there a way I can switch roles internally? Should I talk to my coach? Or should I just start looking for a new job. I’m starting to feel that the field is so hot rn my small stint at D won’t be a big deal to other firms.

like

It’s been ages since I’ve taken college statistics. Can anyone recommend an online course where I can review and brush up?

like

How should I move to tech as a ML Engineer? How did people here make the transition?

likehelpful

Newish to data analytics. Have some experience in power BI, sql, and R. I wanted to get some exposure to aws and saw the AWS cloud practitioner as an available course at my job. Is this cert worth it? Or should I try one of the more advanced ones ? The data analytics one for example but wasn’t sure if it would be difficult to get through as a beginner. Will it look good on my resume?

like

Big 4 Data Scientists, how did you exit to big tech firms? I’ve been unlucky with online applications and even referrals. I think it might be my resume or how I present myself. Can any free birds please give guidance?

like

I have created Algorithmic Product/System for the client to take out inventory not-in-demand for long time to save storage expense and also provide an approach to prioritize Work Orders based on Market Demand. It’s more like an Manufacturing Plan. I want to get into Product Analyst/Lead role. What approach I should take? Any books to start with? Any events to attend? Any groups to join?

like

What’s so good about the Georgia Tech OMSC and OMSA? Is it just the cost? Seems to be recommended by most of reddit

likehelpful

What’s the best/simplest way to understand Sets vs Groups in tableau?

like

Hiring for data scientists and BI analysts across a couple levels, DM me if interested!!

like
like

Any conda users in here have to install a binary and use conda forge? Need some help installing pdftotext. Throwing a weird message saying “Found conflicts!” Any and all help would be appreciated.

like

How does everyone in this bowl feel towards master’s degrees in data science/analytics? I didn’t study this in undergrad so I’m looking to get an analytics degree but I’ve heard mixed reviews.

like

New to Fishbowl?

Download the Fishbowl app to
unlock all discussions on Fishbowl.
That was just a preview…
Sign Up to see all discussions
  • Discover what it’s like to work at companies from real professionals
  • Get candid advice from people in your field in a safe space
  • Chat and network with other professionals in your field
Sign up in seconds to unlock all discussions on Fishbowl.

Already a user?
Login here

Share

Embed this post

Copy and paste embed code on your site

Preview

Download the
Fishbowl app

See what’s happening in your industry
from the palm of your hand.

A phone with Fishbowl app

Scan your QR code to download
Fishbowl app on your mobile

Download app

Sign up for free to view this conversation on Fishbowl

By continuing you agree to Terms of Use and Privacy Policy

Already have an account? Log in

Sign up for free to continue using Fishbowl

By continuing you agree to Terms of Use(New) and Privacy Policy(New)
Messaging rates may apply

Already have an account? Log in

For account settings, visit Fishbowl on Desktop Browser or

General

Legal