Continued the Data Engineering Zoomcamp by Alexey Grigorev and just completed Module 2: Workflow Orchestration.

This module focused on how data workflows are structured, scheduled, and automated in real-world data platforms moving beyond infrastructure into actual pipeline execution.

Here’s what I worked on:
1️⃣ Data lakes and workflow orchestration concepts
2️⃣ Building workflows using Kestra
3️⃣ Managing task dependencies and execution logic
4️⃣ Hands-on homework and practical pipelines

like
Posting as :
works at
You are currently posting as works at

Related Posts

Chicago is opening up - Let'a plan for our first summer outing. Whose interested? Suggestion? Go....!

Do you guys ever do message platforms / message maps? If so, how do you approach it? Is there a specific template you use?

like

What is the perception of a McKinsey solution role that is a CSP? Can I exit to tech? Would the role be better than the T2 role I have now?

like

Is there anyone who can discuss the current development trend of the world economy? I am very willing to learn and share what I know.

like

What’s the best way to find a roommate in NYC? Budget is 2500-3000 and want to live in Manhattan. With this budget (5500/6000 between 2 people), would I be able to find a decent apartment somewhere in Lower Manhattan?

like

Any interview experience at paytm and PayU for data science role

like

Hi
Is cab facility free for cisco employees. If not then how much is charged.
Considering 2-3 days hybrid, what you all suggest for commuting
I live 7 km from cessna park.
Needless to say.. I dont own any vehicle as of now. Probably will plan for one. @cisco

I work in sf and Nyc and have now saved enough where I’m wondering if it makes sense to buy rather than rent an apartment as an investment. Tricky part is I’m still quite young and this wouldn’t be my lifelong/family home. Have also considered buying in less metropolitan areas and renting them out for passive income. Curious if anyone’s gone through this process before and have thoughts ?

like

Is there a reason some of the biglaw websites look like they were made in 2006? Surely that reflects poorly on a company

like

What kind of work is done by Junior Talent in Data & Analytics?

like

How does project allocation happens for lateral joiners? Is it forced upon or do we get a choice to choose or apply for a project? Accenture

like

Hey Accenture India any openings for java, i have around 9+ yrs of experience and currently working as project manager at CTS, I am an ex employee of Accenture.

Anyone from Amazon India Finance division? Looking for an employee referral.

like

Is there any profile which is based on purely SQL and nothing else, no excel/tableau/powerbi task.

like

Hey ppl Need a suggestion. Ik this is out of topic but can you please suggest me a phone under 30k-40k Planning to buy in Samsung, OnePlus or Google pixel (please suggest the best)
TIA

Office bathrooms should have signs that say employees must wash hands before leaving...

like

Thinking having a 24’ HD and a 28’ 4K monitor setup. Is 4K for excel not necessary? How about 28’ monitors?

like

Generally how long are on sites? Are they all on one day’s block? The entire 4 hours?

helpful

I’ve worked as assistant manager for years, but it doesn’t look like I’ll be getting a promotion anytime soon. I feel bad leaving since I'm kind of the glue around here and I’ve gotten to know pretty much everyone. Any advice?

like

If everything is “asap”, nothing is “asap”

likesmart

Additional Posts in Technology/IT Consultants

Thoughts on Workday? Is it a hot product? Worth it to learn it?

like

Interviewing with Oracle for Senior Director role (Strategic Client group). 18+ yoe
How is the work culture and PIP at Oracle? I have a comp discussion planned this week, any insights into their salary structure will help - base, joining bonus, RSUs, etc...

like

Tips for documenting requirements during a BPR/TPR? (this is my first project)

Hi there, I need some guidance for the preparation for cloud architect role at AWS. What is the interview process and how should one prepare for it? Any suggestions or guidance is much appreciated. Please note I only have AWS certifications as an experience in cloud technologies. Overall, I have 11 years of experience.

likehelpful

I work heavily in AWS and am looking to learn another cloud platform. I have zero knowledge of azure and gcp and would like input on which to learn. Azure would make sense since its the second largest in terms of market share, but GCP seems far more interesting and technically challenging with things like Kubernetes and BigQuery.

like

Applying one year out of undergrad?
Contd..

Offered 110k base for a consultant level (commercial) in A&C. 3 yoe, none in consulting. Was this a good offer?

Not the most technical, more like business intelligence type role

like

Did anyone attend the Salesforce world tour in London today?

Currently in cybersecurity but looking for my long-term specialization. Not interested in doing the pen testing route. Not really sure what's out there and where to start...

Anyone leveraging Sap Leonardo ? What about sap + blockchain ? I am about to resign from Deloitte, worked as an sap consultant ( security) for several years, looking to pickup new tech skills.

Looking for 2 to 8 YOE for lateral hire in Technology consulting roles. Folks with red hat, open shift, RPA, BPM, Salesforce CRM, big data & Analytics experience and certification, DM me for referrals.

like

Can I negotiate my entry level offer from EY? Or is that not gonna happen / look bad. I’m a campus hire.

funny

Anyone familiar with Amazon's Solution Architecture team. Sounds like pre-sales /architecture type work. inputs on work, culture, pay, etc. appreciated

Anyone familiar with Ephesoft Transact that would let me pick their brain?

like
like

Looking to specialize in privacy and was considering getting the CIPP/CIPM/CIPT. I already have my CISSP and CISA. Is it worth it?

like

Does anyone work for Capgemini invent? Got a call from a recruiter but looking for more details

like

I want to be qualified / informed enough to be able to reasonably brand myself as an ML or/and IoT expert. (Consultant) what's the fastest way?

like

To people who have worked on both, what is the main difference in responsibility for a consultant working on a COTS delivery project compared to more bespoke agile one? I have experience in agile bespoke delivery, would I find it easy to switch to COTS implementation?

like

The thing I struggle with the most on a project is being able to quickly understand the business process of the clients across different industries. Any tips or resources I can use to improve that?

like

New to Fishbowl?

Download the Fishbowl app to
unlock all discussions on Fishbowl.
That was just a preview…
Sign Up to see all discussions
  • Discover what it’s like to work at companies from real professionals
  • Get candid advice from people in your field in a safe space
  • Chat and network with other professionals in your field
Sign up in seconds to unlock all discussions on Fishbowl.

Already a user?
Login here

Share

Embed this post

Copy and paste embed code on your site

Preview

Download the
Fishbowl app

See what’s happening in your industry
from the palm of your hand.

A phone with Fishbowl app

Scan your QR code to download
Fishbowl app on your mobile

Download app

Sign up for free to view this conversation on Fishbowl

By continuing you agree to Terms of Use and Privacy Policy

Already have an account? Log in

Sign up for free to continue using Fishbowl

By continuing you agree to Terms of Use(New) and Privacy Policy(New)
Messaging rates may apply

Already have an account? Log in

For account settings, visit Fishbowl on Desktop Browser or

General

Legal