Designing a data pipeline could be full of errors like any other software products, but with a massive difference. The errors in data could be silent and show them as a pivot in your BI dashboards or as an outlier in your analysis. This is the main problem in all data pipelines and I will talk about how to handle it.

like
Posting as :
works at
You are currently posting as works at

Related Posts

Got an offer for 60k pounds + bonus for London location at Sr Consultant level in FS industry. How good/bad is the offer? Please suggest.

CCTC: 24lpa in India
Workex post MBA: 3.5 yrs
Total workex: 6.5 yrs

like

Moving from out of state - how do you read between the lines of Greatschool ratings? Is Fairfax really better than Loudon schools? Feeling overwhelmed with all the information on schools. Any tips on what to look for?

like

Looking to relocate, we're house hunting right now. Which would be a better neighborhood? We're an active, child-free couple. Solana Beach or Gaslamp Quarter, or Downtown?

like

Anyone else at CyberArk Impact this week? Anything exciting going on?

Which is a better specialization option within consulting? Commercial Operations (sales & marketing) vs. R&D Strategy in Biotech? Would the answer be different if it was focused within Pharma? No Ph.D.

like

Hello fishes, I am working at IBM as a Data Scientist and currently on bench. I will be resigning today as I have a better offer in hand right now. Wanted to know if I have to serve entire notice period of 90 days even when on bench or IBM gives early release ?

like

I’m looking to apply to LEK soon and haven’t updated my resume since undergrad. I’m struggling on how to fit my ZS experience into just a few bullets and would greatly appreciate some tips. Would any one be willing to DM a resume that they used to lateral to LEK?

like

Serious question- since team matching is taking so long. Is it worth taking another offer for now and switch to Google few months down the line? Not the most ethical I know, but I can’t keep on waiting… and I can’t stand another second of staying in my current job

like

I have never seen anything so incredulous. He knows more than the Supreme Court now. He’s cray cray.

Post Photo
like
like

How is tiger analytics in terms of work culture and employee benefits ?What is the annual hike percentage that tiger provides ?please pour your thoughts.

like

Idk, maybe it’s time we bring these engineers and techs down. If my 🧠 links to a 💻 , all of my non-billable work will come to light. 😤

Post Photo
like

Any Benefits Analysts out there willing to share salaries? I am a remote employee but also looking in the Atlanta area. About 7 yoe and wondering if I’m cheating myself to ask for max $80k.

like

Any experience / recommendations for extended car warranty companies? I have a Volvo XC40 still under factory warranty with an engine issue that isn’t easily resolved. Making me worry about being without a warranty in the future.

Any recs for insightful and well written books on entrepreneurship? Friend is trying to launch his own startup so I’m thinking of sending him a relevant book as part of a thank you gift

like

Does anyone else here have a hospitality management degree? Do you think it was worth it?

like

Hi there anybody here work with influencers & creators often? Would love to network and pick your brain on the legal side/contract clauses to include 🙏🙏🙏 as I'm trying to propose an influencer strategy at my company. Thanks

like

Client removes all copy in ads re: product description or product benefits due to pending legal review. Removes visuals of product doing its job. Blames agency that ads aren’t driving traffic/sales

likefunnysmart

Those with PE offers that are eligible for carry, was carry included in your offer letter?

like

I lived in tampa in my early 20s and am now in my late 30s and looking to move back. One of the reason I left is because I felt I had too much energy for the city for a single young professional, but now husband is from there and we have a kid but we are both social people. Do you guys find it easy to meet interesting people and has the city gotten any more fun?

Additional Posts in Software Engineering

Where/ how can I learn Azure?

like

First post, not sure if this is the best bowl to use but here goes. I’m wondering if anyone can share a bit about their experience working at MongoDB. I have seen they are hiring for many roles and am curious to hear about their experience. In particular, I would like to hear about software engineer roles. Currently I work on database engine C++ code and have seen some roles that indicate continuing down this stream would be possible with my skillset.

like

Engineer 🐠

Has anyone personally learned how to build an AI based tool/ app - is it hard?

How does one source this type of talent?

likefunny

Any top tips for a systems design interview? Thanks in advance

helpful

What would your reaction be if the company you applied to asked for you to get permission from your current firm before moving forward? The situation is the company you're applying to is a client of your current firm, and you've already gone through the interview process with the new company. Thoughts?

like

Is it normal for Amazon recruiters to reach out to you regarding SWE positions? I’ve received a couple messages on LinkedIn about some openings, but considering the fact that I’m still a junior developer I’m not sure if they’re legit or scams.

like

I'm a SWE from Italy. Love my country but salary and taxes here are outrageous. Got 2yrs experience in fullstack and data science, 2masters, a peer reviewed paper and outperform all my peers for 24k€ a year.
I'm thinkin about landing a remote SWE job (leetcoding and building a portfolio this summer).
Have you got some advice? Is it possible to work for US remotely without visa? What other countries pay well? Is it possible to land a 100k$+ with this kind of experience and working from Italy?

like

Trying to learn how to automate work using python. The specific task I wanna do is using information from a different webstie to create zendesk tickets. Any good resources I can use?
Thank you

Is 120k+super a good salary for software tester (manual) with 7 years of experience in Melbourne?

like

What would you say are the best combination of skills for software engineering now?

like
like

I have a technical interview with Google Software Engineering team. Anyone know what kind of questions they will ask? What are the best Google offices in the US or Canafa? are they flexible with remote work?

like

Our team is searching for a seasoned oracle developer specializing in retail/ecommerce, along with cloud exp. Fully remote. If your interested DM me.

like

Serious question from a happy software engineer, what do you all love about your work/actually enjoy doing during working hours?

I'll start; I'm privileged enough to have been given the opportunity to work and learn deeply on Linux and Kubernetes, and I get to tinker and play with them all day. Problem solving with them is a "fun" part of my job.

Of course most things aren't roses and sunshine, but I'd love to hear the positive parts of what you are doing, or what you like to do at work.

like

any good courses for kotlin around? preferably online

Should I specialize in Blockchain or AI? I’m a freshman in a CS degree and I can’t decide. My main argument to choose blockchain is the easy entry with little experience and high salary, I plan on growing my skills during the bear market and get a job once the market recovers. Regarding AI, I find this field fascinating but I feel like it requires a lot of experience, degrees and diplomas.

like

Hey guys! Yesterday the company i worked for laid off the people in our state for economic reasons with no notice. I’m in desperate need of referral in entry level SWE/SD(or similar) positions at the moment. Any help would be greatly appreciated. Thank you!

like

Has anyone else worked two programming roles at one time?
I currently work as a Contracted Software Engineer and I’m set to finish my contracted time at the end of October. To stay ahead of game I started to move forward in the interview process with another opportunity as an Application Software Programmer and just received notification that I got the position. I definitely could use the extra paycheck to help out with my financial obligations. Just wanted to see if anyone has done this before.

like

I got a link for Amazon’s OA for each position I applied to. This is before even talking to a recruiter. Am I supposed to only take 1 OA for the job I am most interested in?

like

New to Fishbowl?

Download the Fishbowl app to
unlock all discussions on Fishbowl.
That was just a preview…
Sign Up to see all discussions
  • Discover what it’s like to work at companies from real professionals
  • Get candid advice from people in your field in a safe space
  • Chat and network with other professionals in your field
Sign up in seconds to unlock all discussions on Fishbowl.

Already a user?
Login here

Share

Embed this post

Copy and paste embed code on your site

Preview

Download the
Fishbowl app

See what’s happening in your industry
from the palm of your hand.

A phone with Fishbowl app

Scan your QR code to download
Fishbowl app on your mobile

Download app

Sign up for free to view this conversation on Fishbowl

By continuing you agree to Terms of Use and Privacy Policy

Already have an account? Log in

Sign up for free to continue using Fishbowl

By continuing you agree to Terms of Use(New) and Privacy Policy(New)
Messaging rates may apply

Already have an account? Log in

For account settings, visit Fishbowl on Desktop Browser or

General

Legal