In my latest post, I discussed silent errors in data pipelines. While it’s difficult to write truly effective tests (such as TDD) for data-related tasks, the best solution I’ve found in my current role is to validate the data at both the start and the end of the pipeline to avoid silent errors.
For example, I created an Airflow DAG that runs every 6 hours. It validates the data by comparing statistical metrics such as sum, avg, std, etc. between the source and target datasets for numeric fields.

Coming from ACN, senior analyst, 3yrs total experience so far & wanting to get into the data analytics/BI work. Currently have had experience working with SQL developer, OBIEE/OBIA, Teradata in ERP and Healthcare projects. I also have my AWS Cloud Practitioner Cert, hoping to eventually get the Data Analytics Cert later. What are my chances of finding a role with another company that'll let me work in BI/data analytics and build up my skill at the same time? Been thinking of leaving ACN.

Are there any role and responsibility differences between being an full time ACD and a freelance ACD?

How to refer someone for a role at JPMC?
Not general refferal, but for a specific role?

Hi Fishes,
At walmart global tech
I was interviewed for IN4 Role but HR said based on Feedback they will give me IN3.
its for Data engineering.
My YOE is 7 Years and Already holding offers for around 35 LPA Fixed.
Two questions?
1) Should I accept IN3 level with 7YOE?
2) What is the Capped compensation for IN3 Role?
Salary negotiation is yet to happen.

Guy,

How can I get into Microsoft without an MBA in a Program manager role?

I am currently an Associate Product Manager. Overall Exp 4yrs.

Is it possible to get in or MBA is a must...

What is the average hike provided in Reliance Jio for an employee who is already at market standard and at Manager position. Consider he rated top in a fiscal year with no promotion? Please consider 4 year average while answering if possible.

I have recently received an offer from HSBC for Data Engineer profile. The designation offered is Senior Analyst- Information Management. They said that it is a techno functional role. Does anyone have an idea about what techno functional role actually is in HSBC? Is it more like a Business Analyst? My prior experience is completely in Technical side. Will this role be suitable for me?

Any suggestion is highly appreciated. Thank you.

I was passed up for a promotion after 1.5 years at the agency/in the role despite consistently great feedback and was told that I just needed more time in role. A guy with my experience level was....

Hi! I’m looking for a position as a BDR or AE in a, preferably, tech leaning companies. Are you guys aware of any open positions? Remote preferably. 6 years of experience.

I’m an occupational therapist looking to transition out of traditional OT. I would like to get a remote position in Utilization Review or Appeals/Denials. I also recently got a data analytics certificate so would be open to healthcare analytics. Anyone know a resource or looking to hire for these?

Any suggestions on Tech Consulting to Product Management path (certifications, courses etc)? 6yoe including tech implementations (BI, ERP) ; consider myself a generalist. Honestly looking for an exit into some intesesting product related work (potentially in big tech) but wondering how to reframe my exp & upskill myself in Prod space.

Hello Everyone,

I am actively looking for job change. Please help to refer me in your organization , if there are any openings for Qlik Development.

Is google hiring for any IT Audit positions? If so, can someone refer me? My current position: I am Exp. Associate and am currently in acting senior role. I have been with PwC for about 3 years now.

This is my first job in a large corporate company, and I’m trying to gauge how long it normally takes to move from entry level to another internal position in the insurance industry. I have been applying internally for a year now and I am wondering if this is normal or if my company is just slow? I am a top performer, with great metrics, and I have some wonderful connections I’ve made who support me. I just can’t seem to move up. How long did it take you to move up? How many tries did it take?

Hello, has anyone recently made the shift to being an implementation role from a non tech role? Need some inputs. Thanks

How do you find joy in a business where you’re told “no” 100 times a day?

Hi all! I’ve been dating my bf for about 4 months now and there are some things he says/is into that make me believe he is either Bisexual or has gender dysphoria. I could really use someone’s advice who has a similar experience like this. Is anyone willing to chat? I just want to be supportive and helpful.

If given the choice, would you join the miltary again?

I wasn’t sure which bowl to solicit advice from so hoping to catch a bite here. I’m currently in ID. Of course, I want OUT! My interests are L&E and corporate. My options are 1) wait it out where I am in hopes to switch to L&E or 2) in house oil and gas industry transactional work. What would you do and why? I figured this bowl being specific to Texas would understand importance of oil and gas industry.

What are good margins for PI associate attorneys; i.e., what should they make for the firm compared to what the firm would/ should pay them?

Why are the Roman numerals so thick and blobby on the newer Rolex Datejusts?

Anyone taken the CFE or CIA? Feedback is appreciated with respect to review courses and prep time. Thanks.

Has anybody had comp discussion yet?

What are some great investment banks to work as an associate in the Washington DC area?

Need an opinion on the Vanguard VIGAX/VIGIX. I’m index riding with that fund but am wondering if I should shift my risk and go with VT or another Vanguard fund. Thoughts?

Any BCG Gamma fish? Can you please share what kind of analytics projects do you guys do?

Hi
Can anyone please refer for a data science role have ~3 years of work exp . Thanks

How’s the John St design dept these days? Is there even one?

What are some tips or recommendations on where to start to become a product manager? Much appreciated

Diwali gift scene at GDS??

Is it true that most personal trainers at commercial gyms aren’t great? Or is that a misconception? I’ve heard this from a few people and I’ve also had a couple bad experiences.

FWIW, I’m about to join a gym (either chelsea piers fitness or crunch fitness) and looking to get a PT to improve my form, provide a meal plan, and set a routine.

Any recommendations for women’s watches? Looking to spend $800-$1000

Which languages do you use at your job as a software engineer?

Hi,
I am looking to renew my contract with a telecom giant in Toronto, Canada . I am a back end java developer with experience in micro services. Overall experience of 6 years . What is the market per hour rate for the above skills ? Don’t want to undersell myself . Need your insights !
Thank you !

Okay, I feel like if a QE in India needs to email me, an SE, to just press the 'resolve' button on a user story that was created after a bug report was issued and fixed, then maybe... Just MAYBE... There might be a bureaucracy problem. 😒

Can you practice for leetcode without knowing how to code?

Looking for a recommended software to scrape data from ZoomInfo.

Thoughts?

Is it common to negotiate software engineer salary at smaller companies? I know it’s common at FAANG, but what about for companies with around 200 engineers? I have a counter offer from my current company and on-site interviews scheduled for end of July with google and Amazon, but I’d prefer to go with the smaller local company if I can negotiate the salary (from offer letter) up another 5% or so.

What do you think about switching tech stacks vs becoming an expert in one stack? I am a backend Java engineer, and have solely used Java since I've started my software engineering career about 2 years ago. I don't know whether I should explore other tech stacks while I'm young, or instead focus on becoming a Java expert, given that I enjoy working in Java.

We're seeking a Manhattan Active SWE. Whose experienced with design and dev SaaS solution. Someone hands on exp with Java 1.8, Spring Boot, Kafka, and Aws. Along with expertise in microservices architecture. Send me a DM if you feel you fit the mold.

What programming language are you mostly using at work? For me it’s Java

Hello Pals - I have 8+ years of exp as business analyst, and consultant. No coding experience, but good in data & reporting. Planning to take a course from Learnbay after reading a lot of reviews in the internet. Its for Data Science Master program - can anyone suggest if they are good and help me make the transition I'm looking for (Feel free to share your choices if any)

Just getting little depressed after being rejected from interview. Anyone else has the same feeling.Could have done better.

What would you say are the best combination of skills for software engineering now?

Hello everyone,

I love in Europe and was wondering how difficult or easy getting remote front end position in a US company would be and if the salary would be the same as a US citizen who lives in the US?

People of Color, how do you deal with an all-white team who doesn't acknowledge your (worthy) accomplishments while pats all incompetent employees?

Please help. I’ve moved up the ranks pretty quickly at the company I work for to become a Principal SE. My manager thinks the best next step for me is to move into management and leadership and has started pushing me to apply for an engineering manager role. They say that I will be a good fit because of my strong technical background paired with the leadership and people skills I display currently.

I’m torn because I do love being an IC but I’m interested in leadership also. What do I do?

Which is the more lucrative and flexible long term career path when comparing .NET development vs salesforce development.

By flexible I mean in terms of moving between positions, companies and technologies.

I've done both and am currently doing salesforce development but don't want to get pigeonholed.