Has anyone worked on great expectations integration with Databricks? I am facing performance issues with large datasets. Would like to be helped if you have any experience on this.

like
Posting as :
works at
You are currently posting as works at

Lets xonnect

What kind of domain of the project

Related Posts

Our employee satisfaction survey is tied to our performance goals. Meaning, if we rate management badly, we cannot meet 10% of our goals which in turn affects our bonuses and raises. We asked HR but they didn’t do anything about it. Is this normal? Is this legal? If not, what else can we do about it?

like

Received less salary this month also. (Same amount as last month)
Why is this happening? Too much tax 🥵

like

Hi fishes,
I am currently working as Branch Manager (scale-2 officer) in one of the leading public sector banks and have 5 yr experience in core banking. I am having 2.5 years experience in the IT sector on vision plus as a software engineer (before joining the bank). I have knowledge of core banking as well as good knowledge of banking tools like finacle, caps, imac etc. I want to switch to private financial institutions.
Any suggestions about such institutions and the domain for I can apply

Best website or realtor o company or way to find and buy a condo in NYC(Queens, Bronx or Manhattan), 2-3 bedroom.

like

Anyone have tips for finding out about social events/does anyone want to hang? Moved here late last year and it's hard to meet people

like

What's the minimum days/ years that one should have worked in order to receive the gratuity at Nagarro?
Do we get the amount in full that was deducted or do they give a fixed amount?

like

Bring back Trump’s market.

likefunny

I don’t understand how people keep posting about the bench and being unassigned. I’m in advisory(not audit) and my entire LoS is trending 90%+ utilization

like

Wharton submitted!!! So anxious

like

Hello is anyone willing to provide an Atlassian job Referral for US/Canada jobs?

like

Do you find it surprising that more people don't invest in cryptocurrencies ? Especially in the consulting industry

Recommendations on how to simultaneously pay off student loans and invest?

like

I uploaded documents after HR discussion last week but not yet received any update after follow ups with CGI.. Shall I ignore or consider them since my joining in a week. CGI .

Guys - A seasoned BSA looking for PO / PrM opportunities in asset and wealth management firms. Is anyone willing to refer me to their team or forward me to their acquaintances? Appreciate it.

like

Trying to get some insight (for comparison purposes) regarding the starting salary for a newly minted JD/LLM role Grant Thornton Baker Tilly RSM and like firm
Location/service line will do.

like

Do you believe in Karma?

like

Hi Fishes,

Please advise, in my current organization 90 days notice period.
Due to this no company wants to schedule an interview. And due to some responsibilities the company will not release me before 90 days.

Please advise, how to move forward.
Do I need to resign without any offer in hand?

like

Hi Team,
I have worked in a project for more than 1.5 years now for a non scripting tool. Feel no learning and skill enhancement here.Can I get my project changed. QA Automation. Will there be any consequences if I do so?

“The best minds of my generation are thinking about how to make people click ads” ~ Facebook data founder.

Is it wrong that we idolize FAANG? Should the govt intervene in business and privacy?

like

Additional Posts in Data Engineering

What are some good product based companies to work as Data Engineer?
Good in terms of learning, interesting work and good work culture.

like

Hi All,
Can anyone give me some pointers on the interview process for data engineering role in PepsiCo?

like

Guys pls reply…
How is Impetus Leaplogic project for a data engineer ? In terms of technology used and WLB?

like

Hello
Can I pl get help in SQL
Thank you

like

Hi all,
Can someone guide me on how should a person start learning for transition into a data engineering role at a beginner level. Currently I have known Python and SQL in my job. Not able to figure how to go forward?
Any advice would be great!!

like

Hi folks, i am looking for a job change i have 2.6 yoe in data engineering with tech stack - hive, hadoop, pyspark, sql, python , aws. These days i am not getting much calls. I worked for x company for 2 yrs and switched to y company in feb 2022. But recently i faced a situation. I cleared all rounds and send my docs to sunlife financial but now when i am trying to connect with them they are saying your candidature is on hold. I alao resigned from my current company. What should i do?

like

Hi everyone ,need your guidance.

I am working as SAP BODS developer which is a GUI based ETL tool , at EY GDS having 1.3 years experience.
I wanted to shift to data engineering based on cloud technology, so wished to get guidance on what things to learn and is it possible to get into this role in other companies.

TIA .

like

Hi, I want to learn how to build ETL pipelines with Pyspark and Azure. As right now i have experience in feature engineering only with SQL and Pyspark.

Can anyone suggest anything online from where i can learn and do hands on?@

I have been working as an Azure data engineer for the last 3 years and am currently looking for a job change.

Please let me know if you have some referrals for similar roles.

I'm currently serving a notice period and will join within 15-20 days.

like

How is Tavant technologies for Data Engineer?

like

Hi guys I work in One of GCP partnered org. My role sr SQL developer I resigned the current job GOT ROLE in FICO child org as a solution integration consultant role -(AWS,PENTAHO ,SQL we will be using ) -offered CTC 25 fixed + 1L JB + 2.5 BONUS + 0.5 L WFH SETUP = total 29LPA if everything will go smoothly ( bonus vary with comp growth it can be between 1.8L to 2.5l .so final CTC will get down to 28LPA as well - Bangalore but WFH ).Current org retain with 25L +2 LP VARIABLE HYDERABAD COMPANY

like

Hi fishes,I have around 5.2 yrs of hands on exp in data engg. and able to clear service based companies interviews easily.Now I want to switch to product based companies as I am looking for some good work,good salary but I am not really strong in dsa as it's not part of my daily work.I don't really use trees and graphs as part of my daily work.
How shall I switch to product based companies considering DSA is their 1st round itself.what level of DSA can I expect from companies for data engineer position?

like

Why Data Modeler role is on high demand these days?

Hi Fish,

I am currently working in non tech as an analyst. I have learnt SQL AND Data warehousing concepts. I am thinking of switching to any data related role Data Analyst/Data engineer. Appreciate your views/thoughts on this.
Should I have to learn some more to switch or should take up any real time projects to start a career in the above mentioned fields.
Overall experience: 3y
CCTC: 4.2 LPA

THANK YOU

like

American Express Hey Guys,Can anyone who is a Data Engineer and working with Big Tech Companies share some light on how you guys are preparing for interviews?How are you learning so fast/so much?Can you please share some plan or guide me on what resources you are following?There are too many things. And in my current organization I am not able to learn those.I want to learn fast and more.I see profiles on LinkedIn that are filled with big data techstack.Please guide. Adobe Amazon Walmart Expedia, Inc. American E

like

What does col a /=/ ‘ONE’ :: “VARCHAR” do in Netezza. Join or checks for null or match to ONE ?

How can I use the same in Oracle database? Any suggestions

like

I have selected as senior data engineer in Fractal analytics, Verizon.

Which to choose based on work life balance and growth and job security ?

like

Nagarro OR Deloitte which firm is good for interesting big data products? And which firm has better work life balance?

like

Hi I'm working as a data engineer and having 1.4 YOE with current CTC as 4LPA, what will be good time for me to switch and how much CTC should I expect?

Hey fishes,

My current salary is 13lpa in SQL, Plsql domain. I just interviewed with mindtree and they are offering 16lpa in big data . Should I switch or negotiate for more. Yoe-4 and new to big data.

Thanks

like

New to Fishbowl?

Download the Fishbowl app to
unlock all discussions on Fishbowl.
That was just a preview…
Sign Up to see all discussions
  • Discover what it’s like to work at companies from real professionals
  • Get candid advice from people in your field in a safe space
  • Chat and network with other professionals in your field
Sign up in seconds to unlock all discussions on Fishbowl.

Already a user?
Login here

Share

Embed this post

Copy and paste embed code on your site

Preview

Download the
Fishbowl app

See what’s happening in your industry
from the palm of your hand.

A phone with Fishbowl app

Scan your QR code to download
Fishbowl app on your mobile

Download app

Sign up for free to view this conversation on Fishbowl

By continuing you agree to Terms of Use and Privacy Policy

Already have an account? Log in

Sign up for free to continue using Fishbowl

By continuing you agree to Terms of Use(New) and Privacy Policy(New)
Messaging rates may apply

Already have an account? Log in

For account settings, visit Fishbowl on Desktop Browser or

General

Legal