What are the best practices and challenges for running Spark jobs in Kubernetes? Is the industry widely adopting Kubernetes for Spark workloads ?

like
Posting as :
works at
You are currently posting as works at

Related Posts

I’m trying to get an estimated ideal of what my costs would be when moving to Chicago. How much do you spend a month on “going out” (before pandemic)? Specifically referring to going to restaurants, getting drinks, take out, and coffee. Not including transportation.

like

Any tips for having to attend a team lunch and a separate happy hour while fasting? Outside of Ramadan happy hours aren’t awkward bc I’ll just drink soda or something. However, now do I just sit there and stare at them when they are drinking/munching on their lunch ? 😂

like

If you notice that a junior associate on your team has over-billed, how would you handle it? I don’t want to get them in trouble, but noticed that they billed extremely high numbers even though I was doing all they work on the deal and they completely disappeared other than for client conference calls. Certain things that they billed for on the final invoice, I alone handled and never asked them to do. Appreciate any advice. I’m a mid-level in case it helps for context.

like

Why is hotstar behind cable TV by about 15-20s?
We have paid for subscription yet treated like this
#INDvSA

like

Hi everyone, i have started my carrier in dot net technologies and worked for about 6 years. Then shifted to dynamics crm and worked for 4 years. My total years of exp is 10 years. Now i want to shift to data science machine learning. I am thinking of doing a training in data science. Will i be considered as a fresher?

like
like
like

Small firm (my boss, me, & a paralegal). After a hearing I did not handle, boss intended to seek review of the ruling in its entirety. What was communicated to me by paralegal was to seek review of a portion.

Seeking review is now time-barred. Boss is not upset, but this is 1 case & 1 problem. There are other cases & other stories.

How do I talk to my boss about being more present (boss is never in office, has “too many” emails, never answers his phone) without being seen as insubordinate?

like

Deloitte 🐠🐟 in the DC area, which health plan do you recommend? I'm with Kaiser and it was a huge mistake. I'm looking to switch for 2020!

What are the healthcare options like in India? I'll be needing regular care and I'm not sure what the insurance providers are and if care works differently in general.

like
likehelpfulfunny

Is the one D&I professional in this business that hasn’t had to create a grassroots movement?

Does anyone have any useful articles, tweets, insta posts that I could send people when they say “if I can’t say that then what CAN I say, everything is offensive.” I’m tired.

like

There are lot of mixed reviews about Nagarro.. some folks are saying Nagarro do not fire even in covid the only did the pay cuts and did not fire anyone... where as some folks are saying Nagarro is hiring rigorously more than their projects strength so firing will happen for sure and if you are on bench for more than 1 month you are in red zone as the same happened in past... what is the mystery.. can anyone from Nagarro an honest review about this organization.

Nagarro Nagarro ES HCL Technologies Tata Consultancy

like

Looking for a dermatologist (preferred board certified) / dermatology office that also performs injectables. I appreciate any referrals.

like

Anyone know good cpas or tax preparers? Mine should be fairly straightforward, but I’ve worked in 3 different states so worried that’s going to complicate things for me

like

Day of remote interviews at a tech co for in-house. 5 YOE. Planning on wearing a suit. Tie or no tie?

like

I’m a new contracts lawyer and am trying to learn how to harmonize indemnification with LOL. Any tips or resources? I know this is a broad question, but would appreciate any direction on what questions to ask when reviewing a K to do this.

like

What would a 4th associate at a midsized law firm make? Does 150K sound about right?

Hi friends! I’m looking for resources to help me be successful in a “Functional Lead” role.

The role is in FinTech
I’m responsible for strategy, comms and key partnerships for a bank product. It reports through Customer Experience but touches product, Ops. marketing. It’s basically a Project Manager role but more nuanced.

Anyone out there in a role like this? Any books. videos or even best practices to share?

like

Additional Posts in Data Engineering

Hi All,

I'm looking for referral in data engineering.
I'm having 2 year of relevant experience in data engineering.

like

Hi Fish,

I am currently working in non tech as an analyst. I have learnt SQL AND Data warehousing concepts. I am thinking of switching to any data related role Data Analyst/Data engineer. Appreciate your views/thoughts on this.
Should I have to learn some more to switch or should take up any real time projects to start a career in the above mentioned fields.
Overall experience: 3y
CCTC: 4.2 LPA

THANK YOU

like

Why Data Modeler role is on high demand these days?

Hi all,
Can someone guide me on how should a person start learning for transition into a data engineering role at a beginner level. Currently I have known Python and SQL in my job. Not able to figure how to go forward?
Any advice would be great!!

like

Anyone here works in Dunnhumby or Gartner?

like

Hi,
I am working as Data Analyst. Now, I seen my interest towards Data Engineering.

Please help me to decide, Should I go with
Azure Data Engineer
Or
with Big Data Technology like Spark, Kafka, Hadoop, Sqoop, Airflow.

Suggest me some good course to start.

Thanks 😊

like

What does col a /=/ ‘ONE’ :: “VARCHAR” do in Netezza. Join or checks for null or match to ONE ?

How can I use the same in Oracle database? Any suggestions

like

Hi fishes,
Hope you are doing well. I am looking for a job having 3+ years of experience in Data Engineer domain/ Python Development. If your organization is recruiting for this position. Then let me know or forward my profile to your connections.
YOE - 3+ yrs
NP - 30 days
Skills - Python, SQL, AWS, Pyspark, Jenkins
Thanks a lot in advance!

like

Hi people,Does anyone have given visa hackerrank interview recently? May I know the kind of questions being asked and their level?

Hello
Can I pl get help in SQL
Thank you

like

I have 2 offers one from my Current company and one from Cisco my current company is giving 10 percent more than cisco Where should I go should I join cisco or stay in my current company( a small stablished startup )Considering my final goal as FAANG (similar) and I come from a Small College Cisco Amazon Uber Walmart

like
like

How is Tavant technologies for Data Engineer?

like

I have selected as senior data engineer in Fractal analytics, Verizon.

Which to choose based on work life balance and growth and job security ?

like

Hi fishes,I have around 5.2 yrs of hands on exp in data engg. and able to clear service based companies interviews easily.Now I want to switch to product based companies as I am looking for some good work,good salary but I am not really strong in dsa as it's not part of my daily work.I don't really use trees and graphs as part of my daily work.
How shall I switch to product based companies considering DSA is their 1st round itself.what level of DSA can I expect from companies for data engineer position?

like

Hi guys I work in One of GCP partnered org. My role sr SQL developer I resigned the current job GOT ROLE in FICO child org as a solution integration consultant role -(AWS,PENTAHO ,SQL we will be using ) -offered CTC 25 fixed + 1L JB + 2.5 BONUS + 0.5 L WFH SETUP = total 29LPA if everything will go smoothly ( bonus vary with comp growth it can be between 1.8L to 2.5l .so final CTC will get down to 28LPA as well - Bangalore but WFH ).Current org retain with 25L +2 LP VARIABLE HYDERABAD COMPANY

like

Hi guys, i have been working as a Data Engineer from past 7 years. I have mostly worked on MSBI stack and also have fair experience in PBI. Now that most of the companies are moving towards cloud based technologies, could you help me with the right pathway going forward for better opportunities.

like

Hi All,
Can anyone give me some pointers on the interview process for data engineering role in PepsiCo?

like

Hey fishes,

My current salary is 13lpa in SQL, Plsql domain. I just interviewed with mindtree and they are offering 16lpa in big data . Should I switch or negotiate for more. Yoe-4 and new to big data.

Thanks

like

New to Fishbowl?

Download the Fishbowl app to
unlock all discussions on Fishbowl.
That was just a preview…
Sign Up to see all discussions
  • Discover what it’s like to work at companies from real professionals
  • Get candid advice from people in your field in a safe space
  • Chat and network with other professionals in your field
Sign up in seconds to unlock all discussions on Fishbowl.

Already a user?
Login here

Share

Embed this post

Copy and paste embed code on your site

Preview

Download the
Fishbowl app

See what’s happening in your industry
from the palm of your hand.

A phone with Fishbowl app

Scan your QR code to download
Fishbowl app on your mobile

Download app

Sign up for free to view this conversation on Fishbowl

By continuing you agree to Terms of Use and Privacy Policy

Already have an account? Log in

Sign up for free to continue using Fishbowl

By continuing you agree to Terms of Use(New) and Privacy Policy(New)
Messaging rates may apply

Already have an account? Log in

For account settings, visit Fishbowl on Desktop Browser or

General

Legal