{ "media_type": "text", "post_content": "Hi big data engineers. Can you please tell what is in demand or will be in demand for future for data engineering. \n1. Python+ spark\n2.Scala+spark\nI know python so naturally have an inclination towards pyspark, but is it enough to get a job or Scala is necessity?", "post_id": "62f24f3b34692d001e19e747", "reply_count": 2, "vote_count": 5, "bowl_id": "604eff54a36544002a88b2e7", "bowl_name": "Data Science and Machine Learning", "feed_type": "bowl" }

Hi big data engineers. Can you please tell what is in demand or will be in demand for future for data engineering.
1. Python+ spark
2.Scala+spark
I know python so naturally have an inclination towards pyspark, but is it enough to get a job or Scala is necessity?

like
Posting as :
works at
You are currently posting as works at

.

PySpark and python is enough.

More Posts

Hi all! What would be the typical package for an M&A manager working in a scale up / unicorn? Assuming 7-8 in IB/startups. Many thanks

like

Who is partner one?

like

I haven't seen the discussion on this topic yet so thought of starting one & try to find what others think.

Is Agile work model really unnecessarily pressuring the developers/designers/testers. I have seen my elder brother/sisters who started IT career in 2006-07 or nearby & were so happy due to which I also attracted towards IT career. Later on with my experience I came to know that I have been working in Agile since starting & they were working on waterfall which doesn't pressurise employee

like

Has any other companies made a final call regarding their internships if they will be on site or virtual? It is a struggle right now to get our HRLT to commit to a decision while I know other organizations have made the call as it is a huge factor in candidates’ decision in accepting an offer. Let me know, and if you are comfortable with putting your organization or DMing it I would greatly appreciate it!

like

Do we also know any cool health marketing and media platforms we can get this onto for our recent campaign PR push?

likefunny

Does anyone use Lawmatics? I’m working on a migration from Clio grow and am having a hard time recreating the same spacing and formatting on the templates. Specifically, I can’t figure out how to single space. Any solutions?

I feel like I'm in a vicious cycle. I'm exhausted all. the. time. No matter how much sleep I get, no matter how clean I eat.

I'm heavy and want to exercise but I'm fighting fatigue to even do work. Weight is coming off with clean eating so there's that. And so slowly.

I'm looking for and am going to go to an endocrinologist - I'm female and hitting 50 and a bit scared how badly the fatigue is.

Anyone where I'm at that have solid things that have helped?

like

FYI, negotiated gym rates around the city:
- Equinox - negotiated $165 all-Chicago clubs rate + $150 gift card
- Shred415 - $125 w/12 months commitment for a single location (South Loop)

likehelpful

Any single Muslim females in this bowl looking for something serious?

like
like

Getting about 30% on the MCQs for FAR on the first go through. Is this normal? I feel so discouraged to continue even though I’m only in the third chapter.

like

Open to anonymous comments around culture, salary, etc

Hello fishes, can someone guide me on what kind of work exists in PwC SDC India? I have been offered a role as Senior Associate-Tech Strategy in PwC SDC. Being a management graduate with around 7 YoE, will it be a wise decision to move to PwC SDC? I have another role with a major IT services firm, which is giving me an option to work on their strategic initiatives. Though the offer from PwC is way lucrative, I am not very keen on immersing myself into technology side of things.

like

Cookie and I are grateful for this turkey today - amazing snuggle bug, town mascot and best big brother 🥰. What are you thankful for today?

Post Photo
like

Suing an older workplace in small claims court. Need some guidance (more than free legal aid clinics can provide). Does anyone know someone willing to work at a discounted price or accept payment upon completion of the case/dispute? Can’t afford a regular lawyer atm.

like

What's the working hours in epam systems?

like

Can someone name anything worse than filling out 8 review control EGAs with the v2016 review control template this weekend - there’s literally only so many ways to describe how someone manually signs off on a piece of paper every month

likefunny

Can anyone point me to any rules/case law requiring you to share 3rd party documents obtained via subpoena with OC? Is there any such requirement in the FRCP (ignore local rules and standing orders for purposes of this Q)? What about if they are responsive to a discovery request? TIA!

like

I jumped from PA with 3 YoE to Senior Fund Accountant in industry. Now 6 months in, I really enjoy the WLB but I regret leaving for fund accounting and only a 17% bump. I could probably make manager in 6-18 months, but I'm really not sure about sticking it out.

With the industry as hot as it is, I'm thinking of looking at positions in Revenue Accounting, Assistant Controllership, or FP&A. What are your thoughts?

like

Everybody lookin to jump on the FDD bandwagon missed the boat by about 6 months. Better luck next year. Now, can everyone stop the “are firms still hiring” posts? Unless you wanna work at CR…

likefunny

Additional Posts in Data Science and Machine Learning

Hi, I am a fresher and want to become a artifical Intelligence Engineer, I want guidence, steps and learning path.
Can I do it in a year ?

like

Hi Everyone,
I am a Data Scientist, I have 4.3 years
experience.
I have 2 offers in hand, which company should I join?
1) Sutherland global services, package - 20 LPA, position: Lead data analytics, Location - Remote
2) SG Analytics, package - 21 LPA + 2 variable, position: Senior data Scientist, Location - Pune

I am looking for good work, job security and work life balance.

like

I became coach here..
can it help me to fetch data science job😜😜😜

likehelpful

Hi Fishes,
I want to learn about how to apply machine learning and different algos on seller risk problem. Will you please share some links or anything from where I can learn.

like
like

Hi all,

I'm currently working as a hardware system design engineer, I want to skill up and learn data science, software architecture, machine vision.

Where do you think I can start ?

Fyi I'm a beginner to both of these but I do have 1 years exp in python.
I love mathematics courses if any needed for these skills let me know.

Thanks in advance

like

How is Ameriprise Financial to work with as Dat Scientist. YOE 8

like
like
like
like

Found it on Andrew Ng's MLOps specialization, Found it very relatable

Post Photo
like
like

Hello
I am a commerce graduate
I am thinking of doing data science diploma from upgrad
Can you guys help me with its worth and if the course is appropriate and do-able for me and is upgrad a good platform to pick up?

like

Hi fishes,
Planning a career transition into Data science filed..Need tips

like

Hi Everyone,

I am having an interview with
Affine for Data Scientist role.
In the process, they have sent me a assessment test (Data Scientist General) - 60min
Has anyone know what type of questions can be asked in this test.
Help me out!!!

like

Hello all, Any idea what would be the range of CTC that can I expect for MLOps role in Mindtree?

Currently working as a Data Scientist. Total YOE: 5.9years
Relevant Exp: 3.6 years


Mindtree , Cognizant , Infosys , Tata Consultancy , Accenture

like

Hi folks,

Need referral. I'm on notice period and my last working day is 3rd nov.
Total experience:5.8
Relevant experience:2.5
Tech stack: Data science

TIA

like

I applied in QuantumBlack for a data science role. I got a test consisting 3 questions on hacker rank. Does anyone have a clue about the level or difficulty?

Please help as cracking this is really imp for me.

like
like

New to Fishbowl?

Download the Fishbowl app to
unlock all discussions on Fishbowl.
That was just a preview…
Sign Up to see all discussions
  • Discover what it’s like to work at companies from real professionals
  • Get candid advice from people in your field in a safe space
  • Chat and network with other professionals in your field
Sign up in seconds to unlock all discussions on Fishbowl.

Already a user?
Login here

Share

Embed this post

Copy and paste embed code on your site

Preview

Download the Fishbowl app

Sign up for free to view this conversation on Fishbowl

By continuing you agree to Terms of Use and Privacy Policy.

Already have an account? Log in

Sign up for free to continue using Fishbowl

By continuing you agree to Terms of Use and Privacy Policy.
Messaging rates may apply

Already have an account? Log in

For account settings, visit Fishbowl on Desktop Browser or

General

Legal