Hello my Data folks!!

How to sync data in MS sql server into S3?The goal is to migrate data in sql server into S3 and there by bring in the incremental data into S3.

like
Posting as :
works at
You are currently posting as works at

I believe DMS can do sql server to S3 directly No need go through RDS.

like

No i wouldn’t it. You can setup a crawler if you need to query that data from S3 using Athena or quick sight

like

DMS into RDS and then Glue crawler into S3

More efficient solutions probably exist, but hard to say without more requirements.

DMS is good as a one time thing to migrate data from sql server to S3 but it’s not sustainable practice to use it in syncing the incremental data.

Also DMS reduces the sql server’s performance when DMS is in process- this is not ideal for our case.

Any ideas using CDC or T logs? Single row event triggers?

File -> export 🤣

Related Posts

I want to be a client instead of an investment banker. Where do I sign up?

likefunny

Has anyone put work in their book that the client denied? I wrote some pretty great lines for a client and it’s like they hate creativity. I really want to put them in my book, is that a bad idea?

Consultant with 15lpa fixed in KGS, is that low?

like

Hi All, Which company is better in terms of all the aspects like wlb, culture, benefits and so on..

1) Rakuten - 25 LPA
2) Applied Materials - 27 LPA

YoE - 5 years, Java

like

Going to Oktoberfest with some buddies from college. Any tips from anyone who has been!? We’ve got rent reservations but looking for any info that may not necessarily be online

Good day everyone, I was turned down by Accenture strategy last minute before offer due to the Macro uncertainties, any of you have referrals for MBB/Big4/@tier2? I am 8+ YOE in strategy & transactions I’m open to all offices THANK YOU!

like

Accenture 🐟

How difficult is it to get the top of the range listed in the job postings? Also, are what are standard sign on bonuses?

like

Hi all do you know if PwC actually calls your ex employers and references ? I got an offer as a senior manager thanks

like

Anybody know of any art director positions open?

Hi fishes, Dm me for referrals I can refer you

Post Photo
like

What are your favorite coffee shops to work remotely from? Open to any neighborhood—I like trying new places.

like

Good Morning. Any recommendations for private investigator in personal injury? Good, reliable, quick responsive person with great prices. Thanks

like

Will need to migrate to office 365 soon. What’s the difference for excel from the 2013 version?

likehelpful

Why are there so many job postings that I have applied for but nothing happening? Are the jobs that are posted truly open? I know we are in 4th quarter and wasn’t sure if corporation’s like to hire then?

like

If a recruiter keeps ghosting me & I have to keep reaching out to get a status. does this mean I’m not being considered & I should move on?

like

Got rejected from one of my desired tech companies, it's agitating but at least they didn't ghost me.

like

Does anyone here live on Vancouver Island or know about it? Worth it?

likehelpful

Hey all. How’s everyone feeling about this merger situation? Who’s having negative impacts? Positive?

Additional Posts in Data & Analytics Consultants

Folks applying for Data and Analytics roles in the industry at M, SM, D Levels, what technical/functional topics do you prepare for on the Analytics side?

like

Any recommended courses or books on customer care/cust success analytics or marketing analytics in general?

like

KPMG folks, thoughts about Lighthouse relative to other big 4s? About to start the interview process. Coming from EY FSO DDnA

like

Mεntal mαth in iηtervieωs. Thoughts, tips, rants, grievances?

like

How is Deloitte’s Analytics and Cognitive practice doing? Saw a couple of open Data Science roles open on their website, are they actively hiring

like

In the most unnecessarily complicated phrasing worthy a dissertation, what are you working on this week?

like

Any conda users in here have to install a binary and use conda forge? Need some help installing pdftotext. Throwing a weird message saying “Found conflicts!” Any and all help would be appreciated.

like

Is anyone working with Elastic at DoD?

Meeting with a recruiter at one of the FAANG companies. I won’t be able to move jobs because of H1b /GC at least for the next year. Any idea if I should start off with that or should I just try to understand the work that they have been doing?

like

Anyone have any suggestions for front end guis for users to run python code? I’ve created a few tools for webscraping data, automation, and modeling but non technical users freak out when they try to run the code themselves. Any suggestions? (Have tried Juypter Notebooks and a few other IDEs)

like

Any cyber security folks here? or those interested in systems engineering? Potential role with TC 120-180, awesome team and wlb, at least compared to consulting.

like

Big 4 Data Scientists, how did you exit to big tech firms? I’ve been unlucky with online applications and even referrals. I think it might be my resume or how I present myself. Can any free birds please give guidance?

like

I was hired a few months ago by D to do data science. I am not doing data science currently, is there a way I can switch roles internally? Should I talk to my coach? Or should I just start looking for a new job. I’m starting to feel that the field is so hot rn my small stint at D won’t be a big deal to other firms.

like

Hi! Does anyone know what kind of knowledge is needed to crack the Data Scientist interview at Google?

I'm currently working in Marketing Analytics (primarily using SQL and a bit of pyspark). Apart from mastering SQL, I wanted to know from people working at Google what does it take to get there as a Data Scientist? (I'm very interested in Strategy Ops)

I plan to another 6-8 months in preparation and upskilling myself before I even apply.
Any help and guidance is appreciated! Thanks :)

like

Business practice: "can you guys build a model that overlays where Coronavirus is going to break out with client sites"

likefunny

Learning cloud architecture right now so apologies if these are obvious questions: Best ways to store video metadata to perform analysis on it? I'm looking at AWS and GCP. Saw that Cassandra would be good for it, but not sure what the GCP equivalent is? But also I'm a bit confused on if Cassandra is just a DB and storage would need to be elsewhere? All help is welcome! I've been spinning my wheels on Google trying to understand

like

Single book recommendation for user research?

Goal is interview prep. Ideally focused on applications in tech.

like

Anybody interviewed for a data engineer role for Facebook? I have a SQL and Python coding interview next, any idea on what to expect?

like

Accenture federal what’s the day to day like as a manager? Is it hands on or more review? Is there a lot of business development at the manager level?

like

New to Fishbowl?

Download the Fishbowl app to
unlock all discussions on Fishbowl.
That was just a preview…
Sign Up to see all discussions
  • Discover what it’s like to work at companies from real professionals
  • Get candid advice from people in your field in a safe space
  • Chat and network with other professionals in your field
Sign up in seconds to unlock all discussions on Fishbowl.

Already a user?
Login here

Share

Embed this post

Copy and paste embed code on your site

Preview

Download the
Fishbowl app

See what’s happening in your industry
from the palm of your hand.

A phone with Fishbowl app

Scan your QR code to download
Fishbowl app on your mobile

Download app

Sign up for free to view this conversation on Fishbowl

By continuing you agree to Terms of Use and Privacy Policy

Already have an account? Log in

Sign up for free to continue using Fishbowl

By continuing you agree to Terms of Use(New) and Privacy Policy(New)
Messaging rates may apply

Already have an account? Log in

For account settings, visit Fishbowl on Desktop Browser or

General

Legal