like
Posting as :
works at
You are currently posting as works at

Use pagination or slice concept

Yes... pagination is what i am thinking..with offset and limit, but shall i use queue or kafka in between...will it help?

I am thinking of following architecture:

client-> gateway-> Service A -> db

Service A checks count puts request in a queue, returns a general response to user that ur file processing has started with this count.

Service B picks up request from queue-> fetch records from DB using pagination (limit and offset) getting few thousands records at once, and writing in a file.
Once done, a db table maintains file is created status.

Polling from UI every 1 min, if any file is completed, ui shows file completed status

User clicks get file-> gateway-> service B
Service B streams file back which gets downloaded in chrome browser.

Please suggest any flaw/improvement in above design^

Related Posts

For questions as to why you are looking to leave your current firm.. I am looking to move because for some reason I am hand-held a lot and given simpler tasks, so I am getting bored and want more challenging / much more fast paced environment. Also kind of bored because I am on one project for a long time and I want exposure to variety of projects. Is this a fair answer or would I be seen as arrogant? Is there a better way to frame my answer?

like

Hi Fishes anyone here working in ADDA project

Hi Guys,

I need referral for Cisco for Project Specialist role. I am pursuing MBA from Tier 1 Bschool.
I have 3y8m of work experience in SAP from TCS.
Any help will be appreciated.

Any one working btis eds du4 project in HCL?
Need some help please reply asap?

like

Hi 🐠,

I have recently joined Infosys and they have put me in a project where I will be the only guy working in the team and the team lead is at the onsite location. Are such projects good? Because I haven’t worked like this anywhere before.

TIA :)

like

Dear freelancers...Immediate need of FREELANCE (remote) of PHARMA Group Art Sup & Group Copy Sup Copy Writers (Mid to Senior) & Project Mgr. MUST have pharma if interested please contact (we will need your hourly rate, CV & Samples/URL looking forward to hearing back, spread the words and stay safe

like

How much do Senior. Client associates make a yr. Specifically with Financial advisors and places like wells fargo.

like

#Capgemini is hiring
email me:
ranjithmgj@gmail.com with code for referrals

961661-Junior Scrum Master
1164963-Scrum Masters
1094856-Agile Coaches
945628 - Project Manager

Location - Pune/Hyderabad/Chennai

5 years experienced.

like

Looking at jobs at Booz Allen Hamilton and noticed many are listed as “Mid.” Like “Strategy Consultant, Mid” and “Project Manager, Mid.” What does “Mid” mean?

like

Has anyone done a collab with influencer MIKIRAI? I know she’s a big deal but i’m trying to figure out if she’s worth the money, our agency just had a bad experience with an influencer and the client is not happy. We need to make a comeback! All insights are appreciated.

#GeneralThought
Why the work environment in banking and insurance projects are so hectic ?
After this company i will never work in Banking or insurance project.
If you want peace in these projects, you need to stay very long to understand the functionality.
😵

like

HI Fishes, Anyone in Infosys working in client location ( Bfsi ) what clients to Infosys has in Gurgaon location. Any idea Infosys

like

Hello,
I am Interior Designer & Contractor, looking for opportunity to work for Home/Office interior project

Ours is Family owned business, 3 decades of experience and personally 15 years of Experience, working on High End Luxury projects

Hoping to hear good

Thanking you

like

I get really giggly when I’m nervous, and laugh at basically everything anyone says. It makes me appear quite immature in front of client & coworkers... Any tips on how to calm my nerves?

ZS 🐠, how often are you at the office vs client site? I’m curious because I’ve heard they don’t travel much

like
like

What origination % are insurance defense firms giving to the attorney that brings in the file/client?

like

I’ve been on the bench with J1 for about 3 months. I was worried that because I couldn’t find another project, I would get laid off so I found J2, which pays more, is very meeting heavy, but I really like. I’ve kept J1 because I’m still on the bench doing absolutely nothing and getting paid. Thinking about looking for a role on a project with J1 that’s not along my career path but will allow for me to do work with no calls so that I can manage both jobs. Does anyone have experience or advice?

like

First time traveling to client - are backpacks (e.g., professional looking Tumi, timbuk2) fine for carrying stuff to client site?

like

Anyone working on Raymond James(RJ) client?

like

More Posts

Hello,

I recently got an offer from DBS bank, there they have promised to pay 3,00,000 as one time relocation allowance.

Two things i want to know,
1. Do they pay this amount regardless of whether you are in the work location ?
2. Inorder to encash this amount does it require require to submit any proofs or what's the process ?

Advance thanks!

like

How does one get into trading from positions elsewhere in the bank? What would impress you most about candidates attempting to do so?

like

Is 58,000 for an FP&A role in healthcare industry on the east coast too low? I have one year of audit experience but I have my CPA and will be relocating from the Midwest.

like

EY GDS - 15LPA
PWC SDC - 12LPA
Which is better to join?
Also, will PWC revise the CTC , if I show EY as counter offer?

YOE - 3.5
Technology - Azure Data Engineer

like

Best way to get cheap park city lift tickets?

like

How much are y’all paying for a studio in River North?

like

Can anyone provide TC for manager positions at Liberty or Progressive? Are they offering remote for these jobs?

likesmart

Hello fishes, can someone tell me what percentage bonus can I expect for supervising associate-64 in CBS for different performance levels.
(In the offer letter it was mentioned as 10 percent.)

like

Any thoughts and ideas on how to break into Microsoft (non-federal practices)

Profile in product development, project management, analytics and business intelligence in financial services plus MBA

Microsoft

like

IS there any instance you know of in which LTI revoked or took back its offer after giving offer letter. If so what circumstances

like

Looking for advice on tips and tricks for landing PE MBA internship, coming from consulting. What were the game changers for you?

like

Best money-tracking app out there? I've heard good things about mint???? 🤔💸🤔💸

like

Anyone else shook after seeing the 2020 AdAge A-list? 🧐

like

Hello desi fam...Anyone know wherr/how to get an iptv box in the Chicago area?.... thanks

like

What are some good east coast cities to buy an investment property in? For those of you who have done this before, what's better for a first time buyer/investor - commercial or residential?

Based in NYC but looking to buy outside the city. Something that's 400-500k and has good rental potential. Thank you.

like

Anyone buys deep out of money SPY puts to protect against a big market sell off?

like

Reccomendations for any good action camera that is not very expensive.. GO Pro worth it?

I’m recently finished my PhD and the transition to full time work has been overwhelming. How was the transition for you?

like

How do you get a job working in food science research? What are some of the best companies to work for in that field?

like

What are some of the best countries to work in as a research scientist?

like

Additional Posts in Financial Services - American Express, Mastercard, JP morgan, Citi, Barclays, Goldman sachs, capital one and similar Fintech/Companies

Any opening for a Business Analyst with 5 YOE?

Hi All,

Need a referral for an in-house legal role at any of the Financial/Fintech Companies. Kindly connect through DM or comment here if you can help me with your referral for any of these companies.

like

Hi guys Any one working in BOA Bank of America pls give your suggestion to join this company. How about work life balance, job security etc..pros and cons BOA Infosys Citi Standard Chartered Barclays Tata Consultancy Accenture Capgemini IBM Deloitte

like

Does citi accept counter offer after releasing the offer letter?

like

Does KPMG india gives any joining bonus for immediate joiners? If yes, how much? KPMG KPMG India KGS Yoe 4

like

I am looking for a reference in Bank of America , for database and PLSQL,
With 8 years of experience and can join from 5th December 2022.

like
likeuplifting

Hi Team,

Looking for some suggestion on below mentioned query. Please help me with your views.

Barclays VS UBS , which one will be preferred as Sr Big Data Engineer

like

How much does Barclays Noida pay for Model Validation roles at AM level ?

What is the average salary at Morgan Stanley for Business Unit Controller for P&L controller team supporting TCM?

Can anyone please help me with a referral in JP Morgan.i have the job id.Thanks in advance

Hi Fishes

My current company has been acquired and is under going restructuring and lots of exits from past management.

Immediately looking for change.

2 yrs exp post MBA and 2 yrs before that as an engineer (non IT/CS)

Current: Finance and product analyst.
Skills: Ms Excel, Excel dashboards, SQL server, Jira, tableau.
Data analysis, financial data analysis, Sprint planning, collaborating with engineers to solve finance data issues.

Need some guidance on where and what roles I can apply.

like

Can anyone help me with the average pay range of business consultant at Societe Generale?

like

Welcome and post your queries about offers here for our experts to provide their opinion.

like

I have offers from Amex and GS with similar Fixed component but the joining date of GS is two months after my last day in the current organization whereas Amex joining date is immediate. Should I wait for GS date or go ahead with Amex?

like

Which university is good for MBA (Distance) and which specialization is best ? I am a computer science engineer and currently working for BFSI Projects. YOE 2.5 Tata Consultancy Infosys MBA Finance

like

How much salary should I ask to citi corp.
No counter offer
CCTC 14.85
Experience : 4.5 business analyst
Notice period 75 days
Please advice
Thanks in advance

like

need review on Work life balance and work culture at Bank of America Global Banking and Markets FP&A Projects team, Gurgaon.

Please reply. I need to make a decision.

like

Need referral to Bank of America. Please can someone working at BOA refer my profile, I will share the job ID and resume. Thank you in advance.

Post Photo
like

New to Fishbowl?

Download the Fishbowl app to
unlock all discussions on Fishbowl.
That was just a preview…
Sign Up to see all discussions
  • Discover what it’s like to work at companies from real professionals
  • Get candid advice from people in your field in a safe space
  • Chat and network with other professionals in your field
Sign up in seconds to unlock all discussions on Fishbowl.

Already a user?
Login here

Share

Embed this post

Copy and paste embed code on your site

Preview

Download the
Fishbowl app

See what’s happening in your industry
from the palm of your hand.

A phone with Fishbowl app

Scan your QR code to download
Fishbowl app on your mobile

Download app

Sign up for free to view this conversation on Fishbowl

By continuing you agree to Terms of Use and Privacy Policy

Already have an account? Log in

Sign up for free to continue using Fishbowl

By continuing you agree to Terms of Use(New) and Privacy Policy(New)
Messaging rates may apply

Already have an account? Log in

For account settings, visit Fishbowl on Desktop Browser or

General

Legal