Anyone use power BI to look at Hospital / physician billing data? Is it any good for it/ can it handle that amount of data? I used PBI a lot for smaller datasets but these hb/pb datasets have millions and millions of line items so wanted to make sure PBI could handle it without losing data or crashing. Data comes in csv/txt files.

like
Posting as :
works at
You are currently posting as works at

With data that size I would suggest looking into Qlik

like

Or I guess the first question is... Are you loading those excel files into a QVD and then utilizing that? A QVD file is typically 10-100 times faster than loading from source

Millions of records are nothing, it will depend how you are designing and of course you need to have enough memory to accommodate that much data.

like

Tableau, PBI and other systems like these should all do fine with that amount of data as long as your design is adequate. If possible, try and connect directly to the billing database itself rather than CSV exports - it will make refreshing the data much more straightforward.

Power BI can handle tens and even hundreds of millions of records. Even terabyte-scale workloads if you do the solution correctly. The question is more about the complexity of your calculations over the dataset and how much related data you're combining. You can also offload file processing to dataflows.

Related Posts

Hi Guys,

Does EY gives wfh.
I will be joining ey in jan next year.@

like

Currently 31 with 6.5 YOE and single . Should have NW of 250k by end of this year. (No significant assets in India). Considering this money all reminds invested I should have a decent nest egg for retirement. Have an LIC policy that will be worth arnd 50 lakhs when I surrender it (plan down payment for an apartment). Struggling to convince parents this should be enough for me to move back. They think I should move back when I have more financial security. What more should I plan for ?

like

How did you all start as an angel investor? I am interested in becoming one… but don’t know how to start. I have 20 yoe in tech, and currently work for a faang. My entire portfolio is in stocks and re. I would like invest $250k or so over the next 12-24 months as an angel investor.

like

Is this true. If yes, can someone recommend some Reits? I am mostly invested in vanguard fubds( vtsax and vigax) . If there’s some better return won’t mind investing elsewhere

Post Photo
like

Anyone with experience in the short term rental space willing to connect?

I was in the market for a first time home in New York but the market and rates got too out of hand. Recently pivoted to a few out of state options for an STR and would love to learn from someone who's set one up.

Thanks!

like

Any good recommendations for books on management techniques? Trying to understand how management manipulates junior employees.

like

Could use some serious advice, tricky situation: I moved to the U.S. for my girlfriend/now wife 1 year ago. Graduated top of class from top European UG business school, have diverse internship (...)

like

You’re going to hear tons of Trumpers talk about “the tolerant left” now that Trump has COVID and obviously, anyone who isn’t far up his ass can see the irony in the situation.

Don’t let them...

like

How to broach taking time during the day for Ramadan for myself as a junior consultant - on a COVID related engagement so I’m reluctant if it’ll be received well...
Also how much time is okay to ask for?

like

Salaams!

Anyone hiring Program Managers (Technical or Non-Technical) or Engagement Managers? Currently with Big 4. Please let me know!

YOE: 6-7
Location: Washington DC area

like

The design of this watch is so good that you can see through all the parts inside,which is very unique ☺️

Post Photo
like

Genuinely curious, do people actually enjoy working in the Oracle EPM system? Been working in it for 2 years and it’s miserable. I can’t imagine anyone waking up and looking forward to implementing that system, but that could just be me.

Will working in this role with these responsibilities as a “Growth and Content Strategy Senior Analyst” help me get into data analysts roles?

Post Photo
like

I currently have an offer from both IBM and TCS for database developer role. IBM's package is a slightly less than what TCS has offered. While my plan is to join TCS but i have no clue about what project/account i will be onboarded to. I am very much comfortable in my current organization and they have agreed to match the IBM offer. Hence, i am slightly confused.

Is there any way HR or recruiting partner at TCS can give the details around my project? Im left with 40 days of notice period.

like

Hi everyone!! Got an offer from Healthplix, Bangalore based start up. Any thoughts on this?

like

Rajma is bae 😍

Post Photo
likefunny

Naked running vs running naked

Post Photo
funnylike

Hi Fishes,

Moving to Bangalore for the first time.
My office is at Manyata tech park. Could you suggest some areas where I could search for accommodation (rented apartment) that are not expensive.

like

Hey friends. Recently joined a startup with a heavy reliance on outbound sales strategy. Without a phone number... what are some of your best ways to get meetings booked with prospects?

Our product sells itself, but how do you set yourself apart to get the initial meeting booked?
What mediums do you use with cold outreach that you find most effective?
What copy have you found gets the best ppen/reply rate?

I am not a sales PRO, but I'm also not a newbie. Really just looking for a think-tank.

like

Has anyone here been in a situation where following up to the wedding was a lot of stress and fighting, but after you got married things became better?

like

Additional Posts in Data & Analytics Consultants

Anyone who has done masters in business analytics Singapore? Could you help on courses, Scholarships and careers and jobs. Looking for help.

What are some interesting non-tech/insurance/advertising/consulting careers where data science is applied? Thinking of epidemiology and economics

like

Any conda users in here have to install a binary and use conda forge? Need some help installing pdftotext. Throwing a weird message saying “Found conflicts!” Any and all help would be appreciated.

like

Coming to the realization that consulting is not for me (tech person) feeling angry that salaries at D will never be on pair with FANG and that leadership is not tech focused. For example you could be a soul contributor at fang making 240k and people at Deloitte wait 10+ years to earn that as Senior Managers because they need to climb the corporate ladder. It seems super clear cut to me now, if you want to make money in tech don’t join consulting firms. Am I wrong?

like

Noob question - I want to consolidate the dates into a single dates column. Would numpy or pandas help me reorganize this dataset effectively or should I do it within excel?

Post Photo
like

Folks applying for Data and Analytics roles in the industry at M, SM, D Levels, what technical/functional topics do you prepare for on the Analytics side?

like

Anyone have any tips or material on effective storytelling to leadership? I have to present an analysis and recommendation to a VP and really need to put together a good story. Thanks!

like

I'm planning to transition to Data Science. What should be the key technologies that i need to learn and add to my resume to make this work?

Thanks for your suggestions.

like

I was hired a few months ago by D to do data science. I am not doing data science currently, is there a way I can switch roles internally? Should I talk to my coach? Or should I just start looking for a new job. I’m starting to feel that the field is so hot rn my small stint at D won’t be a big deal to other firms.

like

Meeting with a recruiter at one of the FAANG companies. I won’t be able to move jobs because of H1b /GC at least for the next year. Any idea if I should start off with that or should I just try to understand the work that they have been doing?

like

Quick survey: Do you guys think having a template package to envelope an ML model as an application would be helpful. The package could contain boiler plate template for unit test, docker image, CI/CD, database connectors etc and act as a starting point for doing that. Tech firms usually have that internally but limited options in open source.

like

Single book recommendation for user research?

Goal is interview prep. Ideally focused on applications in tech.

like

Currently in consulting where I get to do data visualizations sometimes but not always, have an opportunity to shift to a data analytics focused role. Struggling to decide as I am not fully sure if I would be competent in/happy with daily data work. Advice, thoughts? 😣 I just never find what I like…

like

Docket + R - I have an container running a rocker image and I’m trying to launch a bash terminal and the RStudio server (/init) at the same time. Is this possible? I tried adding CMD [“/init”] too.

like

Mεntal mαth in iηtervieωs. Thoughts, tips, rants, grievances?

like

Is 128k a fair base salary for Consultant in Deloitte Analytics & Cognitive. MS CS and about 3 yrs experience. In one of the fastest growing but midtier tech cities in the US.

like

Hiring for data scientists and BI analysts across a couple levels, DM me if interested!!

like

Does your company split data science roles into different practices like data & analytics and software engineering? Does this inhibit collaboration & Where does a data engineer fall?

like

Have a lay-off meeting lined up, and now look for next opportunity. My background is around building machine learning models, data wrangling, visualization, feel confident with python. Open to any industry. Appreciate any lead on job opportunity. 3yrs of work experience

like

New to Fishbowl?

Download the Fishbowl app to
unlock all discussions on Fishbowl.
That was just a preview…
Sign Up to see all discussions
  • Discover what it’s like to work at companies from real professionals
  • Get candid advice from people in your field in a safe space
  • Chat and network with other professionals in your field
Sign up in seconds to unlock all discussions on Fishbowl.

Already a user?
Login here

Share

Embed this post

Copy and paste embed code on your site

Preview

Download the
Fishbowl app

See what’s happening in your industry
from the palm of your hand.

A phone with Fishbowl app

Scan your QR code to download
Fishbowl app on your mobile

Download app

Sign up for free to view this conversation on Fishbowl

By continuing you agree to Terms of Use and Privacy Policy

Already have an account? Log in

Sign up for free to continue using Fishbowl

By continuing you agree to Terms of Use(New) and Privacy Policy(New)
Messaging rates may apply

Already have an account? Log in

For account settings, visit Fishbowl on Desktop Browser or

General

Legal