Recommendations on developing a database that can pull public info from the internet for use in a web application

like
Posting as :
works at
You are currently posting as works at

My recommendation is to get more specific. That could literally be almost any project ever.

Think about the volume of data you're planning to store and how you'll pull the data. That's where I usually start on my projects

likefunny

Yeah you'd need to narrow down what data you're interested in specifically. Then you have to look for where you might access that data. Then determine how your program can read the data. Is it accessible through a free or paid API? Is it an excel or csv download? Can you scrape the website? If you figure all that out, you're well on your way!

like

Related Posts

I ate a margarita and drank a Pacifico for lunch.

likefunnyuplifting

This is for all the mates here who are living with their elderly parents with their siblings stationed abroad. How do you manage your elderly parent's health and how much support do you receive from your siblings who are abroad and don't wish to return either.

like

Does it mean anything if your HR consultant randomly adds you on LinkedIn? I’ve never even met her in person or talked to her over the phone. I’m probably overthinking but just curious. Thanks!

Anyone taken the CFF? Looking for advice on the first exam

Post your suggestions in the comments

Post Photo
likefunny

Hi Fishes, I'm looking for QA opportunities in Chennai. My experience is 9 years.
Please DM me for details.

Automation Tools/Libraries: Selenium, Apache Airflow, Protractor, Test Harness, Rational Robot, Rational Functional Tester, Automation Anywhere, WinAutomation, Rest Assured, Cucumber

Programming Languages: Java, Python, JavaScript
Cloud Platform: AWS
Database: PostgreSQL, MySQL
CI/CD Tools: Jenkins, TeamCity, Kubernetes
Other Tools: Splunk, DataDog, Postman, Git, Jira, Kafka

like

This poor dead bowl 😭. Construction and energy attorney here!

likefunny

The tasting lineup for this evening. Wathens came out the winner, Old Bardstown BIB 2nd, and Blanton's 3rd. That said, none were losers.

Post Photo
like

How much do you have invested in stocks/ETFs/etc? How long have you been investing and what's your annual income range?

like

My score is 620 nothing outstanding but my student loans are killing me. I cant get approve for a house

like

Pursue manager promotion in core tax compliance or pursue transition to M&A tax but remain SA. I am a Macc CPA.

like

I picked up long distance running over the last year but can’t seem to get my avg pace up. I can of course run faster but then I have to take more breaks. What helped you?

like

Any Chicago realtor recommendations?

like

Hello All,
I have been offered a role in TCS for ITA grade C2 . I have been interviewed in QA automation . What are the chances of me getting into a support project? Or will I be surely tagged to a automation project?

HR is not aware of what project I will get into .

Thanks in Advance.

like

I am STRUGGLING to find good workshops to bring in to my company! I'm trying to build L&D but no one (in professional groups) seems to be willing to share the facilitators they like and I'm so stuck because I need to bring in facilitators but need to have them vetted by recs prior.
I desperately need someone to give 1 hour sessions to large groups on broad topics like time mgmt...
I desperately need someone to lead customer support training on best practices to our support teams...
So stuck.

like

Remember to book your PTO and use these codes

Post Photo
likehelpful

hi! newbie here, does anyone know a good wine that doesn’t give you migraine the morning after? lol. thank you 🍷

like

What are some typical questions for FIT interviews? Been prepping for it but want to make sure I cover all my bases.

like

Additional Posts in Technology/IT Consultants

What are the best Certs to get fresh out of school? Got a job in Tech consulting at PwC (commercial) and want to find my niche... any suggestions?(interested in cyber)

like

What do I do if I've developed the belief that technology is harming society more than helping it after being a tech nerd most of my life?

like

During meetings, why do some people blurt out the first idiotic thing that comes to mind rather than taking a second to intelligently think through their answer?

like

Best part time data science program? It can be a certificate or micro masters, etc. I have no experience coding but have working in tax technology and want to slowly pivot out into data analytics. It would be great if it’s a program or certificate that’s reputable and can be used as leverage to pivot. Thanks!!!

like

Hi all, I created a brief series of articles on technology consulting. Would really appreciate any feedback! (Link in comments)

like

Anybody pass the AWS Sys OP exam? Any tips?

I wonder the fish have any clever solutions to accelerate data conversion process typical for erp implementations? It seems the Traditional ETL approach should be a candidate for machine learning but

Hey I’m currently at an Fortune 500 IT company as a consultant working functionally. I’m not a developer and not a data scientist. I’m looking to move towards solutions architect roles, is AWS or Azure certifications gonna hold much weight if my experience isn’t really super technical only have 2 years out of undergrad where I got a degree in civil engineering. Also looking to speak to any AWS Or Azure solution architects that can chat through what the role looks like thanks!

like

I applied for few SA roles at AWS after getting the SAA certificate and some badges like the “WAF” and “Advanced Migration”. I also optimized my resume recently trying to match what AWS would look for, but I did not get any 1st call or screening interview!
I also applied to some of the roles using friend’s referral. I have more than 15 years in IT infrastructure mainly in Storage systems (EMC, Hitachi) What could be the problem? Thanks.

like

Are 60 hour work weeks regular for you guys. I personally don’t like putting in anything over 45. What’s the average for different companies and practices

EY senior Conusltant in Data Analytics vs ZS Decision Analytics AC. Thoughts on which one would be better, both roles based out of New York. EY is paying more money compared to ZS
for now.

like

PWC SAP Manager, what is the salary range for 10+ experience. What is the signing bonus?

What the salary range level 9 and level 10 in T D Bank

like

I recently interviewed at Facebook for IAM analyst position. The interview went very well and I was able to answer all questions and have hands on experience in everything I explained. I was rejected and I am really unsure about the cause. Please help me with a reality check, what could have gone wrong? Thank you

like

PwC 🐠: Whats covered under gym/health fees on travel days? Classpass?

Applied to an FS Advisory position and got the fastest rejection email of all time 😭

like

What Big 4 practices offer the same services as KPMG's CIO Advisory?

like
like

Trying for a job in the big 4 as a senior associate. No luck yet. Any suggestions 🐠. Close to 5 years experience and a Masters Degree. Looking for jobs in Data & Analytics - DW & BI.

like

New to Fishbowl?

Download the Fishbowl app to
unlock all discussions on Fishbowl.
That was just a preview…
Sign Up to see all discussions
  • Discover what it’s like to work at companies from real professionals
  • Get candid advice from people in your field in a safe space
  • Chat and network with other professionals in your field
Sign up in seconds to unlock all discussions on Fishbowl.

Already a user?
Login here

Share

Embed this post

Copy and paste embed code on your site

Preview

Download the
Fishbowl app

See what’s happening in your industry
from the palm of your hand.

A phone with Fishbowl app

Send download link to your phone

OR

Scan your QR code to download
Fishbowl app on your mobile

By continuing you agree to Terms of Use and Privacy Policy.

Messaging rates may apply

Download app

Sign up for free to view this conversation on Fishbowl

By continuing you agree to Terms of Use and Privacy Policy

Already have an account? Log in

Sign up for free to continue using Fishbowl

By continuing you agree to Terms of Use(New) and Privacy Policy(New)
Messaging rates may apply

Already have an account? Log in

For account settings, visit Fishbowl on Desktop Browser or

General

Legal