Recommendations on developing a database that can pull public info from the internet for use in a web application

like
Posting as :
works at
You are currently posting as works at

My recommendation is to get more specific. That could literally be almost any project ever.

Think about the volume of data you're planning to store and how you'll pull the data. That's where I usually start on my projects

likefunny

Yeah you'd need to narrow down what data you're interested in specifically. Then you have to look for where you might access that data. Then determine how your program can read the data. Is it accessible through a free or paid API? Is it an excel or csv download? Can you scrape the website? If you figure all that out, you're well on your way!

like

Related Posts

I am a 2nd year Corporate Associate from v5 firm in NYC looking to move to a Boston firm Big Law firm this summer/early fall (will be getting married and moving to Boston). Are there any recruiters working in the Boston market? Please feel free to DM me.

like
like

Should I stop contributing to my 401K and put all my energy into paying off my student loan? Right now it's unconsolidated so there are rates between 3-6% and it's 20k.

Hey Salesforce Professionals - how has the pandemic impacted your firm? What are you seeing with your customers? How are you helping your customers during these difficult times?

like

Hi, anybody knows what’s the salary after promoting as a Strategy Analyst at the graduate scheme? Thanks

Looking for a remote/hybrid/onsite (Calgary,Alberta) job for my boyfriend who got almost 5 years of experience in proposal writing, RFP, RFI and bid management for a civil engineering firm. He also got an MBA, non drinker, non smoker, clean driving abstract and very polite. He gave out tons of cv in indeed job posters for the past 5 months, ends up becoming the filler candidate, took a huge toll in his mental health and we are going through some very rough patches. Can anyone please kindly help?

like

Hi all,
I want to learn vlsi physical design . Please suggest me some resources.
Currently I am working as software tester from last 1.8 years . Want to change my career path

Best restaurant in NOVA for a date? I'll be visiting and want to wow this woman. Thanks!

likefunny

I need someone either a lot smarter or a lot stupider than me to explain how getting a cake smashed on it relates to Philly cream cheese...

Post Photo
funnylikeuplifting

I lost a baby at full term pregnancy (no genetic cause) and we are ready to plan for a second one. I am wanting to go through IVF because the genetic testing would rule out any bad surprises that could come later and also my husband and me are carriers for AMD. I am lost where to even start from. Would I need a referral for IVF? Will I be paying all the cost? My husband’s company has a plan but I don’t know if we would need to qualify?

like

Contrary to what I posted earlier, I was actually in the mood for an old fashioned tonight as it was cool out due to the hurricane off the coast. Nothing special, but nice while watching Peaky Blinders.

Post Photo
likeuplifting

What is tcs c1y grade ?

like
like

Has anyone here ever accidentally walked in on a hotel guest? Oops...

like

What are the firms that are hiring? (corp that are good exit options for Big4 with 5 YOE)

like

Going to Hawaii soon any recommendations ?

like

Can anyone please help me with a referral in JP Morgan.i have the job id.Thanks in advance

IQVIA is not opting for Hybrid model? Planning to join IQVIA. Looking for more WFH.

So I’m currently entering the 4th and final round of an interview process for a sales role.. The final round entails a sales pitch presentation where I present either a topic or product that I can confidently convey a persuasive message about.

The actual topic isn’t what’s important as it’s more about then actual skills show cased.. I’m currently struggling to decide on an easy topic that would suit well - between the topic and then any other words of advise I can use some tips for this !!

like

Additional Posts in Technology/IT Consultants

Ungrateful or underpaid? got promoted from CL10>9 with AFS TDG for ServiceNow in dc. Salary went from 80 to 93k and bonus of 5k. I was hoping to get 105k base-Realistic? Love my team and leaders tho

like

Has anyone used Mirrorfly’s API for mobile videoconferencing?

Currently at a firm that doesn’t off global deployment programs, but very interested in pursuing one. Any tips on how to make this goal a reality?

Software architects-what diagramming tools do you all use for various types of software architecture diagrams?

like

Hi Guys,

I need to activate DM. Please like my post.

like

Hey guys, anyone happen to know what Quest migration manager licensing is like these days for say 5K users?

like

Hiring for RPA roles in North America. DM me if interested.

likefunny

What does the average pay range look like for a Senior Associate in IT Audit/Cybersecurity Consultant in west region (California)?

like

PEGA certified business architect. Yay or nay?

Does anyone have a know where I can find additional study materials/practice test for the Oracle Cloud Revenue Management certification exam?

like

Hey peeps - trying to assess my career prospects after a moment of doubt - what sorts of post-mba career areas would be a good fit for someone with my background?

-CS undergrad and Current MBA student at t15
-3 YOE at B4 with exposure to implementation/architecture/and product mgmt

Want to utilize my tech skills but explore other business areas…besides PM what other types of opportunites would be a good fit? (And Googling has not been as helpful here)..any advice is much appreciated!!

like

Fish: I know someone at another firm who has been ridiculed based on their perceived economic past as a child. Firm Leadership has circulated a suggestive photo with a demeaning caption with... CONT.

I’m a little over a year into Deloitte now after getting my BS in CS and realizing consulting isn’t for me. Anyone willing to refer me to a big tech company? I’d be happy to chat/send my resume and refer you to Deloitte if that’s what you are seeking.

likefunny

for Amazon SDE roles and code assessment. How much do they really do what's in the assessment? I am doing a code assessment this weekend and I am a developer but I don't really do much of complex data structure stuff or map graph stuff I have seen. Is that what Amazon developers do day to day? Amazon ,AWS

like

I want to pursue a product manager track as an exit from Consulting, then how can I get there?

like

Hello everyone!
I’m seeking advise from fishers. My brother in law is going to university next year. He was engineering (which is one of the worse decisions someone can do from my experience LOOL). I told him if anything he should do managment engineering which he got accepted to. He also got accepted to Mcmaster- information management systems. Which in my opinion you get a bit of everything! And this degree is picking up a lot of traction’s across tech. More thoughts in the comments

like

Anyone from The Walt Disney Company here..I need help with job reference!

like

Anyone thinks $200k is a new $100k in the professional services?

like

Considering a senior mgr role at Unisys. What’s your experience with them? Good? Bad?

like

Looking for a master class or progam on power query. Suggestions?

like

New to Fishbowl?

Download the Fishbowl app to
unlock all discussions on Fishbowl.
That was just a preview…
Sign Up to see all discussions
  • Discover what it’s like to work at companies from real professionals
  • Get candid advice from people in your field in a safe space
  • Chat and network with other professionals in your field
Sign up in seconds to unlock all discussions on Fishbowl.

Already a user?
Login here

Share

Embed this post

Copy and paste embed code on your site

Preview

Download the
Fishbowl app

See what’s happening in your industry
from the palm of your hand.

A phone with Fishbowl app

Scan your QR code to download
Fishbowl app on your mobile

Download app

Sign up for free to view this conversation on Fishbowl

By continuing you agree to Terms of Use and Privacy Policy

Already have an account? Log in

Sign up for free to continue using Fishbowl

By continuing you agree to Terms of Use(New) and Privacy Policy(New)
Messaging rates may apply

Already have an account? Log in

For account settings, visit Fishbowl on Desktop Browser or

General

Legal