The client was asking for lead generation to be done from a public data source. I downloaded 107 MB of XML data files, narrowed in on the relevant subgroup, and wrote an XML parser to extract the data to a Postgres database. I used ChatGPT to handle highly irregular corporate title data by parsing & simplifying it to common titles. I then wrote a fixture to read the main db table data into a pandas DataFrame, put it in a custom order, and output it to an excel spreadsheet [the deliverable].
Built with
- PostgreSQL
- XML
- pandas
- JSON