Final Project resources

Open data portals

There are countless places to get data, notably:

• Local:

  • NYC Open Data

    • Scout can be used to find datasets with certain columns

  • BetaNYC

• U.S. Federal:

  • data.gov

  • Census Bureau

  • Federal Reserve Economic Data (FRED)

• United Nations

• World Bank

• World Health Organization (WHO)

• Economic Policy Institute

• Kaggle

• Google Dataset Search

• Black Wealth Data

• Lists of open data portals:

  • DataPortals

  • Open Data Network

Inspiration

For starters, see the examples from past semesters.

Probably not realistic to make visualizations that are as fancy as these ones made by professionals, but they may give you ideas. Some also include links/downloads of the source data.

• FiveThirtyEight Interactives

• The Guardian Visual Journalism

• New York Times Graphics

• Our World in Data

• ProPublica News Apps

• Visual Capitalist

Counting lines of code

To count the number of lines of code in a notebook:

1. Download the notebook as a Python file.

   1. With the notebook open in Google Colab, go to File->Download->Download .py.

2. Upload the Python file to Google Colab (directly, not to Google Drive).

   1. Click the Files icon in the sidebar.

   2. Click the Upload to session storage button.

   3. Select the .py file.

3. Put the following in a code cell and run it.

   !apt-get install -y cloc > /dev/null
   !cloc --hide-rate --by-file *.py