Class 6: The Bigger Picture#
Guest speakers#
Questions?#
TBD#
Questions?#
Final Project wrap-up#
Heard from lots of people having issues running out of disk, kernel crashing, 500 errors when exporting, etc.
Can only anticipate so much
This is (unfortunately) a big part of coding, and thus the Final Project
Troubleshooting is a skill
“It’s broken”
Ask Me Anything (AMA)#
Have slides on “Python beyond data analysis” as backup, but would rather talk about what you want to hear about.
Python beyond data analysis#
We’ve been focusing on using Python and pandas for data analysis. What else is Python used for?
Data engineering#
Automation / recurring processes
Copying/moving/processing/publishing data, especially Big Data
Monitoring/alerting
Web development#
Building web sites that are interactive (more than just content)
Forms
Presenting data
Workflows, such as:
Signing up for things
Paying for things
Machine learning#
Statistics, but fancy
Building models
Finding patterns
Recommendations
Detection
When people say “artificial intelligence,” they usually mean “machine learning.”
Source, with more thorough explanation
The process#
High-level
Create a model
Gather a bunch of data for training
If supervised machine learning, label it (give it the right answers)
Segment into training and test data
Train the model against the training dataset (have it identify patterns)
Test the model against the test dataset
Run against new data
If reinforcement learning, model refines itself
You have a head start: The fundamentals are applicable anywhere you’re using code.
Post-JupyterHub#
JupyterHub instance (and your copy of files) will be deleted
Download things you want to keep, particularly edited notebooks
Class materials will remain available on the site and through GitHub
Thanks to the grader!
Thank you!#
Keep in touch:
@aidanfeldman on Twitter