Exploring Complex Systems & Maintainable Data Science Pipelines
Summary
Christopher Trudeau joins the Real Python Podcast to discuss distinguishing complicated from complex systems and patterns for tackling them. The episode covers new Python security releases, Django’s shift to annual versioning, and recent PEPs regarding async generators and frozen syntax. Additionally, the hosts review tutorials on validating data with Point Blank, building modular pipelines with Hydra, and using splitlines for text processing. They also highlight projects including a Marimo static site generator and Hexura, a security linter for detecting malicious code.
Topics discussed
Introduction and episode overview
Python security releases and Django 6.0 news
PEP 828: Yield from in async generators
PEP 841: Frozen syntax and PEP 844: Public/Private builtins
Validating data with the Point Blank library
Characteristics and patterns of complex systems
Real Python course: Sending emails with Python
Building modular pipelines with Hydra configuration
Why splitlines() is better than splitting on newlines
Marimo Book static site generator and VS Code extension
Hexura: Static analysis for malicious Python code
Listen ad-free on Castria