Welcome to pyspark-tdd-template’s documentation!

Contents:

• Introduction
  • Initial Pyspark code
  • Handling static configurations
  • Handling spark environments
  • Modularize the code
  • Testing setup
  • Running the example locally
  • Deploying into production
• Jobs package
  • jobs.pipeline module
• Tests package
  • tests.conftest module
  • tests.test_pipeline module
• Dependencies package
  • dependencies.job_submitter module

Indices and tables

• Index
• Module Index
• Search Page