最近會需要在 AWS 上進行 ETL 的處理,找了一下,目前有看到 step functions & airflow 的方式
就來研究一下 step functions 的方式囉
serverless framework plugin
使用 S3 event trigger step function 的方式
- Cloud Watch Event
- EventBridge
Trigger Step Function
- Creating a Step Functions API Using API Gateway - AWS Step Functions
- Starting a State Machine Execution in Response to Amazon S3 Events - AWS Step Functions
github project
- theburningmonk/complete-guide-to-step-functions-examples: Examples for the “Complete Guide to Step Functions” course
- theburningmonk/lambda-saga-pattern: Implementing the Saga pattern for Lambda functions using Step Functions
Reference
- Amazon States Language ** AWS step function 中, 用 json 描述 state machine 的說明,值得一看
- Study Notes - Step Functions | Complete Think