![]() The fifth and final step is copying the DAGs to an Amazon S3 bucket. Remember, updates happen only when there are changes in the plugins or requirements file. It automatically handles creating or updating the MWAA environment. The pipeline runs the change-set using the infra/template.yaml copied from the last step. ![]() The fourth and the fifth steps in the CI/CD process are handled by AWS CodePipeline. Finally, it copies the template.yaml and the corresponding parameter file to the pipeline artifact bucket. Then it moves on to copy the plugins and requirements.txt to the Amazon S3 bucket. When the tests are successful, it moves on to find whether there are changes in requirements.txt or plugins from the last commit. The CodeBuild job starts with testing the DAGs, plugins, and requirements.txt using MWAA local runner. AWS CodeBuild runs this file as part of the build job. The first three steps are covered in the build/buildspec.yaml.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |