Skip to content

Conversation

jlongland
Copy link

No description provided.

@jlongland jlongland marked this pull request as draft October 22, 2024 17:52
@jlongland jlongland changed the title WIP: BYO database BYO database Oct 22, 2024
PyMedic added 3 commits June 26, 2025 10:06
…se these resources have been created already with the original names and we can reuse these resources for the other Stackset instead of creating them again for each stackset. Changed the DAP client related parameter names in the AWS Systems Manager.
@PyMedic
Copy link

PyMedic commented Jul 4, 2025

I am assuming that we will launch a separate CloudFormation stackset for each Canvas instance.

In that case, we may have resource name conflict for several resources among different Cloudformation stackset because their names are semi-hardcoded. These resources are:

Database Client and ListTable Function SecurityGroups
ECS Fargate Cluster
KMS keys and KMSAlias for CD2 secrets
SNS notification name
There could be more.

For some of these AWS resources, I added ${AWS:StackName} to prevent naming conflicts between the canvas and canvas-catalog stackset.

For Database Client and ListTable Function SecurityGroups, we can either:

allow each stackset to create its own security groups OR
create new conditions ExistingDatabaseClientSecurityGroup and ExistingListTablesFunctionSecurityGroup to allow the reuse of existing security groups.

PyMedic added 14 commits July 7, 2025 15:40
…ql from username to schema_name. In the main function part, the value for the schema_name parameter for the create_schema() is already specified to use username for the schema_name. So using username parameter instead of schema_name in the create_schema_sql is redundant. Also using username as schema_name in the create_schema_sql query will cause issue when using create_schema() for creating instructure_dap schema because the function will never use instructure_dap as the schema name because it will be overrided by username.
…schema we used when creating new schema for user.
…urces because the multiple CD2 related cloudformation stacks will share a single Athena connector.
…nce, we will use different value for the SsmPathParameter instead.
…group related resources so that they get created under a certain condition. Added ListTablesFunctionSecurityGroupParameter and conditions associated to this parameter. ListTablesFunctionSecurityGroup only gets created under the condition.
…ed with it. This allows any resource referencing this security group can reference the existing security group if existed.
…up from DatabaseClientSecurityGroupParameter for AthenaPostgreSQLConnector if it already exists.
…hat falls back to DatabaseClientSecurityGroupParameter.
…plied to the DatabaseClientSecurityGroup AWS resource.
PyMedic added 13 commits August 5, 2025 13:49
…p and DatabaseClientEgressToExistingDatabase.
…t is not needed. Changed the condition for DatabaseClientEgressToDatabase so that it only gets creaed when your stack set needs to create DatabaseClientSecurityGroup.
…ecause it is not needed. Changed the condition for DatabaseClientEgressToDatabase so that it only gets creaed when your stack set needs to create DatabaseClientSecurityGroup."

This reverts commit f66be14.
…ditions for several AWS resources to reference KMS Key ID or ARN value either from the actual KMS key resource or parameters.
…there are too many parameters for canvas-catlog in the codepipeline step that causes the error during the canvas-data-2-codepipeline cloudformation stack set udpate. Replaced these parameters by composing the KMS Arn from various parameters.
…es, and sync_table code so that it can reference the correct SSM parameters in case you have multiple CD2 cloudfomration stack.
…s function so that it can assign a dynamic value for the namespace.
…sk Definition to reference the ECR images from the main CD2 stack for the other canvas CD2 stack set.
…ew cd2 database user. Also included the instruction for the additional cd2 stack.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants