Skip to content

Update amber to depend on sub projects - #3111

Merged
shengquan-ni merged 61 commits into
masterfrom
shengquan-amber-sbt-change
Nov 26, 2024
Merged

Update amber to depend on sub projects#3111
shengquan-ni merged 61 commits into
masterfrom
shengquan-amber-sbt-change

Conversation

@shengquan-ni

@shengquan-ni shengquan-ni commented Nov 22, 2024

Copy link
Copy Markdown
Contributor

This PR removes two copies of the code for workflow-core and workflow-operator and makes amber directly depend on those projects.

Important points:

  1. downgraded snakeyaml in workflow-core from 2.0 to 1.30 due to a conflict in amber project.
  2. override all operator definitions in workflow-compiling-service with the latest changes in amber. Then deleted all operator definitions in amber.
  3. we still have 2 implementations in workflow-compiling-service and amber for compilation. We should soon remove the implementation in amber

@shengquan-ni shengquan-ni self-assigned this Nov 22, 2024

@bobbai00 bobbai00 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@shengquan-ni
shengquan-ni merged commit 3b24665 into master Nov 26, 2024
@shengquan-ni
shengquan-ni deleted the shengquan-amber-sbt-change branch November 26, 2024 23:58
shengquan-ni added a commit that referenced this pull request Dec 2, 2024
Since #3111, amber has been built together with other micro-services. So
we need to change the docker scripts and all other amber-related scripts
to adapt this change. This PR updates those scripts.

Important notes:
1. build-docker.sh is removed. We build everything using
build-services.sh.
2. After building amber, we put the binary back into the amber folder
for it to find `amberHomePath`.

---------

Co-authored-by: Jiadong Bai <bobbaicloudwithpants@gmail.com>
Yicong-Huang added a commit that referenced this pull request Dec 2, 2024
#3111 caused changes in #3059 being reverted. This PR applies the
changes again.
PurelyBlank pushed a commit that referenced this pull request Dec 4, 2024
This PR removes two copies of the code for workflow-core and workflow-operator and makes amber directly depend on those projects. 

Important points:
1. downgraded `snakeyaml` in `workflow-core` from 2.0 to 1.30 due to a conflict in `amber` project.
2. override all operator definitions in `workflow-compiling-service` with the latest changes in `amber`. Then deleted all operator definitions in `amber`.
3. we still have 2 implementations in `workflow-compiling-service` and `amber` for compilation. We should soon remove the implementation in `amber`

Co-authored-by: Jiadong Bai <bobbaicloudwithpants@gmail.com>
Co-authored-by: Yicong Huang <17627829+Yicong-Huang@users.noreply.github.com>
PurelyBlank pushed a commit that referenced this pull request Dec 4, 2024
Since #3111, amber has been built together with other micro-services. So
we need to change the docker scripts and all other amber-related scripts
to adapt this change. This PR updates those scripts.

Important notes:
1. build-docker.sh is removed. We build everything using
build-services.sh.
2. After building amber, we put the binary back into the amber folder
for it to find `amberHomePath`.

---------

Co-authored-by: Jiadong Bai <bobbaicloudwithpants@gmail.com>
PurelyBlank pushed a commit that referenced this pull request Dec 4, 2024
#3111 caused changes in #3059 being reverted. This PR applies the
changes again.
SarahAsad23 pushed a commit to madisonmlin/texera that referenced this pull request May 20, 2026
This PR removes two copies of the code for workflow-core and workflow-operator and makes amber directly depend on those projects. 

Important points:
1. downgraded `snakeyaml` in `workflow-core` from 2.0 to 1.30 due to a conflict in `amber` project.
2. override all operator definitions in `workflow-compiling-service` with the latest changes in `amber`. Then deleted all operator definitions in `amber`.
3. we still have 2 implementations in `workflow-compiling-service` and `amber` for compilation. We should soon remove the implementation in `amber`

Co-authored-by: Jiadong Bai <bobbaicloudwithpants@gmail.com>
Co-authored-by: Yicong Huang <17627829+Yicong-Huang@users.noreply.github.com>
SarahAsad23 pushed a commit to madisonmlin/texera that referenced this pull request May 20, 2026
)

Since apache#3111, amber has been built together with other micro-services. So
we need to change the docker scripts and all other amber-related scripts
to adapt this change. This PR updates those scripts.

Important notes:
1. build-docker.sh is removed. We build everything using
build-services.sh.
2. After building amber, we put the binary back into the amber folder
for it to find `amberHomePath`.

---------

Co-authored-by: Jiadong Bai <bobbaicloudwithpants@gmail.com>
SarahAsad23 pushed a commit to madisonmlin/texera that referenced this pull request May 20, 2026
apache#3111 caused changes in apache#3059 being reverted. This PR applies the
changes again.
yangzhang75 pushed a commit to yangzhang75/texera that referenced this pull request Jun 22, 2026
This PR removes two copies of the code for workflow-core and workflow-operator and makes amber directly depend on those projects. 

Important points:
1. downgraded `snakeyaml` in `workflow-core` from 2.0 to 1.30 due to a conflict in `amber` project.
2. override all operator definitions in `workflow-compiling-service` with the latest changes in `amber`. Then deleted all operator definitions in `amber`.
3. we still have 2 implementations in `workflow-compiling-service` and `amber` for compilation. We should soon remove the implementation in `amber`

Co-authored-by: Jiadong Bai <bobbaicloudwithpants@gmail.com>
Co-authored-by: Yicong Huang <17627829+Yicong-Huang@users.noreply.github.com>
yangzhang75 pushed a commit to yangzhang75/texera that referenced this pull request Jun 22, 2026
)

Since apache#3111, amber has been built together with other micro-services. So
we need to change the docker scripts and all other amber-related scripts
to adapt this change. This PR updates those scripts.

Important notes:
1. build-docker.sh is removed. We build everything using
build-services.sh.
2. After building amber, we put the binary back into the amber folder
for it to find `amberHomePath`.

---------

Co-authored-by: Jiadong Bai <bobbaicloudwithpants@gmail.com>
yangzhang75 pushed a commit to yangzhang75/texera that referenced this pull request Jun 22, 2026
apache#3111 caused changes in apache#3059 being reverted. This PR applies the
changes again.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

refactor Refactor the code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants