Skip to content

fix: clone functionality to include submodules#1413

Open
dmaurya929 wants to merge 4 commits intomainfrom
fix/fetch-submodule
Open

fix: clone functionality to include submodules#1413
dmaurya929 wants to merge 4 commits intomainfrom
fix/fetch-submodule

Conversation

@dmaurya929
Copy link
Copy Markdown
Contributor

Please ensure your pull request adheres to the following guidelines:

  • make sure to link the related issues in this description
  • when merging / squashing, make sure the fixed issue references are visible in the commits, for easy compilation of release notes

Related Issues

Thanks for contributing!

@github-actions
Copy link
Copy Markdown

github-actions bot commented Mar 9, 2026

This PR will trigger a patch release when merged.

@dmaurya929 dmaurya929 requested review from rpapani and vdua March 9, 2026 12:34
@dmaurya929
Copy link
Copy Markdown
Contributor Author

@rpapani @vdua please review this PR

Copy link
Copy Markdown
Contributor

@rpapani rpapani left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @dmaurya929

A few things to consider

  • We've set the ephemeral storage to 3GB, for these 15% customers, did you know the rough size of all the modules, if it fits under 1-1.5GB, we are good, otherwise, we may need to increase this.
  • Will the submodules exist in the same repo or external repos? If external repos, we need to know the co-ordinates of those repos, creds etc in the case of standard repos. This may need update to our code object schema to accept multiple repo details
  • can you share an example customer program/repo so that I can try this on my side and see if there's any gap

…po origin

- Changed the construction of the git command's authentication header for standard repositories to use the repo origin instead of the full URL. This ensures the header is applied to all paths on the host, including submodule URLs.
- Updated related test cases to reflect the new header format.
const repoOrigin = `${new URL(repoUrl).origin}/`;
return [
'-c', `http.${repoUrl}.extraheader=Authorization: Basic ${basicAuth}`,
'-c', `http.${repoOrigin}.extraheader=Authorization: Basic ${basicAuth}`,
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

using the origin could be security threat especially with standard repos, so we should reduce this to customer name, like https://git.cloudmanager.adobe.com/{customer_name}/, that way we'll scope to obtaining only that customer code.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sure, anyway tokens are tenant specific I think

@rpapani
Copy link
Copy Markdown
Contributor

rpapani commented Apr 14, 2026

@dmaurya929 I've created https://jira.corp.adobe.com/browse/SITES-43089 for handling the import on mysticat and autofix as well

@dmaurya929
Copy link
Copy Markdown
Contributor Author

dmaurya929 commented Apr 14, 2026

can you share an example customer program/repo so that I can try this on my side and see if there's any gap

Below is the few customer with submodule

014af735-2399-460a-8d0a-2d99a62c8d31
01d5854d-bd26-4c13-871c-875eca46520d
08f21a60-c579-4d97-8a4d-62dc4e34a53b
11df71f8-fb7b-45f8-87da-b0775d282129
15fbab8a-c8cb-4c3b-848e-c95c50699239
16f348d1-ff67-4513-80d2-7cf8e6f25723
1a043d46-13bc-49a8-a859-14323e657126
1e1e28f5-b008-48bc-b5f3-2ebeba08b281
1f17ef2d-d435-4f9d-a6a9-1c810e3d4a65
2069153b-6d75-4429-b3b2-91b12edd2e09
226466f7-6d0d-40c7-8df6-31c744271196
27678910-f0e2-4cd2-92e8-161499648817
29de9575-ae40-4bca-90ad-fe7c36a5a51b
2dbdf56a-93b9-4183-be82-dff5dc92c3e4

We've set the ephemeral storage to 3GB, for these 15% customers, did you know the rough size of all the modules, if it fits under 1-1.5GB, we are good, otherwise, we may need to increase this.

For a few customers, the zip size with submodules is 1 - 1.5 GB. I'll let you know if I see > 2 GB.

@dmaurya929
Copy link
Copy Markdown
Contributor Author

dmaurya929 commented Apr 14, 2026

Will the submodules exist in the same repo or external repos?

yes, atleast till now I have seen the same org

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants