Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE REQUEST] Shared sources for over workspaces for reusing sources #3629

Closed
PaulVrugt opened this issue Nov 24, 2021 · 5 comments
Closed

Comments

@PaulVrugt
Copy link

Currently the pipeline agent always creates a workspace PER pipeline. However, this becomes very ineffecient in private agents when you have multiple pipelines using the same sources repository. In our case we have about 20 pipelines that use the sources from the same repository. Each time a different pipeline is run, the sources are fetched again in a new workspace, taking a lot of time and using a lot of disk space.

Right now, the sources are always a sub folder of the workspace. The problem would be fixed if we could somehow specify a folder for the sources separate from the workspace. Since an agent can only process 1 job at a time, we could specify a workspace independent folder for the sources, so we can reuse the sources for different pipelines.

We can go two ways with this:

  • Be able to specify a shared sources folder somewhere in the YAML definition (at a global level in the pipeline, at job level or even at checkout level). At pipeline level would already do the trick for us, but I don't know if there are any technical reasons to specify it at a certain level
  • There might be even a case to be made for making the shared sources folder the default mode. The "$(Build.SourcesDirectory)" can simply contain a different value, and I can't think of a reason why the sources folder should be part of the workspace at all, since the agent can only process 1 job at a time, and the git checkout task already makes sure the sources are correct.

Please let me know what you think of this request, and if you need any more input from me?

@PaulVrugt
Copy link
Author

FYI, I would be willing to contribute to this feature if you decide it is a valid enhancement

@anatolybolshakov
Copy link
Contributor

Hi @PaulVrugt thanks for reporting! This looks similar to #1506 and related PRs which we are planning to review.

@github-actions
Copy link

This issue has had no activity in 180 days. Please comment if it is not actually stale

@github-actions github-actions bot added the stale label Nov 12, 2022
@PaulVrugt
Copy link
Author

Not stale, just lack of response from Microsoft

@github-actions github-actions bot removed the stale label Nov 12, 2022
@github-actions
Copy link

This issue has had no activity in 180 days. Please comment if it is not actually stale

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants