Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[bug] v2, v3 and v4 fail in 32-bit containers #616

Open
dscho opened this issue Sep 13, 2024 · 4 comments
Open

[bug] v2, v3 and v4 fail in 32-bit containers #616

dscho opened this issue Sep 13, 2024 · 4 comments
Labels
bug Something isn't working

Comments

@dscho
Copy link

dscho commented Sep 13, 2024

What happened?

Thanks to the helpful brown-out to notify everybody about the deprecated v1, I once again tried to run actions/upload-artifact@v4 in an i686 Docker container, and it fails miserably:

exec /__e/node20/bin/node: no such file or directory

What did you expect to happen?

I expected to either be allowed to use the deprecated v1 (which works!), or for v4 to work (which does not).

How can we reproduce it?

name: CI

on: [push, pull_request]

jobs:
  demo:
    name: demonstrate need for "deprecated" actions/upload-artifact in i386 containers
    runs-on: ubuntu-latest
    container: i386/ubuntu:focal
    steps:
    - name: Upload fails
      # shows 'exec /__e/node20/bin/node: no such file or directory'
      uses: actions/upload-artifact@v4
      with:
        name: some-artifact
        path: .

Anything else we need to know?

This has been noted in git/git, which is a quite high-profile project.

What version of the action are you using?

v4

What are your runner environments?

linux

Are you on GitHub Enterprise Server? If so, what version?

no

@dscho dscho added the bug Something isn't working label Sep 13, 2024
@dscho
Copy link
Author

dscho commented Sep 13, 2024

Also related: actions/runner#2115

@dscho
Copy link
Author

dscho commented Sep 13, 2024

For the record: The Git project currently uses git/git@90f2c72, which removes the upload altogether. This is not ideal, of course, as investigating test failures is made much harder by that, requiring any person investigating the test failures to recreate the same environment as in the workflow job, locally, and then hoping that the problem reproduces there.

@dscho
Copy link
Author

dscho commented Sep 13, 2024

I've got more information now:

  • I found out that there is no official linux-x86 build of node20

  • There are unofficial linux-x86 builds of node20 at https://unofficial-builds.nodejs.org/download/release/. This is a subdomain of the official nodejs.org domain, therefore they are maybe officially unofficial? Or maybe officially unofficial but almost official, unofficially?

  • It is quite tricky, but it is possible to convince a container on a hosted runner to use that unofficial build. See here for an example. The trick is to map /__e/node20 via the jobs.<job_id>.container.volumes directive, and to use curl and tar to fetch and extract the linux-x86 node. Here is the full workflow definition that worked:

    name: CI
    
    on: [push, pull_request]
    
    jobs:
      demo:
        name: demonstrate need for "deprecated" actions/upload-artifact in i386 containers
        runs-on: ubuntu-latest
        container:
          image: i386/ubuntu:focal
          volumes:
          - ${{ github.workspace }}:/__e/node20
        steps:
        - name: Try to replace `node` with an i386 version
          shell: bash
          run: |
            ls -lar /__e/node20 &&
            apt-get update &&
            apt-get install -y curl &&
            curl -Lo /tmp/node.tar.gz https://unofficial-builds.nodejs.org/download/release/v20.17.0/node-v20.17.0-linux-x86.tar.gz &&
            cd /__e/node20 &&
            tar -x --strip-components=1 -f /tmp/node.tar.gz
        - name: Upload fails
          # shows 'exec /__e/node20/bin/node: no such file or directory'
          uses: actions/upload-artifact@v4
          with:
            name: some-artifact
            path: .

    It would probably have been a better idea to map runner.temp to /__e/node20 than github.workspace, but hey, this was just a demonstration that I hope leads to a path forward.

  • It should be possible (although I could not wrap my head around the actions/runner code enough during the past few hours) to detect the CPU architecture during the "Initialize containers" phase, probably just after the image was pulled e.g. via docker image inspect (which, according to this tutorial reports that information in the "Architecture" attribute, i.e. docker image inspect --format '{{.Architecture}}' or a variation thereof should do the trick).

  • When x86 is detected, the node20 folder in WellknownDirectoryExternals should be replaced by a x86 variant of node 20.

  • While it is somewhat concerning that the node.js project themselves do not build Linux x86 versions, I gather that a one-off build could be made by the Actions team, or one of the "unofficial-builds" could get blessed, and then used in this scenario.

bkmgit added a commit to bkmgit/inkstitch that referenced this issue Oct 17, 2024
bkmgit added a commit to bkmgit/inkstitch that referenced this issue Nov 21, 2024
i386 hack
Setup Node on each ste
From actions/upload-artifact#616
bkmgit added a commit to bkmgit/inkstitch that referenced this issue Nov 21, 2024
i386 hack
Setup Node on each ste
From actions/upload-artifact#616
bkmgit added a commit to bkmgit/inkstitch that referenced this issue Nov 21, 2024
i386 hack
Setup Node on each ste
From actions/upload-artifact#616
bkmgit added a commit to inkstitch/inkstitch that referenced this issue Nov 22, 2024
i386 hack
Setup Node on each ste
From actions/upload-artifact#616
k-okada added a commit to k-okada/jsk_control that referenced this issue Dec 7, 2024
k-okada added a commit to k-okada/jsk_control that referenced this issue Dec 7, 2024
k-okada added a commit to k-okada/jsk_control that referenced this issue Dec 7, 2024
k-okada added a commit to k-okada/jsk_control that referenced this issue Dec 7, 2024
k-okada added a commit to k-okada/jsk_control that referenced this issue Dec 7, 2024
k-okada added a commit to k-okada/jsk_control that referenced this issue Dec 7, 2024
k-okada added a commit to k-okada/jsk_control that referenced this issue Dec 7, 2024
k-okada added a commit to k-okada/jsk_control that referenced this issue Dec 7, 2024
k-okada added a commit to k-okada/jsk_control that referenced this issue Dec 7, 2024
k-okada added a commit to k-okada/jsk_control that referenced this issue Dec 7, 2024
k-okada added a commit to k-okada/jsk_control that referenced this issue Dec 7, 2024
k-okada added a commit to k-okada/jsk_control that referenced this issue Dec 7, 2024
k-okada added a commit to k-okada/jsk_control that referenced this issue Dec 7, 2024
k-okada added a commit to k-okada/jsk_control that referenced this issue Dec 8, 2024
k-okada added a commit to k-okada/jsk_3rdparty that referenced this issue Dec 9, 2024
k-okada added a commit to k-okada/jsk_common that referenced this issue Dec 9, 2024
k-okada added a commit to jsk-ros-pkg/jsk_common that referenced this issue Dec 9, 2024
k-okada added a commit to k-okada/jsk_visualization that referenced this issue Dec 10, 2024
c.f. jsk-ros-pkg/jsk_control#790

```
Post job cleanup.
/usr/bin/docker exec  a73c1686824111e1103ab64b9f540a586c9548c53a8213840c21206b2f17403a sh -c "cat /etc/*release | grep ^ID"
OCI runtime exec failed: exec failed: unable to start container process: exec: "/__e/node20/bin/node": stat /__e/node20/bin/node: no such file or directory: unknown
```
k-okada added a commit to k-okada/jskeus that referenced this issue Dec 14, 2024
k-okada added a commit to k-okada/jskeus that referenced this issue Dec 14, 2024
k-okada added a commit to k-okada/jskeus that referenced this issue Dec 14, 2024
k-okada added a commit to euslisp/jskeus that referenced this issue Dec 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant