Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-7651

Failures in various pre and post-commits: "No space left on device"

Details

    Description

      I've seen this popping up in several pre and post-commits today. I'll list one example with a full message and then several tests where I've seen it happen.

       https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py27/176/

       

      11:09:46 Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to JNLP4-connect connection from 103.55.66.34.bc.googleusercontent.com/34.66.55.103:46040
      11:09:46 		at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
      11:09:46 		at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
      11:09:46 		at hudson.remoting.Channel.call(Channel.java:955)
      11:09:46 		at hudson.FilePath.act(FilePath.java:1072)
      11:09:46 		at hudson.FilePath.act(FilePath.java:1061)
      11:09:46 		at hudson.FilePath.mkdirs(FilePath.java:1246)
      11:09:46 		at hudson.model.AbstractProject.checkout(AbstractProject.java:1202)
      11:09:46 		at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
      11:09:46 		at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
      11:09:46 		at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
      11:09:46 		at hudson.model.Run.execute(Run.java:1810)
      11:09:46 		at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
      11:09:46 		at hudson.model.ResourceController.execute(ResourceController.java:97)
      11:09:46 		at hudson.model.Executor.run(Executor.java:429)
      11:09:46 java.nio.file.FileSystemException: /home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_WordCountIT_Py27: No space left on device
      11:09:46 	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:91)
      11:09:46 	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
      11:09:46 	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
      11:09:46 	at sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:384)
      11:09:46 	at java.nio.file.Files.createDirectory(Files.java:674)
      11:09:46 	at java.nio.file.Files.createAndCheckIsDirectory(Files.java:781)
      11:09:46 	at java.nio.file.Files.createDirectories(Files.java:767)
      11:09:46 	at hudson.FilePath.mkdirs(FilePath.java:3273)
      11:09:46 	at hudson.FilePath.access$1300(FilePath.java:213)
      11:09:46 	at hudson.FilePath$Mkdirs.invoke(FilePath.java:1254)
      11:09:46 	at hudson.FilePath$Mkdirs.invoke(FilePath.java:1250)
      11:09:46 	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3086)
      11:09:46 	at hudson.remoting.UserRequest.perform(UserRequest.java:212)
      11:09:46 	at hudson.remoting.UserRequest.perform(UserRequest.java:54)
      11:09:46 	at hudson.remoting.Request$2.run(Request.java:369)
      11:09:46 	at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
      11:09:46 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      11:09:46 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      11:09:46 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      11:09:46 	at hudson.remoting.Engine$1.lambda$newThread$0(Engine.java:93)
      11:09:46 	at java.lang.Thread.run(Thread.java:748)

       

      https://builds.apache.org/job/beam_PreCommit_RAT_Cron/978/

      https://builds.apache.org/job/beam_PreCommit_Website_Cron/1196/

      https://builds.apache.org/job/beam_PreCommit_Python_Cron/1482/

      https://builds.apache.org/job/beam_PostCommit_Py_ValCont/3667/

       

      Edit:

      This other failure in several post-commits seems related:

      https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/1054/

      11:04:49 ERROR: Error fetching remote repo 'origin'
      11:04:49 hudson.plugins.git.GitException: Failed to fetch from https://github.com/apache/beam.git
      11:04:49 	at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:894)
      11:04:49 	at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1161)
      11:04:49 	at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1192)
      11:04:49 	at hudson.scm.SCM.checkout(SCM.java:504)
      11:04:49 	at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
      11:04:49 	at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
      11:04:49 	at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
      11:04:49 	at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
      11:04:49 	at hudson.model.Run.execute(Run.java:1810)
      11:04:49 	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
      11:04:49 	at hudson.model.ResourceController.execute(ResourceController.java:97)
      11:04:49 	at hudson.model.Executor.run(Executor.java:429)
      11:04:49 Caused by: hudson.plugins.git.GitException: Command "git config remote.origin.url https://github.com/apache/beam.git" returned status code 4:
      11:04:49 stdout: 
      11:04:49 stderr: error: failed to write new configuration file /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Website_Stage_GCS_Cron/src/.git/config.lock
      11:04:49 
      11:04:49 	at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2042)
      11:04:49 	at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2010)
      11:04:49 	at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2006)
      11:04:49 	at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommand(CliGitAPIImpl.java:1638)
      11:04:49 	at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommand(CliGitAPIImpl.java:1650)
      11:04:49 	at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.setRemoteUrl(CliGitAPIImpl.java:1284)
      11:04:49 	at hudson.plugins.git.GitAPI.setRemoteUrl(GitAPI.java:160)
      11:04:49 	at sun.reflect.GeneratedMethodAccessor49.invoke(Unknown Source)
      11:04:49 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      11:04:49 	at java.lang.reflect.Method.invoke(Method.java:498)
      11:04:49 	at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:929)
      11:04:49 	at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:903)
      11:04:49 	at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:855)
      11:04:49 	at hudson.remoting.UserRequest.perform(UserRequest.java:212)
      11:04:49 	at hudson.remoting.UserRequest.perform(UserRequest.java:54)
      11:04:49 	at hudson.remoting.Request$2.run(Request.java:369)
      11:04:49 	at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
      11:04:49 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      11:04:49 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      11:04:49 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      11:04:49 	at hudson.remoting.Engine$1.lambda$newThread$0(Engine.java:93)
      11:04:49 	at java.lang.Thread.run(Thread.java:748)
      11:04:49 	Suppressed: hudson.remoting.Channel$CallSiteStackTrace: Remote call to JNLP4-connect connection from 103.55.66.34.bc.googleusercontent.com/34.66.55.103:46040
      11:04:49 		at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
      11:04:49 		at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
      11:04:49 		at hudson.remoting.Channel.call(Channel.java:955)
      11:04:49 		at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:283)
      11:04:49 		at com.sun.proxy.$Proxy114.setRemoteUrl(Unknown Source)
      11:04:49 		at org.jenkinsci.plugins.gitclient.RemoteGitImpl.setRemoteUrl(RemoteGitImpl.java:295)
      11:04:49 		at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:882)
      11:04:49 		at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1161)
      11:04:49 		at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1192)
      11:04:49 		at hudson.scm.SCM.checkout(SCM.java:504)
      11:04:49 		at hudson.model.AbstractProject.checkout(AbstractProject.java:1208)
      11:04:49 		at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574)
      11:04:49 		at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
      11:04:49 		at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499)
      11:04:49 		at hudson.model.Run.execute(Run.java:1810)
      11:04:49 		at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
      11:04:49 		at hudson.model.ResourceController.execute(ResourceController.java:97)
      11:04:49 		at hudson.model.Executor.run(Executor.java:429)

       

      https://builds.apache.org/job/beam_PreCommit_Java_Cron/1480/

      https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/832/

       https://builds.apache.org/job/beam_PreCommit_Go_Cron/1485/

       

      Attachments

        Issue Links

          Activity

            People

              markflyhigh Mark Liu
              danoliveira Daniel Oliveira
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: