Init and Prepare Complete But Normal Terminates

classic Classic list List threaded Threaded
9 messages Options
Reply | Threaded
Open this post in threaded view
|

Init and Prepare Complete But Normal Terminates

jrgruher
Trying to run a basic workload against my Swift storage.  The Init and Prepare steps complete, so I assume my access to the Swift store is OK, or it wouldn't be able to complete the Prepare step.  The log below shows a failure when trying to access /tmp/testfile/?  Anyone else seen this, or any suggestions on how to correct?

I did try creating /tmp/testfile/ myself, with access permissions for everyone to read and write, but then I just a different failure at about the same spot, with no useful output (see second set of logs below).

Original failure:

ceph@cephclient01:~/cos$ cat log/system.log
2013-10-07 22:02:55,999 [INFO] [Log4jLogManager] - will append log to file /home/ceph/0.3.1.2/log/system.log
2013-10-07 22:03:13,740 [INFO] [Log4jLogManager] - will append log to file /home/ceph/0.3.1.2/log/system.log
2013-10-07 22:37:30,424 [INFO] [Log4jLogManager] - will append log to file /home/ceph/0.3.1.2/log/system.log
2013-10-07 22:37:48,161 [INFO] [Log4jLogManager] - will append log to file /home/ceph/0.3.1.2/log/system.log
2013-10-07 22:56:23,360 [INFO] [WorkloadProcessor] - begin to process workload w1
2013-10-07 22:56:23,362 [INFO] [WorkloadProcessor] - begin to run stage s1
2013-10-07 22:56:23,758 [INFO] [StageRunner] - successfully booted all tasks in stage s1
2013-10-07 22:56:23,945 [INFO] [StageRunner] - successfully submitted all tasks in stage s1
2013-10-07 22:56:24,031 [INFO] [MissionHandler] - mission M696A343197 has been authed successfully
2013-10-07 22:56:24,034 [INFO] [StageRunner] - successfully authenticated all tasks in stage s1
2013-10-07 22:56:24,242 [INFO] [StageRunner] - successfully launched all tasks in stage s1
2013-10-07 22:56:26,306 [INFO] [MissionHandler] - mission M696A343197 has been executed successfully
2013-10-07 22:56:29,265 [INFO] [StageRunner] - successfully queied all tasks in stage s1
2013-10-07 22:56:29,279 [INFO] [MissionHandler] - mission M696A343197 has been closed successfully
2013-10-07 22:56:29,374 [INFO] [StageRunner] - successfully closed all tasks in stage s1
2013-10-07 22:56:31,743 [INFO] [WorkloadProcessor] - successfully ran stage s1
2013-10-07 22:56:31,744 [INFO] [WorkloadProcessor] - begin to run stage s2
2013-10-07 22:56:31,750 [INFO] [StageRunner] - successfully booted all tasks in stage s2
2013-10-07 22:56:31,772 [INFO] [StageRunner] - successfully submitted all tasks in stage s2
2013-10-07 22:56:31,780 [INFO] [MissionHandler] - mission MF96A360CD9 has been authed successfully
2013-10-07 22:56:31,782 [INFO] [StageRunner] - successfully authenticated all tasks in stage s2
2013-10-07 22:56:31,987 [INFO] [StageRunner] - successfully launched all tasks in stage s2
2013-10-07 22:56:59,303 [INFO] [MissionHandler] - mission MF96A360CD9 has been executed successfully
2013-10-07 22:57:02,029 [INFO] [StageRunner] - successfully queied all tasks in stage s2
2013-10-07 22:57:02,035 [INFO] [MissionHandler] - mission MF96A360CD9 has been closed successfully
2013-10-07 22:57:02,073 [INFO] [StageRunner] - successfully closed all tasks in stage s2
2013-10-07 22:57:04,488 [INFO] [WorkloadProcessor] - successfully ran stage s2
2013-10-07 22:57:04,489 [INFO] [WorkloadProcessor] - begin to run stage s3
2013-10-07 22:57:04,496 [INFO] [StageRunner] - successfully booted all tasks in stage s3
2013-10-07 22:57:04,520 [ERROR] [AbstractCommandHandler] - unexpected error
java.lang.RuntimeException: Folder /tmp/testfiles/ does not exist.
        at com.intel.cosbench.driver.operator.FileWriter.init(FileWriter.java:68)
        at com.intel.cosbench.driver.operator.Operators.getOperator(Operators.java:29)
        at com.intel.cosbench.driver.service.MissionHandler.createOperatorContext(MissionHandler.java:135)
        at com.intel.cosbench.driver.service.MissionHandler.createOperators(MissionHandler.java:126)
        at com.intel.cosbench.driver.service.MissionHandler.init(MissionHandler.java:94)
        at com.intel.cosbench.driver.service.COSBDriverService.createHandler(COSBDriverService.java:111)
        at com.intel.cosbench.driver.service.COSBDriverService.submit(COSBDriverService.java:82)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:309)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
        at org.springframework.osgi.service.util.internal.aop.ServiceTCCLInterceptor.invokeUnprivileged(ServiceTCCLInterceptor.java:71)
        at org.springframework.osgi.service.util.internal.aop.ServiceTCCLInterceptor.invoke(ServiceTCCLInterceptor.java:54)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202)
        at com.sun.proxy.$Proxy17.submit(Unknown Source)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:309)
        at org.springframework.osgi.service.importer.support.internal.aop.ServiceInvoker.doInvoke(ServiceInvoker.java:58)
        at org.springframework.osgi.service.importer.support.internal.aop.ServiceInvoker.invoke(ServiceInvoker.java:62)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at org.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:131)
        at org.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:119)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at org.springframework.osgi.service.util.internal.aop.ServiceTCCLInterceptor.invokeUnprivileged(ServiceTCCLInterceptor.java:71)
        at org.springframework.osgi.service.util.internal.aop.ServiceTCCLInterceptor.invoke(ServiceTCCLInterceptor.java:54)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at org.springframework.osgi.service.importer.support.LocalBundleContextAdvice.invoke(LocalBundleContextAdvice.java:59)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at org.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:131)
        at org.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:119)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202)
        at com.sun.proxy.$Proxy7.submit(Unknown Source)
        at com.intel.cosbench.driver.handler.SubmitHandler.process(SubmitHandler.java:38)
        at com.intel.cosbench.driver.handler.AbstractCommandHandler.handleRequest(AbstractCommandHandler.java:76)
        at com.intel.cosbench.driver.handler.SubmitHandler.handleRequest(SubmitHandler.java:1)
        at org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:48)
        at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:790)
        at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:719)
        at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:644)
        at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:560)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:710)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:803)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
        at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175)
        at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128)
        at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
        at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
        at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286)
        at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:844)
        at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
        at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)
        at java.lang.Thread.run(Thread.java:724)
2013-10-07 22:57:04,525 [ERROR] [AbstractCommandTasklet] - driver report error: HTTP 500 - Folder /tmp/testfiles/ does not exist.
2013-10-07 22:57:04,526 [ERROR] [StageRunner] - detected tasks [t1] have encountered errors
2013-10-07 22:57:04,527 [INFO] [StageRunner] - begin to terminate stage s3
2013-10-07 22:57:04,533 [ERROR] [AbstractCommandTasklet] - driver report error: HTTP 400 - unrecognized request
2013-10-07 22:57:04,533 [ERROR] [Aborter] - fail to abort driver
com.intel.cosbench.controller.tasklet.TaskletException
        at com.intel.cosbench.controller.tasklet.AbstractCommandTasklet.issueCommand(AbstractCommandTasklet.java:67)
        at com.intel.cosbench.controller.tasklet.Aborter.executeAbort(Aborter.java:51)
        at com.intel.cosbench.controller.tasklet.Aborter.execute(Aborter.java:40)
        at com.intel.cosbench.controller.tasklet.AbstractTasklet.call(AbstractTasklet.java:47)
        at com.intel.cosbench.controller.tasklet.AbstractTasklet.call(AbstractTasklet.java:1)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:724)
2013-10-07 22:57:04,534 [INFO] [StageRunner] - stage s3 has been terminated
2013-10-07 22:57:04,535 [ERROR] [WorkloadProcessor] - detected stage s3 encountered error
2013-10-07 22:57:04,536 [INFO] [WorkloadProcessor] - begin to terminate workload w1
2013-10-07 22:57:04,832 [INFO] [SimpleWorkloadArchiver] - workload w1 has been successfully archived
2013-10-07 22:57:04,833 [INFO] [WorkloadProcessor] - successfully terminated workload w1



Failure with manually created /tmp/testfile/:

2013-10-07 23:07:39,490 [INFO] [WorkloadProcessor] - begin to process workload w2
2013-10-07 23:07:39,491 [INFO] [WorkloadProcessor] - begin to run stage s1
2013-10-07 23:07:39,503 [INFO] [StageRunner] - successfully booted all tasks in stage s1
2013-10-07 23:07:39,525 [INFO] [StageRunner] - successfully submitted all tasks in stage s1
2013-10-07 23:07:39,533 [INFO] [MissionHandler] - mission MB96AD90B7C has been authed successfully
2013-10-07 23:07:39,535 [INFO] [StageRunner] - successfully authenticated all tasks in stage s1
2013-10-07 23:07:39,679 [INFO] [MissionHandler] - mission MB96AD90B7C has been executed successfully
2013-10-07 23:07:39,740 [INFO] [StageRunner] - successfully launched all tasks in stage s1
2013-10-07 23:07:44,751 [INFO] [StageRunner] - successfully queied all tasks in stage s1
2013-10-07 23:07:44,756 [INFO] [MissionHandler] - mission MB96AD90B7C has been closed successfully
2013-10-07 23:07:44,767 [INFO] [StageRunner] - successfully closed all tasks in stage s1
2013-10-07 23:07:47,241 [INFO] [WorkloadProcessor] - successfully ran stage s1
2013-10-07 23:07:47,242 [INFO] [WorkloadProcessor] - begin to run stage s2
2013-10-07 23:07:47,249 [INFO] [StageRunner] - successfully booted all tasks in stage s2
2013-10-07 23:07:47,267 [INFO] [StageRunner] - successfully submitted all tasks in stage s2
2013-10-07 23:07:47,274 [INFO] [MissionHandler] - mission MD96ADB1795 has been authed successfully
2013-10-07 23:07:47,276 [INFO] [StageRunner] - successfully authenticated all tasks in stage s2
2013-10-07 23:07:47,482 [INFO] [StageRunner] - successfully launched all tasks in stage s2
2013-10-07 23:08:12,310 [INFO] [MissionHandler] - mission MD96ADB1795 has been executed successfully
2013-10-07 23:08:12,526 [INFO] [StageRunner] - successfully queied all tasks in stage s2
2013-10-07 23:08:12,532 [INFO] [MissionHandler] - mission MD96ADB1795 has been closed successfully
2013-10-07 23:08:12,544 [INFO] [StageRunner] - successfully closed all tasks in stage s2
2013-10-07 23:08:14,983 [INFO] [WorkloadProcessor] - successfully ran stage s2
2013-10-07 23:08:14,984 [INFO] [WorkloadProcessor] - begin to run stage s3
2013-10-07 23:08:14,993 [INFO] [StageRunner] - successfully booted all tasks in stage s3
2013-10-07 23:08:15,016 [ERROR] [AbstractCommandHandler] - unexpected error
java.lang.IllegalArgumentException
        at com.intel.cosbench.driver.random.SequentialIntGenerator.<init>(SequentialIntGenerator.java:43)
        at com.intel.cosbench.driver.random.SequentialIntGenerator.tryParse(SequentialIntGenerator.java:79)
        at com.intel.cosbench.driver.random.SequentialIntGenerator.parse(SequentialIntGenerator.java:66)
        at com.intel.cosbench.driver.random.Generators.getIntGenerator(Generators.java:48)
        at com.intel.cosbench.driver.random.Generators.getNameGenerator(Generators.java:29)
        at com.intel.cosbench.driver.util.FilePicker.init(FilePicker.java:42)
        at com.intel.cosbench.driver.operator.FileWriter.init(FileWriter.java:72)
        at com.intel.cosbench.driver.operator.Operators.getOperator(Operators.java:29)
        at com.intel.cosbench.driver.service.MissionHandler.createOperatorContext(MissionHandler.java:135)
        at com.intel.cosbench.driver.service.MissionHandler.createOperators(MissionHandler.java:126)
        at com.intel.cosbench.driver.service.MissionHandler.init(MissionHandler.java:94)
        at com.intel.cosbench.driver.service.COSBDriverService.createHandler(COSBDriverService.java:111)
        at com.intel.cosbench.driver.service.COSBDriverService.submit(COSBDriverService.java:82)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:309)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
        at org.springframework.osgi.service.util.internal.aop.ServiceTCCLInterceptor.invokeUnprivileged(ServiceTCCLInterceptor.java:71)
        at org.springframework.osgi.service.util.internal.aop.ServiceTCCLInterceptor.invoke(ServiceTCCLInterceptor.java:54)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202)
        at com.sun.proxy.$Proxy17.submit(Unknown Source)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:309)
        at org.springframework.osgi.service.importer.support.internal.aop.ServiceInvoker.doInvoke(ServiceInvoker.java:58)
        at org.springframework.osgi.service.importer.support.internal.aop.ServiceInvoker.invoke(ServiceInvoker.java:62)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at org.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:131)
        at org.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:119)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at org.springframework.osgi.service.util.internal.aop.ServiceTCCLInterceptor.invokeUnprivileged(ServiceTCCLInterceptor.java:71)
        at org.springframework.osgi.service.util.internal.aop.ServiceTCCLInterceptor.invoke(ServiceTCCLInterceptor.java:54)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at org.springframework.osgi.service.importer.support.LocalBundleContextAdvice.invoke(LocalBundleContextAdvice.java:59)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at org.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:131)
        at org.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:119)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202)
        at com.sun.proxy.$Proxy7.submit(Unknown Source)
        at com.intel.cosbench.driver.handler.SubmitHandler.process(SubmitHandler.java:38)
        at com.intel.cosbench.driver.handler.AbstractCommandHandler.handleRequest(AbstractCommandHandler.java:76)
        at com.intel.cosbench.driver.handler.SubmitHandler.handleRequest(SubmitHandler.java:1)
        at org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:48)
        at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:790)
        at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:719)
        at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:644)
        at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:560)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:710)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:803)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
        at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175)
        at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128)
        at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
        at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
        at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286)
        at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:844)
        at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
        at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)
        at java.lang.Thread.run(Thread.java:724)
2013-10-07 23:08:15,020 [ERROR] [AbstractCommandTasklet] - driver report error: HTTP 500 - null
2013-10-07 23:08:15,021 [ERROR] [StageRunner] - detected tasks [t1] have encountered errors
2013-10-07 23:08:15,021 [INFO] [StageRunner] - begin to terminate stage s3
2013-10-07 23:08:15,025 [ERROR] [AbstractCommandTasklet] - driver report error: HTTP 400 - unrecognized request
2013-10-07 23:08:15,025 [ERROR] [Aborter] - fail to abort driver
com.intel.cosbench.controller.tasklet.TaskletException
        at com.intel.cosbench.controller.tasklet.AbstractCommandTasklet.issueCommand(AbstractCommandTasklet.java:67)
        at com.intel.cosbench.controller.tasklet.Aborter.executeAbort(Aborter.java:51)
        at com.intel.cosbench.controller.tasklet.Aborter.execute(Aborter.java:40)
        at com.intel.cosbench.controller.tasklet.AbstractTasklet.call(AbstractTasklet.java:47)
        at com.intel.cosbench.controller.tasklet.AbstractTasklet.call(AbstractTasklet.java:1)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:724)
2013-10-07 23:08:15,026 [INFO] [StageRunner] - stage s3 has been terminated
2013-10-07 23:08:15,026 [ERROR] [WorkloadProcessor] - detected stage s3 encountered error
2013-10-07 23:08:15,027 [INFO] [WorkloadProcessor] - begin to terminate workload w2
2013-10-07 23:08:15,165 [INFO] [SimpleWorkloadArchiver] - workload w2 has been successfully archived
2013-10-07 23:08:15,165 [INFO] [WorkloadProcessor] - successfully terminated workload w2
ceph@cephclient01:~/cos$
Reply | Threaded
Open this post in threaded view
|

Re: Init and Prepare Complete But Normal Terminates

jrgruher
By the way I am using COSBench 0.3.1.2 on Ubuntu 12.04.2 Server with kernel 3.6.10.
Reply | Threaded
Open this post in threaded view
|

Re: Init and Prepare Complete But Normal Terminates

ywang19
Administrator
In reply to this post by jrgruher
From below error log, cosbench is asking for "/tmp/testfiles/" folder existence, instead of "/tmp/testfile":

2013-10-07 22:57:04,520 [ERROR] [AbstractCommandHandler] - unexpected error
java.lang.RuntimeException: Folder /tmp/testfiles/ does not exist.
        at com.intel.cosbench.driver.operator.FileWriter.init(FileWriter.java:68)
        at com.intel.cosbench.driver.operator.Operators.getOperator(Operators.java:29)
Reply | Threaded
Open this post in threaded view
|

RE: Init and Prepare Complete But Normal Terminates

jrgruher

Thanks for the reply.  That’s a typo in my problem description, I did try creating “/tmp/testfiles”, not “testfile”, but it didn’t help, as shown in the second log.  Regardless it seems unlikely the user is expected to manually create a directory in /tmp for COSBench to run so I assume these are symptoms of some deeper problem.  Any other thoughts?

 

From: ywang19 [via COSBench] [mailto:ml-node+[hidden email]]
Sent: Monday, October 07, 2013 11:15 PM
To: Gruher, Joseph R
Subject: Re: Init and Prepare Complete But Normal Terminates

 

From below error log, cosbench is asking for "/tmp/testfiles/" folder existence, instead of "/tmp/testfile":

2013-10-07 22:57:04,520 [ERROR] [AbstractCommandHandler] - unexpected error
java.lang.RuntimeException: Folder /tmp/testfiles/ does not exist.
        at com.intel.cosbench.driver.operator.FileWriter.init(FileWriter.java:68)
        at com.intel.cosbench.driver.operator.Operators.getOperator(Operators.java:29)


If you reply to this email, your message will be added to the discussion below:

http://cosbench.1094679.n5.nabble.com/Init-and-Prepare-Complete-But-Normal-Terminates-tp57p59.html

To start a new topic under cosbench-user, email [hidden email]
To unsubscribe from Init and Prepare Complete But Normal Terminates, click here.
NAML

Reply | Threaded
Open this post in threaded view
|

RE: Init and Prepare Complete But Normal Terminates

ywang19
Administrator
could you paste your workload configuration file? btw, any special considerations to use "file_write" instead of "write"?
Reply | Threaded
Open this post in threaded view
|

RE: Init and Prepare Complete But Normal Terminates

jrgruher
My workload is basically the default.  I just modified it to include my Swift credentials and hit go.  Hopefully that is valid.

<?xml version="1.0" encoding="UTF-8"?>
-<workload description="sample workload configuration" name="test"><auth config="username=johndoe:swift;password=VcGUJptMUBowYTyrkq5FdcoY3GHVhwky5WX7hiyL;url=http://cephtest06:80/auth/v1.0" type="swauth"/><storage config="" type="swift"/>-<workflow>-<workstage name="init"><auth config="username=johndoe:swift;password=VcGUJptMUBowYTyrkq5FdcoY3GHVhwky5WX7hiyL;url=http://cephtest06:80/auth/v1.0" type="swauth"/><storage config="" type="swift"/>-<work name="init" config="containers=r(1,32)" type="init" totalBytes="0" totalOps="1" rampdown="0" rampup="0" runtime="0" division="container" interval="5" workers="1"><auth config="username=johndoe:swift;password=VcGUJptMUBowYTyrkq5FdcoY3GHVhwky5WX7hiyL;url=http://cephtest06:80/auth/v1.0" type="swauth"/><storage config="" type="swift"/><operation config="objects=r(0,0);sizes=c(0)B;containers=r(1,32)" type="init" division="container" ratio="100"/></work></workstage>-<workstage name="prepare"><auth config="username=johndoe:swift;password=VcGUJptMUBowYTyrkq5FdcoY3GHVhwky5WX7hiyL;url=http://cephtest06:80/auth/v1.0" type="swauth"/><storage config="" type="swift"/>-<work name="prepare" config="containers=r(1,32);objects=r(1,50);sizes=u(64,64)KB" type="prepare" totalBytes="0" totalOps="1" rampdown="0" rampup="0" runtime="0" division="object" interval="5" workers="1"><auth config="username=johndoe:swift;password=VcGUJptMUBowYTyrkq5FdcoY3GHVhwky5WX7hiyL;url=http://cephtest06:80/auth/v1.0" type="swauth"/><storage config="" type="swift"/><operation config="createContainer=false;containers=r(1,32);objects=r(1,50);sizes=u(64,64)KB" type="prepare" division="object" ratio="100"/></work></workstage>-<workstage name="normal"><auth config="username=johndoe:swift;password=VcGUJptMUBowYTyrkq5FdcoY3GHVhwky5WX7hiyL;url=http://cephtest06:80/auth/v1.0" type="swauth"/><storage config="" type="swift"/>-<work name="normal" type="normal" totalBytes="0" totalOps="0" rampdown="0" rampup="100" runtime="300" division="none" interval="5" workers="1"><auth config="username=johndoe:swift;password=VcGUJptMUBowYTyrkq5FdcoY3GHVhwky5WX7hiyL;url=http://cephtest06:80/auth/v1.0" type="swauth"/><storage config="" type="swift"/><operation config="containers=u(1,32);objects=u(1,50);" type="read" division="none" ratio="80"/><operation config="containers=u(1,32);objects=u(51,100);sizes=u(64,64)KB" type="write" division="none" ratio="20"/><operation config="containers=u(1,32);fileselection=s;files=/tmp/testfiles/" type="filewrite" division="none" ratio="0"/><operation config="containers=u(1,100);objects=u(1,100);" type="delete" division="none" ratio="0"/></work></workstage>-<workstage name="cleanup"><auth config="username=johndoe:swift;password=VcGUJptMUBowYTyrkq5FdcoY3GHVhwky5WX7hiyL;url=http://cephtest06:80/auth/v1.0" type="swauth"/><storage config="" type="swift"/>-<work name="cleanup" config="containers=r(1,32);objects=r(1,100);" type="cleanup" totalBytes="0" totalOps="1" rampdown="0" rampup="0" runtime="0" division="object" interval="5" workers="1"><auth config="username=johndoe:swift;password=VcGUJptMUBowYTyrkq5FdcoY3GHVhwky5WX7hiyL;url=http://cephtest06:80/auth/v1.0" type="swauth"/><storage config="" type="swift"/><operation config="deleteContainer=false;containers=r(1,32);objects=r(1,100);" type="cleanup" division="object" ratio="100"/></work></workstage>-<workstage name="dispose"><auth config="username=johndoe:swift;password=VcGUJptMUBowYTyrkq5FdcoY3GHVhwky5WX7hiyL;url=http://cephtest06:80/auth/v1.0" type="swauth"/><storage config="" type="swift"/>-<work name="dispose" config="containers=r(1,32);" type="dispose" totalBytes="0" totalOps="1" rampdown="0" rampup="0" runtime="0" division="container" interval="5" workers="1"><auth config="username=johndoe:swift;password=VcGUJptMUBowYTyrkq5FdcoY3GHVhwky5WX7hiyL;url=http://cephtest06:80/auth/v1.0" type="swauth"/><storage config="" type="swift"/><operation config="objects=r(0,0);sizes=c(0)B;containers=r(1,32);" type="dispose" division="container" ratio="100"/></work></workstage></workflow></workload>
Reply | Threaded
Open this post in threaded view
|

RE: Init and Prepare Complete But Normal Terminates

jrgruher
OK - I figured this out and now I can run to completion!

Here was my problem:
1) Even if the ratio for file-write is set to zero the "file selector" path must exist or the run will fail (as in first set of logs)
2) Even if the ratio for file-write is set to zero the "file selector" path must have some files in it, it can't just be an empty directory, or the run will fail (as in second set of logs)
Reply | Threaded
Open this post in threaded view
|

RE: Init and Prepare Complete But Normal Terminates

ywang19
Administrator
Hi Gruher,

This is an known issue (see https://github.com/intel-cloud/cosbench/issues/118), and it's fixed in 0.3.3.0 branch. we are working on one 0.3.3.0 release, which is expected to be available in two weeks.


regards,
-Y.G.
Reply | Threaded
Open this post in threaded view
|

RE: Init and Prepare Complete But Normal Terminates

jrgruher

Great to hear!  Thanks for the reply.