Quantcast

Cosbench driver agent exceptions when running 1000 threads

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Cosbench driver agent exceptions when running 1000 threads

eppo
I'm observing cosbench driver agent errors when running a s3 read job on 64MB objects with a 1000 threads using 4 driver nodes.

Any suggestions how to get around this?

2017-03-10 08:12:58,483 [ERROR] [AbstractAgent] - unexpected exception
java.lang.StringIndexOutOfBoundsException: String index out of range: 12
        at java.lang.String.substring(String.java:1963)
        at com.intel.cosbench.driver.operator.AbstractOperator.isUnauthorizedException(AbstractOperator.java:134)
        at com.intel.cosbench.driver.operator.Reader.doRead(Reader.java:102)
        at com.intel.cosbench.driver.operator.Reader.operate(Reader.java:69)
        at com.intel.cosbench.driver.operator.AbstractOperator.operate(AbstractOperator.java:76)
        at com.intel.cosbench.driver.agent.WorkAgent.performOperation(WorkAgent.java:197)
        at com.intel.cosbench.driver.agent.WorkAgent.doWork(WorkAgent.java:177)
        at com.intel.cosbench.driver.agent.WorkAgent.execute(WorkAgent.java:134)
        at com.intel.cosbench.driver.agent.AbstractAgent.call(AbstractAgent.java:44)
        at com.intel.cosbench.driver.agent.AbstractAgent.call(AbstractAgent.java:1)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)

 
      <workflow>
           
                    <workstage name="Read 64MB" closuredelay="30">
                        <work name="main" type="normal" interval="5" division="object" rampup="30"  rampdown="30" runtime="300" workers="1000" totalOps="0">
                            <operation type="read" config="cprefix=bucket-rf3; containers=s(1,1); oprefix=run1-10-64m; objects=r(1,10000)"/>
                        </work>
                    </workstage>
                   
                   
                    <workstage name="Write 64MB" closuredelay="30">
                        <work name="main" type="normal" interval="5" division="object" rampup="30"  rampdown="30" runtime="300" workers="1000" totalOps="0">
                            <operation type="write" config="cprefix=bucket-rf3; containers=r(1,1); oprefix=run1-1000-64m; objects=r(10001,20000);sizes=c(64)MB"/>
                        </work>
                    </workstage>
   
                </workflow>
     
            </workload>
 
Please let me know, thanks!

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: Cosbench driver agent exceptions when running 1000 threads

cshreyas
I am seeing this with just 10 users. Does anyone know the rootcause?
Loading...