EMC ECS via DNS access

classic Classic list List threaded Threaded
4 messages Options
Jim
Reply | Threaded
Open this post in threaded view
|

EMC ECS via DNS access

Jim
When I run EMC ECS tests using a DNS endpoint , the workload alwasy terminated at s1-init,

How should deal with this issue?

below is my exception log and workload XML,

Thanks.

--------------------------------------------------------XML--------------------------------------------------------

<?xml version="1.0" encoding="UTF-8" ?>
<workload name="ECS-128workers-100R-128KB" description="sample benchmark for s3">

  <storage type="s3" config="accesskey=ecsuser02;secretkey=Un1JCX9D6eZnfZ3M6C6HGNIRYmU9wbu638fC3S06;endpoint=<a href="http://test.ecs:9020&quot;">http://test.ecs:9020" />

  <workflow>

    <workstage name="init">
      <work type="init" workers="1" config="cprefix=testbucket;containers=r(1,50)" />
    </workstage>

    <workstage name="prepare">
      <work type="prepare" workers="64" config="cprefix=testbucket;containers=r(1,50);objects=r(1,100);sizes=c(128)KB" />
    </workstage>

    <workstage name="main">
      <work name="main" workers="128" rampup="60" runtime="60">
        <operation type="read" ratio="100" config="cprefix=testbucket;containers=u(1,50);objects=u(1,100)" />
      </work>
    </workstage>

    <workstage name="cleanup">
      <work type="cleanup" workers="64" config="cprefix=testbucket;containers=r(1,50);objects=r(1,100)" />
    </workstage>

    <workstage name="dispose">
      <work type="dispose" workers="1" config="cprefix=testbucket;containers=r(1,50)" />
    </workstage>

  </workflow>

</workload>
--------------------------------------------------------XML--------------------------------------------------------


--------------------------------------------------------Log--------------------------------------------------------
---------------------------------- mission: M942F1ACBCA, driver: driver1 ----------------------------------
2016-01-15 09:41:21,010 [INFO] [Log4jLogManager] - will append log to file /root/COSBench/0.4.1.0/log/mission/M942F1ACBCA.log
2016-01-15 09:41:21,025 [INFO] [NoneStorage] - performing PUT at /testbucket1
2016-01-15 09:41:21,039 [ERROR] [AbstractOperator] - worker 1 fail to perform operation testbucket1
com.intel.cosbench.api.storage.StorageException: AmazonS3Exception: Status Code: 403, AWS Service: Amazon S3, AWS Request ID: 0a148e51:15242ce7fef:5a6:13482, AWS Error Code: SignatureDoesNotMatch, AWS Error Message: The request signature we calculated does not match the signature you provided. Check your Secret Access Key and signing method. For more information, see REST Authentication and SOAP Authentication for details., S3 Extended Request ID: null
        at com.intel.cosbench.api.S3Stor.S3Storage.createContainer(S3Storage.java:111)
        at com.intel.cosbench.driver.operator.Preparer.doInit(Preparer.java:113)
        at com.intel.cosbench.driver.operator.Preparer.operate(Preparer.java:87)
        at com.intel.cosbench.driver.operator.AbstractOperator.operate(AbstractOperator.java:76)
        at com.intel.cosbench.driver.operator.Initializer.operate(Initializer.java:1)
        at com.intel.cosbench.driver.agent.WorkAgent.performOperation(WorkAgent.java:197)
        at com.intel.cosbench.driver.agent.WorkAgent.doWork(WorkAgent.java:177)
        at com.intel.cosbench.driver.agent.WorkAgent.execute(WorkAgent.java:134)
        at com.intel.cosbench.driver.agent.AbstractAgent.call(AbstractAgent.java:44)
        at com.intel.cosbench.driver.agent.AbstractAgent.call(AbstractAgent.java:1)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Caused by: AmazonS3Exception: Status Code: 403, AWS Service: Amazon S3, AWS Request ID: 0a148e51:15242ce7fef:5a6:13482, AWS Error Code: SignatureDoesNotMatch, AWS Error Message: The request signature we calculated does not match the signature you provided. Check your Secret Access Key and signing method. For more information, see REST Authentication and SOAP Authentication for details., S3 Extended Request ID: null
        at com.amazonaws.http.AmazonHttpClient.handleErrorResponse(AmazonHttpClient.java:644)
        at com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:338)
        at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:190)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:2974)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:2945)
        at com.amazonaws.services.s3.AmazonS3Client.listObjects(AmazonS3Client.java:478)
        at com.amazonaws.services.s3.AmazonS3Client.doesBucketExist(AmazonS3Client.java:811)
        at com.intel.cosbench.api.S3Stor.S3Storage.createContainer(S3Storage.java:106)
        ... 13 more
--------------------------------------------------------Log--------------------------------------------------------



Reply | Threaded
Open this post in threaded view
|

RE: EMC ECS via DNS access

ywang19
Administrator

Jim,

 

The error indicates the authentication can’t get passed.

 

com.intel.cosbench.api.storage.StorageException: AmazonS3Exception: Status Code: 403, AWS Service: Amazon S3, AWS Request ID: 0a148e51:15242ce7fef:5a6:13482, AWS Error Code: SignatureDoesNotMatch, AWS Error Message: The request signature we calculated does not match the signature you provided. Check your Secret Access Key and signing method. For more information, see REST Authentication and SOAP Authentication for details., S3 Extended Request ID: null

 

btw, I noticed below endpoint definition, it seems not in expected format:

           

endpoint=<a href="<a href="http://test.ecs:9020&amp;quot;">http://test.ecs:9020&quot;">http://test.ecs:9020" />

 

 

-yaguang

 

From: Jim [via COSBench] [mailto:ml-node+[hidden email]]
Sent: Friday, January 15, 2016 10:19 AM
To: Wang, Yaguang
Subject: EMC ECS via DNS access

 

When I run EMC ECS tests using a DNS endpoint , the workload alwasy terminated at s1-init,

How should deal with this issue?

below is my exception log and workload XML,

Thanks.

--------------------------------------------------------XML--------------------------------------------------------

<?xml version="1.0" encoding="UTF-8" ?>
<workload name="ECS-128workers-100R-128KB" description="sample benchmark for s3">

  <storage type="s3" config="accesskey=ecsuser02;secretkey=Un1JCX9D6eZnfZ3M6C6HGNIRYmU9wbu638fC3S06;endpoint=<a href="<a href="http://test.ecs:9020&amp;quot;">http://test.ecs:9020&quot;">http://test.ecs:9020" />

  <workflow>

    <workstage name="init">
      <work type="init" workers="1" config="cprefix=testbucket;containers=r(1,50)" />
    </workstage>

    <workstage name="prepare">
      <work type="prepare" workers="64" config="cprefix=testbucket;containers=r(1,50);objects=r(1,100);sizes=c(128)KB" />
    </workstage>

    <workstage name="main">
      <work name="main" workers="128" rampup="60" runtime="60">
        <operation type="read" ratio="100" config="cprefix=testbucket;containers=u(1,50);objects=u(1,100)" />
      </work>
    </workstage>

    <workstage name="cleanup">
      <work type="cleanup" workers="64" config="cprefix=testbucket;containers=r(1,50);objects=r(1,100)" />
    </workstage>

    <workstage name="dispose">
      <work type="dispose" workers="1" config="cprefix=testbucket;containers=r(1,50)" />
    </workstage>

  </workflow>

</workload>
--------------------------------------------------------XML--------------------------------------------------------


--------------------------------------------------------Log--------------------------------------------------------
---------------------------------- mission: M942F1ACBCA, driver: driver1 ----------------------------------
2016-01-15 09:41:21,010 [INFO] [Log4jLogManager] - will append log to file /root/COSBench/0.4.1.0/log/mission/M942F1ACBCA.log
2016-01-15 09:41:21,025 [INFO] [NoneStorage] - performing PUT at /testbucket1
2016-01-15 09:41:21,039 [ERROR] [AbstractOperator] - worker 1 fail to perform operation testbucket1
com.intel.cosbench.api.storage.StorageException: AmazonS3Exception: Status Code: 403, AWS Service: Amazon S3, AWS Request ID: 0a148e51:15242ce7fef:5a6:13482, AWS Error Code: SignatureDoesNotMatch, AWS Error Message: The request signature we calculated does not match the signature you provided. Check your Secret Access Key and signing method. For more information, see REST Authentication and SOAP Authentication for details., S3 Extended Request ID: null
        at com.intel.cosbench.api.S3Stor.S3Storage.createContainer(S3Storage.java:111)
        at com.intel.cosbench.driver.operator.Preparer.doInit(Preparer.java:113)
        at com.intel.cosbench.driver.operator.Preparer.operate(Preparer.java:87)
        at com.intel.cosbench.driver.operator.AbstractOperator.operate(AbstractOperator.java:76)
        at com.intel.cosbench.driver.operator.Initializer.operate(Initializer.java:1)
        at com.intel.cosbench.driver.agent.WorkAgent.performOperation(WorkAgent.java:197)
        at com.intel.cosbench.driver.agent.WorkAgent.doWork(WorkAgent.java:177)
        at com.intel.cosbench.driver.agent.WorkAgent.execute(WorkAgent.java:134)
        at com.intel.cosbench.driver.agent.AbstractAgent.call(AbstractAgent.java:44)
        at com.intel.cosbench.driver.agent.AbstractAgent.call(AbstractAgent.java:1)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Caused by: AmazonS3Exception: Status Code: 403, AWS Service: Amazon S3, AWS Request ID: 0a148e51:15242ce7fef:5a6:13482, AWS Error Code: SignatureDoesNotMatch, AWS Error Message: The request signature we calculated does not match the signature you provided. Check your Secret Access Key and signing method. For more information, see REST Authentication and SOAP Authentication for details., S3 Extended Request ID: null
        at com.amazonaws.http.AmazonHttpClient.handleErrorResponse(AmazonHttpClient.java:644)
        at com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:338)
        at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:190)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:2974)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:2945)
        at com.amazonaws.services.s3.AmazonS3Client.listObjects(AmazonS3Client.java:478)
        at com.amazonaws.services.s3.AmazonS3Client.doesBucketExist(AmazonS3Client.java:811)
        at com.intel.cosbench.api.S3Stor.S3Storage.createContainer(S3Storage.java:106)
        ... 13 more
--------------------------------------------------------Log--------------------------------------------------------





If you reply to this email, your message will be added to the discussion below:

http://cosbench.1094679.n5.nabble.com/EMC-ECS-via-DNS-access-tp439.html

To start a new topic under cosbench-user, email [hidden email]
To unsubscribe from COSBench, click here.
NAML

Jim
Reply | Threaded
Open this post in threaded view
|

RE: EMC ECS via DNS access

Jim
Hi yaguang,

if use ip to connect ,this accesskey & secretkey is ok.

but, when i use dns name to access , cosbench will show The request signature we calculated does not match the signature you provided.

thanks.
Jim
Reply | Threaded
Open this post in threaded view
|

RE: EMC ECS via DNS access

Jim
sorry, i found problem,
beacause ecs needed to set baseurl.