You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A suggested feature add-on was to include the S3 storage functionality in the compliance suite to make it versatile instead of being focused primarily on the API side validation. This would allow for cloud development validation for TES servers. These test cases would be termed as "functional" test cases, while the existing ones would all be referred as the "logical" test cases.
The methodology followed is -
Get the Server S3 storage credentials and pass them in a config file inside compliance suite.
Access the S3 storage via boto3 SDK.
Create a new bucket for compliance testing.
Write a functional test case involving the S3 file storage.
Validate the result via Get Task and the output files inside S3 to check if the TES server behaved properly.
This feature has already been worked upon and the code is inside the feature/s3-storage branch. Majority of the work is done (i.e. till step 4) The approach used in the current code calculates the result of output files in runtime. However, it was discussed that this is not needed as we can refer the existing pre-stored solutions of a Test and validate the result against them. Therefore, no need to calculate the results in runtime.
Due to lack of time as the GSoC was ending its duration, the feature could not be completed, though its already in a working state for simple functional testcases. To complete the feature, the additional changes required would be as follows -
Modify the test case to involve some output files.
Store the expected correct result of this test case already.
Validate the output files generated via the actual TES server implementation against the stored results.
The text was updated successfully, but these errors were encountered:
A suggested feature add-on was to include the S3 storage functionality in the compliance suite to make it versatile instead of being focused primarily on the API side validation. This would allow for cloud development validation for TES servers. These test cases would be termed as "functional" test cases, while the existing ones would all be referred as the "logical" test cases.
The methodology followed is -
config
file inside compliance suite.boto3
SDK.Get Task
and the output files inside S3 to check if the TES server behaved properly.This feature has already been worked upon and the code is inside the
feature/s3-storage
branch. Majority of the work is done (i.e. till step 4) The approach used in the current code calculates the result of output files in runtime. However, it was discussed that this is not needed as we can refer the existing pre-stored solutions of a Test and validate the result against them. Therefore, no need to calculate the results in runtime.Due to lack of time as the GSoC was ending its duration, the feature could not be completed, though its already in a working state for simple functional testcases. To complete the feature, the additional changes required would be as follows -
The text was updated successfully, but these errors were encountered: