Simulation of tasks/jobs - Iqbal et al

WORKLOAD GENERATION

in Iqbal et al paper
based on RUBiS open-source benchmark Web application for auctions.

• provides core functionality of an auction site: browsing, selling, bidding for items.
• 3 user roles: visitor, buyer, seller
• Visitor : not required to register, can browse items.
• PHP implementation of RUBiS is used.

To enable RUBiS to support load balancing in the database tier, Iqbal et al have introduced

• round robin scheduling over a set of database servers listed in the db connection settings file.
• they also developed a server side component, DbConfigAgent 
• to update the db connections settings file after a scaling operation has modified the configuration of the file.

• Web server acts as proxying load balancer for entire web application which is run on a tier of virtual web servers and a tier of virtual db servers. 

I download the httperf paper.
downloaded httperf tool.
Open SSL is required to run httperf, so downloaded that also.
Then I downloaded the RUBiS PHP application also.

Also found many workload generators
Olio Workload Generator
C-Mart

After a bit of searching on the net, found this website, that gives workload in standard workflow format.
How to use workload in cloudsim?
So I download the LCG log with .swf.zip format.
Here is the code:

<br /> WorkloadModel r = new WorkloadFileReader("src" + File.separator + "cstest" + File.separator+"LCG-2005-1.swf.gz", 1);<br /> cloudletList = r.generateWorkload();<br /> Iterator<cloudlet> iterator = cloudletList.iterator();<br /> while (iterator.hasNext()) {<br /> <br /> iterator.next().setUserId(brokerId);;<br /> //System.out.println(count+ " "+iterator.next().getCloudletId()+" "+iterator.next().getCloudletLength());<br /> } <br /> broker.submitCloudletList(cloudletList);<br /> <br />
There was a total of 188070 tasks which were submitted as cloudlets. 
It was taking too long so I decided to try using 100 cloudlets...
Here is the sample output... debt still comes as 356, i guess it is so because we are only give cost per unit memory and did not give the time.
So regardless of the time take debt still remains the same.
<br /> Cloudlet ID STATUS Data center ID VM ID Time Start Time Finish Time<br /> 15 SUCCESS 2 4 0.22 19.6 19.82<br /> 52 SUCCESS 2 1 0.22 19.6 19.82<br /> 85 SUCCESS 2 4 0.73 19.6 20.33<br /> 17 SUCCESS 2 6 0.73 19.6 20.33<br /> 37 SUCCESS 2 6 0.73 19.6 20.33<br /> 12 SUCCESS 2 1 0.73 19.6 20.33<br /> 13 SUCCESS 2 2 0.73 19.6 20.33<br /> 70 SUCCESS 2 9 0.73 19.6 20.33<br /> 75 SUCCESS 2 4 0.84 19.6 20.44<br /> 1 SUCCESS 2 0 0.84 19.6 20.44<br /> 21 SUCCESS 2 0 0.84 19.6 20.44<br /> 9 SUCCESS 2 8 0.84 19.6 20.44<br /> 30 SUCCESS 2 9 0.84 19.6 20.44<br /> 80 SUCCESS 2 9 0.84 19.6 20.44<br /> 24 SUCCESS 2 3 0.84 19.6 20.44<br /> 54 SUCCESS 2 3 0.84 19.6 20.44<br /> 64 SUCCESS 2 3 0.84 19.6 20.44<br /> 4 SUCCESS 2 3 1.22 19.6 20.82<br /> 34 SUCCESS 2 3 1.22 19.6 20.82<br /> 44 SUCCESS 2 3 1.22 19.6 20.82<br /> 84 SUCCESS 2 3 1.22 19.6 20.82<br /> 6 SUCCESS 2 5 1.33 19.6 20.93<br /> 87 SUCCESS 2 6 1.33 19.6 20.93<br /> 31 SUCCESS 2 0 1.33 19.6 20.93<br /> 81 SUCCESS 2 0 1.33 19.6 20.93<br /> 91 SUCCESS 2 0 1.33 19.6 20.93<br /> 59 SUCCESS 2 8 1.33 19.6 20.93<br /> 69 SUCCESS 2 8 1.33 19.6 20.93<br /> 89 SUCCESS 2 8 1.33 19.6 20.93<br /> 63 SUCCESS 2 2 1.33 19.6 20.93<br /> 83 SUCCESS 2 2 1.33 19.6 20.93<br /> 93 SUCCESS 2 2 1.33 19.6 20.93<br /> 46 SUCCESS 2 5 1.44 19.6 21.04<br /> 76 SUCCESS 2 5 1.44 19.6 21.04<br /> 18 SUCCESS 2 7 1.44 19.6 21.04<br /> 48 SUCCESS 2 7 1.44 19.6 21.04<br /> 58 SUCCESS 2 7 1.44 19.6 21.04<br /> 43 SUCCESS 2 2 1.44 19.6 21.04<br /> 47 SUCCESS 2 6 1.55 19.6 21.15<br /> 35 SUCCESS 2 4 1.66 19.6 21.26<br /> 57 SUCCESS 2 6 1.66 19.6 21.26<br /> 67 SUCCESS 2 6 1.66 19.6 21.26<br /> 23 SUCCESS 2 2 1.66 19.6 21.26<br /> 60 SUCCESS 2 9 1.66 19.6 21.26<br /> 7 SUCCESS 2 6 1.77 19.6 21.37<br /> 38 SUCCESS 2 7 1.77 19.6 21.37<br /> 39 SUCCESS 2 8 1.77 19.6 21.37<br /> 3 SUCCESS 2 2 1.77 19.6 21.37<br /> 26 SUCCESS 2 5 1.88 19.6 21.48<br /> 28 SUCCESS 2 7 1.88 19.6 21.48<br /> 98 SUCCESS 2 7 1.88 19.6 21.48<br /> 20 SUCCESS 2 9 2.31 19.6 21.91<br /> 73 SUCCESS 2 2 3.72 19.6 23.32<br /> 68 SUCCESS 2 7 4.66 19.6 24.26<br /> 51 SUCCESS 2 0 5.47 19.6 25.07<br /> 27 SUCCESS 2 6 5.58 19.6 25.18<br /> 41 SUCCESS 2 0 5.7 19.6 25.3<br /> 5 SUCCESS 2 4 6.21 19.6 25.81<br /> 56 SUCCESS 2 5 6.47 19.6 26.07<br /> 90 SUCCESS 2 9 6.71 19.6 26.31<br /> 78 SUCCESS 2 7 6.94 19.6 26.54<br /> 32 SUCCESS 2 1 7.05 19.6 26.65<br /> 82 SUCCESS 2 1 7.38 19.6 26.98<br /> 99 SUCCESS 2 8 7.58 19.6 27.18<br /> 95 SUCCESS 2 4 8.47 19.6 28.07<br /> 61 SUCCESS 2 0 8.71 19.6 28.31<br /> 53 SUCCESS 2 2 8.84 19.6 28.44<br /> 65 SUCCESS 2 4 9.21 19.6 28.81<br /> 10 SUCCESS 2 9 9.58 19.6 29.18<br /> 86 SUCCESS 2 5 10.3 19.6 29.9<br /> 16 SUCCESS 2 5 11.23 19.6 30.83<br /> 36 SUCCESS 2 5 11.4 19.6 31<br /> 33 SUCCESS 2 2 15.28 19.6 34.89<br /> 77 SUCCESS 2 6 22.25 19.6 41.85<br /> 19 SUCCESS 2 8 22.36 19.6 41.96<br /> 49 SUCCESS 2 8 22.5 19.6 42.1<br /> 71 SUCCESS 2 0 22.84 19.6 42.44<br /> 2 SUCCESS 2 1 23.55 19.6 43.15<br /> 11 SUCCESS 2 0 23.66 19.6 43.26<br /> 8 SUCCESS 2 7 25.02 19.6 44.62<br /> 88 SUCCESS 2 7 25.2 19.6 44.8<br /> 66 SUCCESS 2 5 26.5 19.6 46.1<br /> 96 SUCCESS 2 5 29.96 19.6 49.56<br /> 14 SUCCESS 2 3 30.82 19.6 50.42<br /> 74 SUCCESS 2 3 31.56 19.6 51.16<br /> 29 SUCCESS 2 8 31.67 19.6 51.27<br /> 79 SUCCESS 2 8 31.79 19.6 51.39<br /> 97 SUCCESS 2 6 32.74 19.6 52.34<br /> 50 SUCCESS 2 9 32.99 19.6 52.59<br /> 40 SUCCESS 2 9 33.34 19.6 52.94<br /> 45 SUCCESS 2 4 33.45 19.6 53.05<br /> 94 SUCCESS 2 3 34.88 19.6 54.48<br /> 188041 SUCCESS 2 9 34.99 19.6 54.59<br /> 55 SUCCESS 2 4 35.26 19.6 54.86<br /> 25 SUCCESS 2 4 35.68 19.6 55.28<br /> 62 SUCCESS 2 1 41.42 19.6 61.02<br /> 22 SUCCESS 2 1 52.48 19.6 72.08<br /> 42 SUCCESS 2 1 53.2 19.6 72.8<br /> 72 SUCCESS 2 1 54.39 19.6 73.99<br /> 92 SUCCESS 2 1 57.25 19.6 76.85 <br />
To be done:
Write the code for provisioning of the resources in the adaptive resource provisioning paper