2012-09-04 22:51:55 GMT
As some of you know I'm currently completing a comparative study of Yesod against ASP.NET for my MSc, and I'm curious to see if anyone has any suggestions for further tests for me to implement. I have completed the standard three (Pong, big-table and static file twice; small and 'smaller'), and I'm scouting around for further tests.
I was toying with the idea of a database query rps test but feel that this is fraught with issue. If I were to standardise the database used (Sqlite3 presumably) then I imagine that the results would be practically identical as the database would effectively be the bottleneck. If I were to use the fastest available for each it would degrade to a simple database comparison.
Ideally these tests will need to be fairly processor light (the online version are using ab with c20 n1000) to avoid ec2 'cpu stealing', but I will be performing a number of them on a larger instance before the end of the project (the end of the month) to allow for concurrency testing.
The four tests completed will be available online (partly so that anyone interested can run the tests themselves and see the results rather than simply read a dry academic paper, and partly as a project req) tomorrow I just need to write the hamlet up for descriptions.
I'd also like to say that my experience with Yesod has been great thus far (it will be a shame to graduate and almost certainly have to work with another framework), and this group has been a great help. I've gone from being relatively new to web-development and with no experience in Haskell at all to writing tutorials in three months, and it's largely down to a great framework and the people here.
Any suggestions are welcome,