Login Consultants release another beta of their freeware TS and VDI benchmarking tool

Last July, Login Consultants released an early beta version of an upcoming freeware tool called Login VSI. This tool is a Windows desktop benchmarking tool that runs a series of workload simulations and produces a relative performance score.

Last July, Login Consultants released an early beta version of an upcoming freeware tool called Login VSI. This tool is a Windows desktop benchmarking tool that runs a series of workload simulations and produces a relative performance score. The idea is that you'd use Login VSI to test various hardware configurations (Would that extra 4GB RAM make a difference?) or to see what the impact would be of going VDI (How much more hardware would I need to support the same number of users with the same scores as I can do now with TS?). Login VSI is the brainchild of Jeroen van de Kamp, the guy who brought us the Flex Profile Kit five years ago and a frequent BriForum presenter, and they've had several employees working on this full-time for many months.

The cool thing about Login VSI (besides the fact that it's free) is that it is now 100% platform independent. You can run the same tests on VDI and TS environments and compare the results head-to-head.

One very important thing to note about Login VSI is that this thing is a benchmarking tool. It is not meant for server sizing. In other words, Login VSI will give you an idea of the relative performance of different platforms or configurations, but it will not tell you how many users you can get on your server in your environment. (The reason for that is simple: The Login VSI tests are pre-built out-of-the-box. If you were able to change them, then the integrity of the benchmark would be compromised. If you want to know how many users you'll be able to get on your specific server in your environment, then you'll need to build your own custom tests and use a product like Citrix EdgeSight for Load Testing.

Login VSI is still in beta, and it can be downloaded for free from the tools area of loginvsi.com. (You must be logged in for the registration link to be active, but creating an account is free. The download is 286MB)

According to Jeroen, this new beta (Version 0.5) has several new features, including:

  • True platform independence (both VDI & SBC) through a powerful custom command line option within the launcher. This includes the possibility to use a CSV file with advanced connection details for each individual session. In other words if you can script the connection, you can use Login VSI.
  • Randomization of user data within each user load loop, this is the most important new feature of this beta as now optimizers (either at a memory or network level) cannot optimize/cache/compress/de-duplicate in an unrealistic fashion.
  • Simplified and centralized configuration of the launcher(s). The ability to setup multiple launchers (master / slaves) for large scale tests is now more straightforward.
  • The installation and configuration of the target platform is now 99% automated. (Only Office requires a manual default installation.)
  • The scripted user workload is now a more realistic loop of 15 minutes. (The previous beta was 6 minutes.) It is now also more dynamic and includes printing to PDF.
  • Many bug fixes and more robust user workload scripting suited for extreme system loads and improved platform support.

Login's hope is that Login VSI can become the standard benchmark for Windows desktop environments--regardless of whether that desktop is a VDI instance, a shared TS desktop, or a local desktop. They're building this thing from the ground-up for this kind of testing, and if anyone can make it happen, they can.

Join the conversation


Send me notifications when other members comment.

Please create a username to comment.

Pardon my ignorance but are they also looking to include a bandwidth or latency monitor? With something like that you could get a true end to end perspective on session perfomance with one tool.
I don't think you'll see that in Login VSI, because again, Login VSI is a benchmarking tool, not a tool to test user experience or do server sizing. And with benchmark tools, you want the test to be as repeatable as possible.
Especially in VDI, if the mouse movement isn't smooth, the video is choppy, and the audio is chripy, what good is a benchmark? How fast you can accomplish a task while sacrificing the user experience?
Login VSI is focused on comparing scalability and performance on a platform level (how much sessions you can run in total) and not the network. We do measure response time within each session, because only this is relevant to compare platforms.For end to end performance analysis you need to investigate other solution like Edgesight.However, you should be able to compare the impact of the protocol on the network, although this is not the primary purpose of Login VSI. For instance, you can run 50 sessions simultaneously through a different WAN optimization solutions and compare the results with network monitoring solutions. From this perspective, you would basically use Login VSI a load generator to do generic analysis of presentation protocols and network components.
Correct, Login VSI is not focused on user experience or protocol performance. Login VSI is about platform scalability using typical business applications. Measuring the response time of applications within the session allows us to consistently compare test scenario's. This also excludes any uncontrollable influence of the network/client.
However, it would be cool to include a multimedia test run. But I doubt Login VSI will ever focus on measuring  user experience or protocol performance, other tools will be much better at this. Most likely Login VSI could be used as an load generator like I just described in my reply to shanetech ealier.


For complete end to end monitoring of your virtual infrastructure or to see the end user experience, you can probably pick some monitoring solution like eG VM Monitor which won the Gold award for Application and Performance monintoring @ VMworld 2008 (Las Vegas). www.eginnovations.com