SPECjbb2005
SPECjbb2005 from SPEC (Standard Performance Evaluation Corporation) evaluates the performance of server side Java by emulating a three-tier client/server system with emphasis on the middle tier. Instead of testing with a possible disk intensive database system, SPECjbb uses tables of objects, implemented by Java Collections, rather than a separate database. A longer description can be found here.
Again, it is not our objective to show the best possible scores. Very few people will take the time to fully tune the JVM and take the risk that some of the ultra aggressive optimizations backfire. So we tested with some decent but rather generic tuning that we could use on all systems. The JVM is Sun's version 1.5.0_08, which allows us to compare scores with previous results.
We tested SPECjbb2005 with four application instances. Using NUMActl, a clever utility written by Andi Kleen, we were able to bind each Java application to each node on our Tyan server. We didn't bind instances to CPUs on the Intel platforms (though it is possible with taskset) as it gives worse performance. The parameters in bold show the actual JVM optimizations.
On the Opteron we used:
The impact of binding each instance to a specific node is less dramatic as what we have seen before, but still, the Opteron scored only 42254 without the use of numactl. The Opterons are in a neck-and-neck race with the dual core Intel's. As this kind of transactional Java application depends quite a bit on the memory interface, the slightly lower integer power of the Opteron is hidden by its faster access to the memory. Nevertheless, it is the Xeon E5345 which wins this race as the use of 4 instances allows the Xeon 53xx to scale well.
SPECjbb2005 from SPEC (Standard Performance Evaluation Corporation) evaluates the performance of server side Java by emulating a three-tier client/server system with emphasis on the middle tier. Instead of testing with a possible disk intensive database system, SPECjbb uses tables of objects, implemented by Java Collections, rather than a separate database. A longer description can be found here.
Again, it is not our objective to show the best possible scores. Very few people will take the time to fully tune the JVM and take the risk that some of the ultra aggressive optimizations backfire. So we tested with some decent but rather generic tuning that we could use on all systems. The JVM is Sun's version 1.5.0_08, which allows us to compare scores with previous results.
We tested SPECjbb2005 with four application instances. Using NUMActl, a clever utility written by Andi Kleen, we were able to bind each Java application to each node on our Tyan server. We didn't bind instances to CPUs on the Intel platforms (though it is possible with taskset) as it gives worse performance. The parameters in bold show the actual JVM optimizations.
On the Opteron we used:
numactl --cpunodebind=$node --membind=$node -- java -cp jbb.jar:check.jar -Xms2g -Xmx2g -Xmn1g -Xss128K -XX:+AggressiveOpts -XX:+UseParallelOldGC -XX:+UseParallelGC spec.jbb.JBBmain -propfile SPECjbb.props -id $x
On the Xeons we used:java -classpath jbb.jar:check.jar -Xms2g -Xmx2g -Xmn1g -Xss128K -XX:+AggressiveOpts -XX:+UseParallelOldGC -XX:+UseParallelGC spec.jbb.JBBmain -propfile SPECjbb.props -id $x
Below you can find the final score that specjbb2005 reports, which is an average of the last four runs.The impact of binding each instance to a specific node is less dramatic as what we have seen before, but still, the Opteron scored only 42254 without the use of numactl. The Opterons are in a neck-and-neck race with the dual core Intel's. As this kind of transactional Java application depends quite a bit on the memory interface, the slightly lower integer power of the Opteron is hidden by its faster access to the memory. Nevertheless, it is the Xeon E5345 which wins this race as the use of 4 instances allows the Xeon 53xx to scale well.
30 Comments
View All Comments
Spoelie - Monday, August 6, 2007 - link
Thanks for the clarification, I was under the impression the only real states were idle (1ghz) and full tilt (3.2ghz). Never seen any other states but all I ever use are the desktop chips, I wasn't aware CnQ could be more dynamic than that.yuchai - Monday, August 6, 2007 - link
I believe all A64 chips including the desktop ones have the different power states. For example my X2 4200+ has 4 states. 1.0, 1.8, 2.0 and 2.2 Ghz.ButterFlyEffect78 - Monday, August 6, 2007 - link
Are they talking about the barcelona?If not, then this is old news.
I'm sure everyone by now knows that intels new cpu's are better then the current AMD opterons.
KingofFah - Monday, August 6, 2007 - link
It really isn't. The were demonstrating the new 3.2ghz opteron. Also, this was a dual socket setup, and anand said, and everyone who monitors the server world knows, that the opterons come out ahead overall in the 4S environment.The more sockets, the more performance advantage opterons have on intel in the server space. This is well known. The purpose of this was to show it in the dual socket environment.
duploxxx - Monday, August 6, 2007 - link
confused, no it is the stupidity of people like you that think that all Intel offerings are better then the ones for AMD.@anand, you're conclusion of the database world that the quadcore still rules..... where are the benchmarks?
now it is nice to see all these benches next to each other, when are you going to combine benches, no longer servers are used for one application, they are more combined these days with more apps. Maybe its time you also have a look at vmware esx etc.... will probably give you a different look at the offerings of AMD these days.
clairvoyant129 - Monday, August 6, 2007 - link
You don't have to get hostile because he does have a point. In the desktop market, Intel is clearly better unless we're talking about low end. Server market, it's still a toss up but Intel still has a lead.yyrkoon - Monday, August 6, 2007 - link
Um, you guys obviously have not been paying much attention have you ?1) AMD CPUs=cheaper
2) AMD CPUs of comparrible speed perform nearly as good if not as good or better than their Intel counterparts. ie: I think you better check the last benchmarks anandtech post 'homie', because I saw a lot of AMD on top of the game benches. (6000+ vs e6600).
3) Yes, a C2D *may* overclock better, and if it is you intention to overclock, it makes perfect sense to buy one, just be prepared to pay more for the CPU.
4) Up until recently, or possibly still happening into the near future, AMD system boards availible often offered more features for less cost. It does seem however with the P35 Chipset, vendors are starting to come around.
5) last, but not least, THIS article IS NOT about desktop hardware now IS IT ?! why bring some stupid lame ass coment into some place that it does not even fit ? GOd, and I thought I needed a new life . . .
Final Hamlet - Monday, August 6, 2007 - link
It is these "but"s, that make the difference.If they exist, you can't state "all Intel CPUs" anymore, because there are exceptions.
ButterFlyEffect78 - Monday, August 6, 2007 - link
I'm sorry everybody.English is my 2nd language so I sometimes can't always express what I want to say.
What i meant to say is that Intel's new line of cpu's based on Core 2 duo tech. are better-(more advanced) then those based on K8 technology. If this is not true then there should not be a reason to introduce the K10 later this year to counterattack core 2 duo/quad.
But again, I could be wrong.
Calin - Monday, August 6, 2007 - link
Core2Duo technology from Intel is better overall than the K8 technology from AMD - this includes basic architecture, current improvements on the initial architecture (K8 is older and has more of those small improvements), and process/production technology.However, Intel lagged in introduction of Core2 based server processors, and even now their FBDIMM technology is slower and hotter (power hungry) than AMD's Opteron/DDR. Until this changes, AMD still has a market in servers, albeit not as good as before the Core2Duo Xeon processors.