Intel "Harpertown" Xeon vs. AMD "Barcelona" Opteron
by Jason Clark & Ross Whitehead on September 18, 2007 5:00 PM EST- Posted in
- IT Computing
Quest Software Benchmark Factory
We mentioned that the benchmarks we previously used are no longer useful, as we did not have the I/O capacity required to support them. We went looking for alternative benchmarks, and stumbled upon Benchmark Factory from Quest Software. Below is a description of the product and the benchmarks we used in this article.
Benchmark Factory for Databases is a performance and code scalability testing tool that simulates users and transactions on the database and replays a production or synthetic workload in non-production environments. This enables organizations to validate database scalability as user loads increase, application changes are made, and platform changes are implemented. Benchmark Factory is available for Oracle, SQL Server, DB2, Sybase, MySQL and other databases via ODBC and Native connectivity.
Benchmark Factory provides many tests you can run, and has a very nice and customizable metric reporting engine. We decided to run the AS3AP test, and the Scalable Hardware CPU, Reads, and Mixed tests. Here is what Quest's help file says about these tests:
AS3AP
The AS3AP benchmark is an American National Standards Institute (ANSI) Structured Query Language (SQL) relational database benchmark. The AS3AP benchmark provides the following features:
Scalable Hardware
The Scalable Hardware benchmark measures relational database systems. This benchmark is a subset of the AS3AP benchmark and tests the following:
We run three iterations of each load point, and then average the results. We also monitor deviations to ensure they are within an acceptable range. We like to see a max deviation of +/- 3%.
Choosing the contenders
In previous articles, we've been asked to explain why we chose the parts we did for an article. For this article Intel sent us their 3.0 GHz Harpertown CPUs. We requested the 3.0 GHz Clovertown CPUs, which are 120 Watt TDP parts, to allow us to do a clock to clock comparison of Harpertown to Clovertown. We also tried to get Harpertown 2.66 GHz or 2.5 GHz CPUs but none were available. These would have provided us with the closest cost comparison to the Opteron 2350's, but it was not possible. We resourcefully acquired two of AMDs newest Opteron 2350's and we requested the Opteron 2222 3.0 GHz Opteron CPUs, which are the highest clock in the 95 Watt TDP envelope. We did review the results of the Opteron 2224SE 3.2 GHz 119W TDP CPUs but their performance was only marginally better than the 2222's and their performance/watt was consistently lower and thus we concluded of less of interest for this article.
We mentioned that the benchmarks we previously used are no longer useful, as we did not have the I/O capacity required to support them. We went looking for alternative benchmarks, and stumbled upon Benchmark Factory from Quest Software. Below is a description of the product and the benchmarks we used in this article.
Benchmark Factory for Databases is a performance and code scalability testing tool that simulates users and transactions on the database and replays a production or synthetic workload in non-production environments. This enables organizations to validate database scalability as user loads increase, application changes are made, and platform changes are implemented. Benchmark Factory is available for Oracle, SQL Server, DB2, Sybase, MySQL and other databases via ODBC and Native connectivity.
Benchmark Factory provides many tests you can run, and has a very nice and customizable metric reporting engine. We decided to run the AS3AP test, and the Scalable Hardware CPU, Reads, and Mixed tests. Here is what Quest's help file says about these tests:
AS3AP
The AS3AP benchmark is an American National Standards Institute (ANSI) Structured Query Language (SQL) relational database benchmark. The AS3AP benchmark provides the following features:
- Tests database processing power
- Built-in scalability and portability that tests a broad range of database systems
- Minimizes effort in implementing and running benchmark tests
- Provides a uniform metric and straightforward interpretation of benchmark results
Scalable Hardware
The Scalable Hardware benchmark measures relational database systems. This benchmark is a subset of the AS3AP benchmark and tests the following:
- CPU
- Disk
- Network
We run three iterations of each load point, and then average the results. We also monitor deviations to ensure they are within an acceptable range. We like to see a max deviation of +/- 3%.
Choosing the contenders
In previous articles, we've been asked to explain why we chose the parts we did for an article. For this article Intel sent us their 3.0 GHz Harpertown CPUs. We requested the 3.0 GHz Clovertown CPUs, which are 120 Watt TDP parts, to allow us to do a clock to clock comparison of Harpertown to Clovertown. We also tried to get Harpertown 2.66 GHz or 2.5 GHz CPUs but none were available. These would have provided us with the closest cost comparison to the Opteron 2350's, but it was not possible. We resourcefully acquired two of AMDs newest Opteron 2350's and we requested the Opteron 2222 3.0 GHz Opteron CPUs, which are the highest clock in the 95 Watt TDP envelope. We did review the results of the Opteron 2224SE 3.2 GHz 119W TDP CPUs but their performance was only marginally better than the 2222's and their performance/watt was consistently lower and thus we concluded of less of interest for this article.
Facebook
Twitter
RSS
77 Comments
View All Comments
Hans Maulwurf - Thursday, September 20, 2007 - link
Barcelona is about as fast as Harpertown in AS3AP. OK.In your article you write:
"The Scalable Hardware benchmark measures relational database systems. This benchmark is a subset of the AS3AP benchmark and tests the following: ..."
Now you choose a subset of this test in which Harpertown is much faster. Obviously AS3AP consist of several substest and you could as well choose one where Barcelona is much faster. But whats the use of this? You tested all subtest together with your AS3AP-Test.
Its the same as testing a game and both CPUs having the same score. Then you choose a subtest(e.g. KI only) where Harpertown is faster and conclude its faster overall.
So what did I miss here? From what I read Barcelona is as fast in AS3AP as Harpi(and should be faster in some subtest and slower in others) while you conclude:
"Intel has made some successful changes to the quad-core Xeon that have helped it achieve as much as a 56% lead in performance over the 2.0GHz Barcelona part."
I dont understand this.
tshen83 - Thursday, September 20, 2007 - link
Did anyone here notice the huge metal bar across the FB-DIMM slots? It must be for more FB-Dimm cooling. Without looking at the server first hand, you can't tell how the metal bar is attached to the memory.My question is this: where can you buy the bar if you were to build a server class PC yourself? And can someone tell me the mounting mechanism.
Viditor - Thursday, September 20, 2007 - link
One other piece of data is missing from the article, and it's looking like it might be important...
Kris Kubicki wrote in his blog
"The 2.0 GHz samples we saw on Monday were of AMD's B1 stepping of Barcelona. But these processors are not the ones we'll see on Newegg's shelves"
"Production Barcelona samples come with the BA revision designator"
"One AMD developer, who wished to remain anonymous for non-disclosure purposes, stated, "B1 versus BA should be at least a 5%, if not more, gain in stream, integer and FPU performance.""
"An AMD engineer, when confronted with the claim, stated that 5% gains when moving from B1 to BA processors "seem conservative.""
Given that, when you guys do the update, could you let us know which stepping it is that you're using? It appears that it may make a significant difference...
JarredWalton - Thursday, September 20, 2007 - link
Remember: 5% performance gains in synthetic benchmarks that stress specific aspects of a CPU don't mean 5% real-world gains.Viditor - Thursday, September 20, 2007 - link
I agree...but that's exacly why I am looking forward to some real-world benches on the production steppings. We still have no idea how shipping Barcelonas perform yet.
Viditor - Thursday, September 20, 2007 - link
Further on that...supposedly the reason for the better performance is fixing some major errata. It's quite possible that the performance boost is across the board and not just in synthetic benches.Schugy - Wednesday, September 19, 2007 - link
You run two benchmarks, you run closed software, you run software that might be optimized for the market leader's processors only, you run software that can't be optimized for the new architecture, you don't benchmark any alpha software that uses rapid virtualization.Maybe we have some benchmark numbers but the real performance of Barcelona is still speculation.
clnee55 - Wednesday, September 19, 2007 - link
AMD is always the underdog. They need superior product to gain market share. That was the case of Athlon vs Netburst. If Barcelona is just competitive, it is not good enough for them to regain the crown. They will stay as underdog.randomname - Wednesday, September 19, 2007 - link
From what I understand, these new (Harpertown) Xeons will not be released until November (12th?). Yet the article makes no mention of it, and by reading it, you would assume you can buy them right now.Or have I understood something wrong?
mutambo - Wednesday, September 19, 2007 - link
Intel systems are power mongers...generate enough heat to replace a room heater.Check out any dual socket systems they are using all kinds of cooling to cool the FB-DIMMs those are the worst part in intel builds.