NVIDIA GeForce 9800GX2 Review - Benchmarking

Article Type: 
Review

I don't know exactly how other sites and magazines test hardware. But, I do know that they do it as a full-time job, and have a lot more equipment and time at their disposal. They are also "on the hook" to provide a consistent testbed for products from different companies, and to provide a consistent testbed across weeks and months. I can assure you that my testing methods weren't as stringent as those reviewers, but I do believe they reflect a real-world look at the hardware.

As mentioned earlier, I ghosted a drive with a clean install of WinXP SP2. I then updated that install with the latest Windows patches (just prior to SP3), and the latest drivers and BIOS from ASUS (mobo), NVIDIA and Creative Labs. I then installed every game that I was considering for this benchmarking exercise. Then, I began the benchmarking.

I didn't go through and strip Windows down to a limited set of drivers and services. On the contrary, I had a "normal" (but clean) install of Windows running, along with my "normal" run-down of programs such as Steam, AVG Anti-Virus, X-Fire and FRAPS.

Also, unless I needed to, I didn't restart the game and/or the machine during each test. Some games, like Oblivion, require a restart to change the resolution; and some games like World in Conflict showed diminishing numbers between runs, if the machine wasn't rebooted. But, for games like LOTRO and Bioshock, I simply ran one test after the other. Details on each benchmark process is outlined for each game.

Also, everything was run at stock clocks and speeds. Nothing is overclocked.

Total Pixel Counts

This graph shows the total pixels at each resolution. The resolutions are listed by the total pixel count. I have included all the common 4:3, Widescreen and Surround Gaming resolutions. The resolutions covered are:



Looking at the graph, there are four "areas" of pixel count. There are:


Total Pixels


Total Frames Pushed

I saw this type of chart used somewhere else, and I thought it was interesting. This shows the total about of (average) frames pushed though each game, at each resolution. These charts show that the 9800GX2 delivers a sizable performance increase over the 7950GX2 (as we would expect). The first chart shows us that the much of the growth comes in games like World in Conflict and Bioshock, and not from games like Half Life 2.

Looking at the second chart, we can then see where the improvement comes in for each game. We can easily see that Bioshock is seeing significant improvements across the board, but Half Life 2 only picks up significant improvements at the top resolutions. And while World in Conflict only pics up 250 frames in total, it is almost double the previous performance.

Total Pixels

Total Pixels

NVIDIA GeForce 9800GX2 Review - Benchmarking Bioshock

Article Type: 
Review

Bioshock is a relatively new game, having released in August of 2007. The game itself was lauded for its art direction, and its graphics execution. With the 7950GX2, Bioshock was obviously GFX limited, with a relatively flat, downward-sloping line. It didn't show any of the "dips" for the high aspect ratio resolutions, like those in Surround Gaming. Move to the 9800GX2, and you see a dramatic improvement, and you being to shift the limits from the GFX to the CPU.

With the 9800GX2, we see a dip in fps at 2400x600, the first Surround Gaming resolution. We also see the characteristic uptick at 1280x1024 (the 5:4 aspect ratio is the narrowest available). Performance wise, the 9800GX2 shines across the board. A the low end, increases of 100fps are common, often increasing performance by 1.5x to 2x. The middle resolutions bring the fps increases down to the 80-90fps range, but the 9800GX2 still pushes 110-150fps across that range. In the 4M pixel mark, we see increases to the tune of 50fps (+250%), and we cross the holy grail o 60fps.

All settings were maxed out, and the "Horizontal FOV" was unlocked, making the game Hor+. To test Bioschock, I played the game from the opening crash scene, into the bathysphere, and let the bathysphere take it's ride into Rapture. It was basically from the green loading screen, to the red loading screen. This test scenario provided a consistent gameplay experience, that was suitable for benchmarking. However, it may not be indicative of "real" gameplay.

The opening section in the water had few objects and was largely dark sky (though it did have good fire and water effects), and the bathysphere section had a fixed "viewport" for looking out into the gameworld. This last issue's effect may have been that it limited objects from being in the FOV areas covered by widescreen or Surround Gaming aspects.

Bioshock


NVIDIA GeForce 9800GX2 Review - Benchmarking Company of Heroes

Article Type: 
Benchmark

Company of Heroes includes an in-game stress test as well. It is a "movie" rendered in real-time, using the in-game engine. The movie is anamorphic, and it letterboxes in 4:3 or 5:4, and pillarboxes in Surround. It appears to be locked at 60fps.

The 7950GX2 struggled with the test, and posted diminishing numbers as the pixel count increased. With the 7950GX2, the game is obviously GFX limited.

The 9800GX2 completely turns the table, and the demo maxes out at 60fps across the board. Two of the Surround resolutions did clock in at 61fps. My best explanation for this is that the large black areas (the pillarboxing) helped bump the fps just above 60.

The test was run with everything on max settings. But, considering the limited nature of the test, I don't find it a true benchmark of the 9800GX2's real performance. The 9800GX2 performed significantly better across the board, but I am left wondering how well it truly could have performed.

Company of Heroes


NVIDIA GeForce 9800GX2 Review - Benchmarking Elder Scrolls IV: Oblivion

Article Type: 
Review

The 9800GX2 added 4-6fps at the low end, which equates to almost a 10% increase. In the mid-range the performance increase grows, adding 10-15fps. The equates to a 25%-33% increase. The 4M pixel range adds 20-25fps, which is right at a 100% increase. The 9800GX2 certainly improves performance at the higher end, keeping the average frames at a playable 50fps.

But, after tooling around Oblivion for a bit, I have to say I am dissapointed - not in the 9800GX2, but in Oblivion. The game seems to have some sort of 60fps cap on it (after Googling, I found a number of people who think the same thing), and the game "chunks" at the same point every time. Even with the 9800GX2 at the lowest resolutions, I could still bank on the spots where the frame rate would "hitch" and go south of 30fps. That, and I hate wolves. I don't know how many times I had to re-start a run, due to some damn wolf that chased me for miles.

Oblivion is a punishing game, and there are fan-made mods that make it even more so. I installed all of the "highly recommended mods" from Tweak Guide's extensive article on Oblivion (even the 2GB of high quality textures). I then downloaded an end-game save, so I could teleport around to find a good run, where I could put the cards through their paces.

I found a nice long run (about six minutes), that crossed a large lake outside the capitol, then circled through the woods, and ended at a look-out over the same lake (looking at the capitol). This run goes through a tone of foliage and scenery, and I was able to hit some cloud cover that changed the entire light map from normal sunlight to a red hue. That was pretty cool to watch. I still hate wolves, and I don't know why they chase a fully armored knight for what seems like miles, and I don't know why a few swings of a sword doesn't put them down.

Oblivion


NVIDIA GeForce 9800GX2 Review - Benchmarking Half Life2: Lost Coast

Article Type: 
Review

Up through 2.5M pixels, the 9800GX2 gained between 4-11fps. The smallest increases were in the TH2Go resolutions, which all hit 130fps with the 9800GX2. And, all of the TH2Go resolutions hit right at 130fps. So, even though 3840x1024 has over 4.25x the pixels of 2400x600, the performance is dead even.

The 9800GX2 really starts to shine in the 4M pixel area, adding 43fps (+50%) to 3840x1024, and adding 56fps (+63%) to 2560x1600. If HL2 is your game, and you play at less than 4M pixels, the increased performance in between the GX2 generations will be negligible. But, if you are playing at 4M pixels, the performance increase is astounding. With the 9800GX2, Half Life 2 basically becomes CPU-limited.

This test was run using the built-in stress test, in Half Life 2: Lost Coast. It provides a set course through a number of environments, showcasing particle, lighting and water effects. It also showcases HDR, which was added to Half Life 2 with the Lost Coast expansion. All of the settings were maxed out. It was run with Full HDR, 4xAA/16xAF, and V-sync off.

HL2 Graph


NVIDIA GeForce 9800GX2 Review - Benchmarking Lord of the Rings Online

Article Type: 
Benchmark

Lord of the Rings Online is a pretty game, and cranking up the settings only helps to reinforce that. The 7950GX2 posted decent fps across most of the spectrum, especially considering that I had the game running on "Ultra High" settings. With the 7950GX2, the game stayed above 60fps on the low end, and tread between 45-60fps in the middle sections. The high end brought it down to under 30fps. While fps isn't critical for an MMO, this test was purely a "scenery" test, and combat with all of its action and particles would certainly bring the scores down even further.

The 9800GX2 tracked right along with the 7950GX2 in the low end. It started to separate itself at 1440x900, and produced a significant performance gap 1680x1050 and beyond. Between 1680x1050 and 1920x1200 (the mainstream of widescreens), the 9800GX2 added 20-30fps. This represented a 30%-60% increase, basically 1/3 - 2/3 more frames. The performance delta pinched a bit at 3072x768, with the 9800GX2 being hit with the super-wide aspect of Surround Gaming; and considering the 7950GX2 still posted average framerates above 40fps at this resolution. But, performance more than doubled at the 4M pixel mark, with the 9800GX2 averaging 67fps at 2560x1600.

For the test, I tried to find a place where I could make a run, and not be molested by wandering mobs or high traffic. I found a place at the Hunting Lodge, outstide of Archet. This is right outside the starting area in Breeland. I picked a run that would highlight some water effects, along with some foliage. It's not necessarily impressive, but it was repeatable; it still managed to showcase a good performance gap in the cards. The test was run with settings at "Ultra High" with 4xAA. Just to show how punishing the "Ultra High" setting is, when dropping the setting to "Very High," my frames at 2560x1600 jumped from 67fps to 90fps+. That represents a 50% performance increase, with just a slight decline in the visuals.

LOTRO


NVIDIA GeForce 9800GX2 Review - Benchmarking Overlord

Article Type: 
Review

For me, Overlord is a guilty pleasure. I haven't gotten very far in the game, but I love being the bad guy. I also find Overlord to be a very pretty game. Even though it doesn't have the lifelike foliage of LOTRO, or the mind-numbing amount of textures in Oblivion, it will puts a video card through its paces. Overlord responded to the 7950GX2 about how I would expect, with valleys at the Surround resolutions, a peak at 1280x1024, and a downward trend at the 4M pixel range. What did surprise me is that the game is still demanding enough to be GPU limited on the 9800GX2, even at the low-end of the pixel scale.

The 9800GX2 added 7-12fps across the board. Depending on the original fps from the 7950GX2, this represented a 25% (at 1024x768) to 50% (at 2560x1600) jump in framerates. The two trend lines have virtually the exact same shape, the line for the 9800GX2 happens to be "bumped" up a bit. The 9800GX2 brings the low end of the scale north of 50fps, the middle ground into the 40's, and the high-end to 30fps. All in all, it makes the game much more playable.

I played the game long enough to pass the training and intro mission. This allowed me to enter into the game world and pick a free roaming path. I found a rather short path that allowed me to wind though the countryside, catch a sunset, and some particle effects. Like LOTRO, it's not a long run; but it is long enough to put both cards through their paces.

I ran the game at max settings with 4xAA and V-sync off.

Overlord


NVIDIA GeForce 9800GX2 Review - Benchmarking World in Conflict

Article Type: 
Review

Like Half Life 2, World in Conflict comes with a built-in benchmarking tool. The tool plays a set series of animations, using the game's engine. The 7950GX2 supplied passable (>20 fps) framerates at 1280x1024 and below. Beyond that, framerates plateaued at 15fps and then bottomed out in the single digits at the 4M pixel mark.

The 9800GX2 provides significant improvement across the board, with the frame rate delta increasing as the pixel count grows. At 1024x768, we see a 9fps (+35%) improvement; while at the high end (3840x1024 and 2560x1600), we see a 19fps (+211%) improvement.

No matter what resolution you play at, the 9800GX2 provides a worth while investment. If you play at the higher resolutions, you the bang is better for each buck.

This test was run using the built-in stress test. All setting were maxed out. It was run with 4xAA and V-sync off.

WIC