Hardlimit test bank

[krampak]

I just uploaded another HP NUC like that (I'm still finding variants xD), this time an i3 4030U.

[rul3s]

I just uploaded a 2600x something a bit higher in revs
https://bm.hardlimit.com/result.php?bm=781be25ee54bb41e7440f5e2fac6559b1573

[krampak]

@rul3s said in Hardlimit test bench:

I just uploaded a 2600x that was overclocked a bit
https://bm.hardlimit.com/result.php?bm=781be25ee54bb41e7440f5e2fac6559b1573

How less curious

Ah, I haven't said anything, I didn't remember that the 1800 is 8/16.

[cobito]

Upon reviewing, I realized I had an interesting lineup of micros

@magog I was going to say that this model was already validated by @Namiga a year ago, but I went to compare the results and it seems that yours is quite a bit faster. Namiga's was at 2.8GHz when it ran the test and yours was 18% faster: at 3.3GHz. This can be attributed to limitations in the manufacturer's BIOS or something running in the background. But your CPU is pulling double the multi-threaded score. Looking at the performance per MHz of the architecture, it seems your result is quite close to other models like the 6500U, so your submission becomes a pretty representative sample of that model.

In another CPU lineup, Namiga brings us a Ryzen again, this time with integrated graphics. It's a Ryzen 5 2400G, a Zen (plain and simple) with 4 cores, 8 threads, and a maximum frequency of 3.9GHz. The composition of single and multi-threaded performance as well as in modes 0 and AVX2 doesn't resemble any AMD CPU and the Intel CPUs that appear in the comparison are very varied: from an "exotic" i5-5675R to the i7-4790K and all with big differences. Surely, the most interesting thing about this CPU is the integrated GPU although unfortunately we have no way to evaluate that. To not leave the analysis too bland, perhaps it's interesting to see what it resembles in each area:
· In single-threaded mode in FPU mode, the closest is the Core i3-7100.
· In single-threaded mode in AVX2 mode, it resembles the Core i7-4790
· In multi-threaded mode in FPU mode, it has some similarities with the Core i7-7700
· And in multi-threaded mode in AVX2 mode, it almost matches the aforementioned i5-5675R.

And to finish this round, as @krampak said, he's back with his NUCs. We are faced with an i3-4030U, a Haswell from the U series that was discontinued not too long ago. As a good U series, it comes with its TDP at 15W, which won't be a problem for its performance because its 2 cores (with HT) run at a fixed frequency of 1.9GHz. The processor turned out to be the slowest CPU in AVX2 mode of all the ones we have. In fact, the list of similar CPUs seems to have gotten a bit mixed up with the comparison. In summary, in FPU mode it's comparable to processors not of very high range of the old Wolfdale architecture. In AVX2 it's even below an AMD A9, which is nothing more than a Exacavator portable APU. That's right; the last one on the list. Although not to be too unfair to Haswell, that APU needed practically double the frequency to achieve similar performance.

Edited: By the way Krampak, the Xeon from Windows 2008 without R2 I added to the database but it shouldn't appear because the frequency was measured incorrectly in all tests (it measures 800MHz). I don't know if it's a problem with that Windows, that the machine is excessively loaded or some hardware issue (high temperature, incorrect configuration, etc).

[rul3s]

After this piece of news we will have to see how the 1903 affects the Ryzen with this benchmark.

[kynes]

@rul3s said in Hardlimit Test Bench:

After this piece of news we'll have to see how the 1903 affects the Ryzen with this benchmark.

I understand that in theory it shouldn't affect much, since the novelty is that instead of separating the threads as much as possible to avoid hot spots, which hindered communication between threads, now they will bring them together as much as possible, occupying a CCX before starting to "deposit" threads on the other, because of the way games are developed. From how the bench should work, I understand that with independent threads that don't communicate with each other because of the type of calculation they have to perform, the result shouldn't vary much.

[Fassou]

I passed the test to a laptop that's a few years old, and I see that the micro (4702MQ) was not, and it links to the datasheet of a Pentium

The second one in the list https://bm.hardlimit.com/search.php?s=4702

Best regards!

[cobito]

@fassou It's already added. It's a 2013 Haswell. It has 4 cores with HT, a max frequency of 3.2GHz, and a TDP of 37W. With the data available, the most similar CPU is an i5-4440, which makes sense considering that they are contemporaries with very similar specs. Although the MQ has a TDP of less than half that i5, which is surprising since in multi-thread, the i5 only beats it by 12%. Going to slightly different processors, the i3-7100U that came out 3 years later, has very similar single-thread performance.

[cobito]

The day before yesterday, @krampak brought an i7-7700HQ at stock frequency for the first time, even though there were already results at a lower frequency. I realized that some manufacturers (in my case Dell), limit the speed of the i7 HQs, I imagine for thermal reasons. I have a couple of i7-6820HQs here but since they are capped at 3.2Ghz, they are excluded from the statistics.

To the point: the 7700HQ is a portable processor with 4 cores and HT that reach 3.8GHz. With its 45W TDP, it manages to match the performance of an i5-7500, which is practically the same except that the desktop processor allows a higher TDP and does not have HT.

In the overall ranking, it appears in sixteenth position for single-thread and in twenty-third for multi-processing although if I'm not mistaken, it is the second in both rankings in portable CPUs.

[kynes]

@cobito said in Hardlimit test bench:

The day before yesterday, @krampak brought for the first time an i7-7700HQ at stock frequency, even though there were already results at a lower frequency. I realized that some manufacturers (in my case Dell), limit the speed of the i7 HQs, I imagine for thermal reasons. I have here a couple of i7-6820HQs but since they are capped at 3.2Ghz, they are excluded from the statistics.

To the point: the 7700HQ is a portable processor with 4 cores and HT that reach 3.8GHz. With its 45W TDP, it manages to match the performance of an i5-7500, which is actually practically the same except that the desktop processor allows a higher TDP and does not have HT.

In the general ranking, it appears in the sixteenth position for single-thread and in the twenty-third in multi-processing although if I am not mistaken, it is the second in both rankings in portable CPUs.

When comparing with the i5-7300HQ (my laptop) I am surprised by the similarity in the results, is it possible that this 7700HQ had HT disabled?

https://bm.hardlimit.com/compare.php?cpu1=Intel(R)-Core(TM)-i7-7700HQ-CPU-@-2.80GHz-591593&cpu2=Intel(R)-Core(TM)-i5-7300HQ-CPU-@-2.50GHz-591593

[cobito]

@kynes I obtained the data for what I'm about to comment from these results for the 7300HQ and the 7700HQ, both the best results in AVX2.

The 7700HQ has a frequency 8.5% higher than your 7300HQ while the former beats you by 5.4% in single-core. In principle, being the same architecture with everything identical except the frequency, a linear increase in performance should be obtained to the frequency, but this is not the case. If we look at the results of each test individually, both micros get a score per MHz very similar in the first three tests in single-core. The difference occurs in test#4 (the memory test).

7700HQ

7300HQ

When we go to multi-core, important differences begin to be noticed in tests #1 to #3. And in test #4 (memory), your PC gets 3 times more performance than @krampak's. When we look at the hardware details, we see why this might be happening: your laptop is using two memory slots while @krampak's is only using 1. That is, your PC is probably using dual channel while Krampak's is not.

That you get triple the performance in memory I think is not explained only by having dual channel, so there must be other variables: perhaps different chipsets, different latencies, BIOS with different characteristics or whatever: yours is an MSI and Krampak's is an HP so you go figure out what they've caught or stopped catching.

[kynes]

@cobito But my doubt is more about the absence of notable differences between a 4-core processor like the 7300HQ vs an 8-core processor like the 7700HQ. I understand that one should notice a noticeable difference by having hyperthreading activated, right?

[cobito]

@kynes I have seen few models where HT brings a noticeable improvement. I specifically set the mmt ratio so that I could evaluate HT/SMT. You can see the value in the multi-threaded results column in brackets. It is the ratio of the multi-threaded result per thread (that is, the multi-threaded result divided by the number of execution threads) and the single-threaded result of the same test. In a processor without HT (where one process runs per physical core), the result should be 1 (or close to 1): this means that by running multiple threads, the performance of each core is the same as if a single thread were running on one of them. If two threads were run per core without HT/SMT, the result should be 0.5, which is that the performance of each thread is 50% of that obtained in the single-threaded result. In one with HT, it should be higher than 0.5 since that would mean that the performance of several threads executed on a physical core is higher than the performance of a single thread executed on a physical core. But the truth is that in few processors have I seen HT results that substantially exceed that 0.5.

In this result of the i7-4790k or in this one of an i7-7700k, you can see a ratio of about 0.6 in tests 2 and 3. This means that in the i7-4790k, HT can increase performance by 20% compared to not having it. It is possible that this lack of tangible results from hyperthreading is a flaw in the design of the benchmark or that HT is nothing more than a gimmick that slightly improves performance only in some models; the benchmark in this aspect is quite simple since all it does is run several processes in parallel and evaluate the result of each one separately and then sum all the results.

Regarding the result of the 7700HQ in particular, I believe that the memory is acting as a bottleneck there. Perhaps more results and more diverse machines would be needed to draw clearer conclusions.

[cobito]

Bueno, bueno, bueno. Pues @hAyO has brought us the first Zen 2. It's the Ryzen 7 3700X and you can see the results on the front page.

[krampak]

Does @cobito still have the offline version (usb) of the benchmark available? I have a Celeron N4000 1.1Ghz but Windows 10 in S mode won't let me run hlbench xD

[cobito]

@krampak Yes, the link is in the thread of the Live-USB. The only drawback of that version is that it is not compatible with AVX. But for that N4000 it will not be a problem.

[cobito]

The first update in over a year is here. It's a small thing that I decided to change while reviewing the code to remember it and it has been possible thanks to all the models that you have uploaded during this time: from now on, the main page will switch from showing the top 50 to the top 100 processors.

At the end of the first message of this thread, I have made a wishlist of what I would like to add and improve in the benchmark after the summer. If you come up with something else, say it.

[cobito]

@rul3s brought us a new portable CPU yesterday: an i5-9300H that is mounted on an Asus Rog Strix G531GT.

It is a 4-core Coffee Lake with HT that can reach 4.1GHz while maintaining a TDP of 45W. For a portable processor, its performance is really good and is comparable to desktop micros that are not as old as the i7-7700.

According to the result that has been sent, in the best case, the Hyperthreading of this micro improves performance by 20% compared to not having it. And in the worst case, performance increases by 12%, which is within the usual range whenever it has been possible to measure this improvement. In fact, the most similar model we have is an i3-8350K; one of the first Coffee Lakes whose TDP doubles that of the i5-9300H.

In the general ranking, it is in twelfth place in single-thread and in seventeenth in multi-thread. Seen from another perspective (considering only portable processors) and if I'm not mistaken, it takes the silver medal in both rankings, only surpassed by the i7-8750H.

[cobito]

An anonymous user has brought us an Celeron N3150. It is an Airmont, that is, the architecture used in Atoms. Its performance is not great, comparable to Core processors from the LGA775 era in single-threaded mode, although in multi-threaded mode (and especially in SSE3), its performance approaches that of Haswell portable processors, and this with a ridiculous TDP of only 6W. In reality, it is very difficult to compare because the simulated processors differ a lot when looking at the single/multi-threaded table and in different modes.

This CPU comes mounted on micro ITX boards for basic desktop PCs and possibly its biggest drawback is the fact that to obtain more or less decent performance (it is a 2015 micro, so it has probably been sold until recently, if not still found out there), it is necessary to be able to get the most out of its 4 cores, something that is a bit complicated given the field to which it is directed (basic tasks: office work, web browsing, HTPC...).

In another order of processors, @NakedCOOL, who dropped by a few days ago to say hello, left us a result of an AMD FX 8320. It is a Piledriver from 2012 with no less than 8 cores and a turbo frequency of 4GHz. Its performance is really complicated to compare since the architecture was not great (in single-threaded mode we have to go to contemporary portables) while its 8 cores allow it to be at a similar level to the mid-range desktop range of the era.

[cobito]

@NakedCOOL has brought us a kind of rarity as it is a single-core Athlon II that was marketed in 2010. I am not too sure about the end of the single-core era on the desktop, but this must have been one of the last models (someone correct me if I am wrong).

It is impossible to compare as its single core has a performance similar to the first processors of the Core era. Of those I have found a model (that is not in our database) that is a Peryn Core 2 Solo, appeared a year before this one. Coincidentally, the most similar model is also a Peryn, but with two cores so this Athlon II is possibly a competitor of the ephemeral Core 2 Solo. Looking a little more, Intel only released 4 models of this type, the last one from 2009. The models are the Core 2 Solo ULV U2100, ULV U2200, SU3300 and SU3500. After those, I do not see anything else single-core from Intel for desktop or laptop. Now, in October 2013 appeared the last Intel processor of a single core that I have found: the Atom E3815 intended for industrial and automotive fields.

Looking for AMD processors and more specifically about the Sargas core (like the one in this Athlon II) it turns out that there are only two models: this one and the Sempron 150, both from the same date. So yes, this Athlon II 170u is one of the last of its kind.

Its performance, as I have said, is comparable to one of the two cores of the Core 2 Duo T6600.