Play free puzzles         Create free account         Instructions         Discussion forum         Log in    

Show only:

Click on column headings to sort.

Dr Gareth Moore author website
Dr Gareth Moore.com
View my new and upcoming books, plus selected previous titles

View Dr Gareth Moore's YouTube channel
@DrGareth on YouTube
Join me as I solve escape room boxes and puzzles

View Dr Gareth Moore's Twitter feed
@DrGarethMoore on Twitter
View my daily word and number puzzles

Get
Brained Up, daily online brain training site
BrainedUp.com
daily online brain training
Cutting-edge brain training created by
Dr Gareth Moore
Think faster, better,
and improve your mental capabilities

   

Back to the forum

Comments and Results for 'Hanjie 879: Nailing it'

StateTypeTitleSizePlayedAvg timeRating (#users)YoursYour bestPublishedExpires
UnplayedHanjieHanjie 879: Nailing it25x2013220:03Moderate (78)Subscribers only21st Apr-
Show full chart rankings for Hanjie 879: Nailing it
Your puzzle statistics First solution time distribution Overall puzzle statistics
Log in (or create a free user)
to store and view your puzzle statistics
Slowest 10% not shown
0:00
36:32

Solution time without 'show wrong'
0:00
36:43

Unaided first solution time
0:00
26:41
Completed by117 users
Best time without any aid10:35 by winterer
Average solve time with no or minor aid16:56
Average solve time with no aid17:34
Average difficulty rating - all players3.3/10.0
Average difficulty rating - no aid2.7/10.0
Average difficulty rating - show wrong or
multiple sessions
2.7/10.0
5 comments (Add new comment)
Posted 21st Apr 2023 at 07:46
Maartje Daily subscriber Has not played this puzzle yet
Hi Gareth!
I see this puzzle has been rated 9 times now: 6 x moderate, 2 x easy and 1x hard. But the average rating in the table above is 'hard' - it does not seem to add up.
Posted 21st Apr 2023 at 16:05
Last edited by gareth 21st Apr 2023 at 16:16
gareth Administrator Daily subscriber Has not played this puzzle yet
For about six months the average rating presented has been weighted based on my own analysis of 15 years of user ratings, so they no longer reflect a literal average of ratings but rather a perceptual rating based on how people rate puzzles in reality compared to the actual puzzle's difficulty. I've found that this provides a much truer reflection of actual difficulty levels. A true (mean) average unfortunately almost always rated every puzzle 'easy', no matter how hard it actually was.

Based on the counts you list, a true mean average would be 'moderate' but the analysis shows that for a puzzle to average 'moderate' among user ratings it is likely to actually be 'hard'. Now it has been rated by more users than when you posted your comment, the rating has dropped to 'tricky' which (while obviously subjective in some respects) is intended to convey a tougher-than-average difficulty which is still easier than 'hard'. So essentially the mean average is re-mapped to provide the reported average. There is inevitably some noise when only a few people have rated a puzzle and the averages do usually settle down after 20 or so ratings. Also, now the displayed ratings pre-play are more realistic, it's possible people react to a claimed average they disagree with and rate puzzles easier/harder than they otherwise would (although I haven't looked to see if that's the case). It also possibly encourages users to pay more attention to how they rate a puzzle. Either way they tend to stabilize at a rating I broadly agree with. That's in my opinion a huge improvement over how it used to work.

Another underlying issue is the design of the site which misleadingly presents ratings without making it clear they are user-derived, so people used to wonder why every puzzle was 'easy' - it's something I should have changed years ago, and I honestly don't know why it took me so long to apply this update! :) Or perhaps I do - it's because I knew what the averages meant and didn't think about how they would come across to a new user.

But yes, because the site still shows the exact breakdowns of ratings, and a numerical average too, the end result does appear inconsistent sometimes.

Posted 21st Apr 2023 at 20:49
thacky Daily subscriber Has not played this puzzle yet
I often rate puzzles easy because the fact that they took a long time to do doesn't, in my opinion, necessarily make them hard. For instance, the 16 x 16 take me ages to do compared with other people but only because they are time consuming rather than difficult. And then sometimes an interruption happens.
Posted 22nd Apr 2023 at 10:27
JoergWausW Daily subscriber Completion time: 11:16 Used 'check puzzle' when incorrect
As I mentioned a couple years ago, I don't rate (I think I did once or twice or so).
Reason: My understanding is, that I'm supposed to give an objective opionion about the difficulty level.
But I'm not able to give that based on my experience with the puzzle.
One reoccuring mistake of mine is: in a cell with "3x" I put pencilmarks 12 down instead of 13.
That makes the puzzle very hard for me.
The other perspective: there might be a point in a puzzle where there is only one logical step to move on - and it might be not easy to see.
-> if I find this one step right away by chance, I'd rate it easy. If I have to look for it longer, my rating would be different. But this doesn't change the difficulty of the puzzle.
-> I may also not see a problem at all, and put a number down that is logically not valid at this point, but turns out to be the correct number, and everything falls into place -> rating goes to "easy", because, technically, I made a mistake. If I put a wrong number down, then I might run into difficulty and then track back to a point to reconsider that decision.
But usually I get impatient (especially on a day with 3 killer type puzzles at once) and click "show wrong", fix my wrongs and go on from there, finishing quickly, because I got more information from correcting than I'd otherwise had.

At that point, any rating of mine is neither objective or subjective.

I guess there is a way to obtain an objective difficulty rating. You'd have to have a software solve the puzzle using defined methods and calculating how many different next possible steps exist at any point of the puzzle. You apply weights to the methods, add it all up and put a rating on the sum.

Posted 23rd Apr 2023 at 23:09
Last edited by gareth 23rd Apr 2023 at 23:09
gareth Administrator Daily subscriber Has not played this puzzle yet
thacky, yes that's how I rate too, i.e. based on the expectation for the size of puzzle. It's the same across puzzle types too, since most people are better at some types than others so all you can do is rate based on the deviation your expected 'average' difficulty for that type and size.

JoergWausW, of course you're right that sometimes people make puzzles easy or hard for themselves by fortuitous or unlucky mistakes. But that washes out in the averages - if only you were rating then you'd need to be very careful, but once enough people rate then these issues naturally cancel out and/or are minimized. So it's fine to rate if you wish! :)

Add new comment
Add a comment
Your comment:
Sorry: You must log in (create a free user) in order to be able to post comments on this puzzle.

You can however view other players' statistics and comments in the tables above.

Post comment

Key

  • A yellow/light blue highlight in the time distribution charts highlights your time, where relevant.
  • Rating scores out of 10.0 show the average difficulty rating chosen by users, where 1.0 is "Easy" and 10.0 is "Hard".
  • If a puzzle is opened more than once, including by loading from a saved position, then this is potentially a significant aid so it is listed as being completed with 'multiple sessions' for the purpose of the best time/average rating displays above.
  • Minor aid is defined as no more than one use of 'Check solution' when incomplete and/or no more than one use of 'Check solution' when wrong; and/or using highlighting aids (show repeated digits, show broken inequalities and show valid/invalid placements [slitherlink] only). Major aid is any and all other use of the solving aids except for 'show wrong'.

Back to the forum

©Brained Up Ltd/Gareth Moore 2005-2024 - email gareth@puzzlemix.com - publishers please visit Any Puzzle Media - our privacy policy - registered in England & Wales no. 8642393