Ratings Abuse

Skins, Themes, Icons, Wallpapers: All of these things have ratings associated with it. Ratings are designed to allow users to better find things that are of higher quality while helping new skin authors improve on their skill set.

Unfortunately, the ratings system is imperfect. Only those with Apprentice access or higher OR have WinCustomize subscriptions can rate skins. But some people abuse their ratings priviledges. Some people will give a 1 to a nice skin and many people will give 10's to terrible skins.

There is even what appears to be the occasional use of rating trading. Where authors will agree to vote on each others skins in exchange for high ratings for their own.

Let me be clear: We can see the ratings. That is, we know who rates what. And they are cross referenced. The Admins actually get a visual cross reference of what a user rates things. So if User A is giving all of User B's skins 10s (or 1s) and vice versa, it's pretty apparent what's going on.

Here is the standard of which rating should be done:

It's a 1 through 10 setup. 5 means average. A 10 means you think it's one of the best skins of all time. A 9 would be one of the best skins of the year.  Most skins should get between a 4 and 6.

We have begun prooning ratings to try to make them somewhat more representative.  Giving your friend a 10 on a bad skin is not helping them. It is definitely not helping other users who simply conclude that the users here must just have terrible taste. We don't want to have to threaten removing ratings priviledges from users so please, just try to be fair and honest in your ratings.

Thanks!

15,343 views 34 replies
Reply #1 Top
Well said. If you have to trade rating with another person just to get a decent one, thats pretty pathetic.
Reply #2 Top
One way I could think of to remedy this would be to have two ratings.

Personal Taste, and Technical Quality.

This way authoers would get feed back on both how well they did, and how nice the style is...and people who just think something is ugly can give a 1 for personal taste and maybe not be so inclined to give it an ugly rating overall.
Reply #3 Top
WC knows all! That's Spooky
Reply #4 Top
I did rate an author, first because his icons are ugly and not artistic and second because he ripped an icon that JairoB and me did for the kkmenu. I got an e-mail saying that I was abusing the system by rating all of his icons with ones. And I was told that if I continue doing so, I would get my rating privilege revoked. But, if I think that the icons are ugly, why I can't use the rating system to let the author know that his icons are ugly? The e-mail says that I want to get rid of him by lowering his rating. I say no. I just wanted to let the author know that I didn't like the icons. I didn't have those intentions. But I worry about it because the e-mail was sent just because someone thought that was my intention.



Now I'm afraid of rating a person twice.
(Kidding)
Reply #5 Top

Without knowing what icon author you rated a 1 it's hard to say. I would, however, argue that someone rating say Food's icons a 1 or Mormegil's 1 shouldn't be rating icons. But there are definitely some ugly icons out there.


1s and 10s should be very rare though.

Reply #6 Top
Did you report the rip to the site admins? Rating other works ones as a retaliation isn't appropriate IMO. If they're ugly, well are they all ugly and one-worthy or was retaliation also what motivated you to rate them on how bad you thought his work was? If others don't agree and rate them higher, your ratings would tend to look retaliatory to those who can see them.

You can also use the comment section to tell an author you think his work is ugly if you think it's important to let him know. That's more upfront and open than ratings which are anonymous to all but the admins/mods.
Reply #7 Top
That's cool. Someone rated me a "1" on one of my objects at https://www.wincustomize.com/skins.asp?library=3&SkinID=2958 and didn't even comment on why! I assume they were pee'ed off because I converted a web animated gif to a dx object and posted it, but as I have said in the past, when I post a simple object like that, I'm not looking for any ratings because, as I always state, those objects were "converted from a web graphic" and I'm just looking to share. But the object itself surely doesn't deserve a "1" but there it sits with one. For the most part, people are usually fair in their ratings (in the DesktopX objects section, anyway). But thanks for bringing the issue up front, Frogboy!
Reply #8 Top
seeems that rating sytems are bring abused in many different "communities" like WC.

But I have to agree with JeremyG, that I think a two-tier rating system would be nice. I have to admit, I haven't been rating things lately because a lot of the time I don't comment either. I really should start again.

But well said frogboy, and thanks for bringing this to our attentions.
Reply #9 Top
i suggest using a rating system similar to customize.org......where there is an administrator rating and short review, and then a separate rating for the public to use
Reply #10 Top
I have to agree with JeremyG in that there should be two ratings (personal taste and technical quality). Otherwise, work that comes from a know artist that consistently produces quality work may receive a "1" from someone for numerous reasons: personal taste, completeness, expectations, composition, etc.

As an example, I would be less inclined to give a higher rating to work from a seasoned artist, if the new work didn't move in new directions or somehow improve in quality and completeness from previous works, or didn't support the most cutting edge of skinning, than I would of a similar quality work from a less experienced or "greener" artist. Seasoned artists should be challenged to excel and stay fresh and most do "push the envelope" vs. cranking out S.O.S. By the same token, a newer artist does need encouragement to continue, if there is merit in their work, for they may become the next "great" artist. Shooting them down would just deprive the community the diversity it needs to grow and increase membership. Also if I would not personally use a piece of work because of my "taste", I would be more inclined to rate that piece lower than an item that I would use.

I would finally add that ratings need to be tied to comments. Someone should not be allowed to post any sort of rating without providing valid commentary to support their ratings. Valid commentary not only assists the artist in improving the quality of their work, but educates users as to what "the community" perceives as solid quality work and what is not. "Sucks", "Way Cool", ,etc. are not valid commentary.

I appreciate Frogboy bringing this issue to our attention, but if the Admins of WinCustomize wish to truly provide quality work and knowledge of quality work to community as a whole and constructive feedback to artists, the rating system needs to be overhauled.
Reply #11 Top
I was wondering why almost every single wallpaper submissions out of the past 50 or so have 8 ratings...seems very odd...even hideous ones do! Doesn't make much sense...
Reply #12 Top
jeremyG has it right, two tier rating would also help the artist to know where he/she could improve their work, or expand on it.
I think that the ability to rate someone's work should be permitted to the people who are downloading and using the skins, even if it's a seperate ranking system from the one the "apprentices" and "higher" are using. After all , we're using these skins on a daily basis.
Seems wrong to allow only the elite few choose who gets what rank...But hey, the electoral college does that all the time, maybe it's the way to go....
Reply #13 Top
I don't agree that the general populous should be allowed to rate an artist's product. Apprentice access or higher and WinCustomize subscribers have a vested interest in the success of WC. If someone wishes to participate as part of the community in a greater way, now would be a good time to get a subscription https://store.stardock.com/addproduct.asp?PRODUCT_ID=ESD-SDS-W052&REFERER=WinCustomize since there is a Subscription drive happening right now.
Reply #14 Top
I'm just a user of other's art work. That being said I think the amount of downloads a project gets, is a rating within itself.
Reply #15 Top
Frogboy: I'm not going to say what author because I think is enough for me and I don't want to start a "war". Also because I don't want to look again like doing bad advertising to that author, I don't want to be exile. But if someone tells me that mormegil or foood released a new icon set, I won't even look at them. I would rate them 10 and get them right away.

I would say that a lot of people have talent and a lot of people don't have it. I understand that. But I know my limits and I can rate my "work" as a beginner. But taking a 32X32 icon and resize it to 128X128 or even worst 256X256 and then apply a filter in Photoshop or another program don't make you an artist. You should be able to see that, is not the best effort. The first time I did an icon, I took a picture of the icon, cut the background and that was it. But when Jairo started to release icons I wondered, how can he do that? I asked him and he told that I need to "hand draw" them in a vector program, export them to PS and apply styles and colors there. From that moment I understood that doing icons was more that resizing images, and apply automatic filters. Ok, that's a step to start learning and acquiring knowledge. But you know is not the best looking icon.

sig101: From the first moment I saw the rip I e-mailed Jafo and he took care of it. I have to say that I rated all of them with ones mostly because they were ugly. After the rip I rated them with ones (Ok, I was angry) I think that's why the admins from this site said that. Sorry.

Reply #16 Top
I think essencay is crazy taking to suggest giving a 1 to motivate a seasoned person if they turn out a POS once in awhile. >

I turn out consistantly new stuff for DX and I think a lot of it is on the "most cutting edge of skinning" as essencay says, but once in awhile I find a cool animated gif I convert for my own use or for sharing, and I upload it. To have someone like you come along and give it a "1" is sort of de-motivating, if anything. Just makes me not want to share as much, you understand? Sometimes I need a break from the mental anguish in putting some of the other objects together. I don't need anyone to tell other users here that my simple object (often aimed at beginners) is any less better than the more advanced ones by giving it a "1", often hiding it from users who have lower ratings blocked on their profile.

If you want to grade all day, go be a teacher.
Reply #17 Top
brazen, I agree with most of what you have said, except I didn't suggest giving a "1" to motivate a seasoned person. I think you may have "blended" my reasoning in having two ratings in the first paragraph with my example of how I rate in the second paragraph. Anyway, isn't the whole point of rating a "POS" accordingly, as a "POS",no matter who created it?

I personally don't use any DX stuff, but if I did, I would hardly think that I would rate poorly any of it solely on the fact that it was a converted animated gif. If I'm not mistaken, the whole functionality of having an animated gif on your desktop is for amusement and one would either find it amusing or not.

By the way.... you may be right.... I may be crazy
Reply #18 Top
Hmm all my rates is just how I feel about skin, or techinical aspect like brazen weep's desktop objects. I agree that people that abuse rating system should cease abusing it.
Reply #19 Top
Kill the rating system or force those that give a rating to post a comment. You could also have designated critics who pick skins and say why they like or dislike them.
Reply #20 Top
I am a paying Stardock customer, Essencay. I have considered adding the $20. wincustomize subscription service to the almost $40. I pay now to renew my OD subscription, but I find it difficult to want to pay for a subscription to a website that is supposedly part of stardock, in fact is linked to in all the stardock products, but wants to charge me $20. to access the ability to express my opinion of the craftsmanship of a skin.
If this website wants to be part of stardock, why not just raise the price of OD renewal $10.-$15.? and I wasn't referring to the "General Populace" when I made my suggestion. I referred to those who had legitimately purchased the Stardock products.
At this point, with the snobbery and elitism associated with the rating system, I think maybe others were right. Get rid of the rating system. Judge a skin by the quality of the feedback and comments recieved.
Reply #21 Top
You should do rates like winamp.com does. it has user favs and staff favs. I think a rateing should do itself. What I mean by this is the more down loads it gets the higher the rateing. That would be a more honest way of rateing it I think. If the skin gets 20 d loads a day compaired to one that gets 100 the rateing sys would work as people actually thought it was better and wanted it on there computer.
Reply #22 Top
Personally I prefer the favorite system used by deviantart. The 'rating' then is the number of fav's a work has. This also gets around the problem of the initial rating awarded to a submission - everything starts out with no favs.
Reply #23 Top
@docx: That's just impossible to make work. The downloads of a skin usually depends a lot on what the skinner wrote in the description. We are not rating the writing abilities of skinners. I usually download anything that looks of interest to me, especially if they are cursors. I would rather rate something AFTER I downloaded it and tried it. Screenshots can be deceiving, but once you have it and you have tried it, there is no deception.

I think every skin should be rated by staff, or "higher" level users. Then every lower level users' ratings that are outside the range of the "elite" ratings should be ignored. That would solve the problem of dingbats rating a 10 to their "friends" and rating 1 when they are pissed off...

Reply #24 Top
Odd Tombalaci, that you use the word "dingbats" when referring to those with the ability to rate skins, especially as the only ones who have that ability right now are the elite few in ranking positions.They're also the ones "abusing" the ratings.
I'm sure you're one of those who feel we cits should not be able to post comments either. *Shrug* Bummer huh?
Reply #25 Top
Actually, anyone that buys subscriptions can rate. It's not what you are that makes you able to rate, it's that you have paid. So if the rating range was restricted to actually heavily contributing skinners (hence elites), than we wouldn't have this problem. I think that they would be much less likely to "cheat".

I don't know if you paid attention to what I am, but I am at citizen level, also. I just don't like that appearing next to my name. And some of us know how much I like to comment on stuff.