How do I come up with those ratings?
Criteria of my score system explained
It took me some time to figure out a good rating system where all sites are given the score they deserve. The total score is calculated from 5 categories which have a total value of 100 points. Each category has a maximum of a certain amount of points. The categories + maximum values are as follows:
- Content Quality (25 points)
- Content Amount (15 points)
- Update Frequency (10 points)
- Navigation and Design (10 points)
- Price vs Content (10 points)
- Video Downloads (10 points)
- X-Factor (20 points)
So to calculate the final score using the info below you should use the following calculation:
((CQx25) x (CAx15) x (UFx10) x (NDx10) x (PCx10) x (VDx10) x (XFx20))/100. To figure out the score in stars just cut the number in two.
Content Quality (25)
Content quality is a pretty straightforward score. The total amount of points in this category depends on the quality of the movies or pictures. When a site is movie orientated I take the video quality and for a picture site I look at the picture quality. When both account for an equal number I take the one with the highest quality, and substract a point or two when the quality of the other is significantly lower but generally video quality is the main factor.. To be honest, here it becomes a bit of a grey area and when this is the case I try to find some sort of average.
| Points | Movie/Picture quality |
| 10 | 3000+ / 3000x2000+ |
| 09 | 2000-2999k / 2000x1500 |
| 08 | 1000-1999k / 1152x864 |
| 07 | 700-999k / 800x600 |
| 06 | 500-699k / 600x450 |
| 05 | 400+499kbps |
| 04 | 300-399k / 400x300 |
| 03 | 100-299k / 300x225 |
| 02 | 100k or less / low-res |
Content Amount (15)
This is the total amount of videos and pictures. Videos longer as 10 minutes are counted. Videos shorter as 10 minutes count half, as do pictures. Screenshots of videos and streaming video are not counted at all. The amount of pictures will never be more then the amount of videos. I.e. A site with 200 videos and 2000 pictures has a total content amount of: 200 videos + 200 pictures = 400. A site with 200 videos and 200 pictures has a total amount of 200 + 200/2 = 300.
Bonus sites are not counted but will be given extra credit in the X-factor score.
| Points | Amount |
| 10 | 500+ sets |
| 09 | 300-499 sets |
| 08 | 150-299 sets |
| 07 | 100-149 sets |
| 06 | 50-99 sets |
| 05 | 30-49 sets |
| 04 | 20-29 sets |
| 03 | 15-19 sets |
| 02 | 1-14 sets |
Update Frequency (10)
This score is very simple. Here I count the actual amount of times a site updates.
| Points | Update frequency |
| 10 | Daily or more |
| 09 | 5-6 times a week |
| 08 | 3-4 times a week |
| 07 | 2 times a week |
| 06 | weekly |
| 05 | at least 3 times a month |
| 04 | at least 2 times a month |
| 03 | monthly |
| 02 | every now and then |
| 01 | never / stopped updating |
Navigation and Design (10)
Base is 7. This score is more subjective and is mainly based on the experience of the reviewer during the review process. Points are substracted for annoyances in navigation and design or awarded for above average usability.
Price vs Content (10)
This is a more complex score. This is the value you get in terms of quality and quantity for the amount of dollars you pay. Bonus sites are not counted in this number and the cost used for the calculation is the regular monthly memberships fee in US dollars.
Price vs Content = ((Content Amount Score x 2) x (Content Quality Score x2) x Price index) / 5
Price index:
| Points | Cost in $ |
| 10 | less then 0,20 |
| 09 | 0,20-0,29 |
| 08 | 0,30-0,44 |
| 07 | 0,60-0,79 |
| 06 | 0,50-0,69 |
| 05 | 0,60-0,79 |
| 04 | 0,80-0,99 |
| 03 | 1,00-1,09 |
| 02 | 1,10-1,24 |
| 01 | More then $1.25 |
* Cost is cost per day. (Monthly price / 30)
Video Downloads (10)
Base is 6.
Full points are awarded for:
Fast and simpel video downloads in multiple formats.
When clips and full length downloads are availabe.
When only video streams are available a site will get automaticly a score of 4. In general no lower then 4 will be given.
1 or 2 points are also substractedw hen there is a download limited
When its a picture only site this is set to 6.
X-Factor (20)
Base is 6.
Points are awarded for:
Overall experience.
Unique content.
Original or interesting theme.
Bonus sites and extras.
Everything else which makes my reviewers happy.
Points are substracted for everything that makes our
reviewers sad.
i.e. advertising, poor customer service.
