Leaderboard Change Proposals - Discussion

Discussion about MARP's regulation play

Moderator: BBH

Buttermaker
MARP Seer
MARP Seer
Posts: 788
Joined: Sun May 19, 2002 9:06 am

Post by Buttermaker »

Weehawk wrote:The only way to prove that it is unacceptable to the community is to include it as an option...and for people to vote for something else.
Common sense already proves that it is unacceptable.
There does, however appear to be support for it, so I am tentatively including it. It could be modified.
Removing it would be fine with me since there is another option for 1-2-3 scoring. Having both of them would also potentially divide the people who want 1-2-3 scoring into two groups when voting.
LN2 wrote:give LB pts to the top 3...and screw everyone else.
They're not getting screwed. They just need to get better if they wanna step on the podium.
This potentially will discourage some participation by having the top 3 only count where more will figure they can't compete with the top 3 so won't bother.
If you're in 4th place and your inp is great so what? It's still a great inp. There must be a fixed cut-off point after 3rd place. I've explained why in my post above.
Buttermaker
MARP Seer
MARP Seer
Posts: 788
Joined: Sun May 19, 2002 9:06 am

Post by Buttermaker »

Hello page 2, where are you? Edit: Oh, there you are.

Weehawk: Do you wanna run a poll on the board or do you want people to email/PM you their votes? I'd prefer email/PM to make sure only people who really care take part.
LN2
MARPaholic
MARPaholic
Posts: 1669
Joined: Wed Jul 24, 2002 4:46 pm

Post by LN2 »

Buttermaker wrote:They're not getting screwed. They just need to get better if they wanna step on the podium.
I have no objection at all to the sorting of the leaderboard being done by the place points. However, every single one proposing the place points seem to want to do away with the percentage points.

I think we need to show a distinction here...cuz I think the percentage LB points should still also be shown with the average per submission for each player.

If the LB starts getting sorted by places then for the percentage points part you could actually make that just the true percentage even instead of the 15% less per place.

Someone gets 99% of top score for that game they get 99 points for that tally. However, that won't move them up/down the leaderboard. They will get LB points from only a top 3 or 5 finish. It will go into their overall percentage average per submission as a cool statistic on the side..but won't affect their leaderboard standing at all....only top 3 or top 5 scores would do that.

Those percentage points are also still valid for viewing the scores for games as you can quickly and more easily see the difference versus having to do the math in your head..as trivial as that math is.

I still think if going to a pure placing point sorting of the LB the 10-7-5-3-1 for the top 5 for each should be used over 10-3-1. That gives too much weight to 1st vs 2nd place. 2nd place deserves at least half.

It's still cool to track those other percentage points though IMHO for stats. Just don't use those for the ordering of the leaderboard.
User avatar
The TJT
MARPaholic
MARPaholic
Posts: 2479
Joined: Wed Mar 06, 2002 10:56 am
Location: 20 Grand Palace

Re: Leaderboard Change Proposals - Discussion

Post by The TJT »

Excuse me using bm for your reply format :D

Proposition 1
Do nothing.

One would vote for this if one is in favor of not making any change to the current system of awarding leaderboard points.
People will always vote something like this. Resistance for change, for better or worse.

Proposition 2
The old system.

Awarding points only for the top 3 places. 10, 3 , and 1 points respectively.
Buttermaker wrote:I like this because it's like a podium you see in all kinds of competitions.

10-3-1 might not be the best way to distribute the points. Anybody got a better suggestion?
Yes, this option is allways good. I DO like to give first place most points.

Maybe Something like 10-5-3-1 would be better?

Proposition 3
Using the current formula based on percentage of the top score scaled down 15% for each place below first (first getting 100 points). For those comfortable with formuale it would look like this:

pts = 100*(your_score/top_score)*.85^(n-1) where n is the place

but cutting off after 3rd place so that anything below 3rd gets 0
I think 15% is too small. Discourages competition for first place.
Very similar to proposition 2, but too liberal to distribute points for places 2 and 3.
Also about identical to propositions 4 and 5, only that cutoff point is 3...not 5 or 7(geezuz).

Proposition 4
Current formula (see Proposition 3) but cutting off after 5th place so that anything after 5th place gets 0
Buttermaker wrote:Buttermaker:Not good. Too many chances for ABCers to get LB points.
Agreed. About exactly same as proposition 5. If have cutoff after 5th place, then make atleast 4 and 5 get very tiny points. I can not compete against somebody at leaderboard who submits very many out-of-top3-submissions if they get decent points from it. I play different, not everything just little. I rather submit one good one.

Think about time factor...How long time you average taking first place at a game vs 5th place. If you can take 10 5th places same time you take one 1st place...and get much more points doing so, then that courages quantity over quality.


Proposition 5
Places get percentage of score scaled down by a subtracted 15% for each place, that is:

1st place gets 100 pts
2nd place gets (percentage of first place score) * .85
3rd place gets (percentage of first place score) * .70
4th place gets (percentage of first place score) * .55
5th place gets (percentage of first place score) * .40
6th place gets (percentage of first place score) * .25
7th place gets (percentage of first place score) * .10

anything below 7th place gets 0
This wouldn't stop alphabet guys. Almost same as current system. Also again 2nd place is not worthy so much.
Why propositions 3,4 and 5 have same percentage?...Only cutoff is changed from 3 to 7.

Anyway this system over 10-3-1, because there are percentages involved....But give points to only 4 or 5 first like:
100
60
30
15
5

Is that Popularity multiplier forgotten? It wasn't so bad idea...Maybe it wouldn't make popular games even more popular, if there is a cutoff point.
Could work as an alternate, elitistic 8) leaderboard.

I liked Barry's idea to keep 2 leaderboards side by side...Other could be conservative(as 10-3-1 or 100%-50%-25%-10%) to show who really are the ones to beat.
Other could be liberal(like 100%-85%-70%-55%-40%)... inviting those who have lots of 4-5 places to "compete" with each other who have most time to find those games that give you lb-points :twisted:


Maybe John could make 2 main voting options:
Conservative, with 3 different options
AND
Liberal, with 3 different options

Then we could use most voted of both...everyone happy 8O

Thanks,
TJT
LN2
MARPaholic
MARPaholic
Posts: 1669
Joined: Wed Jul 24, 2002 4:46 pm

Re: Leaderboard Change Proposals - Discussion

Post by LN2 »

The TJT wrote:Is that Popularity multiplier forgotten? It wasn't so bad idea...Maybe it wouldn't make popular games even more popular, if there is a cutoff point.
I actually thought it was a quite bad idea. There are some quite unpopular games that have gotten many submissions...yet other classics that have gone partially ignored or not had as many submissions simply because that game hasn't been used in a Deca or other event or because there are a few great scores posted for it so great that any "normal" score wouldn't receive many LB points even with the current system.

The other issue is CPU use. Each time an upload is made it would require recalculating the relative popularity of ALL 4000+ rom sets and thus the LB points for ALL members for ALL of their submissions.

Plus, woohoo, let me make 3 spoof accounts and submit scores using those other accounts just to get the popularity up some. I can see someone doing that around here...or get all their league/clan buddies to all submit scores for the same rom set.

There really is no fair way no matter what system you use of weighing one top score versus another. You could set a new WR on the game yet if only 1 other person had submitted a score you get less points versus playing one of those silly late 70s B&W "games" that last 1-2 minutes so many have played it and submitted scores for it....or perhaps it was used in a Deca or some event.

That's an awful lot of calculating for each upload. Given the slowness of the scripts on Retrogames already, do we really want the site to become slower for visitors cuz someone uploaded a submission and all those calculations are being done?

I tapped into a different aspect of it though....was having a multiplier less than "1" for games that have less than 3 or 5 submissions. 5 or more submissions for the rom set, the multiplier is 1. This would keep the first uploaders to new supported rom sets from getting an easy 100pts even for the short term. If their score was good so withstands other submissions, then the value of it would increase and reach 100 points for first.
I liked Barry's idea to keep 2 leaderboards side by side...Other could be conservative(as 10-3-1 or 100%-50%-25%-10%) to show who really are the ones to beat.
In short that is what I have always been in favor of also. Have a leaderboard close to the current one....perhaps using 10-5-3-1 or 10-7-5-3-1 instead of just 10-3-1 but also still have the percentage points shown. By default sort the LB by place points...but have an option to also view it by percentage points.

BTW, wasn't the point of this thread to focus the discussion on certain changes? It seems essentially all that even weren't received well in that other thread have been rehashed.
User avatar
tar
MARPaholic
MARPaholic
Posts: 1209
Joined: Mon Aug 05, 2002 9:25 am
Location: ohio u.s.a.

Post by tar »

Let us end this debate and vote.
I remind you it takes a week.
JTC knows how to formulate the options.
.
I shall take a nap now .
User avatar
The TJT
MARPaholic
MARPaholic
Posts: 2479
Joined: Wed Mar 06, 2002 10:56 am
Location: 20 Grand Palace

Re: Leaderboard Change Proposals - Discussion

Post by The TJT »

The TJT wrote:I liked Barry's idea to keep 2 leaderboards side by side...Other could be conservative(as 10-3-1 or 100%-50%-25%-10%) to show who really are the ones to beat.
Other could be liberal(like 100%-85%-70%-55%-40%)... inviting those who have lots of 4-5 places to "compete" with each other who have most time to find those games that give you lb-points :twisted:


Maybe John could make 2 main voting options:
Conservative, with 3 different options
AND
Liberal, with 3 different options

Then we could use most voted of both...everyone happy 8O
Otherwise similar options will eat each others votes.

TJT

P.S.
What you call an ABC-uploader in leaderboard top 20????
.
.
.
...QRS-uploader! :lol:
User avatar
Weehawk
MARPaholic
MARPaholic
Posts: 2562
Joined: Wed Jun 25, 2003 7:43 am
Location: Devil's Canyon
Contact:

Post by Weehawk »

TJT wrote:Is that Popularity multiplier forgotten?
Not yet, but we're trying. :wink:

And I considered the possibility of breaking down votes on sub-questions like "Do you favor a system based on percentage of top score yes/no?" or "Should the points be cut off at 3rd place/5th place/not at all?", but I'm not seeing how it would work well.

I have added a 6th Proposition: 10-7-5-3-1

Proposition 5 is showing a lack of support. I am inclined to drop it from the final candidates unless someone speaks out for it.

That would leave us with four options..apart from the "do nothing" option. Two for percentage based allocation....two for allocation based solely on place. Two for cutting off after 3 places....two for cutting off after 5. I think this would work well.
Buttermaker wrote:Weehawk: Do you wanna run a poll on the board or do you want people to email/PM you their votes? I'd prefer email/PM to make sure only people who really care take part.
I don't think we have to worry about too many people getting involved.

I prefer to do it in the open. I do however hope that the administrator can, if necessary, at least check on who voted.

Also...IF YOU WERE NOT REGISTERED ON THE FORUM PRIOR TO THE START OF THIS DISCUSSION, PLEASE EMAIL OR PRIVATE MESSAGE ME IDENTIFYING YOURSELF BY YOUR MARP NAME. I don't care to know how you vote, but I would like to have some confidence that only MARP members are voting, and that they vote only once. :P

This is the last chance for members who we have not heard from yet to voice their opinion. I am concerned that this decision is being made by such a small subset of the membership, but we cannot reach through the internet and pull it from you by force.
John Cunningham (JTC)
Image
User avatar
LordGaz
MARP Knight
MARP Knight
Posts: 220
Joined: Sat Mar 09, 2002 5:07 pm
Location: London, UK

Post by LordGaz »

2 leaderboards side by side
Why not have all 6 leaderboards side by side? Better still, add more leaderboards as people think of new systems and have people choose which one they want to see by clicking on a tab.

Night all :D:D:D.
Buttermaker
MARP Seer
MARP Seer
Posts: 788
Joined: Sun May 19, 2002 9:06 am

Post by Buttermaker »

Weehawk wrote:That would leave us with four options..apart from the "do nothing" option. Two for percentage based allocation....two for allocation based solely on place. Two for cutting off after 3 places....two for cutting off after 5. I think this would work well.
We need two separate polls. One to decide on percentage or place based scoring and one to decide on cut-off after 3 or cut-off after 5.
boxster
Button Masher
Button Masher
Posts: 45
Joined: Thu May 02, 2002 8:57 pm

Post by boxster »

This is the last chance for members who we have not heard from yet to voice their opinion. I am concerned that this decision is being made by such a small subset of the membership, but we cannot reach through the Internet and pull it from you by force.[/size]
This thread started barely 36 hours ago, so if you're truly looking for some opinions on this issue, I think more time is likely going to be required. My guess is that the average MARPer isn't here every single day - especially on weekdays for those in the working world - so if you really want meaningful discussion, it may take some time.

Or more time may not elicit any more opinions - who knows.

I think maybe a different perspective may be helpful. I've been around MARP for 5 or so years and was part of many of the early tournaments. I've left and returned a few times. I consider myself an average player, if even that. I'd love to spend more time MAMEing and MARPing, but life and job interfere for significant periods of time.

Many of the responses to this issue seem to be of the "screw 'em if they're not great players" variety. I can tell you from the perspective of an "average" gamer that this perspective sounds pretty elitist. Perhaps that is the intention. I realize that the rules state that only impressive, etc., scores should be uploaded, but not everyone is capable of spending 8 hours a day playing games and perfecting their skills. Those "casual" gamers may be just as interested in participating in MARP as the die-hards.

So, the issue basically boils down to this: who do you want to be involved in MARP? If you want only the elite gamers, then pursuing the top-3-or-nothing type scoring systems makes sense, because it's going to cause a significant number of "average" gamers to become disinterested in MARP. If you want to maintain the interest of those people who don't live or die MARP, then a little flexibility makes better sense.

That being said, I'll address your proposals. First, correct me if I'm wrong, but the MARP leaderboard is already a combination of props 1 & 2. The total points represents #1 and the leaderboard points also displayed (but not used in the ranking) represents #2. So, essentially, a vote for #1 or #2 is a vote for the status quo, with #2 merely being a change in the way the data is sorted.

Prop 3: I think top 3 is too restrictive. Again, if you're looking for the elite, it's ideal because that's what you'll get. If you want to keep everyone else interested and contributing, top 5, 7, or even 10 makes more sense.

Prop 4: See Prop 3.

Prop 5: See Prop 3. Prop 5 works if you want to keep average gamers interested and submitting.

Prop 6: Essentially a simplified Prop 4. I like this one, as well.

My preference is Prop 6, followed by Prop 5 & 4, respectively. Prop 6 seems a lot easier to implement, but 4-5-6 all offer a better system for those who want to limit the number of "fluff" uploads.

Prop 6 would also eliminate the current issue of one person getting 100 pts for a world record score and second place (albeit far behind #1) getting 3 pts or whatever. I think the current system could discourage people from playing/submitting a game with an astronomical 1st place score for exactly that reason.

I wish that more people had/would voice opinions on this issue, because it would be nice to see what more people think, especially those outside the core die-hard group of forum members. (No offense!) :)

Maybe - if possible - you could give the members the ability to decide which method they want to see individually. Then, those of you who want to only include the top 3 scorers in the point totals could do so. The rest of us who don't have a lot of top 3 scores, but would still like to contribute/participate in MARP, could see how we rate using a more flexible range of scoring options.

Edit: one last thought - I agree with the poster in the other thread that said that MARP wouldn't have anywhere near the submissions it has were it not for the leaderboard. People are naturally competitive and are drawn to sites like this for that reason and that reason alone.
LN2
MARPaholic
MARPaholic
Posts: 1669
Joined: Wed Jul 24, 2002 4:46 pm

Post by LN2 »

boxster wrote:This thread started barely 36 hours ago, so if you're truly looking for some opinions on this issue, I think more time is likely going to be required.
Nope, this was all started in another thread that got somewhat corrupt so John locked it and we are continuing here. Feel free to read that other thread about the leaderboard.

We have been discussing it at least a week now.
Those "casual" gamers may be just as interested in participating in MARP as the die-hards.
yes, this is a point I made in that other thread...not sure if that post was one that got lost or became invisible etc. hehe

There is so much concern over changing the leaderboard cuz of ABC uploaders, I think many changes suggested here and in the other thread overall will discourage average gamers from submitting scores here or even participating at MARP. If that is what MARP wants, fine.

This is why I said the percentage points must stay....and just add an option to sort the leaderboard by place points instead of percentage points.

With only that 1 change and nothing else that might be enough for most.
Again, I only saw about 3-4 ABC uploaders on the leaderboard.

Do you want a new system that hoses 50+ just cuz of those 3-4 ABC uploaders? If they actually got quite high on the leaderboard so what? They have enough info there to clearly make the conclusion they are only there cuz of massive numbers of submissions, not cuz of tons of first through third place scores many a high percentage of the top score.

It's odd many here believe others can't make that conclusion.
If you want only the elite gamers, then pursuing the top-3-or-nothing type scoring systems makes sense, because it's going to cause a significant number of "average" gamers to become disinterested in MARP.
I generally agree with this.
Maybe - if possible - you could give the members the ability to decide which method they want to see individually.
yep, I suggested this above. It would be nice for all that are interested in the leaderboard that way. It might turn out the hard core players sort by place points....while the casual or average gamer sort by percentage points.

If I had that choice, I likely would still view it sorted by percentage points...and only now and then sort by place points. By looking at the top 20 only 2-3 of them really change position with the different sorting anyway.
Edit: one last thought - I agree with the poster in the other thread that said that MARP wouldn't have anywhere near the submissions it has were it not for the leaderboard. People are naturally competitive and are drawn to sites like this for that reason and that reason alone.
It's nice to hear that cuz others have stated the leaderboard is useless. I think it's more important to MARP than many think. It's also handy for a quick reference. I look at my listing just to see how many firsts, seconds, thirds I have etc.
User avatar
The TJT
MARPaholic
MARPaholic
Posts: 2479
Joined: Wed Mar 06, 2002 10:56 am
Location: 20 Grand Palace

Post by The TJT »

Again, I only saw about 3-4 ABC uploaders on the leaderboard.
Yes, looking now latest submissions standard seems much higher for submissions. Lots of 1st places. Looks good 8)
This conversation has made momentarily impact(as happened in past with similar discussions)...They've gone underground, or submitting better scores!
LN2
MARPaholic
MARPaholic
Posts: 1669
Joined: Wed Jul 24, 2002 4:46 pm

Post by LN2 »

nah...they just have all the new rom sets that 0.80 added and have been submitting the first scores for them. :P
boxster
Button Masher
Button Masher
Posts: 45
Joined: Thu May 02, 2002 8:57 pm

Post by boxster »

Nope, this was all started in another thread that got somewhat corrupt so John locked it and we are continuing here. Feel free to read that other thread about the leaderboard.

We have been discussing it at least a week now.
I was specifically referring to this thread with its fairly-well delineated options. I was aware of the other one, as noted later in my post.

My point was primarily that (and I could certainly be wrong) many, if not most, MARP participants likely aren't going to be on here every day to see that this discussion has been taking place. Obviously, a cutoff point is necessary or the discussion will tend to deteriorate into rehashing the same issues, but I think a short (and really, a week is nothing) discussion period misses an opportunity to get real feedback.
It's nice to hear that cuz others have stated the leaderboard is useless. I think it's more important to MARP than many think.
I'm frankly a little surprised that anyone could really believe the leaderboard is useless. I'd argue that it's the single most-important "feature" at MARP, especially to players outside of the elite, say below the top 10 or so. Historically, there has been a lot of wrangling for position in the 20-40 positions, for example, much more so than in the top 10.

I tend to return after a long layoff to find myself dropped into the 50's and play more as a result. Will I ever make the top 10? No. Do I care? Not really. Do I fight for leaderboard ranking and points anyway? Yep.

The leaderboard provides clear goals and inherently breeds more competition and more participation. Lose the leaderboard and you'll lose a prime motivator and a big reason why people participate here in the first place.
Post Reply