Retroactive Public Goods Funding (Retro Funding) 6 was recently announced, and will award OP to contributions made to the Optimism Collective governance system. As part of Round 6 , a set of Guest Voters will be invited to participate alongside Citizens. Similar to the experiment in Round 5 , the goal is to learn more about different voter selection mechanisms as a way to create a foundation of knowledge that can be used when making decisions about Citizen selection in the future.
Research Questions
There are two primary research questions inspiring this experiment:
Do selection methods that aim to select for specific characteristics (such as Web of Trust or Proof of Work) result in a significantly different group composition than random selection?
Do randomly selected voters make resource allocation decisions that are significantly different from voters selected via Web of Trust / Proof of Work? Are we able to assess those differences to be better / worse?
The first research question derives from a hypothesis that selection methods are better than random chance at selecting for specific characteristics. We currently have two cohorts of voters that were selected with a specific selection method: Citizens that were selected via Web of Trust and Round 5 Guest Voters that were selected via Proof of Work. Without a control group, we cannot make any assumptions about the effectiveness of these methods in selecting specific characteristics. Randomly selecting a set of Guest Voters enables us to create this control group and use this group as a baseline against which to compare the two previously selected groups as well as future groups.
The second research question goes a level deeper to try and understand whether deliberately selected voters actually perform differently on the allocation task than a random group of people. Once again the current experiment can be thought of as the creation of a control group against which to compare Citizens. Having a control group is valuable as it allows us to draw conclusions about the effectiveness of the ‘treatment’. In this case, the treatment is ‘being selected via Web of Trust’. If the control group is found to vote in a similar way to Citizens, then there is no effect of ‘being selected via Web of Trust’ on the outcome, which is the Retro Funding allocation.
Experiment Outcome Measures
Research Question 1
Do selection methods that aim to select for specific characteristics (such as Web of Trust or Proof of Work) result in a significantly different group composition than random selection?
The following outcomes will be measured to address the first research question:
Social graph modularity of Guest Voters
Professional background / occupation of Guest Voters
Engagement and alignment of Guest Voters with the Optimism Collective
These measures will be analyzed partially through data associated with Guest Voters’ Farcaster Accounts and linked Ethereum accounts, and partially through data collected in an onboarding survey. The outcomes will be compared with similar measures made for Round 5 Guest Voters and Citizens.
Research Question 2
Do randomly selected voters make resource allocation decisions that are significantly different from voters selected via Web of Trust / Proof of Work? Are we able to assess those differences to be better / worse?
The following outcomes will be measured to address the second research question:
Voting behavior (time spent voting, number of metrics selected etc.)
OP allocation patterns (allocation distribution curve, min and max allocation, median allocation, delta between allocation and ratings provided in impact attestations)
The votes of Citizens and other stakeholders on which overall allocation was perceived to be ‘better’ that of the Guest Voters or Citizens.
Experiment Operations
In order to address the research questions above, a set of voters must be randomly selected. There are a few high-level requirements of this random selection mechanism:
It mustn’t select the same person twice (i.e. one-person-one-vote)
It must select from the general population of Superchain users
There should be as little bias in the sample as possible
The first step of random selection is defining the population. Once the population is defined, a random number generator can be used to randomly select a set of individuals.
There are a few ways to think about defining the population. One is to make an announcement allowing anyone to register their interest, and then randomly select from the set that registered. However, this approach introduces a lot of bias into the sample because the population to be sampled from is skewed towards individuals that are highly engaged with Optimism.
A preferable way to randomly select participants is to define the population as broadly as possible, randomly select individuals and reach out to them with an invitation to participate. There will still be some bias in the sample, but considerably less than if the opt-in process happens prior to the random selection.
The goal is therefore to define a representative population of Superchain users, where there is a low probability that the same person is selected twice, and there is the ability to reach selected individuals with an invitation to participate. After reviewing several options, we decided to sample from the population of active Farcaster accounts. This is because:
The Farcaster Protocol runs on OP Mainnet, so Farcaster users are users of the Superchain
It is possible to reach any Farcaster user via cast or DM
The population is large enough - all Farcaster accounts is ~ 750 , 000 users, with ~ 50 , 000 being active daily
The population is likely representative of the larger set of active Superchain users - creating a social account is a common action and the set is unlikely to be skewed towards any specific characteristic
While some users have multiple Farcaster accounts, the rate of user:account is probably lower than the rate of user:Ethereum account
Random sampling process
Starting with all Farcaster accounts that were created…
Filter out business accounts (we want people, not organizations)
Filter out existing Citizens and Round 5 Guest Voters
Filter out accounts that have had zero Farcaster activity in the last 3 months
Run a script to randomly select voters
Reach out to voters with the invitation to participate
Run the script again to select new voters to fill the remaining unfilled slots until the target number of Guest Voters has been reached
What about Sybils?
While the probability that two accounts belonging to the same person are selected in a set of tens or hundreds of thousands of accounts is low, we must still consider Sybil-resistance in the experiment design.
All Guest Voters are required to participate in an onboarding process that includes a video call requiring active participation. Voters that don’t participate will not receive a voting badge.
Experiment Design
Retro Funding 6 will see the participation of a record number of Guest Voters. Approximately 100 Guest Voters will participate alongside roughly the same number of Citizens. The purpose of inviting such a large cohort of Guest Voters is to maintain experiment conditions that have a similar number of participants.
While Guest Voters will participate in the allocation task under the same conditions as Citizens, at the end of the round their votes may be counted differently.
Citizens will be able to review the aggregated voting results of Guest Voters and cast a final vote on whether to integrate the votes of Guests at a 1 : 1 ratio, or whether to diminish the aggregate voting power of the Guest cohort by 25 %, 50 % or 100 %. This process will act as a fail-safe in case the system is captured by Guest Voters.
The post discusses the introduction of Retroactive Public Goods Funding (Retro Funding) Round 6, where Guest Voters will participate in the Optimism Collective governance system alongside Citizens. The experiment aims to compare selection methods such as Web of Trust, Proof of Work, and random selection in voter composition and resource allocation decisions. Various outcomes will be measured, and a process for random selection from the population of Superchain users is described. The post also outlines the experiment design, including the inclusion of a large number of Guest Voters and a review process by Citizens to ensure system integrity.
Retroactive Public Goods Funding (Retro Funding) 6 was recently announced, and will award OP to c…
Retroactive Public Goods Funding (Retro Funding) 6 was recently announced, and will award OP to contributions made to the Optimism Collective governance system. As part of Round 6 , a set of Guest Voters will be invited to participate alongside Citizens. Similar to the experiment in Round 5 17 , the goal is to learn more about different voter selection mechanisms as a way to create a foundation of knowledge that can be used when making decisions about Citizen selection in the future.
Research Questions
There are two primary research questions inspiring this experiment:
Do selection methods that aim to select for specific characteristics (such as Web of Trust or Proof of Work) result in a significantly different group composition than random selection?
Do randomly selected voters make resource allocation decisions that are significantly different from voters selected via Web of Trust / Proof of Work? Are we able to assess those differences to be better / worse?
The first research question derives from a hypothesis that selection methods are better than random chance at selecting for specific characteristics. We currently have two cohorts of voters that were selected with a specific selection method: Citizens that were selected via Web of Trust and Round 5 Guest Voters that were selected via Proof of Work. Without a control group, we cannot make any assumptions about the effectiveness of these methods in selecting specific characteristics. Randomly selecting a set of Guest Voters enables us to create this control group and use this group as a baseline against which to compare the two previously selected groups as well as future groups.
The second research question goes a level deeper to try and understand whether deliberately selected voters actually perform differently on the allocation task than a random group of people. Once again the current experiment can be thought of as the creation of a control group against which to compare Citizens. Having a control group is valuable as it allows us to draw conclusions about the effectiveness of the ‘treatment’. In this case, the treatment is ‘being selected via Web of Trust’. If the control group is found to vote in a similar way to Citizens, then there is no effect of ‘being selected via Web of Trust’ on the outcome, which is the Retro Funding allocation.
Experiment Outcome Measures
Research Question 1
Do selection methods that aim to select for specific characteristics (such as Web of Trust or Proof of Work) result in a significantly different group composition than random selection?
The following outcomes will be measured to address the first research question:
Social graph modularity of Guest Voters
Professional background / occupation of Guest Voters
Engagement and alignment of Guest Voters with the Optimism Collective
These measures will be analyzed partially through data associated with Guest Voters’ Farcaster Accounts and linked Ethereum accounts, and partially through data collected in an onboarding survey. The outcomes will be compared with similar measures made for Round 5 Guest Voters and Citizens.
Research Question 2
Do randomly selected voters make resource allocation decisions that are significantly different from voters selected via Web of Trust / Proof of Work? Are we able to assess those differences to be better / worse?
The following outcomes will be measured to address the second research question:
Voting behavior (time spent voting, number of metrics selected etc.)
OP allocation patterns (allocation distribution curve, min and max allocation, median allocation, delta between allocation and ratings provided in impact attestations)
The votes of Citizens and other stakeholders on which overall allocation was perceived to be ‘better’ that of the Guest Voters or Citizens.
Experiment Operations
In order to address the research questions above, a set of voters must be randomly selected. There are a few high-level requirements of this random selection mechanism:
It mustn’t select the same person twice (i.e. one-person-one-vote)
It must select from the general population of Superchain users
There should be as little bias in the sample as possible
The first step of random selection is defining the population. Once the population is defined, a random number generator can be used to randomly select a set of individuals.
There are a few ways to think about defining the population. One is to make an announcement allowing anyone to register their interest, and then randomly select from the set that registered. However, this approach introduces a lot of bias into the sample because the population to be sampled from is skewed towards individuals that are highly engaged with Optimism.
A preferable way to randomly select participants is to define the population as broadly as possible, randomly select individuals and reach out to them with an invitation to participate. There will still be some bias in the sample, but considerably less than if the opt-in process happens prior to the random selection.
The goal is therefore to define a representative population of Superchain users, where there is a low probability that the same person is selected twice, and there is the ability to reach selected individuals with an invitation to participate. After reviewing several options, we decided to sample from the population of active Farcaster accounts. This is because:
The Farcaster Protocol runs on OP Mainnet, so Farcaster users are users of the Superchain
It is possible to reach any Farcaster user via cast or DM
The population is large enough - all Farcaster accounts is ~ 750 , 000 users, with ~ 50 , 000 being active daily
The population is likely representative of the larger set of active Superchain users - creating a social account is a common action and the set is unlikely to be skewed towards any specific characteristic
While some users have multiple Farcaster accounts, the rate of user:account is probably lower than the rate of user:Ethereum account
Random sampling process
Starting with all Farcaster accounts that were created…
Filter out business accounts (we want people, not organizations)
Filter out existing Citizens and Round 5 Guest Voters
Filter out accounts that have had zero Farcaster activity in the last 3 months
Run a script to randomly select voters
Reach out to voters with the invitation to participate
Run the script again to select new voters to fill the remaining unfilled slots until the target number of Guest Voters has been reached
What about Sybils?
While the probability that two accounts belonging to the same person are selected in a set of tens or hundreds of thousands of accounts is low, we must still consider Sybil-resistance in the experiment design.
All Guest Voters are required to participate in an onboarding process that includes a video call requiring active participation. Voters that don’t participate will not receive a voting badge.
Experiment Design
Retro Funding 6 will see the participation of a record number of Guest Voters. Approximately 100 Guest Voters will participate alongside roughly the same number of Citizens. The purpose of inviting such a large cohort of Guest Voters is to maintain experiment conditions that have a similar number of participants.
While Guest Voters will participate in the allocation task under the same conditions as Citizens, at the end of the round their votes may be counted differently.
Citizens will be able to review the aggregated voting results of Guest Voters and cast a final vote on whether to integrate the votes of Guests at a 1 : 1 ratio, or whether to diminish the aggregate voting power of the Guest cohort by 25 %, 50 % or 100 %. This process will act as a fail-safe in case the system is captured by Guest Voters.
I’m suggest announcing the full details of Retro Funding 6 , including start and end dates, total …
I’m suggest announcing the full details of Retro Funding 6 , including start and end dates, total OP allocation, and eligibility criteria, before introducing the Guest Voter mechanism. This would help the community better understand the scope of Round 6 and align their expectations accordingly.
we can ensure the community is fully informed and engaged with both the process and the reasoning behind the introduction of Guest Voters.
Here is a point of clarification in response to a few questions that came up in the recent joint ho…
Here is a point of clarification in response to a few questions that came up in the recent joint house call: this experiment does not specifically focus on expertise as a variable to test between the Citizens and Guest Voter groups. Rather, the experiment seeks to understand if there are any voting differences based on the fact that one group is a random set of Superchain users and the other group (Citizens) was selected via Web of Trust.
Hi @fujiar this has now been published here: Retro Funding 6 : Governance - Round details 71
Hi @fujiar this has now been published here: Retro Funding 6 : Governance - Round details 71
Hi @fujiar this has now been published here: Retro Funding 6 : Governance - Round details
Hi @fujiar this has now been published here: Retro Funding 6 : Governance - Round details
Sortition, 2000 year + kind of lindy. Most egalitarian thing ever.
The voting power assigned to g…
Sortition, 2000 year + kind of lindy. Most egalitarian thing ever.
The voting power assigned to guest voters could also be randomized (prevrandao) to a value of 1 - XX% of citizen influence on outcome.
I was selected! Very excited to participate.
Small question. My project was also submitted for retr…
I was selected! Very excited to participate.
Small question. My project was also submitted for retro funding.
I hope there is a way to excuse ourselves from voting on submissions we have a conflict of interest with?
As far as I know, you will have the Conflict of Interests option as one of the vote options. By the…
As far as I know, you will have the Conflict of Interests option as one of the vote options. By the way, how did you learn you’ve been selected?
Voters will be able to declare Conflicts of Interest before submitting their ballot. You can refer …
Voters will be able to declare Conflicts of Interest before submitting their ballot. You can refer to the full Optimist Expectations here: Optimist Expectations
Voters will be able to declare Conflicts of Interest before submitting their ballot. You can refer …
Voters will be able to declare Conflicts of Interest before submitting their ballot. You can refer to the full Optimist Expectations here: Optimist Expectations 9
This was the X post on RPGF 6 Guest Voters x.com 2 and also another one on Farcaster through thi…
This was the X post on RPGF 6 Guest Voters x.com 2 and also another one on Farcaster through this cast Warpcast 5
This was the X post on RPGF 6 Guest Voters x.com and also another one on Farcaster through this ca…
This was the X post on RPGF 6 Guest Voters x.com and also another one on Farcaster through this cast Warpcast
Oh thanks @Mon @ 1 a 35 e 1 , Just saw that :pray:
I’m not selected, so I want to ask if some of th…
Oh thanks @Mon @ 1 a 35 e 1 , Just saw that :pray:
I’m not selected, so I want to ask if some of the chosen participants don’t respond and how we’ll move further?
last post/cast about guest voters on socials I think they already reached 100 guest voters count,…
last post/cast about guest voters on socials I think they already reached 100 guest voters count, follow along the official channels sure they will give an update
Thanks for your patience everyone! Guest Voters in Round 6 have been randomly selected and have r…
Thanks for your patience everyone! Guest Voters in Round 6 have been randomly selected and have received an email with next steps.
Thank you to everyone who expressed interest in participating! Make sure to follow Optimism channels on socials to be informed of any similar opportunities in the future :pray:
Very excited about the opportunity. I was selected as a guest voter. @optimistic_emily Does the bad…
Very excited about the opportunity. I was selected as a guest voter. @optimistic_emily Does the badge disapear after the round?
image 267 × 100 1 . 74 KB
The attestation will not be revoked after the round, but the schema 8 includes a field to specify…
The attestation will not be revoked after the round, but the schema 8 includes a field to specify the round, so the attestation will not be valid for voting in other rounds.
