Q3'21 Accomplishments and Q4 Deliverables
Role
Project
Openings
Meeting Minutes
Contributor(s)
Created
Nov 8, 2021
Related to Open Positions DB (Property)
Last Touched
Nov 8, 2021
Workstream
Event Date
Below is a list of every working group in FDD with their key accomplishments from Q3 and their intended Q4 deliverables.
Initiative Stream | Lead(s)
Squad | Lead(s)
Stream Ops | Disruption Joe / Christine
Stream Onboarding | Armand / Bob / David
Key Accomplishments
Q4 Deliverables
Contributor Management | Disruption Joe / Christine
Key Accomplishments
Q4 Deliverables
Structural Planning | Disruption Joe
Key Accomplishments
Q4 Deliverables
Legal | Pete / Larry
Key Accomplishments
FDD Stream Operations | Disruption Joe / Christine / Huxwell
Key Accomplishments
Q4 Deliverables
Cross Stream Ops Governance Participation | Joe / Armand / Cali
Key Accomplishments
Q4 Deliverables
Anti-Sybil ML | BlockScience / Omnianalytics
BlockScience ML Pipeline | Blockscience
Key Accomplishments
Q4 Deliverables
Model Training | Omnianalytics
Key Accomplishments
Q4 Deliverables
Model Validation | TBD
Key Accomplishments
Q4 Deliverables
Feature Engineering | Omnianalytics
Key Accomplishments
Q4 Deliverables
Model Supervision | Armand
Key Accomplishments
Q4 Deliverables
Onchain Forensics | Omnianalytics / Walter
Key Accomplishments
Q4 Deliverables
Data & DevOps | Philip
Cloud DevOps | Philip
Key Accomplishments
Q4 Deliverables
Data Operations | Omnianalytics
This squad will likely begin in Q4. Github API work outlined in Anti-Sybil ML section.
Reporting & Analytics | Omnianalytics, Xue Dong
Key Accomplishments
Q4 Deliverables
Evaluation Squads | Armand
Key Accomplishments
Q4 Deliverables
Grant Approvals | David
Key Accomplishments
Q4 Deliverables
Grant Disputes | David / Disruption Joe
Key Accomplishments
Q4 Deliverables
User Reviews | Disruption Joe
This squad will likely begin in Q4
Internal Appeals Panel | TBD
Key Accomplishments
Q4 Deliverables
External Appeals Panel | David
Key Accomplishments
Q4 Deliverables
ML Human Evaluations | Armand
Key Accomplishments
Q4 Deliverables
Policy | David
Key Accomplishments
Q4 Deliverables
Grant Flagging Policy | Disruption Joe / Christine / Huxwell
Key Accomplishments
Grant Dispute Policy | Armand | Bob | David
Key Accomplishments
User QF Eligibility Policy | TBD
Appeals Policy | David | Larry
Key Accomplishments
Q4 Deliverables
Sanctions Policy | Pete / Larry
Key Accomplishments
Research | Abiodun (BFA)
Open Science - DAO Compensation w/ TE | BFA
Key Accomplishments
Q4 Deliverables
Squad Experiments | TBD
Q4 Deliverables
Curation Games | TBD
User Support | Bob Jiang
Discord Support | Bob / Abiodun / Armand
Key Accomplishments
Finishing Q3
Q4 Deliverables
Knowledge Base | Huxwell / Abiodun
Key Accomplishments
Q4 Deliverables
Translations | Riely
Key Accomplishments
Q4 Deliverables
Ambassadors | Renee Lee
Finishing Q3
Q4 Deliverables
FORMAT GUIDE:
Initiative Stream | Lead(s)
Description
Squad | Lead(s)
Stream Ops | Disruption Joe / Christine
Stream Ops is responsible for coordinating externally to the community and with CrossStream DAOops. Internally it manages projects, tools, structure, and contributor needs for the FDD workstream.
Stream Onboarding | Armand / Bob / David
Key Accomplishments
- Established onboarding process adopted by entire DAO
- Successfully onboarded 17 new active contributors to FDD
- Increase participation in the overall DAO onboarding process
- Create suggestions for topics to cover during the onboard success call
Q4 Deliverables
- Create a run-book for onboarding new contributors to each squad
Contributor Management | Disruption Joe / Christine
Key Accomplishments
- Created FDD Q3 budget format
- Established mechanism for reporting start/stop dates
- Setup 7 stream leads for FTE participation
- Get signed DAO Contributor Agreements from all FDD workstream*
- Create budgeting bucket model to show payment types per stream
Q4 Deliverables
- Move FTE / PTE pay into dRewards mechanism
- Create a How We Pay Contributors in FDD blog post
Structural Planning | Disruption Joe
Key Accomplishments
- Setup L1, L2, L3 terminology and phased to workstream/initiative/squad
- Clearly outlined the process for progressive decentralization of FDD
- Establish representative oversight by FDD Multisig Keyholders
Q4 Deliverables
- Begin autonomous experimentation with rewards mechanisms in squads
- Begin autonomous experimentation with participation policy in squads
- Set KPIs and goals for submissions to be less prescriptive from higher levels
- Setup process for squads to create Moloch DAOs w/ non-transferable shares
- Run discovery process for launching self governance of L3 streams
Legal | Pete / Larry
Key Accomplishments
- Recruited 2 active contributors
- Decided on Non-incorporated non-profit as best legal structure in combo with using new DAO Contributor agreements
- Open sourcing the DAO Contributor Agreements
- Align on needs for Q4**
FDD Stream Operations | Disruption Joe / Christine / Huxwell
Key Accomplishments
- Created a dashboard for contributors to see what they have earned
- Setup successful Notion and Discord comms norms
- Developed a regular meeting cadence for contributors and the community
- Published GR11 Governance Brief
Q4 Deliverables
- Establish a regular cadence of weekly epoch payments
- Begin basic treasury risk management
- Establish a clear message to stewards for “Why FDD”
- Update all Notion pages to proper page designs to improve async comms
- Setup improved calendar processes to eliminate link update issues
Cross Stream Ops Governance Participation | Joe / Armand / Cali
Key Accomplishments
- Formed L2 Cross Steam DAOops group with representation from all workstreams
- Aligned on “How We Make Decisions Process”
- Established 11 L3 Squads as Subject Matter Experts for operational needs
- Create and ratify list of contributors to each L3 stream**
Q4 Deliverables
- Sharpen process flows to be a industry leading example of DAO operations
- Set a standard for DAO operations protocols
Anti-Sybil ML | BlockScience / Omnianalytics
Anti-sybil ML is responsible for the detection of user accounts that present as adversarial and guiding the human systems which train and correct the machine learning outputs.
BlockScience ML Pipeline | Blockscience
Key Accomplishments
- Lowered fraud task from GR10
- Added statistical validation to check validity of ml results
Q4 Deliverables
- Define and document the operational process framework
- Iterate on the operational process application architecture
- Define the sybil survey for statistical validations
- Define the onboarding process for ML model development
- Revise human evaluation spreadsheet for understanding & consistency
Model Training | Omnianalytics
Key Accomplishments
- Initial code review of the existing BlockScience Anti-Sybil model hosted in the private GitcoinDAO Github repository was conducted to assess the high-level structure of the codebase
- Key scripts were identified that indicate the structure of the inputs, outputs, and the training procedure for the current Random Forest model implementation.
- Further code execution conducted and documentated to track the amount of effort required to execute the current model and its maintenance requirements.
- Update specialized session keys to solve errors that arise in the feature generation portion of the script that prevents contributors from performing an end-to-end execution of the ML pipeline.
Q4 Deliverables
- By the end of Q4, the current BlockScience hosted version of the ML model will have been fully understood by the FDD team; with special focus placed on the inputs required to train the model and resource requirements necessary to automate the execution process.
- Various model training benchmarks will have been tracked to better understand the resourced requirements for performing the modeling at scale.
- A small-scale prototype of the community-created Anti-Sybil ML model will be compared to the current BlockScience model in production to give the first comparison of the accuracy and resource efficiency of each.
Model Validation | TBD
Key Accomplishments
- Initial review of the BlockScience codebase to gain familiarity with the current outputs from the model.
- Provided initial guidance to the Human Evaluation team on how to best encode human label certainty for more seamless inter-rater reliability measurements between human evaluators.
- Gained familiarity with the human evaluation process to inform first efforts for comparing the current ML outputs against the existing human identified sybil accounts.
Q4 Deliverables
- In Q4, we intend to provide an initial report on the level of accuracy between human evaluators, the current BlockScience model, and the community developed Anti-Sybil ML model.
Feature Engineering | Omnianalytics
Key Accomplishments
- Performed a deep dive into both the public and private BlockScience Anti-Sybil ML models.
- Began development on the community Anti-Sybil ML model build by recreating the GitHub data scraping through both the API and via web scraping with implementations in both R and Python.
- Initial brainstorming has been done on expanding the feature set of the Anti-Sybil model beyond the current three data points leveraged by the BlockScience implementation.
- Continue to review and document the existing models with the intent to develop an initial end-to-end recreation of the BlockScience implementation.
- Continue onboarding contributors to vet existing features and develop new model inputs.
- Work with the human evaluation team to use their processes to inform the feature generation process.
Q4 Deliverables
- Create an MVP of the community-developed Anti-Sybil ML workflow.
Model Supervision | Armand
Key Accomplishments
- Coordinated and supervised the Machine Learning model on GitHub, making sure to not exceed the amount of allocated resource and granting each access “Administration Level” to the proper contributors or squad leader
- At the end of Q3, we were able to fully understand the process on how to bring actionable insights from the Machine Learning Model and distinctly separate Sybils accounts from non-Sybil accounts
Q4 Deliverables
- In Q4, we plan to regroup all the feedback gathered from Q3 and investigate the data to quantify the mismatching analysis and transform it into a “Positive Sum” or “Positive Data”
Onchain Forensics | Omnianalytics / Walter
Key Accomplishments
- Performed an initial survey of on-chain data sources relevant for anti-sybil detection (BrightID API, FingerPrintsJS API, TrueBlock’s LLC On-Chain Data accessibility package)
- Engage each data provider to understand the capabilities of each service to inform the Data and Dev. Ops and Feature Engineering workstreams of the on-chain information available for storage and model development.
Q4 Deliverables
- Provide initial documentation of the on-chain data available for Anti-Sybil detection.
- Begin progress on at least one initial integration of the on-chain data into the Anti-Sybil ML model workflow.
Data & DevOps | Philip
Cloud DevOps | Philip
Key Accomplishments
- Setup gitcoindao.com Google Cloud instance
- Setup dggtc github repo
- Created job description for DevOps contributor
- Trial run with potential DevOps lead*
Q4 Deliverables
- Create requests forms for DAO contributors to submit needs
- Hire FTE - DevOps & Data Engineer
- Design schematic for “community data lake”
Data Operations | Omnianalytics
This squad will likely begin in Q4. Github API work outlined in Anti-Sybil ML section.
Reporting & Analytics | Omnianalytics, Xue Dong
Key Accomplishments
- Created an initial scope outlining the short term, medium-term, and long term Reporting and Analytics tasks.
- Began onboarding contributors for the workstream.
- Identified existing Reporting and Analytics resources that can be leveraged by the GitcoinDAO (https://gitcoin.co/results)
Q4 Deliverables
- Begin conducting DAO stakeholder interviews to crowdsource insights into what information will be valuable for community decision making.
- Provide an initial model for the relevant on-chain and website generated data to be collected for reporting and dashboarding.
Evaluation Squads | Armand
Key Accomplishments
- Created and planned the evaluation strategy for each L3 workstream
- Established a comprehensive reference point in each work group
- Defined the “Core Values” for the FDD Evaluation body/panel
- We have established a plan for the Evaluation Policy, Evaluation Strategy and Evaluation Charter to better understand the overall process and each of the “elements” from the “Evaluation Plan”
Q4 Deliverables
- The perception for Q4 are to form the evaluation body/panel and have a clear vision on how to decentralize the evaluation squads process in order to match GitcoinDAO mission
- In the early Q4 we will come up with a user guide to use as a global reference to be able to decide which option is best suited to make a proper evaluation over a squad, “Decentralized” or a simple “Review” from internal core members or “Stewards”
Grant Approvals | David
Key Accomplishments
- Recruited & trained >10 volunteer grant reviewers (advised of future drewards)
- Reviewed every grant in GR11 with >1 review
Q4 Deliverables
- Retain >4 reviewer from GR11
- Identify and promote able and interested reviewers into higher positions within the Gitcoin Dao
- Recruit 4 more reviewers for GR12
Grant Disputes | David / Disruption Joe
Key Accomplishments
- Merged with approval squad
- Designed flow charts for visual understanding
- Conducted 2 rounds of dispute reviews for GR11 w/ 9 determinations
- Tornado Cash & MatrixETF agreed to follow community norms!
Q4 Deliverables
- Establish core squad members
- Create a run-book overview of the process
- Increase cycle time to 24-48 hours
- Setup automation from Gitcoin Holdings dB to Notion (Ticket submitted)
User Reviews | Disruption Joe
This squad will likely begin in Q4
Internal Appeals Panel | TBD
Key Accomplishments
- The Internal Gitcoin Dao Appeals Panel (GDAP) created and recruited experienced persons. Draft eligibility standards and analyze policy integration.
- GDAP to replace the Steward Vote mechanism for increased speed accuracy and control. External Appeals mechanism created for binding 2nd level appeal.
- GDAP >10 members and final draft of GDAP eligibility standards and documentation ready for integration to policy.*
Q4 Deliverables
- GDAP >15 members and actively hearing appeals in GR12
- GDAP documentation assessed for automation/gamification
External Appeals Panel | David
Key Accomplishments
- Revision to Appeals system and planned creation of an external appeal hearing system.
- Meetings with developers from Gitcoin Dao and 1Hive’s Celeste conflict resolution system.
Q4 Deliverables
- A draft roadmap for coding.
- Programming underway to securely integrate Celeste with the Gitcoin Dao
ML Human Evaluations | Armand
Key Accomplishments
- Successfully recruited and trained over eight new human evaluators for the human evaluation model and delivered the result on time to feed the pipeline on GitHub
- Successfully recruited two Machine Learning engineers and one Data Scientist to dig into the work done by blockscience and match these contributors together to deliver a workable and strategic plan
- Partially coordinated and ratified the work done by Blockscience with the new L2 squad leader (Omnianalytics) and L3 substream squad contributors
Q4 Deliverables
- As per previous rounds, this work is a continuity from precedent sequences and will be continually updated before/during/after each Grants Rounds in view of the next Gitcoin Round 12 and so on
Policy | David
Due to human resource constraints, and as part of the greater Gitcoin Dao build and scale strategy, which mustn’t hinder grant operations, the FDD made two operational decisions. First, to reconfigure and bring all FDD Policy work under a single squad. Second, to merge most Gitcoin Policies into the Gitcoin Knowledge Base.
Grant Approval Policy | Joe / Armand / Bob
Key Accomplishments
- Planned integration with Gitcoin Knowledge Base to create a single ‘living’ collection of all Gitcoin policies that is always current.
- Identified friction points related to outdated policy and planned tactical revisions that will facilitate policy integration with the Gitcoin Knowledge Base workstream.
- Identified and tasked human resources to the integration.
Q4 Deliverables
- Friction point revisions are complete and integration is now being built.
Grant Flagging Policy | Disruption Joe / Christine / Huxwell
Key Accomplishments
- Identified as redundant and for merging with Grant Approval Policy
- Revised and tuned the grant flagging mechanics
- Merger with Grant Approval Policy completed
Grant Dispute Policy | Armand | Bob | David
Key Accomplishments
- Identified as redundant and for merging with Grant Approval Policy (GAP)
- Coordinated and synced the Grant Dispute reviewer together to come up with a unique conclusion over each grant dispute appeal
- Merge with Grant Approval Squad
User QF Eligibility Policy | TBD
This squad will begin working in Q4 2021.
Appeals Policy | David | Larry
Key Accomplishments
- Big revisions to incorporate the creation of GDAP and an external modular higher-level appeals system (Celeste, Kleros, Aragon Court).
- Potential to use the higher-level system for a wide variety of Gitcoin Dao sanctions or penalties.
Q4 Deliverables
- Policy rough-drafted following Celeste integration.
Sanctions Policy | Pete / Larry
Key Accomplishments
- Big picture planning and discussion about how the Gitcoin Dao will approach violations of norms and policies.
- Alternatives to sanctions & penalties
Q4 Deliverables
- Polling and signal soliciting completed.
- General consensus achieved and communicated throughout Gitcoin Dao
- Meeting with Gravity Dao to explore community-building conflict resolution strategies.
Research | Abiodun (BFA)
This squad recently took shape at the end of September as the primary focus was on mission critical items for GR11. This quick overview will look at the current work being started and the potential squads to be developed moving forward. We are also considering using more democratic processes and autonomy in letting this stream develop “bottom-up”.
Open Science - DAO Compensation w/ TE | BFA
Key Accomplishments
- The primary objective was to identify threats and solutions to the legitimacy and credibility of each product, processes and policy of GitcoinDAO, from there we came up with a “Brainstorm” document to outline many aspects in the FDD Research (Still in construction)
- Recruited 4 researchers to participate in TE Open Science program Review the motivation behind this particular work to create a deliverable document from the collected data and analysis and plan a strategy for functional/praticalable observation
Q4 Deliverables
- Regroup and finalize the document to explain the goals in order to identify internal weaknesses inside GitcoinDAO structure and culture
Squad Experiments | TBD
Q4 Deliverables
- New Squad started 10/18
Curation Games | TBD
- Starting Q4 - In planning now
User Support | Bob Jiang
The user support stream was determined to need a little more push to apply directly to the DAO, but was a needed function overall. The goal for user support is to build a world class support team for GitcoinDAO.
Discord Support | Bob / Abiodun / Armand
Key Accomplishments
- Created different user support group for each primary region to deliver a proper user support experience in the Discord chat
- East Asia / China / Australia
- Europe / Africa / Middle East
- North & South America
- Setup new escalation process connecting DAO support stream to the GH team
- Gathered common questions data and repurposed into training material
Finishing Q3
- Implement new escalation policy
- Design ticketing system for support stream
- Visualize user support flow
Q4 Deliverables
- Implement new ticketing system for user support
- Expand each regional team to provide thorough, round the clock support
- Create pathways and levels to begin gamification of the support system
- Connecting/Integrate ticketing system to knowledge base
Knowledge Base | Huxwell / Abiodun
Key Accomplishments
- Setup new knowledge base as an open source implementation
- Proposal created by Huxwell for dKnowledge Base
- Created sourcecred implementation
- Connected with Translations group to provide in French, Spanish, and Chinese
- Posting proposal for dKnowledge base to productize in dGitcoin stream
Q4 Deliverables
- Develop bot integration for Discord to interact with Knowledge Base
- Further develop relationships with Translations and Ambassadors
- Implement decentralized access control management
- Launch with sourcecred on Github and decommission current knowledge base
Translations | Riely
Key Accomplishments
- Pushed content to Github https://github.com/Discovery-Labs/gkb
- Setup instance for translation of the knowledge base on Crowdin
Q4 Deliverables
- Create local translation communities with playbooks
- Create API documentation
- Set Up a vote system for indicating which languages to prioritize
Ambassadors | Renee Lee
Finishing Q3
- Began conversations with other workstreams on their needs
- Currently doing discovery on how ambassadors would interact and what services would they need to support
- Deliver plan for Q4 deliverables and a long term vision
Q4 Deliverables
- Currently undertaking a feasibility study to ascertain the purpose, value and timing of a Gitcoin Ambassador Program. Includes interviews with DAO leads and community members to ascertain whether this project should proceed as a funded project beyond October 2021. Should the program development be supported by the wider DAO community we will then look to achieve two other objectives in Q4
- Develop a the MVP and go to market strategy and implementation plan to launch the program by Q2 2022
- Co-create, cross-DAO a gamified, education pathway for onboarding Ambassadors (and other people into web3) by supporting the proposed https://gov.gitcoin.co/t/proposal-gitcoin-discovery-decentralize-the-knowledge-base-quests/8747/12
- Item in progress, expected to be completed prior to 11/1
- * Item in progress, unsure if it will be accomplished prior to 11/1