Polkadot Protocol Conformance Tests
Create and maintain a comprehensive test-suite for conformance of core functionalities of Polkadot Host implementations against the official Polkadot Protocol Specification. The goal is to develop a proof of concept initially, with long-term funding from the on-chain treasury.
Eligibility: Open to teams interested in creating and maintaining a test-suite for Polkadot Host conformance; no specific restrictions mentioned.
Pipeline
Funder track record Β· does Web3 Foundation actually pay grants?
π‘ Some payout evidence Β· 7 grantees found Β· last payout 2026-01-27 Β· checked 2026-10-29 Β· 0 forum reports, 9 web pages read, 3 unverifiable claims dropped
Proven payer: at least 3 named grantees and one payout in the last 90 days. Every grantee below is quoted word for word from its source. When a source does not date a grant, the date is when that page or post was published.
| Grantee | Amount | Date | Evidence |
|---|---|---|---|
| Pop CLI | β | 2026-01-27 page date | βMilestone Report: Pop CLI | An All-in-one Tool for Polkadot Developmentβ source |
| Ink!ubator V2 | β | 2026-01-27 page date | βThe Final report of Ink!ubator V2β source |
| "Revive" Smart Contracts | β | 2026-01-27 page date | β"Revive" Smart Contracts: Status Updateβ source |
| Liberland Blockchain Team | β | 2023-03-13 | βThe Liberland Blockchain Team is happy to announce that they have received a grant from Web3 Foundation, and that they have successfully completed the first milestone.β source |
| Cere Network | β | 2021-09-17 | βCere Network has been awarded a Web3 Foundation grant, an award typically awarded to entities performing research and development in the field of decentralized software protocols.β source |
| open-web3-stack | β | undated | βORML is part of the bigger `Open-Web3-Stack` initiative, that is currently under a General Grant from Web3 Foundation.β source |
| Crust | β | undated | βCrust is the member of Web3 Bootcamp and Substrate Builders Program, and has received Web3 grant from Web3 Foundation.β source |
Trust breakdown (1/2 checkable facts verified)
| Signal | Weight | Result | Note |
|---|---|---|---|
| apply link | 0.075 | 100% | link in source |
| funder | 0.075 | 0% | funder not named in source |
| source quality | 0.15 | 100% | official page or repo |
| model confidence | 0.1 | 80% | model self-report |
Fit breakdown (against the ORG_* profile)
| Signal | Weight | Result | Note |
|---|---|---|---|
| model fit | 0.5 | 10% | model rated 10% |
| ecosystem overlap | 0.25 | 0% | polkadot, substrate vs aleo |
| category overlap | 0.15 | 17% | research, dev_tooling, testing vs zk, privacy, infra, dev_tooling, security, interoperability |
| tech overlap | 0.1 | 33% | rust, go, c++ vs rust, leo, zk |
Sources (1)
| Role | Document | From | Fetched |
|---|---|---|---|
| primary | Polkadot Protocol Conformance Tests | Web3 Foundation Grants: RFPs (GitHub) | 2026-09-09 |
History (2)
| v | Changed | Fields |
|---|---|---|
| 2 | 2026-09-09 | status |
| 1 | 2026-09-09 | created |
Extracted text
# Polkadot Protocol Conformance Tests
:::caution
This Request for Proposals is currently considered **under development**, meaning one or more grants have been signed to address the topic. We might be interested in additional implementations, but itβs better to double check this with the grants team.
:::
* **Status:** [Under Development (Zondax)](https://github.com/w3f/Grants-Program/pull/1956), [Under Development (LimeChain)](https://github.com/w3f/Grants-Program/pull/1950)
* **Proposer:** [Bhargav Bhatt](https://github.com/bhargavbh), [David Hawig](https://github.com/Noc2)
* **Objectives:** Create and maintain a comprehensive test-suite for conformance of core functionalities of Polkadot Host.
## Project Description :page_facing_up:
The reliability and security of the Polkadot network crucially depends on bug-free implementation of Hosts/Nodes. Currently, Substrate and Smoldot (in Rust) are implementations in production, while [Gossamer (in Go)](https://github.com/ChainSafe/gossamer) and [Kagome (in C++)](https://github.com/soramitsu/kagome/) are in advanced stages of development. This RFP invites teams to create and maintain a comprehensive test-suite to check conformance of Host implementations against the official [Polkadot Protocol Specification](https://spec.polkadot.network/).
The objectives are multifold. The test-suite can:
- be used to objectively evaluate the conformance of a Host Implementation against the Spec.
- help implementers in early stages and steer their development efforts.
- complement the specifications to clarify corner cases and intricacies of the Spec. In several scenarios, precise tests are highly valuable in clarifying the inevitable ambiguities in the Spec.
Initially, the focus would be on unit tests with tests designed and generated at the right layer of abstraction to accommodate the existing implementations. The scope of the test-suite covers all the components/protocols described in the Specification but we would like to prioritise the following:
- Mapping the consensus attack surface and producing fuzzing targets accordingly. An indicative, non-exhaustive list of potential targets:
- Host API
- Sequences of storage and child-storage operations
- Cryptography primitives, particularly those exposed in the Host API
- Trie root
- BABE
- Block import
- Block validation
- Next/current validators aka VRF/block lottery
- Secondary slot verification
- GRANDPA
- Block import
- Block validation
- Justification import & validation/verification
- Trie proof verification
- Scale encoding and decoding, for specific message types, and randomly generated ones
- Parachain candidate validation
The goal of the initial grant should be to develop a PoC. The long-term goal should be to develop a comprehensive test suite that is funded by the on-chain treasury.
**Useful resources:**
- [Polkadot Protocol Specification](https://spec.polkadot.network/)
- [GitHub polkadot-tests](https://github.com/w3f/polkadot-tests)
- [Chopsticks](https://github.com/AcalaNetwork/chopsticks)
- [Zombienet](https://github.com/paritytech/zombienet)
- [try-runtime](https://paritytech.github.io/try-runtime-cli/try_runtime/)
## Deliverables
The structure of the grant and the milestones depends highly on the project itself and the goal of the initial PoC. Itβs therefore up to the applying team to come up with a milestone and delivery structure.