nWaku version: v0.37, v0.37-lp2p-1.10.1

task: vac:dst:waku:2025q4-waku-evaluation:regression-testing

Summary:

Initial experiments were conducted for versions v0.35, v0.36, and v0.37. During these tests, v0.37 exhibited significantly degraded performance compared to previous versions. Analysis of logs from v0.37 revealed a high occurrence of "failed to send the buffer" errors associated with “libp2p yamux”. To investigate further, we used a new experimental version v0.37-lp2p-1.10.1, which incorporates libp2p v1.10.1. This new version mostly resolves the libp2p yamux errors. Key findings include:

• A high bandwidth utilization is seen in v0.37 and v0.37-lp2p-1.10.1
• Some packet loss is seen for both v0.37 versions for 2000 nodes and very high packet loss is seen for 3000 nodes network.
• A negligible packet loss is seen for v0.35 and v0.36
• A higher message distribution time is seen for v0.37 and v0.37-lp2p-1.10.1

Additional Notes:

• Both v0.37 versions are used with log-level=DEBUG to capture message receive traces
• Excessive discv5 logging is seen in both v0.37 versions
• Many libp2p-yamux errors seen in v0.37. These errors are resolved in v0.37-lp2p-1.10.1 t
• Many libp2p pubsubpeer exception messages seen in both versions of 0.37
• Many waku node ping api errors seen in both versions of v0.37
• Many waku metadata error messages seen in all versions

Experiment 1: Bandwidth