I’m making an attempt to go over all transactions information from each block on the bitcoin blockchain from the earlier 4 years. With virtually 2k transaction per block, it would take lots of queries per block. I’ve a full node operating regionally and I attempted two methods:
Python with RPC: That is very sluggish and retains shedding connection after a while (httpx.ReadTimeout)
Python with os.popen instructions: Would not have the connection drawback, however nonetheless very sluggish.
Would there be another method? Any advice on the best way to analyze bulk information from the blockchain? The strategies listed above are unfeasible given the time it will take.
EDIT: The issue is not reminiscence, however the time the bitcoin node takes to reply the queries.
