I’m attempting to go over all transactions information from each block on the bitcoin blockchain from the earlier 4 years. With nearly 2k transaction per block, it’s going to take quite a lot of queries per block. I’ve a full node working domestically and I attempted two methods:

Python with RPC: That is very gradual and retains dropping connection after a while (httpx.ReadTimeout)

Python with os.popen instructions: Does not have the connection drawback, however nonetheless very gradual.

Would there be every other approach? Any suggestion on easy methods to analyze bulk information from the blockchain? The strategies listed above are unfeasible given the time it could take.

EDIT: The issue is not reminiscence, however the time the bitcoin node takes to reply the queries.