I’ve a full node, and have written some restricted python packages with bitcoinrpc. I wish to begin doing barely extra formidable issues now, e.g. visualisations throughout the whole blockchain (probably analysing all transactions) and must slice and cube the information in ways in which make me instinctively wish to have it queryable in a db (e.g. bigquery). Then once more there’s already over 800m transactions and so the efficiency of querying a desk of transactions may not be any higher than querying by way of bitcoinrpc.

I suppose my query is whether or not anybody who’s made related selections prior to now has any guiding rules for fascinated about when it is sensible to do dump massive elements of the blockchain into your personal db as an alternative of question it straight by way of your node? E.g. I am assuming the bitcoin api companies (e.g. blockcypher) aren’t simply operating a bunch of full nodes and querying them straight when new requests are available however as an alternative have structured the information in a manner that makes that rather more environment friendly? A associated query I’ve is whether or not Bitcoin was even designed with maximally-efficient-blockchain-querying in thoughts?